The research of SOA based marine environmental data warehouse architecture

Author(s):  
Fangning Zhang ◽  
FengJing Shao
2014 ◽  
Vol 668-669 ◽  
pp. 1374-1377 ◽  
Author(s):  
Wei Jun Wen

ETL refers to the process of data extracting, transformation and loading and is deemed as a critical step in ensuring the quality, data specification and standardization of marine environmental data. Marine data, due to their complication, field diversity and huge volume, still remain decentralized, polyphyletic and isomerous with different semantics and hence far from being able to provide effective data sources for decision making. ETL enables the construction of marine environmental data warehouse in the form of cleaning, transformation, integration, loading and periodic updating of basic marine data warehouse. The paper presents a research on rules for cleaning, transformation and integration of marine data, based on which original ETL system of marine environmental data warehouse is so designed and developed. The system further guarantees data quality and correctness in analysis and decision-making based on marine environmental data in the future.


2014 ◽  
Vol 668-669 ◽  
pp. 1378-1381 ◽  
Author(s):  
Wei Jun Wen

Marine environment data warehouse can store massive data. After the full amount of historical data has been initially loaded, the incremental update mode must be applied to ensure timely updates of data. In this paper, in view of the marine environment data warehouse’s characteristics, such as massive data amount, large number of historical data and low update frequency, a complete set of mechanisms for incremental update of marine environment data warehouse was proposed to greatly improve the operating efficiency of marine environment data warehouse.


2020 ◽  
Vol 20 (2020) ◽  
pp. 515-516
Author(s):  
Eleine Francioni de Abreu Lima ◽  
Denise de Almeida Pires Do Rosário ◽  
Paulo de Castro Villi ◽  
Georgia Moraes Catabriga Sousa

IEEE Access ◽  
2019 ◽  
Vol 7 ◽  
pp. 185121-185130
Author(s):  
Zhigang Li ◽  
Di Cai ◽  
Jialin Wang ◽  
Yingqi Li ◽  
Guan Gui ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document