One long term goal of AtlantOS is to ensure that Atlantic data from different and diverse in-situ observing networks are readily accessible and useable to the wider community, international ocean science community and other stakeholders in this field.
The AtlantOS Integrated Data Portal designed under WP7 “Data flow and integration” is not a new system. It is an integrated access to existing systems, these being enhanced to ingest more in-situ observation data on Atlantic and to better serve the users, in a harmonised way across the systems.
The actors: Networks and Integrators
The Networks involved in Data integration for AtlantOS are:
- Ship-based observation Networks: GO-SHIP (Global Ocean Ship-based Hydrographic Investigations Program), VOS (Voluntary Observing Ship)/SOOP (Ship of Opportunity Program), CPR (Continuous Plankton Recorder), fish and plankton surveys (ICES), seafloor mapping
- Autonomous observing Networks: Argo, Gliders, Drifters, OceanSITES, EATN (European Animal Tracking Network)
- Coastal observing systems: Ferrybox, FOS (Fishery Observing System), coastal profilers, fixed moorings
Some Networks are organized with DACs and GDACs components. A DAC is a Data Assembly Centre typically operating at either the national or regional scale. A DAC manages data and metadata for its area with a direct link to scientists and operators. The DAC pushes observations to the network GDAC. A GDAC is a Global Data Assembly Centre. It is designed for a global observation network such as Argo, OceanSITES, EGO for Gliders, etc. The GDAC aggregates data and metadata provided by Network DACs, in RT (Real Time) and DM (Delayed Mode).Therefore it is a portal to access, at any time, the “best version” of the Network data.
The European infrastructures or global assembly centres involved as Integrators in AtlantOS are:
- For marine environmental data: SeaDataNet for validated and archived data; and the In-Situ Thematic Assembling Centre (INS TAC) component of Copernicus Marine Environment Monitoring Service (CMEMS) for NRT data and for the past 60 years of historical data assembled for reanalysis needs
- for marine biodiversity data: the ICES system, and EurOBIS
The Portals involved as Integrators in AtlantOS are:
- EMODnet lots (physics, chemistry, bathymetry, biology) fed by Copernicus INS TAC, SeaDataNet and EurOBIS
The UE integrated data system within AtlantOS
> Starting point
To summarize the situation at the beginning of AtlantOS project, the data acquired by the different in situ observing networks contributing to the AtlantOS project were processed and distributed using different methodologies and means. Depending on the network, the data were either processed following recommendations elaborated by the network and made accessible through a unique portal (FTP or Web), or were processed by individual scientific researchers and made available through National Data Centres or at the Institution level. Some datasets were available through Integrators by ad-hoc links that were developed in past years within projects such as Copernicus, EMODNet, SeaDataNet, etc.
To facilitate access to the broad array of Atlantic observations and avoid “mixing apples and oranges”, the actors first agreed on common standards for metadata and data description (detailed in D7.1 Data Harmonization and D7.2 QC Report),.
relying on existing international standards and protocols
Facilitate discovery, viewing and downloading by the users.
Ease access to existing observations
> The roadmap
- for the Networks to (1) implement the AtlantOS recommendations for standardization across Networks, (2) plan NRT QC procedures enhancement if needed and (3) facilitate access to Network data,
- for the Integrators to enhance (1) their tools for data integration (update their ingestion procedure to integrate new Network data, enhance viewing and downloading services on Network data, perform cross Network assessments and provide feedback to Networks, develop traceability and monitoring facilities for providers and users) and (2) the services to users