Topic Centre Services


Latest ETC/ICM Announcements

Friday, 25 July 2014 Edited by: Constança Belchior, Marek Staron

WISE SoE data request 2014

To: Eionet PCPs and NRCs for Marine and Coastal Environment
To: Eionet PCPs and NRCs for Maritime
To: New Eionet PCPs and NRCs for Marine
To: National contact points for biological data in TC waters (identified in 2009; TC members of WFD WG Ecostat

Cc: Eionet National Focal Points

From: Trine Christiansen, EEA

Dear Colleague,

Data collection will run from 1 August until 31 October 2014.

The 2014 WISE SoE annual data request will run from Friday 1 August until Friday, 31 October 2014. Data are requested only for:

  • water quality including biological quality elements in marine and coastal environment

The dataset from last year’s submission is available at the Water Data Center called Waterbase – Transitional, coastal and marine waters.

As announced at the Eionet NRC coastal and marine workshop in September 2013, this year we are focussing on improving the business processes of WISE SoE TCM dataflow. Therefore we have made minimal changes to the data delivery structures; only the necessary ones to be able to receive your 2013 data as defined below.

We will revise and propose changes to these data delivery structures in the 2015 data call. This will be based on this year's in-depth analysis for the WISE SoE TCM in particular, but also for the common elements with WISE SoE as a whole in collaboration with the freshwater colleagues.

We also included the Eionet PCP's and NRC's Maritime contacts in this data call as well as the new Eionet PCPs and NRCs for Marine due to the ongoing Eionet NFP's revision of the marine and maritime Eionet roles. We therefore didn't want to risk missing any contact while this process is going and apologize for any cross-posting.

Reporting of 2013 data

Use only the latest versions of data delivery templates downloaded from DD.

The Reporting Obligation Database (ROD) has been updated for this data request.

Detailed definitions of the requested data are available in the Reportnet Data Dictionary (DD):

Data Dictionary downloads

In order to facilitate the processing of your data, please use only the latest versions of data delivery templates downloaded from the DD. The available reporting formats are:

  • MS Excel - please use only the original .xls format, don't change it to the newer .xlsx
  • XML files - for more technically inclined
  • MS Access - database template with data entry control, quality checks and export functions. It can be used for delivery only in combinations with one of the other formats. Detailed instructions are included in the template.

The Data Dictionary has not been modified from the 2013 WISE SoE data request except for the increasing of the upper limit of the Year field, which is now set to 2013, and the changes in the respective Methodology texts.

The code lists of nutrients and hazardous substances for all reporting categories in the DDs are identical to the 2013 status.

Clarification of unsolved validation questions

Replying on the station related critical QA issues is needed to achieve the highest evaluation score.

The unsolved data quality questions that we want you to focus on during this data collection are solely connected to station related issues. The existence of duplicate stations within and between the various station lists (Eionet, WFD, and ICES) is an important factor that prevents the proper use of data. The identification of such duplicates is crucial in the light of improving the quality of EEA indicators (CSI21, 23 and MAR001) e.g. by "creating" the correct and longer time series of data.

kml file example

This is a follow-up of the exercise initiated by ETC-ICM in 2013 after the Eionet NRC coastal and marine workshop, to which some member countries responded. This feedback was incorporated and we now hope to receive wider feedback, as this should improve both the national reporting and ETC-ICM handling processes. A more detailed explanation on this follow-up exercise and how to proceed with the mapping and cleaning of stations is provided in the Annex 1.

The files for carrying out this exercise are available on Forum, under the folder on Validation questions and respective country folders. We kindly ask all countries to check the validation questions in their respective folder, even those who already responded in 2013. There may be additional feedback needed.

Replying on these critical QA issues is needed to achieve the highest evaluation score.

Data Delivery and Automatic QA

Please check the results of the automatic QA, correct problems and redeliver corrected data.

All delivery files should be uploaded either to the Central Data Repository (CDR) or to your national Eionet server, depending on the choice of your country for delivering Eionet priority data. Please, use the proper formats for delivery of your datasets.

Automatic QA procedures have been updated following the changes in the Data Dictionaries. Procedures checks variety of data quality indicators. The most common are:

  • availability of mandatory fields
  • duplicities in primary key fields
  • correctness of data types of provided values
  • correctness of used codes where codelists are defined
  • tests of specified logical rules
  • detection of potential outliers

The QA procedures are embedded in the CDR. Results of data tests will immediately be available after data upload. We warmly recommend checking the results, correct problems (if any) and redeliver corrected data. The more problems you can fix before you release the data, the faster your deliveries can be processed. A further level of data quality checks will be carried out by ETC data managers, as usual.

You can find out more about the Automatic QA service for WISE SoE data flows at: http://cdr.eionet.europa.eu/help/WISE_SoE. The help files were created for one of the previous data flows and show the main elements of standard procedure.

Evaluation and scoring criteria

EEA has reported to EEA Management Board on country responses to the Eionet water data collection since 1999 (see archive of EIONET Progress reports).

The scoring criteria for the 2014 data collection of TCM data remain the same as in 2013.

No scoring criteria for reporting of data on Biology in TC waters has been developed yet.

Helpdesk and support

helpdesk@ eionet.europa.eu

  • In case of login problems or any other technical difficulties with Eionet web services, please contact Eionet Helpdesk.
  • In case of questions related to the content of the data requested, please contact the ETC-ICM transitional, coastal and marine data manager Jørgen Nørrevang Jensen, as specified in the updated Data Dictionary guidelines (see there under Methodology).

I would like to take this opportunity to thank you for your continued support and look forward to another successful annual data flow.

Trine Christiansen
Head of Group - Marine
European Environment Agency


Annex 1

WISE SoE 2014 - TCM Validation questions: monitoring stations

In the WISE SoE 2014 data request the national reporters are asked to clarify unsolved TCM data quality questions by focusing solely on the station related issues. The existence of duplicate stations within and between the various station lists (Eionet, WFD, and ICES) is an important factor that prevents the proper use of data. The identification of such duplicates is crucial in light of improving the quality of the CSI e.g. by “creating” the correct and longer time series of data.

This is a follow-up of the exercise initiated by ETC-ICM in 2013 after the Eionet NRC coastal and marine workshop. The countries were asked to revise the Eionet stations in order to clarify potential duplicate stations among Eionet stations, and Eionet stations that coincide with WFD and/or stations in the ICES Station Dictionary (e.g. OSPAR, and HELCOM stations). A questionnaire was sent out after this meeting asking the member countries to identify potential duplication of stations as well as potential overlap between stations in different station lists e.g. WFD and/or stations in the ICES Station Dictionary (that contains OSPAR and HELCOM stations).

For those 7 countries who responded back, we have incorporated their valuable feedback in the station´s information available for this year’s validation questions. If extra feedback is still needed, we have identified it in the country´s stations file. We also kindly request the countries who have not responded to provide us with feedback on the identified potential duplicates within and between their station lists. This exercise should prove valuable to improve both the national reporting and ETC-ICM handling processes.

Station validation questions

ETC/ICM has prepared a set of Validation question files in order to coordinate and to help the revision of the Eionet stations to clarify potential duplicate TCM stations. All the files are found on Eionet Forum under the following folder:

http://forum.eionet.europa.eu/nrc-eionet-freshwater/library/wise-soe-reporting-2014-only-tcm/validation-questions/

In it, there is a general folder, containing these instructions together with the master file with the station lists (all Eionet stations, WFD and ICES) as well as the supporting Google Earth files. In order to ease the revision process, tables have been prepared for each EEA country and uploaded to their country folder. Where relevant (e.g. unclear initial feedback from the country), tailored guidance is also provided. No issues have been or could be detected for countries whose folders are empty.

Please note that the CountryCode in these tables sometimes are different than the actual country. This is due to the fact that CountryCode represents the EEZ of the particular country which might be different from the data submitting country. The 3 last fields (columns) in this table indicate if there is a potential duplicate/overlap with other stations:

Eionet alias?

The field indicates if there is other EIONET station that might be the same (duplicates). There might be several stations with a potential overlap with this particular station. The number(s) given in this field is the RecordID of the potential duplicate station. Note that the duplicate station might have a very simple reason (but not always obvious for the data receiver) as station ID's might in some incidence have a zero in front (e.g. 01234789) and in other incidences this zero is not reported.

WFD alias?

The field indicates if there might be an overlap with at WFD station. The number(s) given in this field is the Station_Unique_ID of the potential corresponding WFD station, taken from the WFD Stations official list (Validations questions - general/WFD Stations).

ICES SD alias?

The field indicates if there might be an overlap with at station in the ICES Station Dictionary. The number(s) given in this field is the ID of the potential corresponding ICES Station Dictionary station (Validations questions – general/ICES Stations).

Suggested action

Each country is asked to review the suggested linkages between Eionet stations, and between Eionet stations and WFD and/or ICES Station dictionary stations. It should be noted that the suggested station correspondence is based on a visual inspection of the spatial distribution of stations and the station names etc. There might be other or more stations that are corresponding. Please also provide information on such corresponding stations.

Please indicate if these suggested linkages are correct or not and any other additional linkages using the provided country´s excel stations overview and upload these to the relevant Eionet CDR folder for your country. The Google Earth files with the mapped Eionet, WFD and ICES stations provided should support this process.

Please contact Jørgen Nørrevang Jensen joergen@ices.dk in case any further clarifications on the data or the review process are needed.