Topic Centre Services


Latest ETC/ICM Announcements

Wednesday, 01 August 2012 Edited by: Miroslav Fanta, Marek Staron

WISE SoE data request 2012

To: Eionet PCPs and NRCs for Rivers and Lakes
To: Eionet PCPs and NRCs for Groundwater
To: Eionet PCPs and NRCs for Marine and Coastal Environment
To: Eionet PCPs and NRCs for Water emissions
To: Eionet PCPs and NRCs Water Quantity and Use
To: Ecostat network and national contact points who provided biological test data in 2009 and 2011

Cc: Eionet National Focal Points

From: Beate Werner, EEA

Dear Colleague,

Data collection will run from 1 August until 31 October 2012.

The 2012 WISE SoE annual data request will run from Wednesday 1 August until Wednesday, 31 October 2012. Data are requested for:

  • water quality including biological quality elements in: :
    • rivers
    • lakes
    • groundwater
    • marine and coastal environment
  • emissions to water
  • water quantity

The datasets from last years submission are available at the Water Data Centre browse catalogue and interactive maps from the list by category.

Reporting of 2011 data

Use only the latest versions of data delivery templates downloaded from DD.

The Reporting Obligation Database (ROD) has been updated for this data request.

Detailed definitions of the requested data for all water category datasets, except for Water quantity, are available in the Reportnet Data Dictionary (DD):

Data Dictionary downloads

In order to facilitate the processing of your data, please use only the latest versions of data delivery templates downloaded from the DD. The available reporting formats are:

  • MS Excel - please use only the original .xls format, don't change it to the newer .xlsx
  • XML files - for more technically inclined
  • MS Access - database template with data entry control, quality checks and export functions. It can be used for delivery only in combinations with one of the other formats. Detailed instructions are included in the template.

DD is continuously being improved and has been updated for the 2012 WISE SoE data request after consultation with NFPs and NRCs for water (see Summary of NFP/NRC consultation on Data Dictionary and Scoring criteria update).

The code lists of nutrients and hazardous substances for all reporting categories in the DDs have been updated. The list of hazardous substances has been exteded to take account of the draft new EQS Directive as well as further Hazardous substances proposed for inclusion by NRCs. The "preferred substances" for reporting, which will be used for indicator analysis, are indicated in the code lists. Preferred nutrients for TCM have been defined for the first time.

Water Quantity reporting

Please download and use only the newest version of the WQ Reporting Tool.

Water quantity data are strongly recommended to be reported by using the WQ Reporting Tool and Manual. Please download and use only the newest version (v.1.3) of the WQ Reporting Tool which you will find under the above link. Do not use older versions from previous years.

If you have long-time series for certain Water Quantity parameters, which are difficult to report via the WQ Reporting Tool, you can report them by providing the specific internet URL link from where the data can be easily retrieved. You need to make sure that the parameters reported this way are following the WQ data manual definition. In the case of small discrepancies, you need to describe them clearly, please. The WQ Reporting Tool itself provides a space for entering the internet link for streamflow and precipitation data. Should you choose another parameter, you can insert the corresponding link into the comments field provided.

Biological quality elements reporting

Please provide data on biological quality elements in rivers/lakes in one template together with data on water quality in rivers/lakes.

Reporting category „Biological quality elements in Rivers and Lakes“ was integrated into the reporting of Rivers/Lakes water quality; Biology in TC waters was not integrated into the reporting of TCM waters, because we are expecting many changes due to 2nd WFD intercalibration exercise.

Please provide data on biological quality elements in rivers/lakes in one template together with data on water quality in rivers/lakes, as described in the Data dictionaries for Rivers and Lakes. If you need to fill and report the template separately for water quality and biological elements, then provide biological quality elements together with relevant stations in a copy of the template. Both files should be uploaded to the same envelope. In case Biological elements data are not available in your country, please provide an explanation why biological data cannot be delivered (see examples in the introductory text to the Scoring criteria for Rivers/Lakes).

Clarification of unsolved validation questions

Replying on critical QA issues is needed to achieve the highest evaluation score.

The general QA rules for each reporting category are available in the folder on Validation questions (outliers, violations of internal logical rules for the data, errors/gaps in station information) and are specified for each reporting category. Data reported in previous years which were violating these rules, and for which validation questions have not been answered, clarified and corrected by countries, are uploaded to Forum in country folders. The most important validation questions (critical QA issues) are also specified for each reporting category. Replying on these critical QA issues is needed to achieve the highest evaluation score.

Please check these validation questions for water all water categories and update/resubmit your datasets where necessary together with the new data. You may report separately, if identified potential outliers are indeed correct values.

Water quantity validation questions contain this year also findings from the comparison with reportings to EUROSTAT and WFD (see QA rules and country specific files).

Validation questions and country files for TCM waters and Lakes reporting categories will be available by the mid of August 2012.

Data Delivery and Automatic QA

Please check the results of the automatic QA, correct problems and redeliver corrected data.

All delivery files should be uploaded either to the Central Data Repository (CDR) or to your national Eionet server, depending on the choice of your country for delivering Eionet priority data. Please, use the proper formats for delivery of your datasets.

Automatic QA procedures have been updated following the changes in the Data Dictionaries. Procedures checks variety of data quality indicators. The most common are:

  • availability of mandatory fields
  • duplicities in primary key fields
  • correctness of data types of provided values
  • correctness of used codes where codelists are defined
  • tests of specified logical rules
  • detection of potential outliers

The QA procedures are embedded in the CDR. Results of data tests will immediately be available after data upload. We warmly recommend checking the results, correct problems (if any) and redeliver corrected data. The more problems you can fix before you release the data, the faster your deliveries can be processed. A further level of data quality checks will be carried out by ETC data managers, as usual.

For the reporting on water quantity, the automatic QA procedures are included into the WQ reporting tool.

You can find out more about the Automatic QA service for WISE SoE data flows at: http://cdr.eionet.europa.eu/help/WISE_SoE. The help files were created for one of the previous data flows, but the content is still valid with just some minor exceptions.

Automatic QA procedures for TCM waters will be finalised by the mid of August 2012.

Evaluation and scoring criteria

smileys

EEA has reported to EEA Management Board on country responses to the Eionet water data collection since 1999 (see archive of EIONET Progress reports).

The scoring criteria for the 2012 data collection have been updated for the 2012 WISE SoE data request after consultation with NFPs and NRCs for water (see Summary of NFP/NRC consultation on Data Dictionary and Scoring criteria update). The most important changes in scoring criteria are:

  • Biological quality elements data reporting have been added to the Rivers and Lakes scoring criteria, but without possible negative affect on the evaluation
  • „Preferred“ nutrient groups were specified for TCM waters
  • Revision of criteria for reporting TCM waters and Emissions to water.

No scoring criteria for reporting of data on Biology in TC waters have been developed yet, but will be considered after this year data collection.

Helpdesk and support

helpdesk@ eionet.europa.eu

  • In case of login problems or any other technical difficulties with Eionet web services, please contact Eionet Helpdesk
  • In case of questions related to the content of the data requested, please contact the responsible person as specified in the updated Data Dictionary guidelines (see there under Methodology).

I would like to take this opportunity to thank you for your continued support and look forward to another successful annual data flow.

Beate Werner
Head of Group - Water
European Environment Agency