WORLD METEOROLOGICAL ORGANIZATION

WASHINGTON, 15 TO 19 MARCH 1999

CONTENTS

1. Organization of the meeting
2. Reports on data management activities of participating programmes
3. Development of a WMO data management plan
4. Requirements for the future WMO information system
5. Recommendations
6. Closure of the meeting

Annex 1 - Agenda
Annex 2 - List of participants
Annex 3 - List of acronyms

1. ORGANIZATION OF THE MEETING (agenda item 1)

1.1 Opening remarks (agenda item 1.1)

1.1.1 The meeting opened Monday, 15 March 1999 at 1000 at the headquarters of the U.S. Department of Agriculture in Washington, D.C. Mr D. McGuirk, on behalf of the Secretary-General of WMO, opened the meeting and welcomed all participants. He noted that data management is a fundamental component of all scientific programmes and is particularly important for international programmes where data must be exchanged and understood regardless of language. He stated that the Twelfth World Meteorological Congress decided that it was important to accelerate the development of an integrated WMO data management system and that CBS should act as the focal point for this activity. Dr G. Bange, chair of the World Agricultural Outlook Board, welcomed the participants on behalf of the U.S. Department of Agriculture and wished them all a productive meeting and pleasant stay in Washington.

1.2 Election of chairman (agenda item 1.2)

Dr G. Love (Australia) was elected chairman of the meeting.

1.3 Adoption of the agenda (agenda item 1.3)

The meeting adopted the agenda as reproduced in Annex 1.

2. REPORTS ON CURRENT AND PLANNED DATA MANAGEMENT ACTIVITIES OF PARTICIPATING PROGRAMMES (agenda item 2)

2.1 To improve coordination of data management activities between the various WMO and related international programmes, all WMO technical commissions and related international programmes (i.e. WCRP, GCOS, IGBP, CEOS) were invited to send representatives to the meeting. Furthermore, Mr Matt Schwaller of NASA Headquarters was invited as to add a perspective of other inter-programme coordination and knowledge of NASA EOSDIS.

2.2 Each of the representatives made brief presentations on the data management activities of their commissions, programmes or agencies as summarised below.

2.3 Dr Love outlined the new structure of CBS and its role in the broader organization of WMO. He then discussed the data management activities of CBS which are principally being conducted in the Open Programme Area Group (OPAG) on Information Systems and Services (ISS). In particular, he added:

• The role of the Implementation/Coordination Team (ICT) to monitor the flow of data and information on the GTS, and to recommend ways of improving that system;

• The role of the ICT on data representation and codes, and their important task of assisting all members in better representing data and products for international exchange in standardised ways;

• The activities of a number of Expert Teams (ETs) focussing on crucial data management tasks aimed at better utilisation of the Internet and Internet protocols by the WMO, and improving data management across all programmes.

2.4 Dr R. Basher summarised the structure and role of the Commission on Climatology. CCl coordinates the collection, management and application of data for climatic purposes, including related research, for, firstly, long term climate variation and change, including climate change detection, secondly, near-real time seasonal climate monitoring and prediction, climate system monitoring and assessment and the El Niño, and thirdly, statistical analysis and application for economic uses, especially at the national level, for engineering design, agricultural and water management, human health, commerce, etc. The Commission is structured into three technical working groups, on (i) data, (ii) climate information and predictions services (CLIPS), and (iii) climate change detection (set up jointly with CLIVAR), plus an overall advisory working group and numerous supporting rapporteurs. CCl is the lead commission for the World Climate Data and Monitoring Programme (WCDMP) and the World Climate Applications and Services Programme (WCASP). He listed the four thrusts of the Climate Agenda and pointed out the inputs to these from WCDMP and WCASP and the Commission. The terms of reference of the CCl Working Group on Climate Data, which he chairs, spans the identification of needs, data management and archiving, and data dissemination, data products and assessments. The principal data management issues faced by CCl include: the securing of vulnerable historical data sources; the development of GCOS and related climate system monitoring and prediction capabilities; the development of the CLICOM data management system; the role of Resolution 40 in the exchange of climate data, especially archived data; and the needs for metadata, data homogenisation, automatic weather - manual station overlap, and continued support for long-term stations.

2.5 Dr R. Motha explained that the CAgM Working Group on Agrometeorological Data Management produced a report that focussed on the rapidly expanding improvements in technology for data collection, analysis, dissemination and archival. Agriculture has a diverse multi-disciplined set of data requirements that are needed for operational and research applications. The report was divided into four main topic areas: Ground-Based and Remotely-Sensed Observations; Computer-Based Management Systems; Suitable Software Packages and Training Requirements; and, Data and Products for Current and Future Requirements. Observations include manual and automated weather stations, radar-derived products, and weather satellite data. CLICOM was recognized as an important tool for operational applications. New technologies that are becoming more useful include Geographic Information System (GIS) applications, automated information delivery systems and the Internet. Recommendations of the working group included: standardised formats and a modular structure of database design; greater use of GIS technology and user-friendly interactive computer systems; guidelines to maintain data quality from automated weather stations; feasibility studies of increasing the grid of weather radars to enhance precipitation analysis and monitoring of pest migrations; improve user-friendly access to satellite data and products that can be integrated into agricultural weather analyses; coordinate training plans between CAgM and CBS for the demonstration of low-cost advanced receiving stations; develop standardised scales of phenological data for important crops to establish a history and pattern recognition with respect to weather and climate variability; provide recommendations to the Commission for Climatology regarding future upgrades of CLICOM; and make all reference material available on a WMO Internet server.

2.6 Mr J. Fenix described the World Area Forecast System (WAFS) with particular emphasis on the U.S. broadcast. He noted the USA International Satellite Communication System (ISCS) supports transmission of WAFS products and supports two-way communication in WMO Region IV. There is still considerable spare capacity on the broadcast which could possibly be used to broadcast additional products such as climate predictions. He pointed out that there was a pressing need for a standard format to broadcast colour images since the widely-used GIF format does not provide for the capability to resize, cut, paste or zoom which is needed for meteorological applications.

2.7 Mr W. Murray provided an overview of the terms of reference of CMM and discussed efforts to improve the quality and availability of marine climatological data. He pointed out the pressing requirement for an international standard for exchange of historical marine observations. He noted that the current format for marine observations does not provide for the inclusion of all necessary ancillary information.

2.8 Mr B. Stewart, Chairman of the CHy Working Group on Basic Systems, described the data needs of the Hydrology and Water Resources Programme (HWRP) in relation to programmes as presented in the WMO Fifth Long-term Plan. These included Basic Systems in Hydrology, Forecasting and Applications in Hydrology, Sustainable Development of Water Resources, Capacity Building in Hydrology and Water Resources, and Water-related Issues. The data management requirements that WMO must consider within this Programme fall into three categories. These include metadata (data and information describing data), general hydrological data and project specific data.

2.9 Metadata, that is information about the data itself and its availability, is collected in INFOHYDRO (Hydrological Information Referral Service) and to some extent within HOMS (Hydrological Operational Multipurpose System). INFOHYDRO contains information on national, regional and international hydrological agencies, networks and data centres of WMO members. The primary focus of HOMS is technological exchange between WMO members. HOMS components thus contain information on a range of different technologies. The Global Runoff Data Centre (GRDC), in Koblenz, Germany, holds general hydrological data of interest to the members of WMO in relation to water resources assessment and also WCP-Water. The GRDC has collected daily and monthly discharge data for over 3,600 stations monitoring approximately 2,900 rivers from 147 countries. The WMO has also brought together data for a number of specific projects undertaken within its programmes. These have included assessment and intercomparison projects.

2.10 The WMO’s WHYCOS project also involves the collection of hydrological data and consideration will need to be given as to if and how this data would be stored and made available. The WHYCOS stations will record at a minimum water level/flow, precipitation, temperature and humidity. The stations will be equipped with Data Collection Platforms, which transmit via meteorological satellites to Data Receiving Stations at a number of locations. Mr Stewart identified metadata, data codes, data standards and responsibilities for updating the information held by WMO as key issues for future consideration.

2.11 Mr R. Vet presented information on the Global Atmosphere Watch (GAW) which is a measurement program for detecting and forecasting changes in the background chemical composition and related physical characteristics of the atmosphere which have effects on climate, ultraviolet radiation, the ozone layer and ecosystems. Measurements include greenhouse and related gases, solar radiation, UV radiation, vertical and column ozone, surface ozone and precursors, precipitation chemistry, aerosols, and optical depth. The GAW operates approximately 30 global sites to measure the global background of long-lived atmospheric constituents as well as several hundred regional sites that determine regional patterns. Advice and guidance are provided to the GAW by six Scientific Advisory Groups. To ensure proper quality assurance and data dissemination, GAW has put in place an extensive infrastructure which includes three Quality Assurance Science Activity Centres, eight World/Regional Calibration Centres and seven GAW World Data Centres. The GAW World Data Centres, comprising the World Data Centre for Greenhouse Gases (Japan), the World Ozone and Ultraviolet Radiation Data Centre (Canada), the World Data Centre for Aerosols (Italy), the World Data Centre for Precipitation Chemistry (USA), the World Radiation Data Centre (Russia), the World Data Centre for Surface Ozone (Norway), and the World Data Centre for Aerosol Optical Depth (USA), archive and disseminate data from the various measurement programs of GAW. The Mr Vet noted that the GAW is concerned with many data management issues such as standards for quality control flags, metadata, data formats and station identification schemes.

2.12 Mr Murray also presented information on the data management activities of the G3OS. He noted that GCOS, GOOS and GTOS had agreed to coordinate their data management activities through the Joint Data and Information Management Panel. The panel has agreed on a joint data and information management plan and further efforts to implement the plan are underway.

2.13 Dr G. Szejwach presented information on IGBP-DIS. He provided the background on IGBP and its organization. IGBP recently decided to restructure its data and information system to make it more user and demand driven. It will be led by a steering group composed of representatives of the core projects and framework activities and data experts. The first tasks of the new steering group will be to establish a proposal highlighting future tasks and priorities and propose a new chair. It must also continue data services to the scientific community, play a key role in IGBP synthesis and maintain strong links with the IGBP Secretariat and GAIM. New databases will be developed by ad hoc task teams or data groups involving data providers and users. He noted that the data needs of users are highly diverse and their approach towards data cover a range of options which must be accommodated. The IGBP Data Integration Project is expected to provide an IGBP search engine, a World Wide Web system, recommendations on standards and CD-ROM products which will be provided by IGBP-DIS partners. The project is currently in its implementation phase and progress in ongoing according to its original schedule.

2.14 Mr G. Shumbera informed the group about the ICSU World Data Centres (WDCs). He described the World Data Centre system and the principles and responsibilities guiding its operation. He noted WDCs are operated for the benefit of the international scientific community and they make information on their holdings freely available and provide data to scientists of any country with no restrictions. No data with restrictions or security classifications are accepted or held. Data and model output from a variety of international research programmes are made available through WDCs.

3. DEVELOPMENT OF A WMO DATA MANAGEMENT PLAN (agenda item 3)

3.1 The experts noted that development of a WMO Data Management Plan would provide an opportunity to address cross-cutting issues such as adoption of proven standards, definition of requirements for new or improved standards, and the sharing of data management techniques and software. However, the experts agreed preparation of a detailed plan would require considerable resources and given the heavy workloads and other high-priority tasks there was some doubt that preparation of such a plan could be brought to conclusion in a timely fashion. Technologies are moving very rapidly and a plan specifying deliverables may not be able to reflect the state of the art developments.

3.2 The experts therefore agreed that the most effective action would be to develop a framework to guide future cooperative activities in the area of data management. As a first step the experts discussed issues that they thought might benefit from inter-programme coordination.

3.3 Issues identified by the representative for CAgM included the requirement to:

• be aware of the needs of the agricultural sector when siting new surface observing stations (there is a preference for sites in agricultural locations rather than highly developed or heavily urbanised areas);

• make data available in a timely fashion. By way of example it was noted that many operational services in the agricultural area can only be provided if the supporting basic data are received in a timely fashion (e.g. in the USA 24 hr precipitation data are required by noon each day);

• better understand the technical specifications of data obtained from automatic weather stations not under the direct management control of the NMHS;

• be able to rapidly integrate real-time and non-real-time (archive) data sets to better interpret weather events in a climatological context.

3.4 Issues identified by the representative for CAS included the requirement to:

• implement a standard method for station numbering;

• implement a standard approach for the archiving and exchange of metadata;

• consolidate guidance on "best practice" for the management of meteorological and related data on a WMO-wide basis;

• consolidate guidance on specifications for, and procedures for the installation and maintenance of, automatic weather stations;

• make widely available an electronic (on-line) catalogue of all meteorological and related data for exchange to support WMO Programmes;

• Identify the potential of observation sites established by one Programme to meet the requirements of other Programmes (e.g. GAW). Data could be used directly, enhanced products be developed, or additional measurements taken for low incremental cost.

3.5 Issues identified by the representative for CMM included the requirement to:

• review the approach to the numbering of mobile observing platforms such as ships (recognising that they may be sold across national boundaries);

• put in place agreed, WMO standard practices for the collection and electronic archival of metadata.

3.6 Issues identified by the representative for CHy included the requirement to:

• structure sets of meteorological and related data (such as rainfall and evaporation) to meet needs of other programmes (for example high frequency rainfall data is very valuable in extreme event analysis);

• structure the output of weather forecast models (particularly precipitation forecasts) to suit the needs of real-time hydrologic, flood forecast models;

• collect, archive and exchange metadata relating to the operating characteristics and performance of observing systems including, in particular automatic weather stations.

3.7 Issues identified by the representative for CCl included the requirement to:

• commit to the maintenance of the observational capabilities at sites with long records;

• maintain observation of a wide range of meteorological elements;

• define, collect, electronically archive and exchange as required metadata relating to all observational programs;

• agree and adopt standards for the implementation of automatic weather stations;

• support the development and dissemination of climate products, related data and predictions to NMHSs, including oceanographic information;

• improve the international exchange of CLIMAT and CLIMAT TEMP messages;

• consolidate documentation on cross-cutting issues relating to the management of data in support of WMO Programmes;

• support oceanographic and non-traditional observations (e.g. sea ice) required for climate monitoring and prediction

3.8 The experts agreed that the following common issues would benefit from inter-programme coordination.

1. Identification, collection, maintenance and accessibility of metadata

2. Implementation and operation of Automatic Weather Stations and their applicability to multiple programmes

3. Identification and dissemination of data available in support of WMO programmes, especially data applicable to the activities of multiple programmes

4. Standard identification schemes for observing sites

5. How infrastructure (observation platforms, models, communications, etc) deployed for one Programme can be most effectively utilised to meet the requirements of other Programmes

3.9 The experts agreed that it would be worthwhile to gather together general principles for effective management of meteorological, hydrological and related data from the various commissions for inclusion in a WMO Guide on Data Management. This guide would provide general information applicable to all WMO programmes while guides for individual programmes would contain specific details pertinent to their own requirements. The WMO guide should include the following subject areas. (Some examples of possible content are included under each category.)

• General principles

Whenever data are collected their possible application for other WMO programmes should be considered

Use existing data management standards where possible and develop standards only where they are needed to meet requirements unique to WMO programmes

Use existing station identification standards unless they clearly do not meet the requirements of your network. Consult broadly within the WMO framework before developing new ones.

• Guidelines on information system capabilities

All programmes should implement electronic catalogues of information exchanged in support of their programme. These should support standard search protocols to allow cross-catalogue searches. (e.g. Catalogue Interoperability Protocol)

Systems should address, as a minimum, requirements common to all WMO programmes (e.g. enable users to distinguish between WMO Resolution 40 "essential" and "additional" data)

Provide data and metadata in agreed standard formats

• Standards for documentation and ancillary information (metadata)

Definition of directory-level metadata

Guidelines on archive-level metadata - sufficient information about the data should be maintained to ensure its utility for all applications that can be envisioned. The guide would include the definition of a minimum set of archive-level metadata common to all programmes.

All metadata should be available in electronic format

Metadata should be exchanged according to agreed standard formats (e.g. FGDC, ISO)

• Guidance on quality control procedures

All data should be subject to quality control and validation procedures

Procedures should aim to detect errors as close to the source as possible

Original data values should be recoverable after quality control has been performed

• Principles and standards for data archival

Data of enduring value should be placed in long-term archive centres and should not be the responsibility of individual scientists.

Data should be duplicated at more than one site

Archives should be maintained in appropriate environmental conditions

4. REQUIREMENTS FOR THE FUTURE WMO INFORMATION SYSTEM (agenda item 4)

4.1 CBS, at its recent extraordinary session (Karlsruhe, October 1998) reiterated its commitment to ensure the Basic Systems meet the requirements of all WMO and related international programmes. In this regard it directed its Open Programme Area Group on Information Systems and Services (OPAG-ISS) to develop a statement of the volume and timeliness requirements for the data and products to be exchanged on the GTS and other telecommunication systems used to meet requirements of WMO Programmes. It also directed the group to develop monitoring and follow-up procedures for the production, collection, distribution and exchange of information in the WWW, in coordination with the other OPAGs and other technical commissions, as appropriate. The CBS Advisory Working Group (Melbourne, 18-22 January 1999) recommended that an inter-programme task team be established to develop a strategic overview of WMO information systems and services. The experts considered the communication and information system requirements of their programmes and discussed how the various programmes could participate in the inter-programme task team. They agreed to consider the requirements of their respective programmes and to present these requirements to the inter-programme team at its next meeting, tentatively scheduled for early November 1999.

5. RECOMMENDATIONS (agenda item 5)

1. A WMO Guide on Data Management should be prepared, taking full account of the structure outlined in paragraph 3.9.

Australia kindly volunteered to review the World Weather Watch, Hydrological and draft Climatological guides on data management to produce a draft WMO guide to be distributed to all Commissions for review.

2. Guidelines for implementation and operation of automatic weather stations and their application to WMO Programmes should be developed.

Considering that meetings related to this issue are scheduled to be held this calendar year the president of CBS should invite the presidents of the other Technical Commissions to collate the requirements of their respective programmes regarding automatic weather stations. As further steps, CBS and CIMO should match the collected requirements with the current and planned future capabilities of these systems so that CIMO could develop the recommended guidelines.

3. A catalogue (possibly distributed/virtual) of data available in support of WMO programmes should be developed.

Members should identify and catalogue data they are willing to exchange in support of WMO Programmes. At the same time a document identifying and describing standards for these catalogues to allow cross-catalogue searches should be developed. The Secretariat agreed to investigate the possibility of hiring a consultant to carry out this task. Furthermore, as an interim step the Secretariat agreed to develop a list of Internet addresses of all WMO data and data processing centres, ICSU World Data Centres and the CEOS International Directory Network and to make this available via the WMO Web site.

4. All commissions should participate in the planning and development of the future WMO information system.

The president of CBS should invite the presidents of the other Technical Commissions to identify the requirements of their respective programmes for presentation at a meeting on this topic tentatively scheduled to be held in early November 1999. These should identify the need for collection, transmission and processing of relevant data. Furthermore, the presidents should be invited to designate representatives of their commissions at this meeting.

6. CLOSURE OF THE MEETING

6.1 The meeting closed at 1730 Thursday 18 March 1999.

1. ORGANIZATION OF THE MEETING

1.1 Opening remarks
1.2 Election of chairman
1.3 Adoption of the agenda
1.4 Working arrangements

2. REPORTS ON DATA MANAGEMENT ACTIVITIES OF PARTICIPATING PROGRAMMES

3. DEVELOPMENT OF A WMO DATA MANAGEMENT PLAN

4. REQUIREMENTS FOR THE FUTURE WMO INFORMATION SYSTEM

5. RECOMMENDATIONS

6. CLOSURE OF THE MEETING