Meteorological Assimilation Data Ingest System (MADIS)

The Meteorological Assimilation Data Ingest System (MADIS) is dedicated toward making value-added data available from the National Oceanic and Atmospheric Administration's (NOAA) Forecast Systems Laboratory (FSL) for the purpose of improving weather forecasting, by providing support for data assimilation, numerical weather prediction, and other hydrometeorological applications.

MADIS subscribers have access to a reliable and easy-to-use database containing real-time and archived datasets. The FSL MADIS database is available via ftp, by using Unidata's Local Data Manager (LDM) software, through the use of OPen source project for Network Data Access Protocol (OPeNDAP (formerly DODS)) clients, or for the surface datasets through the Text/XML Viewer found below. Users can subscribe to the entire database, or ask for only particular datasets of interest.

Quality Control (QC) of MADIS observations is also provided, since considerable evidence exists that the retention of erroneous data, or the rejection of too many good data, can substantially distort forecast products. Observations in the FSL database are stored with a series of flags indicating the quality of the observation from a variety of perspectives (e.g. temporal consistency and spatial consistency), or more precisely, a series of flags indicating the results of various QC checks. Users of MADIS can then inspect the flags and decide whether or not to ingest the observation.

MADIS also includes an Application Program Interface (API) that provides users with easy access to the data and quality control information. The API allows each user to specify station and observation types, as well as QC choices, and domain and time boundaries. Many of the implementation details that arise in data ingest programs are automatically performed. Users of the MADIS API, for example, can choose to have their wind data automatically rotated to a specified grid projection, and/or choose to have mandatory and significant levels from radiosonde data interleaved, sorted by descending pressure, and corrected for hydrostatic consistency. The API is designed so that the underlying format of the database is completely invisible to the user, a design that also allows it to be easily extended to non-FSL databases. The current version of the API supports the FSL database, and also the database used in the National Weather Service (NWS) Advanced Weather Interactive Processing System (AWIPS) deployed at NWS weather forecast offices. The API can also be used as an OPeNDAP client to access data directly from the MADIS OPeNDAP server.

MADIS data files are compatible with AWIPS and AWIPS-like display systems and the analysis software provided by the Local Analysis and Prediction System (LAPS) and the Weather Research and Forecasting (WRF) Model 3D-Variational (3DVAR) Data Assimilation System. They have also been used to initialize the Advanced Regional Prediction System (ARPS) , MM5 , and Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPStm) forecast models.

The FSL MADIS database and API are freely available to interested parties in the meteorological community.

Information


Data Access

MADIS subscribers can receive real-time data or obtain access to an on-line archive of saved real-time data by requesting an ftp, OPeNDAP or Text/XML Viewer account. For real-time data, LDM access is also available. OPeNDAP and Text/XML Viewer accounts are recommended for those who have a need for data on-demand, as contrasted with continuous real-time access. In general, users who require a continuous datafeed will get better performance by accessing the data via ftp or LDM. Also note that at this time, the Text/XML Viewer can only be used for the surface datasets.

Text/XML Viewer

Public MADIS Meteorogical and Hydrological Surface datasets can be viewed in either text or XML formats. The unrestricted data are available from the links below. Users eligible for the restricted mesonets should request a Text/XML Viewer account.

Compatible Data Assimilation Software

The links below provide information about, and downloads of, the data assimilation software packages that are directly compatible with the MADIS datasets.

FSL Observation Displays


Staff



Last updated 16 September 2004.