Earth Science Asked on January 4, 2022
How do the web services exchange meteorological data?
One method is transferring NetCDF and GRIB data and hooking them up to your software.
I read here about the possibility of using WFS and WCS. Here, I read about the proposal of using calls like dataQuery, similar to getCapabilities of WMS servers. I also note that NASA uses JSON output, e.g. for the DCP-30 dataset. In Europe, the INSIPRE committee publishes very complex guidelines . DWD, UK Met office and others recently held a conference on that.
Is there a global standard and what is it? I know the OGC-DWG is working on that since 2009. What are the latest updates?
There are also standards in the sense of transport standards for data as a service which is what I think you mean. The OGC standards have been mentioned above, and are examples of this (although you might also consider adding OGC SOS or Sensorthings to the list).
The previous answer mentions THREDDS and NetCDF, but I would argue that OPeNDAP is more comparable to the OGC standards as a data transport standard, whereas THREDDS / ERDDAP / Hyrax are the software that can communicate using that standard (ERDDAP can also serve out WMS for instance)
Depending on how broadly you define "Meteorlogical Data", but you could also consider that IOOS and CIOOS use a mix of OGC SOS and OPeNDAP.
Answered by alex_danielssen on January 4, 2022
I don't think there can be "the single standard" for a range of technical and organisational reasons.
Probably the biggest thing to note is that different formats serve different purposes. For example, comparing WFS, WMS and WCS. WFS is a feature concept - the sort of data you might get as observations from a set of irregularly distributed sites (e.g. automated weather stations at airports). WMS is a picture (e.g. PNG image or JPEG) - the sort of data you might get as an IR image from a satellite, or some particular styling of a gridded forecast such as wave heights (turned into colour bands). WCS is a coverage (so no particular visual representation) - in the gridded forecast of wave heights example, it would be a floating point number of the height (average, peak, whatever is defined) for that "grid area".
Note that these OGC protocols weren't really designed to handle multiple parameters at a time, nor were they designed to handle data represented in more than two dimensions at a time (e.g. you can ask for an elevation and a time, but you can't ask for multiple elevations and times in a single output without some custom (i.e. not standard) approach.
So you'll see observations and forecasts in specialist formats (like BUFR, GRIB and NetCDF). Those formats can be transmitted (e.g. raw files), but they're also able to be subsetted. THREDDS is a particularly good tool for this purpose. Note that GRIB and NetCDF have some overlap in scope. There are also multiple versions of GRIB, and there are non-standard parts to GRIB (e.g. forecast centre specific tables). Adding new standards doesn't help.
Changing formats isn't easy - there are often massive collections of data and complex tools (like numerical forecasting models) that need to be updated or reworked to handle new formats. Not everyone can do that (e.g. for financial reasons, or organisational expertise reasons, or some programmatic reason like there is already another upgrade going on) at the same time.
So you can expect to need to handle lots of formats for a long time to come.
If you have options and need to exchange data, I'd start with NetCDF, mainly because it has a lot of pretty good tools.
Answered by BradHards on January 4, 2022
2 Asked on November 30, 2020
0 Asked on November 29, 2020 by michal-paszkiewicz
1 Asked on November 29, 2020 by user18590
1 Asked on November 27, 2020 by diksha
1 Asked on November 27, 2020 by graham-charles
0 Asked on November 27, 2020
2 Asked on November 23, 2020
3 Asked on November 12, 2020
1 Asked on November 6, 2020 by pattywatty27
0 Asked on October 31, 2020 by alex_danielssen
0 Asked on October 22, 2020 by el-dude
2 Asked on October 21, 2020 by user11318
2 Asked on October 6, 2020 by kakk11
2 Asked on September 7, 2020 by elnorcat
2 Asked on September 5, 2020 by muze
Get help from others!