2nd International Verification Challenge

Deadline for entries extended to 31 May 2021!

Verification Header


2nd International Verification Challenge – Seeking the Best New Verification Metrics Making Use of Non-Traditional Observations


Do you have an idea for using non-traditional observations to verify forecasts?

If the answer is yes, we'd like to hear from you!

Forecast verification is evolving beyond traditional metrics for basic weather variables to make use of many new sources of data to assess forecast quality. This additional information gives people greater confidence to use the forecasts in their decision making.

Research shows that impact-based forecasts and warnings are more effective than traditional weather forecasts and warnings in prompting people to take action, but we are only just starting to quantify the impact of the weather on human activities and use this information to evaluate forecasts. The advent of social media and the ease of sharing photos and other data from smart phones and home weather stations means that citizens can now contribute relevant information for assessing forecasts and warnings. Weather and climate sensitive industries also have a strong interest in measuring the utility of forecasts and warnings for their business, which means translating the forecasts into user-relevant variables (e.g. energy output, crop yield, aircraft departure rates, etc.) that can be verified against industry measurements.

To encourage the development of verification approaches making use of new sources and types of observations, the World Meteorological Organization's Joint Working Group on Forecast Verification Research (JWGFVR) is conducting a challenge to develop and demonstrate new forecast verification metrics using non-traditional observations. The contest is in support of the WWRP projects on High Impact Weather, Subseasonal to Seasonal Prediction (S2S), and Polar Prediction (PPP).

The challenge will consider all applications of meteorological and hydrological forecasts, deterministic and ensemble, that are relevant to the public and user sectors including operational forecasting, agriculture, energy, emergency management, transport, etc. The metrics can be quantitative scores or diagnostics (e.g., diagrams), but they must use non-traditional observations to be considered for the prize.

The JWGFVR warmly encourages all interested researchers and practitioners to participate.


Please download the entry form as .docx HERE and as .pdf HERE


The deadline for entries has been extended to 31 May 2021. For more information please contact verifchallenge@bom.gov.au.


You may be interested in a new paper from the JWGFVR that describes non-traditional observations for high-impact weather and their use in forecast verification (Marsigli et al. 2020)


Challenge participants making use of crowd-sourced observations are invited to submit an article to a special issue of the journal Atmosphere on "Advances in the Use of Crowdsourced Data in Numerical Weather Prediction".

wwrpsmall jwgfvr_small      wcrp_small