[TT-NWPSV-17] Task Team on Reviewing NWP Standardized Verification

The seventy-eighth session of the Executive Council (EC-78) adopted resolutions to evolve WIPPS to meet user needs, support the Early Warnings for All initiative, and align with the WMO Unified Data Policy. Mandatory products of RSMCs for global and limited-area NWP, considered as core data under the WMO Unified Data Policy, have been updated with higher spatial and temporal resolutions and additional variables.

To reflect these updates, the Task Team on Reviewing NWP Standardized Verification (TT-NWPSV) under SC-WIPPS has been revising the standardized verification methods since 2023. This physical meeting at ECMWF, Reading, UK, will focus on further discussing and drafting the revised standardized verification of deterministic and ensemble NWP as well as developing a plan to demonstrate the revised standardized verification in 2025.

 

Please find the meeting-related information below:

  • Local information about ECMWF here
  • Provisional meeting agenda here
  • Template: presentation template (PPT) here; document template (Doc) here

 

Agenda 

 

Day 1 - Monday, 27 Jan 2025

Local Time

(UTC)

Agenda Item [duration]

Lead/ Agenda Item

09:00-09:30

Registration

 

09:30-10:00 [30 m]

1.   Opening

1.1 Welcoming remarks [10 m]
1.2 Roundtable introductions [5 m]
1.3 Adoption of the agenda [10 m)
 

2.   Review of Progress on and Overview

 

2.1 Deliverables and timelines for workplan for INFCOM-4 – Secretariat [5 m]

 

 

 

Matthieu Chevallier (ECMWF) &Thomas Haiden (Chair of TT-NWPSV) & Yuki Honda (WMO)/ 1.1
All participants/ 1.2 
Secretariat/ 1.3 & 2.1

10:00-10:30

Break

 

10:30-12:30 [120 m]

3.   Standardized Verification Procedure for Global Deterministic NWP

 

3.1 Reviewing the LC-DNV website (ECMWF) [20 m]

3.2 Overview of the proposed restructured contents [20 m + 20 m]
3.3 Overview of agreed verification procedures [20 m]
3.4 Revisiting and Finalising Pending Decisions [40 m + 40 m]

 

 

 

Thomas Haiden/ 3.1

Thomas Haiden/ 3.2

Secretariat/ 3.3

TT members/ 3.4

12:30-13:30

Group photo & Lunch

 

13:30-15:00 [90 m]

3.4 Revisiting and Finalising Pending Decisions [40 m + 40 m]

 

4.   Standardized Verification Procedure for Global Ensemble NWP 

 

4.1 Reviewing the LC-EPS website (JMA) [20 m]
4.2 Reviewing the individual sections by TT members (the section number below is indicated based on the current Appendix 2.2.35)

4.2.1 Verification statistics (section 2) [30 m + 90 m]

 

 

 

 

 

Yoichi Hirahara/ 4.1

 

Barbara Casati & Philip Gill/ 4.2.1

15:00-15:30

 Break

 

15:30-17:00 [90 m]

4.3.1 Verification statistics (section 2) [30 m + 90 m]

Barbara Casati & Philip Gill/ 4.2.1

17:00-17:30 [30 m]

3.   Standardized Verification Procedure for Global Deterministic NWP

 

3.5 Reviewing the proposed text (time reserved for individual self-pace review) [30 m + 60 m]

 

 

 

TT members/ 3.5

 

19:30~ 

Social dinner (self-funded) – location TBD

 

 

Day 2 - Tuesday, 28 Jan 2025

Local Time

(UTC)

Agenda Item [duration]

Lead/ Agenda Item

09:00-10:00 [60 m]

3.   Standardized Verification Procedure for Global Deterministic NWP

 

3.5 Reviewing the proposed text [30 m + 60 m] 
 

 

 

 

TT members/ 3.5

10:00-10:30

Break

 

10:30-12:30 [120 m]

4.   Standardized Verification Procedure for Global Ensemble NWP

 

4.2.2 Parameters (section 3) [120 m]
 

 

 

Felix Fundel & Beth Ebert/ 4.2.2

12:30-13:30

Lunch

 

13:30-15:00 [90 m]

4.2.3 Verification against analyses (section 7) [10+20 m] 

4.2.4 Verification against observation (section 8) [10+20 m] 

4.2.5 Scores (section 9) [30 m + 60 m]

 

Yanina Garcia Skabar/ 4.2.3

Thomas Haiden/ 4.2.4

Barbara Casati & Philip Gill/ 4.2.5

15:00-15:30

 Break

 

15:30-17:00 [90 m]

4.2.5 Scores (section 9) [30 m + 60 m]

4.2.6 Exchange of scores (section 10) [30 m]

Barbara Casati & Philip Gill/ 4.2.5

Thomas Haiden/ 4.2.6

17:00-17:30 [30 m]

4.3 Reviewing the proposed text (time reserved for individual self-pace review) [30 m + 120 m]

 

TT members/ 4.3

 

Day 3 - Wednesday, 29 Jan 2025

Local Time

(UTC)

Agenda Item [duration]

Lead/ Agenda Item

09:00-10:00 [60 m]

4.   Standardized Verification Procedure for Global Ensemble NWP

 

4.3 Reviewing the proposed text [30 m + 60 m + 60 m
 

 

 

 

TT members/ 4.3

10:00-10:30

Break

 

10:30-12:30 [120 m]

4.3 Reviewing the proposed text [30 m + 60 m + 60 m]

 

5.   Standardized Verification Procedure for Limited-area Det/Ens NWP 

 

5.1 Review and discuss on the proposed text for the new Appendix on the Limited-area NWP [60 m]

 

TT members/ 4.3

 

 

 

 

Thomas Haiden/ 5.1

 

12:30-13:30

Lunch

 

13:30-15:00 [90 m]

6.   Plan for Verification Demonstration by Lead Centres for verification

 

6.1 Review and discuss on the proposed plan [60 m]

 

7.   Plan for Implementation at the contributing centres incl. Lead Centres

 

7.1 Review and discuss on the draft roadmap [30 m + 30 m]

 

 

 

 

Thomas Haiden/ 6.1

 

 

 

TBD/ 7.1

15:00-15:30

 Break

 

15:30-17:30 [120 m]

7.1 Review and discuss on the draft roadmap [30 m + 30 m]

 

8.    Any other business 

8.1 TBD         

 

9.    Closing

9.1 TBD  

TBD/ 7.1

 

 

 

TBD/ 8.1

 

 

Thomas Haiden (Chair of TT-NWPSV) & Yuki Honda (WMO)/ 9.1

 

- End -