[TT-NWPSV-17] Task Team on Reviewing NWP Standardized Verification
The seventy-eighth session of the Executive Council (EC-78) adopted resolutions to evolve WIPPS to meet user needs, support the Early Warnings for All initiative, and align with the WMO Unified Data Policy. Mandatory products of RSMCs for global and limited-area NWP, considered as core data under the WMO Unified Data Policy, have been updated with higher spatial and temporal resolutions and additional variables.
To reflect these updates, the Task Team on Reviewing NWP Standardized Verification (TT-NWPSV) under SC-WIPPS has been revising the standardized verification methods since 2023. This physical meeting at ECMWF, Reading, UK, will focus on further discussing and drafting the revised standardized verification of deterministic and ensemble NWP as well as developing a plan to demonstrate the revised standardized verification in 2025.
Please find the meeting-related information below:
- Local information about ECMWF here
- Provisional meeting agenda here
- Template: presentation template (PPT) here; document template (Doc) here
Agenda
Day 1 - Monday, 27 Jan 2025
Local Time (UTC) | Agenda Item [duration] | Lead/ Agenda Item |
09:00-09:30 | Registration | |
09:30-10:00 [30 m] | 1. Opening 1.1 Welcoming remarks [10 m] 2. Review of Progress on and Overview
2.1 Deliverables and timelines for workplan for INFCOM-4 – Secretariat [5 m]
|
Matthieu Chevallier (ECMWF) &Thomas Haiden (Chair of TT-NWPSV) & Yuki Honda (WMO)/ 1.1 |
10:00-10:30 | Break | |
10:30-12:30 [120 m] | 3. Standardized Verification Procedure for Global Deterministic NWP
3.1 Reviewing the LC-DNV website (ECMWF) [20 m] 3.2 Overview of the proposed restructured contents [20 m + 20 m]
|
Thomas Haiden/ 3.1 Thomas Haiden/ 3.2 Secretariat/ 3.3 TT members/ 3.4 |
12:30-13:30 | Group photo & Lunch | |
13:30-15:00 [90 m] | 3.4 Revisiting and Finalising Pending Decisions [40 m + 40 m]
4. Standardized Verification Procedure for Global Ensemble NWP
4.1 Reviewing the LC-EPS website (JMA) [20 m] 4.2.1 Verification statistics (section 2) [30 m + 90 m] |
Yoichi Hirahara/ 4.1
Barbara Casati & Philip Gill/ 4.2.1 |
15:00-15:30 | Break | |
15:30-17:00 [90 m] | 4.3.1 Verification statistics (section 2) [30 m + 90 m] | Barbara Casati & Philip Gill/ 4.2.1 |
17:00-17:30 [30 m] | 3. Standardized Verification Procedure for Global Deterministic NWP
3.5 Reviewing the proposed text (time reserved for individual self-pace review) [30 m + 60 m] |
TT members/ 3.5 |
| ||
19:30~ | Social dinner (self-funded) – location TBD |
|
Day 2 - Tuesday, 28 Jan 2025
Local Time (UTC) | Agenda Item [duration] | Lead/ Agenda Item |
09:00-10:00 [60 m] | 3. Standardized Verification Procedure for Global Deterministic NWP
3.5 Reviewing the proposed text [30 m + 60 m] |
TT members/ 3.5 |
10:00-10:30 | Break | |
10:30-12:30 [120 m] | 4. Standardized Verification Procedure for Global Ensemble NWP
4.2.2 Parameters (section 3) [120 m] |
Felix Fundel & Beth Ebert/ 4.2.2 |
12:30-13:30 | Lunch | |
13:30-15:00 [90 m] | 4.2.3 Verification against analyses (section 7) [10+20 m] 4.2.4 Verification against observation (section 8) [10+20 m] 4.2.5 Scores (section 9) [30 m + 60 m]
| Yanina Garcia Skabar/ 4.2.3 Thomas Haiden/ 4.2.4 Barbara Casati & Philip Gill/ 4.2.5 |
15:00-15:30 | Break | |
15:30-17:00 [90 m] | 4.2.5 Scores (section 9) [30 m + 60 m] 4.2.6 Exchange of scores (section 10) [30 m] | Barbara Casati & Philip Gill/ 4.2.5 Thomas Haiden/ 4.2.6 |
17:00-17:30 [30 m] | 4.3 Reviewing the proposed text (time reserved for individual self-pace review) [30 m + 120 m]
| TT members/ 4.3 |
Day 3 - Wednesday, 29 Jan 2025
Local Time (UTC) | Agenda Item [duration] | Lead/ Agenda Item |
09:00-10:00 [60 m] | 4. Standardized Verification Procedure for Global Ensemble NWP
4.3 Reviewing the proposed text [30 m + 60 m + 60 m] |
TT members/ 4.3 |
10:00-10:30 | Break | |
10:30-12:30 [120 m] | 4.3 Reviewing the proposed text [30 m + 60 m + 60 m]
5. Standardized Verification Procedure for Limited-area Det/Ens NWP
5.1 Review and discuss on the proposed text for the new Appendix on the Limited-area NWP [60 m]
| TT members/ 4.3
Thomas Haiden/ 5.1
|
12:30-13:30 | Lunch | |
13:30-15:00 [90 m] | 6. Plan for Verification Demonstration by Lead Centres for verification
6.1 Review and discuss on the proposed plan [60 m]
7. Plan for Implementation at the contributing centres incl. Lead Centres
7.1 Review and discuss on the draft roadmap [30 m + 30 m]
|
Thomas Haiden/ 6.1
TBD/ 7.1 |
15:00-15:30 | Break | |
15:30-17:30 [120 m] | 7.1 Review and discuss on the draft roadmap [30 m + 30 m]
8. Any other business 8.1 Verification of ML Models [30 m] 8.2 TBD
9. Closing | TBD/ 7.1
TT/ 8.1
Thomas Haiden (Chair of TT-NWPSV) & Yuki Honda (WMO)/ 9 |
- End -