The project to deliver the Rapid Evaluation Framework (REF) for the CMIP AR7 Fast Track, focused on supporting the next IPCC Assessment Report 7 (AR7) cycle, was launched on Monday 4th November.

Registration and venue

Registration is now closed as this event has already occured

What is the REF?

Responding to requests for a tool to provide a fast evaluation of the AR7 Fast Track simulations, the CMIP Model Benchmarking Task Team proposed the concept for a new Rapid Evaluation Framework (REF).

The initial focus of the REF will be on delivery of rapid evaluation, and plot generation, for a key set of diagnostics defined by the Model Benchmarking Task Team using input from the community (current proposed diagnostics here). However, the REF is designed to be open source and modular, enabling the community to build and expand its capabilities beyond the AR7 Fast Track and potentially serve other WCRP communities e.g., the Coordinated Regional Downscaling Experiment (CORDEX). The REF will leverage existing community evaluation packages. The framework scope includes an application programming interface (API) for executing metrics generation from community evaluation packages across the globe. 

This project has been made possible through support from the U.S. Department of Energy Office of Science and ESA.

Programme

Time (UTC/GMT)	MONDAY 04 NOVEMBER
10:30-11:00	Arrival tea and coffee reception
11:00-12:00	Session 1: Vision and Implementation Plan Overview (Chairs: Forrest Hoffman, Birgit Hassler) Video of session | Slides Importance of model benchmarking and evaluation Rapid Evaluation Framework vision, objectives and outcomes Community response (outcomes of survey) Timeline for the AR7 Fast Track REF Timeline for the Community REF Plans for communicating evaluation outcomes Q&A
12:00-12:45	Session 2: How to get involved in the AR7 FT REF (Chairs: Forrest Hoffman, Birgit Hassler) Video of session | Slides Modelling centres ESGF Tier 1 nodes Nodes not yet in ESGF Observations providers Model Evaluation package developers Scientific users Downstream non-climate scientific users Q&A
12:45-13:15	Session 3: Wider REF ecosystem (Chairs: Forrest Hoffman, Eleanor O’Rourke) Video of session | Slides Improving model diagnostics and benchmarking process Pathway towards transfer to community Discussion: Governance framework & Long term preservation and sustainment
13:15-14:00	Lunch
14:00 – 14:40	Session 4: Diagnostics (Chairs: Birgit Hassler, Eleanor O’Rourke) Video of session | Slides Role of diagnostics List of diagnostics for AR7 Fast Track, Metrics Reference datasets Practical applications Next steps Discussion
14:40 – 15:20	Session 5: Interoperability with ESGF (Chair: Forrest Hoffman) Video of session | Slides Overview of ESGF architecture for CMIP7 ESGF Event Stream Errata service linkages Discussion
15:20-16:00	Session 6: QA/QC (Chair: Forrest Hoffman) Video of session | Slides Essential acceptance criteria Discussion
16:00	Event close – tea and coffee reception

Organising committee

• CMIP Model BenchmarkingTask Team Co-leads Birgit Hassler (DLR) and Forest Hoffman (ORNL) and Task Team members.
• CMIP International Project Office, Briony Turner, Eleanor O’Rourke

With thanks to the ESA Climate and Long-Term Action Division for hosting this event and to the IPO staff for supporting the documentation of the event.