Hybrid hackathon, being run by the Model Benchmarking Task Team and the REF delivery team. We welcome attendance from technical and domain scientists from modelling centres involved in the CMIP AR7 Fast Track, observation dataset providers as well as ESGF nodes and developers.

The CMIP AR7 Fast Track Rapid Evaluation Framework (AR7 FT REF) will be a complete end to end system providing a systematic and rapid performance assessment of the expected models participating in the CMIP AR7 Fast Track, supporting the next IPCC Assessment Report 7 (AR7) cycle.

Registration closes Friday 07 March

During the hackathon there will also be dedicated drop-ins for wider community interest for:

• 10 March 14:00 UTC – 15:00 UTC Hackathon launch -providing a brief overview of the REF and a status update by the AR7 FT REF delivery team – agenda here
• 11 March 17:00 – 18:00 UTC Modelling Centres #1 – agenda here
• 13 March 08:00 – 09:00 UTC Modelling Centres #2 – agenda here
• 13 March 11:00 – Midday UTC Observation dataset providers -agenda here

People must register for remote or in-person attendance at any of these drop-ins. Recordings of the launch and drop-ins will be made available on this page after the events have taken place.

Details for those joining in person available here.

Hackathon Goals

Technical goals:

• Identify and seek to address functionality and requirements of modelling centres for integration of the REF
• Completion of a working prototype –this includes development and finalise implementation plan for an executor that works with Slurm that can operate in the HPC context.

Science goals:

• Using example output, explore how best to integrate the REF into science-based workflows.
• Completing a first draft of the REF technical paper.

Hackathon workstreams

1. Metrics –  Identifying AR7 FT and CMIP7 scientific workflows, road-mapping integration of REF to those and identifying any associated requirements,functionality and infrastructure dependencies. Technical testing will include ingestion of larger volumes of the CMIP6-compatible datasets to capture any errors or failures. This workstream will also include impact analysis of implementation of the new CMIP7 file naming. 
2. Infrastructure –development, integration/deployment and implementation plan for an executor that works within modelling centers for the AR7 Fast Track, and a transition plan for CMIP7 infrastructure compatibility.
3. Observations – dataset format, obs4MIPs and staging area integration, requirements development for obs4MIPs gridded
4. REF paper  & documentation – paper production, and review and development,  testing and plan for remaining  documentation

We will have points during the hackathon where we brainstorm across these workstreams on the following areas:

• ESGF Integration -includes Quality Assurance and Quality Control
• CMIP7 compatibility – includes data request and new file naming, variable registry and higher frequency reference datasets
• Impact and innovation– this will include data citation and how will we evaluate the REF
• Governance of REF expansion  –setting up the scientific steering panel, considerations for the transition from the AR7 FT Ref to the Community REF, community governance and maintenance for expansion of the REF.

Who should attend

• Developers – ESGF infrastructure and evaluation packages – willing to review and contribute to the code base.
• Experienced modelling centre and MIP scientists – producers of data and those wishing to assess their data.
• Observation data providers – identifying diagnostics now/in the future they can support, preparing and providing data for the staging environment, testing ingesting of their data

Registration

Registration is essential. To register to attend one or more of the drop-ins and/or to participate in the Hackathon, whether online, or in person, complete this form. It will give you an opportunity to indicate which workstreams you are interested in and your availability. REGISTRATION NOW CLOSED.

Those able to join us in person are warmly welcomed. Please note that this must be self-funded. There are no funds available to support accommodation, travel or subsistence.

For those wishing to register for a drop-in only, you can do so using the same form.

Hackathon Launch

10th March, 14:00 UTC, Hybrid. Recording here.

• 2pm Housekeeping
• 2.05 Welcome from Met Office
• 2.15 Overview of REF vision and status
• 2.30 Objective of hackathon and signposting to planned drop-ins
• 2.40 Introduction to the 4 workstreams
• 2.50 Q&A
• 3pm online event closes.

Drop-ins

Modelling Centres Drop-in #1

11th March, 17:00 UTC, Hybrid.

• 17:00 Housekeeping
• 17:02 Welcome, recap of REF and AR7 FT timeline
• 17:10 Modelling Centre workflows
• 17:20 Update from REF delivery team
• 17:30 Questions Hackathon team have for Modelling Centres
• 17.40 Q&A
• 18:00 online event closes.

Modelling Centres Drop-in #2

13th March, 08:00 UTC, Hybrid.

• 08:00 Housekeeping
• 08:02 Welcome, recap of REF and AR7 FT timeline
• 08:10 Modelling Centre workflows
• 08:20 Update from REF delivery team
• 08:30 Questions Hackathon team have for Modelling Centres
• 08.40 Q&A HH to chair
• 08:00 online event closes.

Observation Providers Drop-in

13th March, 11:00 UTC, Hybrid.

• 11:00 Housekeeping
• 11:02 Welcome, recap of REF and AR7 FT timeline
• 11:10 Requirements  
• 11:20 AR7 FT Reference dataset progress report and obs4MIPs workflow
• 11:30 Questions Hackathon team have for  observation providers
• 11.40  Q&A
• 12:00 online event closes.

Details for those joining in person

For travel directions, please see the information on the Met Office website:

How to find our offices – Met Office

If you wish to stay close to the venue, these two hotels are near to it.

Holiday Inn Express, M5 JCT 29

https://www.ihg.com/holidayinnexpress/hotels/gb/en/exeter/exeuk/hoteldetail

Premier Inn (M5 JCT 29)

https://www.premierinn.com/gb/en/hotels/england/devon/exeter/exeter-m5-j29.html

City Centre options

Whilst the hackathon will take place at the UK Met Office, you might prefer to stay more centrally in Exeter with easy access to restaurants.

The Leonardo, Exeter

Leonardo Hotel Exeter | UK | Leonardo Hotels

Mercure Southgate, Exeter

https://all.accor.com/hotel/6624/index.en.shtml

Hotel du Vin, Exeter

https://www.hotelduvin.com/locations/exeter

Venue location