Co-leads: Katharina Berger (DKRZ) and Sasha Ames, (LLNL)
On this Page
The Climate Data Node Operations Team (CDNOT) was established by the WGCM Infrastructure Panel (WIP) and Earth System Grid Federation (ESGF) to coordinate ESGF node administrators and ensure reliable and consistent publication and distribution of CMIP data across the global ESGF network.
CDNOT’s responsibilities include:
- Oversight of all ESGF data nodes involved in CMIP publishing and replication.
- Coordination of ESGF software stack deployment.
- Preparation and validation of ESGF infrastructure for CMIP data publication through a series of data challenges.
- Ensuring ESGF sites meet policies for security, software versions, data quality, resource availability and support.
- Dissemination of operational information to the nodes via communications, regular meetings and online documentation.
CDNOT has played a crucial role in operationalising the infrastructure for CMIP data delivery. CDNOT coordination efforts ensure that data from global modelling centres can be reliably published, replicated, and accessed by users worldwide via ESGF, supporting scientific assessments such as the forthcoming IPCC AR7.
Challenge
CDNOT is addressing several challenges. CMIP6 produced around 20 PB of data from over 300 experiments, a 10x increase in data from CMIP5. Several factors drove this increase: model resolution and model complexity, the quantity of requested variables and the number of Model Intercomparison Projects (MIPs) undertaken. CMIP7 is predicted to generate 6-10 PB of data from the initial Assessment Fast Track (AFT) experiments, with >80 PB forecast over the lifetime of CMIP7.
Therefore, there is a requirement for reliable installation and maintenance of the ESGF software stack across globally distributed nodes to enable access to the CMIP7 data. For CMIP6 in 2018 CDNOT conducted five increasingly complex data challenges to validate the publication and replication system’s capability under real-world conditions. Experiments are underway for CMIP7, to test high-speed data transfers between geographically distributed nodes, infrastructure and network performance.
All CDNOT efforts for publication and replication are based on voluntary or project-specific funding.
Aim & Objectives
The core objectives of CDNOT are to:
- Enable flexible, secure, and scalable data distribution for CMIP7.
- Ensure that ESGF sites:
- Install and maintain required software and security protocols.
- Follow workflows for data quality, versioning, citation, and access.
- Provide adequate computing and network resources.
- Maintain regular communication with the WIP (CDNOT) and peer sites.
- Support operational readiness of ESGF nodes through coordinated efforts, documentation, and community support.
- Integrate CMIP7-specific value-added services like:
- Citation and DOI registration
- Errata reporting and tracking
- Earth System Documentation (ES-DOC)
- Persistent Identifiers (PIDs)
- Dashboard for download and publication metrics
Members
| Sasha Ames | Co-lead; 2021- | LLNL | USA |
| Katharina Berger | Co-lead; 2021- | DKRZ | Germany |
Activities
CDNOT holds regular monthly drop-in meetings for nodes to raise issues and report on any operational problems.
Contact
If you would like to join the CDNOT mailing list, contact the CMIP-IPO.
ESGF Slack: We invite single-channel guests for general ESGF operations discussions. Please contact us for an invitation.
Supporting this working group
CDNOT are actively looking for new nodes to join the ESGF and support publication and replication of CMIP and CORDEX data. If you are an institution or organisation that uses CMIP data for example, and you have storage capacity to support our activities, please contact the CMIP-IPO
