Skip to content

Python code for aerosol, greenhouse gas, nitrogen, ozone, solar and volcanic forcings for ScenarioMIP for ACCESS-ESM1.6 - #135

Open
penguian wants to merge 54 commits into
mainfrom
127-n2-and-o3-for-esm16-h-and-vl
Open

Python code for aerosol, greenhouse gas, nitrogen, ozone, solar and volcanic forcings for ScenarioMIP for ACCESS-ESM1.6 #135
penguian wants to merge 54 commits into
mainfrom
127-n2-and-o3-for-esm16-h-and-vl

Conversation

@penguian

@penguian penguian commented Jun 2, 2026

Copy link
Copy Markdown
Collaborator

Closes #127. Closes #132. Closes #133. Closes #134.

The Python code produces ancillaries for aerosol, greenhouse gas, nitrogen, ozone, solar and volcanic forcings for ScenarioMIP for ACCESS-ESM1.6 when run with the current u-dq819/scenarios@358302 Cylc 8 workflow and the current 3-port-cmip7-ozone-code-for-esm16 branch of (https://github.com/ACCESS-NRI/ancillary-file-science
See also https://github.com/ACCESS-NRI/ancillary-file-science/issues/3

@penguian penguian self-assigned this Jun 2, 2026
@penguian penguian changed the title Python code for nitrogen, ozone, solar and volcanic forcings for ScenarioMIP for ACCESS-ESM1.6 Python code for greenhouse gas, nitrogen, ozone, solar and volcanic forcings for ScenarioMIP for ACCESS-ESM1.6 Jun 5, 2026
@penguian

penguian commented Jun 5, 2026

Copy link
Copy Markdown
Collaborator Author

See #137 for the failing readthedocs check.

@penguian
penguian requested a review from MartinDix June 9, 2026 04:13
@penguian
penguian marked this pull request as draft June 9, 2026 04:14
@penguian penguian changed the title Python code for greenhouse gas, nitrogen, ozone, solar and volcanic forcings for ScenarioMIP for ACCESS-ESM1.6 Python code for aerosol, greenhouse gas, nitrogen, ozone, solar and volcanic forcings for ScenarioMIP for ACCESS-ESM1.6 Jun 15, 2026
@penguian

Copy link
Copy Markdown
Collaborator Author

The latest run of u-dq819.scenarios completed successfully.

See gadi:/scratch/tm70/pcl851/cylc-run/u-dq819.scenarios/run77 for the run logs.

The branches created are:

The file output is:

$ tree /g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.06.15/
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.06.15/
├── modern
│   ├── historical
│   │   ├── atmosphere
│   │   │   ├── aerosol
│   │   │   │   └── global.N96
│   │   │   │       └── 2026.06.15
│   │   │   │           ├── BC_1849_2023_cmip7.anc
│   │   │   │           ├── Bio_1849_2023_cmip7.anc
│   │   │   │           ├── OCFF_1849_2023_cmip7.anc
│   │   │   │           └── scycl_1849_2023_cmip7.anc
│   │   │   ├── forcing
│   │   │   │   └── resolution_independent
│   │   │   │       └── 2026.06.15
│   │   │   │           ├── TSI_CMIP7_ESM
│   │   │   │           └── volcts_cmip7.dat
│   │   │   └── land
│   │   │       └── biogeochemistry
│   │   │           └── global.N96
│   │   │               └── 2026.06.15
│   │   │                   └── Ndep_1849_2023_cmip7.anc
│   │   └── forcing
│   │       └── global.N96
│   │           └── 2026.06.15
│   │               └── ozone_1849_2023_cmip7.anc
│   └── pre-industrial
│       ├── atmosphere
│       │   ├── aerosol
│       │   │   └── global.N96
│       │   │       └── 2026.06.15
│       │   │           ├── BC_1850_cmip7.anc
│       │   │           ├── Bio_1850_cmip7.anc
│       │   │           ├── OCFF_1850_cmip7.anc
│       │   │           └── scycl_1850_cmip7.anc
│       │   └── land
│       │       └── biogeochemistry
│       │           └── global.N96
│       │               └── 2026.06.15
│       │                   └── Ndep_1850_cmip7.anc
│       └── forcing
│           └── global.N96
│               └── 2026.06.15
│                   └── ozone_1850_cmip7.anc
└── scenarios
    ├── h
    │   ├── atmosphere
    │   │   ├── aerosol
    │   │   │   └── global.N96
    │   │   │       └── 2026.06.15
    │   │   │           ├── BC_h_2022_2100_cmip7.anc
    │   │   │           ├── Bio_h_2022_2100_cmip7.anc
    │   │   │           ├── OCFF_h_2022_2100_cmip7.anc
    │   │   │           └── scycl_h_2022_2100_cmip7.anc
    │   │   ├── forcing
    │   │   │   └── resolution_independent
    │   │   │       └── 2026.06.15
    │   │   │           ├── TSI_CMIP7_ESM
    │   │   │           └── volcts_cmip7.dat
    │   │   └── land
    │   │       └── biogeochemistry
    │   │           └── global.N96
    │   │               └── 2026.06.15
    │   │                   └── Ndep_h_2022_2100_cmip7.anc
    │   └── forcing
    │       └── global.N96
    │           └── 2026.06.15
    │               └── ozone_h_2022_2100_cmip7.anc
    └── vl
        ├── atmosphere
        │   ├── aerosol
        │   │   └── global.N96
        │   │       └── 2026.06.15
        │   │           ├── BC_vl_2022_2100_cmip7.anc
        │   │           ├── Bio_vl_2022_2100_cmip7.anc
        │   │           ├── OCFF_vl_2022_2100_cmip7.anc
        │   │           └── scycl_vl_2022_2100_cmip7.anc
        │   ├── forcing
        │   │   └── resolution_independent
        │   │       └── 2026.06.15
        │   │           ├── TSI_CMIP7_ESM
        │   │           └── volcts_cmip7.dat
        │   └── land
        │       └── biogeochemistry
        │           └── global.N96
        │               └── 2026.06.15
        │                   └── Ndep_vl_2022_2100_cmip7.anc
        └── forcing
            └── global.N96
                └── 2026.06.15
                    └── ozone_vl_2022_2100_cmip7.anc

59 directories, 30 files

More compactly:

$ cd /g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.06.15/ && find . -type f | sort
./modern/historical/atmosphere/aerosol/global.N96/2026.06.15/BC_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.06.15/Bio_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.06.15/OCFF_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.06.15/scycl_1849_2023_cmip7.anc
./modern/historical/atmosphere/forcing/resolution_independent/2026.06.15/TSI_CMIP7_ESM
./modern/historical/atmosphere/forcing/resolution_independent/2026.06.15/volcts_cmip7.dat
./modern/historical/atmosphere/land/biogeochemistry/global.N96/2026.06.15/Ndep_1849_2023_cmip7.anc
./modern/historical/forcing/global.N96/2026.06.15/ozone_1849_2023_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.06.15/BC_1850_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.06.15/Bio_1850_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.06.15/OCFF_1850_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.06.15/scycl_1850_cmip7.anc
./modern/pre-industrial/atmosphere/land/biogeochemistry/global.N96/2026.06.15/Ndep_1850_cmip7.anc
./modern/pre-industrial/forcing/global.N96/2026.06.15/ozone_1850_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.06.15/BC_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.06.15/Bio_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.06.15/OCFF_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.06.15/scycl_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/forcing/resolution_independent/2026.06.15/TSI_CMIP7_ESM
./scenarios/h/atmosphere/forcing/resolution_independent/2026.06.15/volcts_cmip7.dat
./scenarios/h/atmosphere/land/biogeochemistry/global.N96/2026.06.15/Ndep_h_2022_2100_cmip7.anc
./scenarios/h/forcing/global.N96/2026.06.15/ozone_h_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.06.15/BC_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.06.15/Bio_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.06.15/OCFF_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.06.15/scycl_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/forcing/resolution_independent/2026.06.15/TSI_CMIP7_ESM
./scenarios/vl/atmosphere/forcing/resolution_independent/2026.06.15/volcts_cmip7.dat
./scenarios/vl/atmosphere/land/biogeochemistry/global.N96/2026.06.15/Ndep_vl_2022_2100_cmip7.anc
./scenarios/vl/forcing/global.N96/2026.06.15/ozone_vl_2022_2100_cmip7.anc

@penguian
penguian marked this pull request as ready for review June 15, 2026 11:55
@penguian
penguian requested a review from atteggiani June 15, 2026 11:55
@penguian

Copy link
Copy Markdown
Collaborator Author

Please note:

  1. The Python code for the ScenarioMIP aerosol forcings is AI-assisted and partially based on code generated by Gemini 3.5 Flash via Google Antigravity.
  2. My testing of the ScenarioMIP IIASA-IAMC aerosol forcings discovered that some of the datasets are not contiguous in time. Had I been more familiar with the CMIP6 scenario forcings this would not have been a surprise.
    See Document the non-contiguous IIASA-IAMC ScenarioMIP datasets PCMDI/input4MIPs_CVs#447

@penguian
penguian marked this pull request as draft June 16, 2026 23:30
@penguian

Copy link
Copy Markdown
Collaborator Author

I have changed the ScenarioMIP start year back to 2022 for all except greenhouse gases.

The run output is at /scratch/tm70/pcl851/cylc-run/u-dq819.scenarios/run82/

The new branches are

The file output is identical to the run on 2026-07-15, except for the ScenarioMIP aerosol forcings, and is at:

$ cd /g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.06.17/ && find . -type f | sort
./modern/historical/atmosphere/aerosol/global.N96/2026.06.17/BC_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.06.17/Bio_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.06.17/OCFF_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.06.17/scycl_1849_2023_cmip7.anc
./modern/historical/atmosphere/forcing/resolution_independent/2026.06.17/TSI_CMIP7_ESM
./modern/historical/atmosphere/forcing/resolution_independent/2026.06.17/volcts_cmip7.dat
./modern/historical/atmosphere/land/biogeochemistry/global.N96/2026.06.17/Ndep_1849_2023_cmip7.anc
./modern/historical/forcing/global.N96/2026.06.17/ozone_1849_2023_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.06.17/BC_1850_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.06.17/Bio_1850_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.06.17/OCFF_1850_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.06.17/scycl_1850_cmip7.anc
./modern/pre-industrial/atmosphere/land/biogeochemistry/global.N96/2026.06.17/Ndep_1850_cmip7.anc
./modern/pre-industrial/forcing/global.N96/2026.06.17/ozone_1850_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.06.17/BC_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.06.17/Bio_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.06.17/OCFF_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.06.17/scycl_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/forcing/resolution_independent/2026.06.17/TSI_CMIP7_ESM
./scenarios/h/atmosphere/forcing/resolution_independent/2026.06.17/volcts_cmip7.dat
./scenarios/h/atmosphere/land/biogeochemistry/global.N96/2026.06.17/Ndep_h_2022_2100_cmip7.anc
./scenarios/h/forcing/global.N96/2026.06.17/ozone_h_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.06.17/BC_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.06.17/Bio_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.06.17/OCFF_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.06.17/scycl_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/forcing/resolution_independent/2026.06.17/TSI_CMIP7_ESM
./scenarios/vl/atmosphere/forcing/resolution_independent/2026.06.17/volcts_cmip7.dat
./scenarios/vl/atmosphere/land/biogeochemistry/global.N96/2026.06.17/Ndep_vl_2022_2100_cmip7.anc
./scenarios/vl/forcing/global.N96/2026.06.17/ozone_vl_2022_2100_cmip7.anc

@penguian

Copy link
Copy Markdown
Collaborator Author

The reason why there is no new historical config branch is that there are no changes from the existing branch:

$ cat /scratch/tm70/pcl851/cylc-run/u-dq819.scenarios/run82/log/job/1/HI_git_commit_push/NN/job.out
Workflow : u-dq819.scenarios/run82
Job : 1/HI_git_commit_push/01 (try 1)
User@Host: pcl851@cylc.pcl851.tm70.ps.gadi.nci.org.au

2026-06-17T10:22:36+10:00 INFO - started
git status is:

Finished with no config files changes to commit.
2026-06-17T10:22:38+10:00 INFO - succeeded

@penguian
penguian marked this pull request as ready for review June 17, 2026 03:08
@penguian

penguian commented Jun 17, 2026

Copy link
Copy Markdown
Collaborator Author

Based on feedback from @MartinDix I have changed the interpolation method so that each month in the year is interpolated separately.

The new run is at /scratch/tm70/pcl851/cylc-run/u-dq819.scenarios/run86

The run re-generated the ScenarioMIP ancillaries only.

The newly generated branches are:

The updated file output is:

[pcl851@gadi-login-02 scenarios]$ pwd
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.06.17/scenarios
[pcl851@gadi-login-02 scenarios]$ find . -type f | sort | xargs ls -lh-rw-r--r-- 1 pcl851 tm70 213M Jun 17 19:30 ./h/atmosphere/aerosol/global.N96/2026.06.17/BC_h_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 422M Jun 17 19:29 ./h/atmosphere/aerosol/global.N96/2026.06.17/Bio_h_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 213M Jun 17 19:29 ./h/atmosphere/aerosol/global.N96/2026.06.17/OCFF_h_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 631M Jun 17 19:29 ./h/atmosphere/aerosol/global.N96/2026.06.17/scycl_h_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 8.3K Jun 17 19:35 ./h/atmosphere/forcing/resolution_independent/2026.06.17/TSI_CMIP7_ESM
-rw-r--r-- 1 pcl851 tm70 125K Jun 17 19:41 ./h/atmosphere/forcing/resolution_independent/2026.06.17/volcts_cmip7.dat
-rw-r--r-- 1 pcl851 tm70 213M Jun 17 19:28 ./h/atmosphere/land/biogeochemistry/global.N96/2026.06.17/Ndep_h_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 165M Jun 17 20:09 ./h/forcing/global.N96/2026.06.17/ozone_h_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 213M Jun 17 19:29 ./vl/atmosphere/aerosol/global.N96/2026.06.17/BC_vl_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 422M Jun 17 19:29 ./vl/atmosphere/aerosol/global.N96/2026.06.17/Bio_vl_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 213M Jun 17 19:29 ./vl/atmosphere/aerosol/global.N96/2026.06.17/OCFF_vl_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 631M Jun 17 19:29 ./vl/atmosphere/aerosol/global.N96/2026.06.17/scycl_vl_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 8.3K Jun 17 19:42 ./vl/atmosphere/forcing/resolution_independent/2026.06.17/TSI_CMIP7_ESM
-rw-r--r-- 1 pcl851 tm70 125K Jun 17 19:42 ./vl/atmosphere/forcing/resolution_independent/2026.06.17/volcts_cmip7.dat
-rw-r--r-- 1 pcl851 tm70 213M Jun 17 19:28 ./vl/atmosphere/land/biogeochemistry/global.N96/2026.06.17/Ndep_vl_2022_2100_cmip7.anc
-rw-r--r-- 1 pcl851 tm70 165M Jun 17 20:08 ./vl/forcing/global.N96/2026.06.17/ozone_vl_2022_2100_cmip7.anc

@penguian

Copy link
Copy Markdown
Collaborator Author

Note: The change to the interpolate_monthly function used by ScenarioMIP is partially AI-generated via Google Antigravity and Gemini 3.5 Flash.

@penguian
penguian force-pushed the 127-n2-and-o3-for-esm16-h-and-vl branch from 9cec57f to 57a0305 Compare June 26, 2026 07:41
@penguian

Copy link
Copy Markdown
Collaborator Author

I force pushed because I accidentally added commits that are relevant only to #121 and then rebased the commits away.

@penguian
penguian marked this pull request as draft July 29, 2026 04:35
@paul-leopardi

paul-leopardi commented Jul 30, 2026

Copy link
Copy Markdown
Collaborator

I ran u-dq819/scenarios-pr which succeeded. The logs are at /scratch/tm70/pcl851/cylc-run/u-dq819.scenarios-pr/run1/log and the output is at

[pcl851@gadi-login-03 u-dq819.scenarios-pr]$ pushd /g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.07.30/ && find . -type f | sort
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.07.30 ~/roses/u-dq819.scenarios-pr
./modern/historical-emissions/atmosphere/forcing/global.N96/2026.07.30/CO2_fluxes_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.07.30/BC_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.07.30/Bio_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.07.30/OCFF_1849_2023_cmip7.anc
./modern/historical/atmosphere/aerosol/global.N96/2026.07.30/scycl_1849_2023_cmip7.anc
./modern/historical/atmosphere/forcing/global.N96/2026.07.30/ozone_1849_2023_cmip7.anc
./modern/historical/atmosphere/forcing/resolution_independent/2026.07.30/TSI_CMIP7_ESM
./modern/historical/atmosphere/forcing/resolution_independent/2026.07.30/volcts_cmip7.dat
./modern/historical/atmosphere/land/biogeochemistry/global.N96/2026.07.30/Ndep_1849_2023_cmip7.anc
./modern/pre-industrial-mean/atmosphere/forcing/global.N96/2026.07.30/ozone_1850_1870_mean_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.07.30/BC_1850_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.07.30/Bio_1850_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.07.30/OCFF_1850_cmip7.anc
./modern/pre-industrial/atmosphere/aerosol/global.N96/2026.07.30/scycl_1850_cmip7.anc
./modern/pre-industrial/atmosphere/forcing/global.N96/2026.07.30/ozone_1850_cmip7.anc
./modern/pre-industrial/atmosphere/land/biogeochemistry/global.N96/2026.07.30/Ndep_1850_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.07.30/BC_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.07.30/Bio_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.07.30/OCFF_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/aerosol/global.N96/2026.07.30/scycl_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/forcing/global.N96/2026.07.30/ozone_h_2022_2100_cmip7.anc
./scenarios/h/atmosphere/forcing/resolution_independent/2026.07.30/TSI_CMIP7_ESM
./scenarios/h/atmosphere/forcing/resolution_independent/2026.07.30/volcts_cmip7.dat
./scenarios/h/atmosphere/land/biogeochemistry/global.N96/2026.07.30/Ndep_h_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.07.30/BC_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.07.30/Bio_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.07.30/OCFF_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/aerosol/global.N96/2026.07.30/scycl_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/forcing/global.N96/2026.07.30/ozone_vl_2022_2100_cmip7.anc
./scenarios/vl/atmosphere/forcing/resolution_independent/2026.07.30/TSI_CMIP7_ESM
./scenarios/vl/atmosphere/forcing/resolution_independent/2026.07.30/volcts_cmip7.dat
./scenarios/vl/atmosphere/land/biogeochemistry/global.N96/2026.07.30/Ndep_vl_2022_2100_cmip7.anc

@paul-leopardi
paul-leopardi marked this pull request as ready for review July 30, 2026 07:35
@paul-leopardi
paul-leopardi requested review from MartinDix and removed request for MartinDix July 30, 2026 07:36
@paul-leopardi
paul-leopardi force-pushed the 127-n2-and-o3-for-esm16-h-and-vl branch from 29a02de to aa513d6 Compare July 31, 2026 01:54
@penguian

penguian commented Jul 31, 2026

Copy link
Copy Markdown
Collaborator Author

I re-ran u-dq819/scenarios-pr after the force push, and it succeeded. The logs are at /scratch/tm70/pcl851/cylc-run/u-dq819.scenarios-pr/run2/log and the output files at /g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.07.31/ are identical to the output files at /g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.07.30/.

@penguian
penguian requested review from blimlim and removed request for MartinDix July 31, 2026 05:48
@paul-leopardi

Copy link
Copy Markdown
Collaborator

With the Python scripts unchanged, I updated u-dq819/scenarios-pr to include scen7-hl and scen7-m. The logs are at /scratch/tm70/pcl851/cylc-run/u-dq819.scenarios-pr/run5/log and the output is at

[pcl851@gadi-login-03 ~]$ find /g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02 -type f | sort
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/historical-emissions/atmosphere/forcing/global.N96/2026.08.02/CO2_fluxes_1849_2023_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/historical/atmosphere/aerosol/global.N96/2026.08.02/BC_1849_2023_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/historical/atmosphere/aerosol/global.N96/2026.08.02/Bio_1849_2023_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/historical/atmosphere/aerosol/global.N96/2026.08.02/OCFF_1849_2023_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/historical/atmosphere/aerosol/global.N96/2026.08.02/scycl_1849_2023_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/historical/atmosphere/forcing/resolution_independent/2026.08.02/TSI_CMIP7_ESM
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/historical/atmosphere/forcing/resolution_independent/2026.08.02/volcts_cmip7.dat
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/historical/atmosphere/land/biogeochemistry/global.N96/2026.08.02/Ndep_1849_2023_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/pre-industrial-mean/atmosphere/forcing/global.N96/2026.08.02/ozone_1850_1870_mean_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/pre-industrial/atmosphere/aerosol/global.N96/2026.08.02/BC_1850_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/pre-industrial/atmosphere/aerosol/global.N96/2026.08.02/Bio_1850_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/pre-industrial/atmosphere/aerosol/global.N96/2026.08.02/OCFF_1850_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/pre-industrial/atmosphere/aerosol/global.N96/2026.08.02/scycl_1850_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/pre-industrial/atmosphere/forcing/global.N96/2026.08.02/ozone_1850_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/modern/pre-industrial/atmosphere/land/biogeochemistry/global.N96/2026.08.02/Ndep_1850_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/h/atmosphere/aerosol/global.N96/2026.08.02/BC_h_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/h/atmosphere/aerosol/global.N96/2026.08.02/Bio_h_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/h/atmosphere/aerosol/global.N96/2026.08.02/OCFF_h_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/h/atmosphere/aerosol/global.N96/2026.08.02/scycl_h_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/h/atmosphere/forcing/global.N96/2026.08.02/ozone_h_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/h/atmosphere/forcing/resolution_independent/2026.08.02/TSI_CMIP7_ESM
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/h/atmosphere/forcing/resolution_independent/2026.08.02/volcts_cmip7.dat
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/h/atmosphere/land/biogeochemistry/global.N96/2026.08.02/Ndep_h_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/hl/atmosphere/aerosol/global.N96/2026.08.02/BC_hl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/hl/atmosphere/aerosol/global.N96/2026.08.02/Bio_hl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/hl/atmosphere/aerosol/global.N96/2026.08.02/OCFF_hl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/hl/atmosphere/aerosol/global.N96/2026.08.02/scycl_hl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/hl/atmosphere/forcing/global.N96/2026.08.02/ozone_hl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/hl/atmosphere/forcing/resolution_independent/2026.08.02/TSI_CMIP7_ESM
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/hl/atmosphere/forcing/resolution_independent/2026.08.02/volcts_cmip7.dat
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/hl/atmosphere/land/biogeochemistry/global.N96/2026.08.02/Ndep_hl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/m/atmosphere/aerosol/global.N96/2026.08.02/BC_m_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/m/atmosphere/aerosol/global.N96/2026.08.02/Bio_m_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/m/atmosphere/aerosol/global.N96/2026.08.02/OCFF_m_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/m/atmosphere/aerosol/global.N96/2026.08.02/scycl_m_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/m/atmosphere/forcing/global.N96/2026.08.02/ozone_m_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/m/atmosphere/forcing/resolution_independent/2026.08.02/TSI_CMIP7_ESM
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/m/atmosphere/forcing/resolution_independent/2026.08.02/volcts_cmip7.dat
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/m/atmosphere/land/biogeochemistry/global.N96/2026.08.02/Ndep_m_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/vl/atmosphere/aerosol/global.N96/2026.08.02/BC_vl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/vl/atmosphere/aerosol/global.N96/2026.08.02/Bio_vl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/vl/atmosphere/aerosol/global.N96/2026.08.02/OCFF_vl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/vl/atmosphere/aerosol/global.N96/2026.08.02/scycl_vl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/vl/atmosphere/forcing/global.N96/2026.08.02/ozone_vl_2022_2100_cmip7.anc
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/vl/atmosphere/forcing/resolution_independent/2026.08.02/TSI_CMIP7_ESM
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/vl/atmosphere/forcing/resolution_independent/2026.08.02/volcts_cmip7.dat
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.02/scenarios/vl/atmosphere/land/biogeochemistry/global.N96/2026.08.02/Ndep_vl_2022_2100_cmip7.anc
[pcl851@gadi-login-03 ~]$ find /g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.03 -type f | sort
/g/data/tm70/pcl851/CMIP7/esm1p6_ancil/2026.08.03/modern/historical/atmosphere/forcing/global.N96/2026.08.03/ozone_1849_2023_cmip7.anc

@paul-leopardi
paul-leopardi requested a review from MartinDix August 6, 2026 00:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

2 participants