Skip to content

Conversation

@anton-seaice
Copy link
Collaborator

@anton-seaice anton-seaice commented Nov 13, 2025

The goal here is to enable multiple timesteps per history file when using PIO, to be consistent with the access-esm1.6 branch. In the access-esm1.6 branch, this change was implemented only when using Netcdf for IO. Closes #58

  1. This change relies on latest in ParallelIO (Collective access when extending a file NCAR/ParallelIO#2016). (Updating ParallelIO is not answer changing - build and repro )
  2. This changes the time variable to be in the middle of the averaging interval
  3. error handling is added/modified on an as needed basis, rather than comprehensively
  4. Output files follow the ocean convention now, e.g iceh-1monthly-mean_1900.nc

Resulting build is bfb. History output is the same:

image

Baseline for comparison: /g/data/tm70/as2285/payu/om2-pio/baseline-dev-025deg_jra55_ryf/archive
New output: /g/data/tm70/as2285/payu/om2-pio/pio-dev-025deg_jra55_ryf/archive

@anton-seaice anton-seaice self-assigned this Nov 13, 2025
@anton-seaice anton-seaice changed the title 58 pio io_pio: multiple history timesteps per file Nov 13, 2025
@anton-seaice anton-seaice force-pushed the 58-pio branch 3 times, most recently from 114aaad to c61b7b5 Compare December 4, 2025 02:15
@anton-seaice anton-seaice marked this pull request as ready for review December 4, 2025 02:15
@anton-seaice
Copy link
Collaborator Author

@dougiesquire @blimlim - can you take a look sometime. Ill revert the manifest changes before merging

@anton-seaice
Copy link
Collaborator Author

@CodeGat - tell me the CI failure is not my fault :)

The self-hosted runner lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.

@CodeGat
Copy link
Member

CodeGat commented Dec 4, 2025

The CI error is not your fault @anton-seaice :) the cluster that hosts the self-hosted runner is being starved of resources due to a lot of parallel builds. This will inform what the limit is for concurrent runners - thanks!

Copy link

@dougiesquire dougiesquire left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @anton-seaice. Looks great.

The indentation is very inconsistent. Might be worth going through and making sure that at least the code you added is consistent.

@anton-seaice anton-seaice force-pushed the 58-pio branch 3 times, most recently from f1b7d52 to da19cf1 Compare December 16, 2025 02:42
@anton-seaice
Copy link
Collaborator Author

I think i addressed all the comments @dougiesquire

@dougiesquire
Copy link

dougiesquire commented Dec 16, 2025

Are all your review-related changes in the most recent commit (da19cf1)?

@anton-seaice
Copy link
Collaborator Author

@dougiesquire
Copy link

dougiesquire commented Dec 16, 2025

Thanks @anton-seaice. Great stuff. Just waiting on your response to this before hitting approve

@anton-seaice anton-seaice force-pushed the 58-pio branch 2 times, most recently from 5f4527a to d37ebc1 Compare December 17, 2025 00:13
@dougiesquire
Copy link

@anton-seaice are the build-ci failures expected?

The file names now follow ocean convention: e.g. iceh-daily_0786-01.nc instead of iceh_d.0786-01.nc
anton-seaice and others added 2 commits December 17, 2025 13:17
Co-authored-by: Dougie Squire <42455466+dougiesquire@users.noreply.github.com>
@anton-seaice
Copy link
Collaborator Author

Finally got there @dougiesquire !

Copy link

@dougiesquire dougiesquire left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! So do you want to do an ACCESS-OM2 release?

@anton-seaice anton-seaice merged commit c9d8721 into master Dec 17, 2025
7 checks passed
@anton-seaice anton-seaice deleted the 58-pio branch December 17, 2025 03:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Concatenate daily ice outputs

4 participants