Hi everyone,
I am running CMAQ v5.5 on an HPC cluster. The simulation period is April 2026.
I originally had a MEGAN-related issue, but after fixing the restart configuration the model is now able to complete Day 1 successfully and start Day 2.
The output files from Day 1 are generated correctly, including:
CCTM_CGRID_v55_gcc_D03_Apr2026_20260401.nc
CCTM_CONC_v55_gcc_D03_Apr2026_20260401.nc
CCTM_MSOILOUT_v55_gcc_D03_Apr2026_20260401.nc
Day 2 starts normally:
Processing 2026-04-02
and a Day 2 concentration file is also created:
CCTM_CONC_v55_gcc_D03_Apr2026_20260402.nc
However, the model crashes before completion.
The batch log ends with:
MPI_ABORT was invoked on rank 3 in communicator MPI_COMM_WORLD
ERROR: CMAQ failed on 2026-04-02
The processor-specific logs show:
*** ERROR ABORT in subroutine OPACONC on PE 001
*** ERROR ABORT in subroutine OPACONC on PE 002
*** ERROR ABORT in subroutine OPACONC on PE 003
Immediately before the OPACONC error I see:
Maximum current record number 4
>>--->> WARNING in subroutine DESC3
Invalid file name argument "CTM_CONC_1"
*** ERROR ABORT in subroutine OPACONC on PE 001
My run script contains:
setenv CTM_CONC_1 $OUTDIR/CCTM_CONC_${CTM_APPL}.nc
and the output directory exists and is writable.
Has anyone encountered an OPACONC crash associated with:
WARNING in subroutine DESC3
Invalid file name argument "CTM_CONC_1"
Any suggestions for additional diagnostics would be greatly appreciated.
Thank you.