MPI_ABORT CMAQ v5.3.1

Hello,

I am trying to run the two day benchmark data on the new CMAQ v5.3.1 but I keep running into this error. The openmpi did work on v5.3.
MPI_ABORT was invoked on rank 9 in communicator MPI_COMM_WORLD
with errorcode 538976288.

NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.

[AdamsTower2:27095] 11 more processes have sent help message help-mpi-api.txt / mpi-abort
[AdamsTower2:27095] Set MCA parameter “orte_base_help_aggregate” to 0 to see all help / error messages
Command exited with non-zero status 32
real 4336.04
user 0.20
sys 0.83


** Runscript Detected an Error: CGRID file was not written. **
** This indicates that CMAQ was interrupted or an issue **
** exists with writing output. The runscript will now **
** abort rather than proceeding to subsequent days. **


==================================
***** CMAQ TIMING REPORT *****

Start Day: 2016-07-01
End Day: 2016-08-01
Number of Simulation Days: 1
Domain Name: 2016_12SE1
Number of Grid Cells: 280000 (ROW x COL x LAY)
Number of Layers: 35
Number of Processes: 12
All times are in seconds.

Num Day Wall Time
01 2016-07-01 4336.04
Total Time = 4336.04
Avg. Time = 4336.04

cctm.log.txt (943 Bytes)