Compiler is set to gcc Working Directory is /central/groups/seinfeldgroup/CMAQ_EAP_base5.3/CCTM/scripts Build Directory is /central/groups/seinfeldgroup/CMAQ_EAP_base5.3/CCTM/scripts/BLD_CCTM_v53_gcc_saprc07tic_ae7i_aq_debug Output Directory is /central/groups/seinfeldgroup/CMAQ_EAP_base5.3/data/LA1km/output_CCTM_v53_gcc_LA1km_2012emis_WRFv38 Log Directory is /central/groups/seinfeldgroup/CMAQ_EAP_base5.3/data/LA1km/output_CCTM_v53_gcc_LA1km_2012emis_WRFv38/LOGS Executable Name is CCTM_v53.exe ---CMAQ EXECUTION ID: CMAQ_CCTMv53_epenning_20200102_034526_503741188 --- Set up input and output files for Day 2012-07-20. Existing Logs and Output Files for Day 2012-07-20 Will Be Deleted /bin/rm: No match. CMAQ Processing of Day 20120720 Began at Wed Jan 1 19:45:26 PST 2020 Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: Program received signal SIGILL: Illegal instruction. Backtrace for this error: #0 0x2aaaac92927f in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? ------------------------------------------------------- Primary job terminated normally, but 1 process returned a non-zero exit code. Per user-direction, the job has been aborted. ------------------------------------------------------- #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? #0 0x2aaaac92927f in ??? #1 0x64b9b1 in ??? #2 0x651d09 in ??? #3 0x404acc in ??? #4 0x2aaaac9153d4 in ??? #5 0x404afc in ??? #6 0xffffffffffffffff in ??? -------------------------------------------------------------------------- mpirun noticed that process rank 2 with PID 0 on node hpc-25-20 exited on signal 4 (Illegal instruction). -------------------------------------------------------------------------- real 0.54 user 0.56 sys 0.47 ************************************************************** ** Runscript Detected an Error: CGRID file was not written. ** ** This indicates that CMAQ was interrupted or an issue ** ** exists with writing output. The runscript will now ** ** abort rather than proceeding to subsequent days. ** ************************************************************** ================================== ***** CMAQ TIMING REPORT ***** ================================== Start Day: 2012-07-20 End Day: 2012-07-26 Number of Simulation Days: 1 Domain Name: LA1km Number of Grid Cells: 3097780 (ROW x COL x LAY) Number of Layers: 49 Number of Processes: 64 All times are in seconds. Num Day Wall Time 01 2012-07-20 0.54 Total Time = .54 Avg. Time = .54