Start Model Run At Wed Feb 5 12:47:11 EST 2020 Compiler is set to intel Intel(R) Parallel Studio XE 2018 Update 3 for Linux* Copyright (C) 2009-2018 Intel Corporation. All rights reserved. Working Directory is /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/CCTM/scripts Build Directory is /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/CCTM/scripts/BLD_CCTM_v531_intel Output Directory is /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/data/output_CCTM_v531_intel_Bench_2016_12SE1 Log Directory is /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/data/output_CCTM_v531_intel_Bench_2016_12SE1/LOGS Executable Name is CCTM_v531.exe ---CMAQ EXECUTION ID: CMAQ_CCTMv531_xr32_20200205_174711_644380340 --- Set up input and output files for Day 2016-07-01. Existing Logs and Output Files for Day 2016-07-01 Will Be Deleted /bin/rm: No match. CMAQ Processing of Day 20160701 Began at Wed Feb 5 12:47:11 EST 2020 srun: job 89953531 queued and waiting for resources srun: job 89953531 has been allocated resources CTM_APPL | v531_intel_Bench_2016_12SE1_20160701 ================================================================================ | | | The Community Multiscale Air Quality (CMAQ) Model | | Version 5.3.1 | | | | Built and Maintained by the | | Office of Research and Development | | United States Environmental Protection Agency | | | | https://www.epa.gov/cmaq | | | | Source Code: https://www.github.com/USEPA/cmaq/tree/master | | Documentation: https://www.github.com/USEPA/cmaq/tree/master/DOCS | | | | The CMAQ Model is tested and released with cooperation from | | the Community Modeling and Analysis System (CMAS) Center via | | contract support. CMAS is managed by the Institute for the | | Environment, University of North Carolina at Chapel Hill. | | CMAS URL: (https://www.cmascenter.org) | | | ================================================================================ This program uses the EPA-AREAL/MCNC-EnvPgms/BAMS Models-3 I/O Applications Programming Interface, [I/O API] which is built on top of the netCDF I/O library (Copyright 1993, 1996 University Corporation for Atmospheric Research/Unidata Program) and the PVM parallel-programming library (from Oak Ridge National Laboratory). Copyright (C) 1992-2002 MCNC, (C) 1992-2013 Carlie J. Coats, Jr., (C) 2003-2012 Baron Advanced Meteorological Systems, LLC, and (C) 2014-2016 UNC Institute for the Environment. Released under the GNU LGPL License, version 2.1. See URL https://www.gnu.org/licenses/old-licenses/lgpl-2.1.html for conditions of use. ioapi-3.2: $Id: init3.F90 98 2018-04-05 14:35:07Z coats $ IOCPL version 3.2-cpl-mpi of Jun 21 2018 22:07:49 $ PVM version 3.4.6 MPI/PnetCDF parallel-I/O enabled PnetCDF Library Version "1.9.0 of 19 Dec 2017" netCDF version 4.6.1 of May 22 2018 16:36:04 $ =========================================== |>--- ENVIRONMENT VARIABLE REPORT ---<| =========================================== |> Grid and High-Level Model Parameters: +========================================= --Env Variable-- | --Value-- -------------------------------------------------------------------------------- BLD | (default) OUTDIR | /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/data/output_CCTM_v531_intel_Bench_2016_12SE1 NEW_START | T ISAM_NEW_START | Y (default) GRID_NAME | 2016_12SE1 CTM_TSTEP | 10000 CTM_RUNLEN | 240000 CTM_PROGNAME | DRIVER (default) CTM_STDATE | 2016183 CTM_STTIME | 0 NPCOL_NPROW | 20 12 CTM_MAXSYNC | 300 CTM_MINSYNC | 60 |> Multiprocess control, output and error checking: +==================================================== --Env Variable-- | --Value-- -------------------------------------------------------------------------------- PRINT_PROC_TIME | T FL_ERR_STOP | F CTM_CKSUM | T AVG_FILE_ENDTIME | F AVG_CONC_SPCS | ALL CONC_SPCS | O3 NO ANO3I ANO3J NO2 FORM ISOP NH3 ANH4I ANH4J ASO4I ASO4J ACONC_BLEV_ELEV | 1 1 CONC_BLEV_ELEV | 1 1 IOAPI_LOG_WRITE | F VERTEXT | F VERTEXT_COORD_PA | /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/CCTM/scripts/lonlat.csv gc_matrix_nml | /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/CCTM/scripts/BLD_CCTM_v531_intel/GC_cb6r3_ae7_aq.nml ae_matrix_nml | /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/CCTM/scripts/BLD_CCTM_v531_intel/AE_cb6r3_ae7_aq.nml nr_matrix_nml | /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/CCTM/scripts/BLD_CCTM_v531_intel/NR_cb6r3_ae7_aq.nml tr_matrix_nml | /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/CCTM/scripts/BLD_CCTM_v531_intel/Species_Table_TR_0.nml |> Chemistry and Photolysis: +============================= --Env Variable-- | --Value-- -------------------------------------------------------------------------------- CTM_PHOTDIAG | F CORE_SHELL_OPTIC | F (default) OPTICS_MIE_CALC | F (default) GEAR_ATOL | 0.100E-08 (default) GEAR_RTOL | 0.100E-02 (default) RB_RTOL | 0.100E-02 (default) RB_ATOL | 0.100E-06 (default) |> Aerosols: +============= --Env Variable-- | --Value-- -------------------------------------------------------------------------------- CTM_AVISDIAG | F (default) CTM_ZERO_PCSOA | F (default) CTM_AOD | F (default) CTM_PMDIAG | F CTM_APMDIAG | T APMDIAG_BLEV_ELE | 1 1 AVG_PMDIAG_SPCS | (default) STM_SO4TRACK | F |> Cloud Processes: +==================== --Env Variable-- | --Value-- -------------------------------------------------------------------------------- CLD_DIAG | F |> Air-Surface Exchange Processes: +=================================== --Env Variable-- | --Value-- -------------------------------------------------------------------------------- PX_VERSION | T CTM_ABFLUX | T CTM_MOSAIC | F CTM_SFC_HONO | T CLM_VERSION | F NOAH_VERSION | F CTM_STAGE | F (default) CTM_DEPV_FILE | F CTM_HGBIDI | F CTM_BIDI_FERT_NH | T CTM_WBDUST_BELD | BELD3 |> Transport Processes: +======================== --Env Variable-- | --Value-- -------------------------------------------------------------------------------- CTM_VDIFF_DIAG_F | F (default) SIGMA_SYNC_TOP | 0.700E+00 ADV_HDIV_LIM | 0.900E+00 (default) CTM_ADV_CFL | 0.950E+00 KZMIN | T CTM_WVEL | T CTM_GRAV_SETL | T |> Emissions Parameters: +========================= --Env Variable-- | --Value-- -------------------------------------------------------------------------------- EMISSCTRL_NML | /scratch/panosg/gscratch/CMAQ5.3.1/CMAQ-5.3.1/CCTM/scripts/BLD_CCTM_v531_intel/EmissCtrl_cb6r3_ae7_aq.nml CTM_EMLAYS | 0 (default) N_EMIS_GR | 2 N_EMIS_TR | 0 (default) CTM_EMISCHK | F CTM_BIOGEMIS | T BIOG_SPRO | DEFAULT (default) BIOSW_YN | T B3GTS_DIAG | F CTM_MGEMDIAG | F (default) CTM_OCEAN_CHEM | T CTM_WB_DUST | F CTM_DUSTEM_DIAG | F CTM_SSEMDIAG | F CTM_LTNG_NO | F LTNG_ASSIM_DT | 0 (default) LTNGNO | InLine (default) USE_NLDN | F (default) LTNGDIAG | F MOLSNCG | 0.350E+03 (default) MOLSNIC | 0.350E+03 (default) N_EMIS_PT | 8 IPVERT | 0 (default) EMISDIAG | F EMIS_SYM_DATE | F |> Process Analysis Parameters: +================================ --Env Variable-- | --Value-- -------------------------------------------------------------------------------- CTM_PROCAN | F PA_BCOL_ECOL | (default) PA_BROW_EROW | (default) PA_BLEV_ELEV | (default) MET data determined based on WRF ARM version 3.8 -=- MPP Processor-to-Subdomain Map -=- Number of Processors = 240 ____________________________________________________ | | | PE #Cols Col_Range #Rows Row_Range | |__________________________________________________| | | | 0 5 1: 5 7 1: 7 | | 1 5 6: 10 7 1: 7 | | 2 5 11: 15 7 1: 7 | | 3 5 16: 20 7 1: 7 | | 4 5 21: 25 7 1: 7 | | 5 5 26: 30 7 1: 7 | | 6 5 31: 35 7 1: 7 | | 7 5 36: 40 7 1: 7 | | 8 5 41: 45 7 1: 7 | | 9 5 46: 50 7 1: 7 | | 10 5 51: 55 7 1: 7 | | 11 5 56: 60 7 1: 7 | | 12 5 61: 65 7 1: 7 | | 13 5 66: 70 7 1: 7 | | 14 5 71: 75 7 1: 7 | | 15 5 76: 80 7 1: 7 | | 16 5 81: 85 7 1: 7 | | 17 5 86: 90 7 1: 7 | | 18 5 91: 95 7 1: 7 | | 19 5 96: 100 7 1: 7 | | 20 5 1: 5 7 8: 14 | | 21 5 6: 10 7 8: 14 | | 22 5 11: 15 7 8: 14 | | 23 5 16: 20 7 8: 14 | | 24 5 21: 25 7 8: 14 | | 25 5 26: 30 7 8: 14 | | 26 5 31: 35 7 8: 14 | | 27 5 36: 40 7 8: 14 | | 28 5 41: 45 7 8: 14 | | 29 5 46: 50 7 8: 14 | | 30 5 51: 55 7 8: 14 | | 31 5 56: 60 7 8: 14 | | 32 5 61: 65 7 8: 14 | | 33 5 66: 70 7 8: 14 | | 34 5 71: 75 7 8: 14 | | 35 5 76: 80 7 8: 14 | | 36 5 81: 85 7 8: 14 | | 37 5 86: 90 7 8: 14 | | 38 5 91: 95 7 8: 14 | | 39 5 96: 100 7 8: 14 | | 40 5 1: 5 7 15: 21 | | 41 5 6: 10 7 15: 21 | | 42 5 11: 15 7 15: 21 | | 43 5 16: 20 7 15: 21 | | 44 5 21: 25 7 15: 21 | | 45 5 26: 30 7 15: 21 | | 46 5 31: 35 7 15: 21 | | 47 5 36: 40 7 15: 21 | | 48 5 41: 45 7 15: 21 | | 49 5 46: 50 7 15: 21 | | 50 5 51: 55 7 15: 21 | | 51 5 56: 60 7 15: 21 | | 52 5 61: 65 7 15: 21 | | 53 5 66: 70 7 15: 21 | | 54 5 71: 75 7 15: 21 | | 55 5 76: 80 7 15: 21 | | 56 5 81: 85 7 15: 21 | | 57 5 86: 90 7 15: 21 | | 58 5 91: 95 7 15: 21 | | 59 5 96: 100 7 15: 21 | | 60 5 1: 5 7 22: 28 | | 61 5 6: 10 7 22: 28 | | 62 5 11: 15 7 22: 28 | | 63 5 16: 20 7 22: 28 | | 64 5 21: 25 7 22: 28 | | 65 5 26: 30 7 22: 28 | | 66 5 31: 35 7 22: 28 | | 67 5 36: 40 7 22: 28 | | 68 5 41: 45 7 22: 28 | | 69 5 46: 50 7 22: 28 | | 70 5 51: 55 7 22: 28 | | 71 5 56: 60 7 22: 28 | | 72 5 61: 65 7 22: 28 | | 73 5 66: 70 7 22: 28 | | 74 5 71: 75 7 22: 28 | | 75 5 76: 80 7 22: 28 | | 76 5 81: 85 7 22: 28 | | 77 5 86: 90 7 22: 28 | | 78 5 91: 95 7 22: 28 | | 79 5 96: 100 7 22: 28 | | 80 5 1: 5 7 29: 35 | | 81 5 6: 10 7 29: 35 | | 82 5 11: 15 7 29: 35 | | 83 5 16: 20 7 29: 35 | | 84 5 21: 25 7 29: 35 | | 85 5 26: 30 7 29: 35 | | 86 5 31: 35 7 29: 35 | | 87 5 36: 40 7 29: 35 | | 88 5 41: 45 7 29: 35 | | 89 5 46: 50 7 29: 35 | | 90 5 51: 55 7 29: 35 | | 91 5 56: 60 7 29: 35 | | 92 5 61: 65 7 29: 35 | | 93 5 66: 70 7 29: 35 | | 94 5 71: 75 7 29: 35 | | 95 5 76: 80 7 29: 35 | | 96 5 81: 85 7 29: 35 | | 97 5 86: 90 7 29: 35 | | 98 5 91: 95 7 29: 35 | | 99 5 96: 100 7 29: 35 | |100 5 1: 5 7 36: 42 | |101 5 6: 10 7 36: 42 | |102 5 11: 15 7 36: 42 | |103 5 16: 20 7 36: 42 | |104 5 21: 25 7 36: 42 | |105 5 26: 30 7 36: 42 | |106 5 31: 35 7 36: 42 | |107 5 36: 40 7 36: 42 | |108 5 41: 45 7 36: 42 | |109 5 46: 50 7 36: 42 | |110 5 51: 55 7 36: 42 | |111 5 56: 60 7 36: 42 | |112 5 61: 65 7 36: 42 | |113 5 66: 70 7 36: 42 | |114 5 71: 75 7 36: 42 | |115 5 76: 80 7 36: 42 | |116 5 81: 85 7 36: 42 | |117 5 86: 90 7 36: 42 | |118 5 91: 95 7 36: 42 | |119 5 96: 100 7 36: 42 | |120 5 1: 5 7 43: 49 | |121 5 6: 10 7 43: 49 | |122 5 11: 15 7 43: 49 | |123 5 16: 20 7 43: 49 | |124 5 21: 25 7 43: 49 | |125 5 26: 30 7 43: 49 | |126 5 31: 35 7 43: 49 | |127 5 36: 40 7 43: 49 | |128 5 41: 45 7 43: 49 | |129 5 46: 50 7 43: 49 | |130 5 51: 55 7 43: 49 | |131 5 56: 60 7 43: 49 | |132 5 61: 65 7 43: 49 | |133 5 66: 70 7 43: 49 | |134 5 71: 75 7 43: 49 | |135 5 76: 80 7 43: 49 | |136 5 81: 85 7 43: 49 | |137 5 86: 90 7 43: 49 | |138 5 91: 95 7 43: 49 | |139 5 96: 100 7 43: 49 | |140 5 1: 5 7 50: 56 | |141 5 6: 10 7 50: 56 | |142 5 11: 15 7 50: 56 | |143 5 16: 20 7 50: 56 | |144 5 21: 25 7 50: 56 | |145 5 26: 30 7 50: 56 | |146 5 31: 35 7 50: 56 | |147 5 36: 40 7 50: 56 | |148 5 41: 45 7 50: 56 | |149 5 46: 50 7 50: 56 | |150 5 51: 55 7 50: 56 | |151 5 56: 60 7 50: 56 | |152 5 61: 65 7 50: 56 | |153 5 66: 70 7 50: 56 | |154 5 71: 75 7 50: 56 | |155 5 76: 80 7 50: 56 | |156 5 81: 85 7 50: 56 | |157 5 86: 90 7 50: 56 | |158 5 91: 95 7 50: 56 | |159 5 96: 100 7 50: 56 | |160 5 1: 5 6 57: 62 | |161 5 6: 10 6 57: 62 | |162 5 11: 15 6 57: 62 | |163 5 16: 20 6 57: 62 | |164 5 21: 25 6 57: 62 | |165 5 26: 30 6 57: 62 | |166 5 31: 35 6 57: 62 | |167 5 36: 40 6 57: 62 | |168 5 41: 45 6 57: 62 | |169 5 46: 50 6 57: 62 | |170 5 51: 55 6 57: 62 | |171 5 56: 60 6 57: 62 | |172 5 61: 65 6 57: 62 | |173 5 66: 70 6 57: 62 | |174 5 71: 75 6 57: 62 | |175 5 76: 80 6 57: 62 | |176 5 81: 85 6 57: 62 | |177 5 86: 90 6 57: 62 | |178 5 91: 95 6 57: 62 | |179 5 96: 100 6 57: 62 | |180 5 1: 5 6 63: 68 | |181 5 6: 10 6 63: 68 | |182 5 11: 15 6 63: 68 | |183 5 16: 20 6 63: 68 | |184 5 21: 25 6 63: 68 | |185 5 26: 30 6 63: 68 | |186 5 31: 35 6 63: 68 | |187 5 36: 40 6 63: 68 | |188 5 41: 45 6 63: 68 | |189 5 46: 50 6 63: 68 | |190 5 51: 55 6 63: 68 | |191 5 56: 60 6 63: 68 | |192 5 61: 65 6 63: 68 | |193 5 66: 70 6 63: 68 | |194 5 71: 75 6 63: 68 | |195 5 76: 80 6 63: 68 | |196 5 81: 85 6 63: 68 | |197 5 86: 90 6 63: 68 | |198 5 91: 95 6 63: 68 | |199 5 96: 100 6 63: 68 | |200 5 1: 5 6 69: 74 | |201 5 6: 10 6 69: 74 | |202 5 11: 15 6 69: 74 | |203 5 16: 20 6 69: 74 | |204 5 21: 25 6 69: 74 | |205 5 26: 30 6 69: 74 | |206 5 31: 35 6 69: 74 | |207 5 36: 40 6 69: 74 | |208 5 41: 45 6 69: 74 | |209 5 46: 50 6 69: 74 | |210 5 51: 55 6 69: 74 | |211 5 56: 60 6 69: 74 | |212 5 61: 65 6 69: 74 | |213 5 66: 70 6 69: 74 | |214 5 71: 75 6 69: 74 | |215 5 76: 80 6 69: 74 | |216 5 81: 85 6 69: 74 | |217 5 86: 90 6 69: 74 | |218 5 91: 95 6 69: 74 | |219 5 96: 100 6 69: 74 | |220 5 1: 5 6 75: 80 | |221 5 6: 10 6 75: 80 | |222 5 11: 15 6 75: 80 | |223 5 16: 20 6 75: 80 | |224 5 21: 25 6 75: 80 | |225 5 26: 30 6 75: 80 | |226 5 31: 35 6 75: 80 | |227 5 36: 40 6 75: 80 | |228 5 41: 45 6 75: 80 | |229 5 46: 50 6 75: 80 | |230 5 51: 55 6 75: 80 | |231 5 56: 60 6 75: 80 | |232 5 61: 65 6 75: 80 | |233 5 66: 70 6 75: 80 | |234 5 71: 75 6 75: 80 | |235 5 76: 80 6 75: 80 | |236 5 81: 85 6 75: 80 | |237 5 86: 90 6 75: 80 | |238 5 91: 95 6 75: 80 | |239 5 96: 100 6 75: 80 | |__________________________________________________| application called MPI_Abort(MPI_COMM_WORLD, 538976288) - process 20 In: PMI_Abort(538976288, application called MPI_Abort(MPI_COMM_WORLD, 538976288) - process 20) srun: Job step aborted: Waiting up to 32 seconds for job step to finish. slurmstepd: error: *** STEP 89953531.0 ON hal0133 CANCELLED AT 2020-02-05T12:47:20 *** srun: error: hal0133: tasks 0-19,21-31: Killed srun: error: hal0133: task 20: Exited with exit code 32 srun: error: hal0137: tasks 128-159: Killed srun: error: hal0134: tasks 32-63: Killed srun: error: hal0140: tasks 224-239: Killed srun: error: hal0136: tasks 96-127: Killed srun: error: hal0139: tasks 192-223: Killed srun: error: hal0138: tasks 160-191: Killed srun: error: hal0135: tasks 64-95: Killed 0.161u 0.216s 0:08.86 4.1% 0+0k 0+0io 0pf+0w Wed Feb 5 12:47:20 EST 2020 tail: cannot open 'buff_CMAQ_CCTMv531_xr32_20200205_174711_644380340.txt' for reading: No such file or directory ************************************************************** ** Runscript Detected an Error: CGRID file was not written. ** ** This indicates that CMAQ was interrupted or an issue ** ** exists with writing output. The runscript will now ** ** abort rather than proceeding to subsequent days. ** ************************************************************** (standard_in) 2: syntax error (standard_in) 1: syntax error (standard_in) 1: syntax error ================================== ***** CMAQ TIMING REPORT ***** ================================== Start Day: 2016-07-01 End Day: 2016-07-01 Number of Simulation Days: 1 Domain Name: 2016_12SE1 Number of Grid Cells: 280000 (ROW x COL x LAY) Number of Layers: 35 Number of Processes: 240 All times are in seconds. Num Day Wall Time 01 2016-07-01 Total Time = Avg. Time =