Combine run Error

Hi all,
I’m trying to run the combine post-processor and come across the following error:


WARNING File does not exist:INFILE5
Value for GENSPEC: N returning FALSE

 Value for IOAPI_CHECK_HEADERS not defined;returning default:   FALSE
  
 "OUTFILE" opened as OLD:READ-WRITE  
 File name "/home/hdong/CMAQv5.3/data/combine/COMBINE_ACONC_v53_gcc_14-01-2015_201501.nc"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name "HN-01-2015"
 Dimensions: 24 rows, 27 cols, 1 lays, 134 vbles
 NetCDF ID:    327680  opened as READWRITE           
 Starting date and time  2015014:130000 (13:00:00  Jan. 14, 2015)
 Timestep                          010000 (1:00:00 hh:mm:ss)
 Maximum current record number         0

Processing starting at: 2015014 130000
ending at: 2015014 220000

Copying Variables at time:2015014:130000

Program received signal SIGABRT: Process abort signal.

Backtrace for this error:
#0 0x7f584601cef7 in ???
#1 0x7f584601c12d in ???
#2 0x7f584550f4af in ???
#3 0x7f584550f428 in ???
#4 0x7f5845511029 in ???
#5 0x7f58455517e9 in ???
#6 0x7f584555a379 in ???
#7 0x7f584555e53b in ???
#8 0x416336 in ???
#9 0x416f45 in ???
#10 0x41a1ed in ???
#11 0x41e96e in ???
#12 0x4035ac in ???
#13 0x7f58454fa82f in ???
#14 0x4035d8 in ???
#15 0xffffffffffffffff in ???
Abort (core dumped)

I don’t know why it’s trying to open INFILE5 when there should be only 4 input files. And it also should be able to create the OUTFILE, in COMBINE_DEP_v53_gcc_14-01-2015_201501 file have data, but in COMBINE_ACONC_v53_gcc_14-01-2015_201501.nc file have not data. Any advice?

And here are my scripts and log files.
Thanks!
run_combine.csh (7.3 KB)
combine_v53.log.txt (64.2 KB)

The warning about the missing INFILE5 is just that, a warning, and doesn’t cause the problem you are reporting. The executable doesn’t know how many INFILEs there are, so it just tries to open them sequentially until it encounters one that is undefined (note that the successful ‘combine’ run for deposition also has this warning, but since INFILE4 was explicitly defined as blank in the script, the warning looks a bit different than when running ‘combine’ for aconc).

It’s hard to tell what’s causing the crash when running for ‘aconc’, but it may be a memory issue. My two suggestions are to 1) compile ‘combine’ in debug mode to see if there any more specific error messages, and 2) edit CMAQ_HOME/POST/combine/scripts/spec_def_files/SpecDef_${MECH}.txt to create a test version with just a few species instead of the many species currently defined and see if this helps.

Your run script performs two different combine runs. The first to create an output file called COMBINE_ACONC* , and the second to create the output file called COMBINE_DEP* . The first step is failing, while the second succeeds.

According to your log file, you have an output file that already exists.
Can you try removing that and rerunning only the first part of your run script.

 "OUTFILE" opened as **OLD:READ-WRITE**  
 File name "/home/hdong/CMAQv5.3/data/combine/COMBINE_ACONC_v53_gcc_14-01-2015_201501.nc"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name "HN-01-2015"
 Dimensions: 24 rows, 27 cols, 1 lays, 134 vbles
 NetCDF ID:    327680  opened as READWRITE           
 Starting date and time  2015014:130000 (13:00:00  Jan. 14, 2015)
 Timestep                          010000 (1:00:00 hh:mm:ss)
 Maximum current record number         0

Processing starting at: 2015014 130000
ending at: 2015014 220000

Copying Variables at time:2015014:130000

Program received signal SIGABRT: Process abort signal.

Thank you for replying but I use a Dell Precision 7510 15.6-inch Full HD Core i7 6820HQ laptop / 32GB RAM / 1TB SSD / NVIDIA so I think it works well for this.

Thanks for answering.
I have tried following your instructions but it did not solve the problem.
Do you have any other suggestions?
Sincere thanks.

Assuming that the Species Definition file: SpecDef_cb6r3_ae7_aq.txt is OK

The first variable that it tries to write out is AIR_DENS, which should be coming from the METCRO3D file.

AIR_DENS ,kg m-3 ,DENS[2]

/ File [2]: METCRO3D file

I noticed that you have a different Grid name in your log file between INFILE1 and INFILE2.

"INFILE1" opened as OLD:READ-ONLY   
 File name "/home/hdong/CMAQv5.3/data/cctm/14-01-2015/CCTM_ACONC_14-01-2015_20150114.nc"
 File type GRDDED3 
 Execution ID "CMAQ_CCTMv53_hdong_20200107_162831_453815532"
 Grid name "HN-01-2015"
 Dimensions: 24 rows, 27 cols, 1 lays, 226 vbles
 NetCDF ID:     65536  opened as READONLY            
 Starting date and time  2015014:130000 (13:00:00  Jan. 14, 2015)
 Timestep                          010000 (1:00:00 hh:mm:ss)
 Maximum current record number        10
  
 "INFILE2" opened as OLD:READ-ONLY   
 File name "/home/hdong/CMAQv5.3/data/mcip/14-01-2015/METCRO3D_14-01-2015.nc"
 File type GRDDED3 
 Execution ID "mcip"
 Grid name "HN-01-2015_CROSS"
 Dimensions: 24 rows, 27 cols, 32 lays, 18 vbles
 NetCDF ID:    131072  opened as READONLY            
 Starting date and time  2015014:130000 (13:00:00  Jan. 14, 2015)
 Timestep                          010000 (1:00:00 hh:mm:ss)
 Maximum current record number        12

I thought that it may cause a problem, but perhaps not. Can you use ncdump -h to determine if DENS is available in the METCRO3D_14-01-2015.nc file

Thanks lizadams
But the file creation COMBINE_DEP * does not matter though its source files also have such Grid names.

  1. First, recompile the combine executable to use debug mode
    i. make clean
    ii. setenv DEBUG true
    iii. make
    iv. rerun the combine script and see if you get a traceback to tell us what is causing the abort
  2. Then please verify that your species definition file is not corrupted.
    i. compare your species def to the one in the repo using the diff command: CMAQ_REPO/CCTM/src/MECHS/cb6r3_ae7_aq/SpecDef_cb6r3_ae7_aq.txt
  3. Please also use ncdump -h to verify that the variable DENS is available in the METCRO3D_14-01-2015.nc file.

Thank you for your comments.
I found the error: on the third line “#layer 1” in the SpecDef_cb6r3_ae7_aq.txt file I added an “!” before “#”.
Thank you once again.