Debugging SMOKE for sectors needing MCIP files

SMOKE Emissions Inventory
1

Hello all,

I’ve been spending a lot of time running SMOKE v5.1 with the 2022v1 NEI to generate input files for CAMx, and have run into some errors running certain sectors. For context, I’m running on a basic PC with these specifications:

Processor Intel(R) Core™ i7-6700 CPU @ 3.40GHz 3.41 GHz
Installed RAM 16.0 GB (15.9 GB usable)
Internal drive 240GB, External USB drive 3TB (nominal)
Windows 10 Pro, V22H2 (host OS)
Oracle VirtualBox 7.0, Linux Mint 22 (guest OS), SMOKE v5.1

For most sectors, running the scripts were straightforward using the precompiled executables from EPA. For sectors that needed MCIP met files I could only run the onetime scripts before getting errors in the next scripts. Some of the early errors I fixed included commenting out a redefinition of SMOKE_LOCATION near the end of the scripts, and editing the appropriate directory_definitions_12US2.csh as well. I decided to postpone running the onroad scripts since I didn’t have disk space for all eftables files, and barely had enough space for just the January 2020 MCIP files (scripts edited to run January 2020 only).

Here are a list of errors I encountered, quoted from the intermed/*/logs/ files and ++++++++++ marks where the script stopped running:

/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c1c2_12/logs/smkinven_cmv_c1c2_12_jan_2022hc_cb6_22m.log

last line:
Reading hour -specific data…
Successful open for emissions file:
/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c1c2_12/cmv_C1C2_02_cmv_c1c2_2022_gapfilled_masked_12US1_2022_CA_hourly.csv

++++++++++

/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/logs/smkinven_cmv_c3_12_jan_2022hc_cb6_22m.log

last line:
Successful open for emissions file:
/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c3_12/cmv_C3_02_cmv_c3_2022_gapfilled_masked_12US1_2022_CA_hourly.csv

*** ERROR ABORT in subroutine RDFF10PD:CHECKMEM
Failure allocating memory for “HSVAL”: STATUS= 41

++++++++++

/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/beis4/logs/tmpbeis4_beis4_2022hc_cb6_22m_20220101_12US1.log

last line:
Processing Sunday Jan. 2, 2022
at time 0:00:00

*** ERROR ABORT in subroutine HRBEIS4
TAIR= 0.00 out of range at (C,R)= 1, 1
Date and time 0:00:00 Jan. 2, 2022 (2022002:000000)

++++++++++

/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/ptfire-rx3D/logs/smkinven_ptfire-rx3D_jan_2022hc_cb6_22m.log

last line:
Successful open for emissions file:
/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/ptfire-rx/ptday_sf2_2022v1_20240626_caps_rx_08jul2024_v0

*** ERROR ABORT in subroutine RDFF10PD:CHECKMEM
Failure allocating memory for “HSVAL”: STATUS= 41

++++++++++

/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/ptfire-wild3D/logs/smkinven_ptfire-wild3D_jan_2022hc_cb6_22m.log

last line:
Reading day -specific data…
Successful open for emissions file:
/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/ptfire-wild/ptday_sf2_2022v1_20240802_caps_wf_02aug2024_v0

++++++++++

Earlier I got advice from @james.beidler about running with at least 32GB RAM and enough drive space, and he recommended running rwc, ptfire and onroad to see if my system was up to it. Runs with rwc, ptagfire ptfire_othna and nonpoint/onroad* generated output in either /premerged/ or /smoke_out/, but the specific ones mentioned stopped prematurely. I also had trouble getting results running the *_adj scripts after their precursor script ran.

I strongly suspect I’ve run into an insufficient RAM issue that I can’t do anything about, but would appreciate confirmation from more experienced users. Practice runs with SMOKE on this PC are the best I can do until our regular Linux cluster is back online, but I’ve learned a lot anyway.

Thanks for your advice!

2

From some of the errors below it looks like you are running out of RAM.

You could consider trying to run for a smaller grid that is a subset of the 12US1 grid to see if that helps.

You also mention “the January 2020 MCIP files (scripts edited to run January 2020” but you also say you are working with the 2022 platform. I wouldn’t expect the met.-dependent processes to work with 2020 met data for a 2022 run.

Did you mean to say 2022 instead of 2020 here?

3

@eyth.alison thanks for confirming my guess, and yes I meant to type January 2022 (cut and paste got me). My supervisor suggested I duplicate the EPA run so I could get the same /premerged/ or /smoke_out/ results, an apples to apples comparison once I figure out how to use m3diff properly. After that I can then move on to preparing CAMx input files.

Would there be any reason to doubt whether running a subset grid of 12US1 in SMOKE would agree to 1e-6 of the same subset grid cut out from the EPA /premerged/ or /smoke_out/ files on AWS?

Our Linux cluster doesn’t have the ifort compiler and I am unsure if it will run EPA’s precompiled executables, so there’ll probably be some differences due to the gfortran compiler. I’m hoping there’s a free to download ifort compiler somewhere.

4

M3Tools program m3diff is documented here.

You can download the Intel Fortran compiler here. Note that the compiler-name has changed (as have some flags): it is now ifx instead of ifort; this means you’ll want to use I/O API BIN-types { Linux2_x86_64ifx, Linux2_x86_64ifxdbg, Linux2_x86_64ifx_medium, Linux2_x86_64ifx_mediumdbg }. If your cluster does have gfortran then find out the version using the command gfortran --version; if the version is 10 or greater, you need to use the *gfort10* I/O API binary types, and the corresponding flags. See
Easy Guide® for Building SMOKE…

If your subset-grid is in fact “cut out” from the larger grind, then the per-cell emissions values should be an exact match (assuming you’re using M3Tools program m3wndw ) or some otherwise “correct” (binary) windowing program, and not going through some ASCII intermediate data-file (note that the language-standards explicitly do not guarantee the quality of rounding in operations to/from ASCII).

5

@cjcoats thanks, this answers a lot of my questions. Your new edit just answered my next question (Do the new I/O API BIN types relate to the compilation of the SMOKE executables or somewhere else?)

Since the influence of the grid points surrounding the subset grid of the EPA /premerged/ or /smoke_out/ data would be reduced to the equivalent of time-varying boundary conditions, would there be a noticeable difference from the SMOKE run subset grid where the boundary conditions are imposed by the input data?

6

No. It should be exact, independent of the boundary-met (etc.).

7

Thanks @eyth.alison and @cjcoats, I’ll think about how to best approach this next task.

8

Hi Flyenz0,

Were you able to resolve this issue? I am getting the same error message when I try to process daily c1c2 US data (as you are using here for the Canadian data) but I am running on a small modelling domain and have 32 GB of RAM available. I am running SMOKE 5.1 using the provided intel compilation. When I try and run a smaller dummy emission file (taking the original c1c2 file and deleting all but a few thousand lines of emissions ~ 7MB of data instead of 850 MB of data) I get an error message that “US , , , , , , , , , , , , , , , , , , “ not recognized in the COSTCY file posted to the log file. The COSTCY file comes from 2019 NEI emissions package and is a standard control file. This makes me think this is not a RAM issue but something related to this compilation of SMOKE and a problem with reading FF10 files?

9

Unfortunately not. Often there’s not enough information from the error messages to diagnose where SMOKE stops working and why. I didn’t even consider editing the input files like you did, since I didn’t know what parts were relevant to the problem.

When I took the SMOKE training course, running sectors were generally problem free as the SMOKE configuration and input files were already optimized for new users. Back in the real world I edited out a number of errors to make progress, but computer limitations led to dead ends.

I’m hoping once our SMOKE Linux cluster gets upgraded and running again, generating CAMx input files will go more smoothly.

10

As far as alternatives, we support the idea of winnowing down the inventory and running a test. We note that one user said:

When I try and run a smaller dummy emission file (taking the original c1c2 file and deleting all but a few thousand lines of emissions ~ 7MB of data instead of 850 MB of data) I get an error message that “US , , , , , , , , , , , , , , , , , , “ not recognized in the COSTCY file posted to the log file. The COSTCY file comes from 2019 NEI emissions package and is a standard control file. This makes me think this is not a RAM issue but something related to this compilation of SMOKE and a problem with reading FF10 files?

DLyder: for your test, did you also set up the annual FF10 and the hourly FF10 consistently with your daily file? Meaning, did you remove the same sources from both the annual and hourly FF10s? If so, could you provide the trimmed files you used for their test (to make sure they are set up properly)? If not, you could try updating the annual file – as both files need to be consistent.

Regardless, splitting up the inventory into multiple parts is the best path forward. The most straightforward way would be to put the US inventories in one sector and CAN/MEX in another (this is most easily achieved by moving the annual and hourly inventories by country into separate directories, one directory per sector), although you might need to split the US inventories further – like pulling out data for one or two states based on FIPS codes.

The modeling domain won’t have any effect on the memory requirements, because the most memory intensive part of the process is Smkinven (processing the hourly data), which is grid-independent; so running a smaller modeling domain won’t help.

11

Hi Eyth,

Thanks for your reply.

I did find the problem with “US, , , , , ,” error. There were a number of “,”s in the header of the file after COUNTRY US which I deleted to fix this problem. I was then able to generate the same error message “HSVAL”: STATUS= 41 with the smaller data set. I did not use a modified annual inventory but I will do so to make sure this isn’t the issue. There are not a lot of sectors that use the POINT_HOURLY format (c1c2 and c3 - are the only ones I see) so I really wonder if smkinven is parsing emission emission line correctly?

It also seems that combine_v6.csh is looking for the “nexthour” file when processing December data but I can’t find any such file. This is a very confusing part of combine_v6 and seems to be tailored for specific input files (NEI?) without a lot of details. If I can get to processing December I will have to cross that bridge at that time…

Again, many thanks for your response.

12

Can you please post the entire log containing the HSVAL: STATUS=41 error to help us with debugging?

Are you running for the entire 12US1 domain or a subset?

13 

@james.beidler

I wasn't sure which of us you were referring to, but here is the relevant log 
file running on the 12US1 domain from me  
(/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/logs/smkinven_cmv_c3_12_jan_2022hc_cb6_22m.log) 
The log file ends just after the HSVAL line, sorry about the inline quote which
 I've cut and pasted from a VirtualBox terminal into the browser.

 This program uses the EPA-AREAL/MCNC-EnvPgms/BAMS/ UNC IE       
 Models-3 I/O Applications Programming Interface, [I/O API]      
 which is built on top of the netCDF I/O library (Copyright      
 993, 1996 University Corporation for Atmospheric Research       
 Unidata Program) and the PVM parallel-programming library       
 (from Oak Ridge National Laboratory).                           
 Copyright (C) 1992-2002 MCNC,                                   
 (C) 1992-2018 Carlie J. Coats, Jr.,                             
 (C) 2003-2012 Baron Advanced Meteorological Systems, LLC, and   
 (C) 2014-2023 UNC Institute for the Environment.                
 Released under the GNU LGPL  License, version 2.1.  See URL     
                                                                 
     https://www.gnu.org/licenses/old-licenses/lgpl-2.1.html     
                                                                 
 for conditions of use.                                          
                                                                 
 ioapi-3.2: $Id: init3.F90 247 2023-03-22 15:59:19Z coats $
 $Tag: 2023075 $
 Version with PARMS3.EXT/PARAMETER::MXVARS3= 2048
 netCDF version 4.9.2 of May 21 2024 15:42:07 $
  
  
 Missing environment variable EXECUTION_ID
 SMOKE ---------------
 Copyright (c)2004 Center for Environmental Modeling for Policy Development
 All rights reserved

 Program SMKINVEN, Version SMOKEv5.1_Jul2024
 Online documentation 
     https://cmascenter.org/smoke/                                         
  
 Program SMKINVEN to take ASCII area or point source files
 in IDA, EMS-95, or SMOKE list format, or mobile files
 in IDA format, and produce the I/O API and ASCII SMOKE
 inventory files and list of unique SCCs in the inventory.
  
  
 You will need to enter the logical names for the input and
 output files (and to have set them prior to program start,
 using "setenv <logicalname> <pathname>").
  
 You may use END_OF-FILE (control-D) to quit the program
 during logical-name entry. Default responses are given in
 brackets [LIKE THIS] and can be accepted by hitting the
 <RETURN> key.
  
 Value for PROMPTFLAG:  N returning FALSE
 Returning default value TRUE for query:
 "Continue with program?"
 Value for SMK_SOURCE:  'P'
 Value for SMK_SOURCE:  'P'
 Value for OUTZONE:  0
 Value for SMKINVEN_FORMULA:  'PMC=PM10-PM2_5'
 Value for SMKINVEN_FORMULA:  'PMC=PM10-PM2_5'
 Value for IMPORT_AVEINV_YN:  N returning FALSE
 Value for DAY_SPECIFIC_YN:  N returning FALSE
 Value for HOUR_SPECIFIC_YN:  Y returning TRUE
 Value for IMPORT_MEDS_YN not defined;returning default:   FALSE
 Value for FF10_AVEDAY_ANNINV_YN not defined;returning default:   FALSE
 Value for SMK_PROCESS_HAPS not defined; returning defaultval ':  ' '
 Value for SMK_PROCESS_HAPS not defined; returning defaultval ':  ' '
 No processing of combining criteria VOC with hazardous air pollutants (HAP).
 Value for PROMPTFLAG:  N returning FALSE

 File "PNTS" opened for input on unit:  98
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_map_cmv_c3_12_2022hc_cb6_22m.txt

 Value for PNTS:  '/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_map_cmv_c3_12_2022hc_cb6_22m.txt'
 Value for PNTS:  '/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_map_cmv_c3_12_2022hc_cb6_22m.txt'

 File "PSRC" opened for input on unit:  97
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/psrc_cmv_c3_12.txt

 Value for IOAPI_CHECK_HEADERS not defined;returning default:   FALSE
  
 "PNTS" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 13 vbles
 NetCDF ID:     65536  opened as READONLY            
 Time-independent data.
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/CO.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/NOX.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/PM10.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/PM2_5.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/SO2.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/VOC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/VOC_INV.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/PMC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE

 File "PTHOUR" opened for input on unit:  96
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c3_12/pthour_cmv_c3_12_jan_2022hc_cb6_22m.lst

 Value for USE_EXP_GEO_CODES not defined;returning default:   FALSE

 File "COSTCY" opened for input on unit:  95
 /mnt/Buffalo_3TB/EPA2022v1/ge_dat/costcy_for_2017platform_20dec2023_v8.txt


 File "SCCDESC" opened for input on unit:  94
 /mnt/Buffalo_3TB/EPA2022v1/ge_dat/smkreport/sccdesc_2021platform_24may2024_nf_v1.txt


 File "ORISDESC" opened for input on unit:  93
 /mnt/Buffalo_3TB/EPA2022v1/ge_dat/smkreport/orisdesc_04dec2006_v0.txt


 File "INVTABLE" opened for input on unit:  92
 /mnt/Buffalo_3TB/EPA2022v1/ge_dat/invtable_2022platform_integrate_03jun2024_v0.txt

 Setting up to read inventory data...
 Value for SMK_DEFAULT_TZONE not defined; returning default:  5
 Reading state and county names and time zones...
 NOTE: Population data read from country/state/county file for year     2000
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 WARNING: Different descriptions for the same data name at line     525 . 
      Using description: 
            "Brake PM" and ignoring: 
            "PM10 Brake WEAR".
 WARNING: Different descriptions for the same data name at line     631 . 
      Using description: 
            "PM2.5 BRAKEWEAR" and ignoring: 
            "Brake PM".
 WARNING: Different descriptions for the same data name at line     627 . 
      Using description: 
            "PM10 EXHAUST" and ignoring: 
            "Particulate matter, 210 microns and less".
 WARNING: Different descriptions for the same data name at line     629 . 
      Using description: 
            "PM25 EXHAUST" and ignoring: 
            "Particulate matter, 2.5 microns and less".
 WARNING: Different descriptions for the same data name at line     661 . 
      Using description: 
            "Particulate matter, 210 microns and less" and ignoring: 
            "Particulate matter, 10 microns and less".
 WARNING: Different descriptions for the same data name at line     632 . 
      Using description: 
            "PM10 TIRE WEAR" and ignoring: 
            "Tire PM".
 WARNING: Different descriptions for the same data name at line     633 . 
      Using description: 
            "PM2.5 TIRE WEAR" and ignoring: 
            "Tire PM".
 Value for SMKINVEN_MONTH:  1
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/CO.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/NOX.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/PM10.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/PM2_5.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/SO2.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/VOC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/VOC_INV.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/PMC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
 Reading source data from inventory file...
 Determining number of time steps for hour -specific files...
 Value for SMKINVEN_FORMULA:  'PMC=PM10-PM2_5'
 Value for SMKINVEN_FORMULA:  'PMC=PM10-PM2_5'
 Successful open for emissions file: 
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c3_12/cmv_C3_02_cmv_c3_2022_gapfilled_masked_12US1_2022_CA_hourly.csv
 Value for HOURLY_TO_DAILY not defined;returning default:   FALSE
 Value for OUTPUT_LOCAL_TIME:  Y returning TRUE
 Value for BASE_YEAR:  2022
 Value for SMK_MAXWARNING:  10
 Generating unique lists from inventory data...
  
 "IOAPI_DAT" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/CO.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file IOAPI_DAT
  
 "IOAPI_DAT" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/NOX.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file IOAPI_DAT
  
 "IOAPI_DAT" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/PM10.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file IOAPI_DAT
  
 "IOAPI_DAT" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/PM2_5.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file IOAPI_DAT
  
 "IOAPI_DAT" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/SO2.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file IOAPI_DAT
  
 "IOAPI_DAT" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/VOC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file IOAPI_DAT
  
 "IOAPI_DAT" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/VOC_INV.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file IOAPI_DAT
  
 "IOAPI_DAT" opened as OLD:READ-ONLY   
 File name "/mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/intermed/cmv_c3_12/pnts_cmv_c3_12_dat/PMC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 683198 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file IOAPI_DAT
 WARNING: Skipping pollutant "CO2" at line      10 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      17 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      24 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      31 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      38 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      45 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      52 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      59 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      66 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      73 - not in Inventory Table
 WARNING: Skipping pollutant "CO2" at line      80 - not in Inventory Table
 Successful open for emissions file: 
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c3_12/cmv_C3_02_cmv_c3_2022_gapfilled_masked_12US1_2022_MX_hourly.csv
 Successful open for emissions file: 
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c3_12/cmv_C3_02_cmv_c3_2022_gapfilled_masked_12US1_2022_US_hourly.csv
 Successful open for emissions file: 
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c3_12/cmv_C3_01_cmv_c3_2022_gapfilled_masked_12US1_2022_CA_hourly.csv
 Successful open for emissions file: 
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c3_12/cmv_C3_01_cmv_c3_2022_gapfilled_masked_12US1_2022_MX_hourly.csv
 Successful open for emissions file: 
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c3_12/cmv_C3_01_cmv_c3_2022_gapfilled_masked_12US1_2022_US_hourly.csv
 Determining number of sources for hour -specific files...
 Successful open for emissions file: 
 /mnt/Buffalo_3TB/EPA2022v1/2022hc_cb6_22m/inputs/cmv_c3_12/cmv_C3_02_cmv_c3_2022_gapfilled_masked_12US1_2022_CA_hourly.csv
 
 *** ERROR ABORT in subroutine RDFF10PD:CHECKMEM
 Failure allocating memory for "HSVAL":  STATUS=        41
14

Re: the nexthour files, assuming they are using the 2022hc package, the nexthour files are included in the posted 2022hc inventory zips (https://gaftp.epa.gov/Air/emismod/2022/v1/2022emissions/).

15

Hi James,

I did seem to make some progress with this problem. Firstly, I took Eyth’s advice (thank you Eyth) and made sure that I created a subset of the annual data and daily data for the same sources. In my case I used the Washington State (53xxx) emissions, since these are in my modelliing domain (I am not using US1). I also only selected Jan and Feb for testing setting my starting time to be 01:01:00 and ending time 01:31:23 and set the year of my emissions to 1980 since this is year of my meteorology and I want to make sure any time stamps that my be created in the ncf files will sync with the met data. When I do all of this I seem to get past the HSVAL:STATS=41 error, so I suspect this error may be a timing issue where the original emissions data was labelled 2019 (from the 2019 NEI data set) but I was starting on January 1, 1980 (I was expecting a warning that the emission time and the modelling time didn’t sync but this is hourly data…so it needs to be manually synced beforehand). I should note that in the combine_v6 script there seems to be reference year set to 1980 so I am not sure how the current set up will handle data from earlier than 1980? (I need the data for the spinup period in 1979).

I have attached the log file from smkiven below. The last file that successfully opened (cmv…._US_hourly.csv) was the file where the program was previously stuck with the HSVAL error. Now, I seem to have gotten past this but now I am getting an error that smkinven can’t find a CEMSUM file…but this isn’t CEMS data???

 This program uses the EPA-AREAL/MCNC-EnvPgms/BAMS/ UNC IE       
 Models-3 I/O Applications Programming Interface, [I/O API]      
 which is built on top of the netCDF I/O library (Copyright      
 993, 1996 University Corporation for Atmospheric Research       
 Unidata Program) and the PVM parallel-programming library       
 (from Oak Ridge National Laboratory).                           
 Copyright (C) 1992-2002 MCNC,                                   
 (C) 1992-2018 Carlie J. Coats, Jr.,                             
 (C) 2003-2012 Baron Advanced Meteorological Systems, LLC, and   
 (C) 2014-2023 UNC Institute for the Environment.                
 Released under the GNU LGPL  License, version 2.1.  See URL     
                                                                 
     https://www.gnu.org/licenses/old-licenses/lgpl-2.1.html     
                                                                 
 for conditions of use.                                          
                                                                 
 ioapi-3.2: $Id: init3.F90 247 2023-03-22 15:59:19Z coats $
 $Tag: 2023075 $
 Version with PARMS3.EXT/PARAMETER::MXVARS3= 2048
 netCDF version 4.9.2 of May 21 2024 15:42:07 $
  
  
 Missing environment variable EXECUTION_ID
 SMOKE ---------------
 Copyright (c)2004 Center for Environmental Modeling for Policy Development
 All rights reserved

 Program SMKINVEN, Version SMOKEv5.1_Jul2024
 Online documentation 
     https://cmascenter.org/smoke/                                         
  
 Program SMKINVEN to take ASCII area or point source files
 in IDA, EMS-95, or SMOKE list format, or mobile files
 in IDA format, and produce the I/O API and ASCII SMOKE
 inventory files and list of unique SCCs in the inventory.
  
  
 You will need to enter the logical names for the input and
 output files (and to have set them prior to program start,
 using "setenv <logicalname> <pathname>").
  
 You may use END_OF-FILE (control-D) to quit the program
 during logical-name entry. Default responses are given in
 brackets [LIKE THIS] and can be accepted by hitting the
 <RETURN> key.
  
 Value for PROMPTFLAG:  N returning FALSE
 Returning default value TRUE for query:
 "Continue with program?"
 Value for SMK_SOURCE:  'P'
 Value for SMK_SOURCE:  'P'
 Value for OUTZONE:  0
 Value for SMKINVEN_FORMULA:  'PMC=PM10-PM2_5'
 Value for SMKINVEN_FORMULA:  'PMC=PM10-PM2_5'
 Value for IMPORT_AVEINV_YN:  N returning FALSE
 Value for DAY_SPECIFIC_YN:  N returning FALSE
 Value for HOUR_SPECIFIC_YN:  Y returning TRUE
 Value for IMPORT_MEDS_YN not defined;returning default:   FALSE
 Value for FF10_AVEDAY_ANNINV_YN not defined;returning default:   FALSE
 Value for SMK_PROCESS_HAPS:  'ALL'
 Value for SMK_PROCESS_HAPS:  'ALL'
 Treat all sources as integrate sources to compute NONHAP[VOC|TOG].
 Value for PROMPTFLAG:  N returning FALSE

 File "PNTS" opened for input on unit:  98
 /home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_map_cmv_c1_c2_36US_2024_assessment.txt

 Value for PNTS:  '/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_map_cmv_c1_c2_36US_2024_assessment.txt'
 Value for PNTS:  '/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_map_cmv_c1_c2_36US_2024_assessment.txt'

 File "PSRC" opened for input on unit:  97
 /home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/psrc_cmv_c1_c2_36US.txt

 Value for IOAPI_CHECK_HEADERS not defined;returning default:   FALSE
  
 "PNTS" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 13 vbles
 NetCDF ID:     65536  opened as READONLY            
 Time-independent data.
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/CO.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/NOX.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/PM10.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/PM2_5.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/SO2.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/VOC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/VOC_INV.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/PMC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE

 File "PTHOUR" opened for input on unit:  96
 /home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/inputs/cmv_c1_c2_36US/pthour_cmv_c1_c2_36US_jan_2024_assessment.lst

 Value for USE_EXP_GEO_CODES not defined;returning default:   FALSE

 File "COSTCY" opened for input on unit:  95
 /home/my_software/SMOKE_5.1/SMOKE-ADMF/ge_dat/costcy_for_2017platform_24apr2020_nf_v1.txt


 File "SCCDESC" opened for input on unit:  94
 /home/my_software/SMOKE_5.1/SMOKE-ADMF/ge_dat/smkreport/sccdesc_2014platform_21apr2020_nf_v5.txt


 File "ORISDESC" opened for input on unit:  93
 /home/my_software/SMOKE_5.1/SMOKE-ADMF/ge_dat/smkreport/orisdesc_04dec2006_v0.txt


 File "INVTABLE" opened for input on unit:  92
 /home/my_software/SMOKE_5.1/SMOKE-ADMF/ge_dat/invtable_2014platform_integrate_21dec2018_v3.txt

 Setting up to read inventory data...
 Value for SMK_DEFAULT_TZONE not defined; returning default:  5
 Reading state and county names and time zones...
 NOTE: Population data read from country/state/county file for year     2000
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 NOTE: No population data will be read from country/state/county file.
 WARNING: Different descriptions for the same data name at line     531 . 
      Using description: 
            "Brake PM" and ignoring: 
            "PM10 Brake WEAR".
 WARNING: Different descriptions for the same data name at line     637 . 
      Using description: 
            "PM2.5 BRAKEWEAR" and ignoring: 
            "Brake PM".
 WARNING: Different descriptions for the same data name at line     633 . 
      Using description: 
            "PM10 EXHAUST" and ignoring: 
            "Particulate matter, 210 microns and less".
 WARNING: Different descriptions for the same data name at line     635 . 
      Using description: 
            "PM25 EXHAUST" and ignoring: 
            "Particulate matter, 2.5 microns and less".
 WARNING: Different descriptions for the same data name at line     667 . 
      Using description: 
            "Particulate matter, 210 microns and less" and ignoring: 
            "Particulate matter, 10 microns and less".
 WARNING: Different descriptions for the same data name at line     638 . 
      Using description: 
            "PM10 TIRE WEAR" and ignoring: 
            "Tire PM".
 WARNING: Different descriptions for the same data name at line     639 . 
      Using description: 
            "PM2.5 TIRE WEAR" and ignoring: 
            "Tire PM".
 Value for SMKINVEN_MONTH:  1
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/CO.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/NOX.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/PM10.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/PM2_5.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/SO2.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/VOC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/VOC_INV.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
  
 "TMP_POL_FILE" opened as OLD:READ-ONLY   
 File name "/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/pnts_cmv_c1_c2_36US_dat/PMC.ncf"
 File type GRDDED3 
 Execution ID "????????????????"
 Grid name ""
 Dimensions: 836 rows, 1 cols, 1 lays, 8 vbles
 NetCDF ID:    131072  opened as READONLY            
 Time-independent data.
 Closing file TMP_POL_FILE
 Reading source data from inventory file...
 Determining number of time steps for hour -specific files...
 Value for SMKINVEN_FORMULA:  'PMC=PM10-PM2_5'
 Value for SMKINVEN_FORMULA:  'PMC=PM10-PM2_5'
 Successful open for emissions file: 
 /run/media/root/DISK1_4TB1/ADMF/2024_assessment/smoke_inputs/2019/2019emissions/c1c2/cmv_C1C2_02_cmv_c1c2_2019_12US1_2019_US_hourly.csv
 Value for HOURLY_TO_DAILY not defined;returning default:   FALSE
 Value for OUTPUT_LOCAL_TIME:  Y returning TRUE
 Value for FLOW_RATE_FACTOR not defined; returning default :  0
 NOTE: Hourly flow rates will not be calculated from CEM data
 Generating unique lists from inventory data...
 Generating ORIS lists...

GETEFILE ERROR: input file not found: CEMSUM
/home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/cemsum_cmv_c1_c2_36US_2024_assessment.txt

 Could not open input file "CEMSUM".
 
 *** ERROR ABORT in subroutine RDCEMSUM
 Ending program "RDCEMSUM".
16

Obvious question: what does the following command say?

ls -l /home/my_software/SMOKE_5.1/SMOKE-ADMF/2024_assessment/intermed/cmv_c1_c2_36US/cemsum_cmv_c1_c2_36US_2024_assessment.txt

17

Hi Carlie,

The file can’t be accessed as there is no such file or directory.

Cheers,

David

18

Can you share the first few rows of your inventory file

cmv_C1C2_02_cmv_c1c2_2019_12US1_2019_US_hourly.csv

SMOKE shouldn’t be looking for CEMSUM for this type of source.

Also for the corresponding annual file?

Thank you.

19

Hi Eyth,

I have attached the first few lines of cmv_C1C2_02_cmv_c1c2_2019_12US1_2019_US_hourly.csv and cmv_C1C2_01_cmv_c1c2_2019_12US1_2019_US_hourly.csv and the annual file. The February file was copied from the January file for brevity (for testing) with the dates simply switched to be in February (i.e., emissions on January 1st - > emissions on Feb 1st, etc). I have also included the Assign file in case there may something there you need to see. I am only running US data right now, I will run CA data separately. Thanks.

David

cmv_c1c2_2019_12US1_2019_US_annual_11feb2022_v0.csv (8.8 KB)

cmv_C1C2_02_cmv_c1c2_2019_12US1_2019_US_hourly.csv (2.5 KB)

cmv_C1C2_01_cmv_c1c2_2019_12US1_2019_US_hourly.csv (2.5 KB)

Annual_cmv_c1c2_daily_36US_1980ADMF36.csh (7.2 KB)

20

Thank you for providing the files. We didn’t see any problems with them. Follow up question: did you start your work by using our provided 2019 files as is with no modifications? Or did you try to use customized data in your first attempt?

So that we can continue to troubleshoot the nature of this issue, please upload the customized files you are testing with if the system will accept them.