CMAQv5.2 benchmark difference

huangj1311 · October 7, 2019, 8:00pm

Hi all,

I built and ran CMAQv5.2 without any error. Here is the rum cctm log file
https://raw.githubusercontent.com/JiaoyanHuang/Testing-codes/master/run.cctm_1day_v2.log

I downloaded reference data from
https://drive.google.com/drive/folders/0B2kjxCwKICxUZWp2ZVFGZkx6YzA

after

tar xzvf CMAQv5.2_Benchmark_SingleDay_Output_09_05_2017.tar.gz

I do see two ACONC files in the dir

-rw-r--r-- 1 jhuang hpc  174445528 Aug 31  2017 CCTM_ACONC_v52_cb6r3_intel17.0_SE52BENCH_20110701.nc
-rw-r--r-- 1 jhuang hpc  174445528 Jun 28  2017 CCTM_ACONC_v52_intel_SE52BENCH_20110701.nc

Here are all my reference files

CMAQv5.2_Benchmark_MultiDay_Input_09_05_2017.tar.gz
https://drive.google.com/open?id=1iBV-hGvIxGEQzdW8E1tXIwaaRUNeW7_K
CMAQv5.2_Benchmark_MultiDay_Output_09_05_2017.tar.gz
https://drive.google.com/open?id=0B3Xmjif6GtQZLUk2NFlfcENXZGs
CMAQv5.2_Benchmark_SingleDay_Input_09_12_2017.tar.gz
https://drive.google.com/open?id=1C7ZnaK8yNRu9yQotHTvRdhLIdfaCoaEv
CMAQv5.2_Benchmark_SingleDay_Output_09_05_2017.tar.gz
https://drive.google.com/open?id=1VA6ofMAuk3zoHwwr7slgYvoAK4kk7typ

My simulations have <0.5% difference for O3 compared with

CCTM_ACONC_v52_intel_SE52BENCH_20110701.nc

but show large difference for O3 compared with

CCTM_ACONC_v52_cb6r3_intel17.0_SE52BENCH_20110701.nc

Also large difference compared with reference data when I ran multiday simulations

I am a little confused here, what data I should use for benchmark run?

Thank you.

Joey

peng · November 18, 2019, 6:18am

can I see your config_cmaq.csh and bldit.cctm?

huangj1311 · November 18, 2019, 5:22pm

Hi Peng,

Here are my config and bldit,

github.com

JiaoyanHuang/Testing-codes/blob/master/config.cmaq

#! /bin/csh -f

# ================= CMAQ5.0.2 Configuration Script ================== #
# Requirements: I/O API & netCDF libs, PGI, Intel, Gnu Compiler       #
#               Collection (GCC), MPICH for multiprocessor computing  #
# Note that this script is configured/tested for Red Hat Linux O/S    #
#                                                                     #
# To report problems or request help with this script/program:        #
#             http://www.cmascenter.org/help_desk.cfm                 #
# =================================================================== #

#> config.cmaq
#> sourced from bldit.<model>

#> model repository location
 setenv M3HOME /storage/highspeed/Models/aq/CMAQ/CMAQv5.0.2
 setenv M3MODEL ${M3HOME}/models
 setenv M3DATA  ${M3HOME}/data

#===============================================================================

This file has been truncated. show original

github.com

JiaoyanHuang/Testing-codes/blob/master/bldit.cctm

#!/bin/csh -f

# ====================== CCTMv5.0.2 Build Script ======================= #
# Usage: bldit.cctm >&! bldit.cctm.log                                   #
# Requirements: I/O API & netCDF libs, a Fortran compiler,               #
#               and MPI for multiprocessor computing                     #
# Note that this script is configured/tested for Red Hat Linux O/S       #
# The following environment variables must be set for this script to     #
# build an executable.                                                   #
#   setenv M3MODEL <source code repository>                              #
#   setenv M3LIB   <code libraries>                                      #
# To report problems or request help with this script/program:           #
#             http://www.cmascenter.org/html/help.html                   #
# ====================================================================== #

#> Source the config.cmaq file to set the build environment
 source ../config.cmaq

#> Check for M3HOME and M3LIB settings:
 if ( ! -e $M3HOME || ! -e $M3LIB ) then

This file has been truncated. show original

peng · November 20, 2019, 2:51pm

Thank you very much.

esm · December 1, 2019, 8:27pm

Hi

I want to calculate benchmarking difference. How did you calculate the difference between your simulations and benchmark files? could you guide me, please?
Thank you

Ensiyeh

huangj1311 · December 2, 2019, 1:57am

Ensiyeh,

The easiest way is using VERDI, you can add two files and add the species you would like to compare into formula, and make a quick plot.

You can also use m3stat or m3diff (from m3tools) to see the overall differences between two files.

If you would like to investigate the detail differences in each grid at each time step, you can use ncl/R/python, read the files, and subtract data in one file from another file.

Joey

cjcoats · January 8, 2020, 11:20pm

M3Tools program m3diff does that also…

esm · December 2, 2019, 10:21pm

Thank you very much.

esm · July 21, 2020, 1:53am

Hi
I have a question about benchmarking. Why we have different errors for different species? For example, my maximum error for ozone is 0.08%, but for NO2 is 4.5%! Why we don’t have similar errors for all of the species??
Thank you