CMAQv5.2 benchmark difference

Hi all,

I built and ran CMAQv5.2 without any error. Here is the rum cctm log file
https://raw.githubusercontent.com/JiaoyanHuang/Testing-codes/master/run.cctm_1day_v2.log

I downloaded reference data from
https://drive.google.com/drive/folders/0B2kjxCwKICxUZWp2ZVFGZkx6YzA

after

tar xzvf CMAQv5.2_Benchmark_SingleDay_Output_09_05_2017.tar.gz

I do see two ACONC files in the dir

-rw-r--r-- 1 jhuang hpc  174445528 Aug 31  2017 CCTM_ACONC_v52_cb6r3_intel17.0_SE52BENCH_20110701.nc
-rw-r--r-- 1 jhuang hpc  174445528 Jun 28  2017 CCTM_ACONC_v52_intel_SE52BENCH_20110701.nc

Here are all my reference files

CMAQv5.2_Benchmark_MultiDay_Input_09_05_2017.tar.gz
https://drive.google.com/open?id=1iBV-hGvIxGEQzdW8E1tXIwaaRUNeW7_K
CMAQv5.2_Benchmark_MultiDay_Output_09_05_2017.tar.gz
https://drive.google.com/open?id=0B3Xmjif6GtQZLUk2NFlfcENXZGs
CMAQv5.2_Benchmark_SingleDay_Input_09_12_2017.tar.gz
https://drive.google.com/open?id=1C7ZnaK8yNRu9yQotHTvRdhLIdfaCoaEv
CMAQv5.2_Benchmark_SingleDay_Output_09_05_2017.tar.gz
https://drive.google.com/open?id=1VA6ofMAuk3zoHwwr7slgYvoAK4kk7typ

My simulations have <0.5% difference for O3 compared with

CCTM_ACONC_v52_intel_SE52BENCH_20110701.nc

but show large difference for O3 compared with

CCTM_ACONC_v52_cb6r3_intel17.0_SE52BENCH_20110701.nc

Also large difference compared with reference data when I ran multiday simulations

I am a little confused here, what data I should use for benchmark run?

Thank you.

Joey

can I see your config_cmaq.csh and bldit.cctm?

Hi Peng,

Here are my config and bldit,


Thank you very much.

Hi

I want to calculate benchmarking difference. How did you calculate the difference between your simulations and benchmark files? could you guide me, please?
Thank you

Ensiyeh

Ensiyeh,

The easiest way is using VERDI, you can add two files and add the species you would like to compare into formula, and make a quick plot.

You can also use m3stat or m3diff (from m3tools) to see the overall differences between two files.

If you would like to investigate the detail differences in each grid at each time step, you can use ncl/R/python, read the files, and subtract data in one file from another file.

Joey

1 Like

M3Tools program m3diff does that also…

1 Like

Thank you very much.

Hi
I have a question about benchmarking. Why we have different errors for different species? For example, my maximum error for ozone is 0.08%, but for NO2 is 4.5%! Why we don’t have similar errors for all of the species??
Thank you