I saw someone in the community reporting this issue, but it hasn’t been resolved(Issues with CMAQ-DDMv5.4 sensitivity output - #13 by bandaoshutiao). I believe this should be an occasional but real exist problem.
All concentration files are correct, and the logs have not reported any errors. However, one day after the simulation started, mine was on the 10th day, O3_ ANX starts from a certain grid point in the simulation domain to 0. As the simulation continued, after another 7 days, O3_ BCO also began to become zero. There are also issues with other variables. Given that there were no issues with the results at first few days of the simulation, I guess my model settings should not have been wrong.
Has anyone else encountered the same problem? Do you have any suggestions? Or can I send the file to you? @sergey
I have not been able to replicate this behavior on our local system here. Is there any way for you to share the INPUTS so that I may try your exact case? The best would be the smallest number of simulation days that start from clean initial conditions and progress in the the first occurrence of the problem.
Thank you for your attention and response to this question.
I shared my file on google drive, which includes scripts and input files.
The script runs as follows: csh xxx 20210530
I look forward to your reply very much. If you have any questions, please feel free to contact me at any time. @sergey
Arfter I change exe to 5.3.2，the error will be disappear. So, I guess some change have happened between 126.96.36.199 and 5.3.2
Great! So your simulation proceeds normally with the newest code? Is that correct?
@sergey, no, unfortunately I think @bandaoshutiao is encountering the problem with the newest code (CMAQv188.8.131.52), but can avoid this specific problem when downgrading to CMAQv5.3.2.
Hi Sergey and Christian,
I have successfully executed CMAQ/DDM v5.2 and CMAQ/DDM v184.108.40.206 and obtained satisfactory results. In my practices, other versions of CMAQ, including CMAQ 5.3.2 with the DDM-3D, do not appear to be fully functional.
CMAQ/DDM v5.4 exhibits significantly elevated higher-order sensitivities. However, these issues have been addressed and resolved in CMAQ v220.127.116.11, as seen here. I do not have the problem posted here in utilizing CMAQ v18.104.22.168 with DDM-3D.
I am also seeing same issue with the CMAQv22.214.171.124 model and still waiting for a right solution.
@sergey Hy Sergey, were you able to replicate the issue using the data provided above? Any suggestion would be highly appreciated.
I have the data locally and I will post back here when I find some time to try it out.
I ran this case locally and was able to trigger an instability in O3_ANX at hour 21. The rest of my results were without error. This is different from the other case reported here, but hopefully good enough to investigate. I will try to figure out what is causing it and will report back.
I found that the restart SENGRID file for the case you sent me already has bad value for some VS* species. Here is one example from m3stat command on SENGRID:
3-D grid statistics
Max 1.30980E+22 @(c,r,l)=(172,61,20)
Min -2.38146E+22 @(c,r,l)=(171,60,17)
Could you, please, go back further in time checking SENGRID restart files until you find a clean one?
I am uploading file, pleasy wait a moment.
I’m sorry for replying so late, I was on vacation before.
This is the SENGRID file which do not have bad value
@sergey Hy Sergey, were you able to find anything on the issue?
I have not yet had the chance to try the new inputs, but it is my my list for this week.
It is possible that the issue originates in the sensitivity treatment of the organic PM module. However, I will need your help to track it down. Could you, please, go through the sensitivity output and see when in your simulation time species relating to organic PM first begin to show unreasonable behavior. Examining only the “ANX” sensitivity is sufficient. These species are listed below.
Can it be accurately searched on a certain day, or should I view in all output files throughout the simulation period?
I would pick one of those variables and go back through the output files until you find a day that it breaks. Then, check the other variables to make sure they don’t break earlier.
ok, please give me some time