Download daily average hemispheric CMAQ output for BCON - "google drive quota exceeded" error

EQUATES
,
1

I am downloading the daily average hemispheric CMAQ output files from the CMAS data warehouse. But I am always getting this “google drive quota exceeded” error. It seems google drive doesn’t allow us to download such large files (~50G each) from the CMAS google drive account.

Is there any other ways we can get these files? We need daily average hemispheric CMAQ output files for 2013-2019.

Thanks,

Yongtao Hu

Georgia Institute of Technology

2

By the way, the error message I got from using gdown to download one of the monthly files is as follows:

$gdown 1CV3lrjXuJGPUNg1aY4B4Dy1SY6RKJLEy
Access denied with the following error:

    Too many users have viewed or downloaded this file recently. Please
    try accessing the file again later. If the file you are trying to
    access is particularly large or is shared with many people, it may
    take up to 24 hours to be able to view or download the file. If you
    still can't access a file after 24 hours, contact your domain
    administrator.

You may still be able to access the file from the browser:

     https://drive.google.com/uc?id=1CV3lrjXuJGPUNg1aY4B4Dy1SY6RKJLEy

Thanks,

Yongtao

3

We use “gdrive” and I got those “quote exceeded” messages from time to time. In my case, it happened when I tried to download lots of files in a short period of time and it’s not about individual file size. The issue would sometimes go away if I wait a few hours then try again.

CMAS Data Warehouse on AWS has 2018 and 2019 data you are looking for. AWS S3 Explorer

2 Likes
4

Thank you very much! The AWS information is very helpful.

5

It turns the rclone program works just fine.

1 Like