You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
**Note:** Interpolated data is stored under `derived` with the `interpolation` field indicating the target grid (e.g., `gr006`). This distinguishes it from calculated variables which use `interpolation=native`.
@@ -62,7 +24,7 @@ The repository uses a structured directory path format to organize downloaded, d
62
24
Format of the files is "{var}\_{dataset}\_{date}.nc"
63
25
With date:
64
26
- "{year}{month}" for big datasets like CERRA saved month by month (download is faster this way).
65
-
- "{year}" for the other datasets that are saved year by year.
27
+
- "{year}" for the other datasets the data is saved year by year.
- Setting up the directory structure before starting downloads
84
-
- Verifying the paths that will be used
85
-
- Preparing storage locations in advance
86
44
87
45
## Contents
88
46
89
47
| Directory | Contents |
90
48
| :-------- | :------- |
91
49
| [requests](https://github.com/SantanderMetGroup/c3s-cds/tree/main/requests) | Contains one CSV file per CDS catalogue, listing the requested variables, temporal resolution, interpolation method, the target save directory, and whether the variable is raw or requires post-processing to be standardized.
92
-
| [scripts](https://github.com/SantanderMetGroup/c3s-cds/tree/main/scripts) | Python scripts to download data from the CDS.
93
50
| [provenance](https://github.com/SantanderMetGroup/c3s-cds/tree/main/provenance) | Contains one JSON file per catalogue describing the provenance and definitions of each variable.
94
-
| [standardization](https://github.com/SantanderMetGroup/c3s-cds/tree/main/standardization) | Python recipes to standardize the variables.
95
-
| [derived](https://github.com/SantanderMetGroup/c3s-cds/tree/main/derived) | Python recipes to calculate derived products from the variables.
51
+
| [scripts/download](https://github.com/SantanderMetGroup/c3s-cds/tree/main/scripts/download) | Python scripts to download data from the CDS.
52
+
| [scripts/standardization](https://github.com/SantanderMetGroup/c3s-cds/tree/main/scripts/standardization) | Python recipes to standardize the variables.
53
+
| [scripts/derived](https://github.com/SantanderMetGroup/c3s-cds/tree/main/scripts/derived) | Python recipes to calculate derived products from the variables.
54
+
| [scripts/interpolation](https://github.com/SantanderMetGroup/c3s-cds/tree/main/scripts/interpolation) | Python recipes to interpolate data.
55
+
| [scripts/catalogue](https://github.com/SantanderMetGroup/c3s-cds/tree/main/scripts/catalogue) | Python recipes to produce the catalogues of downloaded data.
96
56
| [catalogues](https://github.com/SantanderMetGroup/c3s-cds/tree/main/catalogues) | CSV catalogues of datasets consolidated in Lustre or GPFS. The catalogues are updated through a nightly CI job.
0 commit comments