Changelog (Mip Convert)
Release 3.1.1, March 19 2025
-
Added mappings for RAMIP (CDDSO-632)
-
Downgraded CMOR to v3.8 to avoid QC issues following changes to
the handling of the
realm
global attribute (CDDSO-633)
Release 3.1.0, February 13 2025
-
Ancillary STASH variables can now be configured via the CDDS Plugins and
the MIP Convert config file (CDDSO-582)
-
Added new AerChem mappings to GCAERmon table in GCModelDev (CDDSO-483)
Release 3.0.6, January 21, 2024
-
Mapping corrections for HadREM3-GA7-05 (CDDSO-581) including
corrections to time sampling for some hourly variables (CDDSO-588)
Release 3.0.5rc1, December 5, 2024 (only to be used for LESFMIP)
-
Changes were made to the following mappings, needed for LESFMIP
processing, but the changes were not merged into release branches or
the main branch. Variables altered;
EmonZ/epfy
,EmonZ/epfz
,EmonZ/vtem
,EmonZ/wtem
. Release created from branchCDDSO-560_lesfmip-special-release
(CDDSO-560).
Release 3.0.4, November 19, 2024
-
Added HadGEM3 mapping for
AERday/ua10
,AEday/ua10
that does notuse the Heaviside field (CDDSO-547)
-
Altered mapping for HadREM3
mon/tas
to use daily data to calculatemonthly mean (CDDSO-548)
Release 3.0.3, October 24, 2024
-
Allow forced coordinate rotation. Output data will be forced to
include rotated coordinates and true lat-lon coordinates if the
force_coordinate_rotation
parameter in therequest
section ofthe MIP Convert config file is set to
True
(CDDSO-529)
Release 3.0.2, September 27, 2024
-
Add functionality to remove halo columns and rows from atmosphere
data (CDDSO-521)
-
Add Mappings for CP4A (CDDSO-515)
Release 3.0.1, August 21, 2024
-
Separated test reference data by versions in MIP Convert functional
tests (CDDSO-400)
-
Added a log identifier to separate log files of multiple functional
tests in the same test class (CDDSO-476)
-
Added mappings for CORDEX (CDDSO-421)
Release 3.0.0, May 15, 2024
-
MIP Convert now returns exit codes correctly (CDDSO-387)
-
The field
child_base_date
in therequest
section of the MIP Convert Config file has been renamed for clarity
to
base_date
(CDDSO-455)
Release 2.5.10, December 12, 2024
-
Add mappings for the eUKESM1 model (duplicates of the existing UKESM1*.cfg
mappings) (CDDSO-572)
Release 2.5.9, June 25, 2024
-
Added new MIP tables (GC3hrPtUV, GCAmon6hr, GCAmonUV, GC3hr, GC1hr)
and mappings for CP4A, along with sizing and memory configuration
tuning for new diagnostics (CDDSO-414, CDDSO-463).
Release 2.5.8, February 28, 2024
- No changes
Release 2.5.7, February 21, 2024
-
Additional Mappings for the HadREM3-CP4A-4p5km model (CDDSO-354,
CDDSO-405)
Release 2.5.6, February 09, 2024
-
Updated mapping for fco2nat to use anomalous LBTIM code in UKESM
model data. This change makes no difference to the output data, but
keeps consistency with previous CMIP6 data production (CDDSO-394)
-
Added GCAmon6hr/tas mapping (tas, but with monthly means sampled
every 6 hours) to GCModel Dev (CDDSO-389)
-
Added new variables for UKCP to GCModelDev (CDDSO-388)
Release 2.5.5, January 18, 2024
-
Issues with incorrect/inconsistent LBFT codes in PP data (section 3)
should no longer break processing (CDDSO-383)
Release 2.5.4, December 13, 2023
-
Fix the
reference_date
parsing logic for variablesdefined with a forecast time dimension (CDDSO-363)
-
Implement annual ocean diagnostics for the
GCOyr
MIPtable (CDDSO-369)
Release 2.5.3, November 22, 2023
-
Adaptations needed for new CMIP6Plus MIP tables (CDDSO-336,
CDDSO-365)
-
Update to version of CMOR to 3.6.3 (CDDSO-368)
Release 2.5.2, October 18, 2023
-
Polar row masking is now specified directly in the MIP Convert
config files (CDDSO-331)
-
Upgraded CMOR to version 3.7.3, which now permits much larger arrays
to be passed for writing without segfaulting (CDDSO-357)
Release 2.5.1, August 4, 2023
- Add
zos
mapping for HadGEM3-GC3p05-N216ORCA025 (CDDSO-328)
Release 2.5.0, July 27, 2023
-
Updated CMOR to version 3.7.2, which required iris update to 3.4.1
(CDDSO-321)
-
Relocated test data to enable testing on multiple platforms
(CDDSO-278)
-
Change date format in config file to ISO datetime (CDDSO-294,
CDDSO-313)
Release 2.4.6, June 23, 2023
- Add Eday/evspsbl mapping to MIP Convert (CDDSO-291)
Release 2.4.5, May 22, 2023
-
MIP Convert can now correctly output data from CICE daily streams
where the time coordinate data is faulty, and SIday/siconc can be
produced (CDDSO-277)
Release 2.4.4, May 4, 2023
- No changes
Release 2.4.3, March 31, 2023
-
Add a
--relaxed-cmor
option tomip_convert
. When used certainmetadata fields e.g. experiment_id are not checked against the
controlled vocabularies (CDDSO-252).
-
All ancillary STASH codes are now correctly treated as time
invariant (CDDSO-247).
Release 2.4.2, March 1, 2023
-
Add mappings for
zostoga
diagnostic in the UKCP18GC3p05-N216ORCA025 model configuration (CDDSO-239)
Release 2.4.1, January 18, 2023
-
Implement a
mask_slice
option in configuration filefor providing ocean data masks (CDDSO-67, 215)
-
Add support for the UKCP18 GC3p05-N216ORCA025 model and UV grid
mappings (CDDSO-222)
Release 2.4.0, September 12, 2022
-
Move test execution from nose to pytest (CDDSO-128)
-
Refactor functional tests (CDDSO-76, 170)
Release 2.3.2, September 01, 2022
-
MIP Convert can now produce files with a forecast time coordinate as
introduced at CMOR v3.7.0 (CDDSO-124)
-
Approved mapping for fsitherm (CDDSO-163)
Release 2.3.1, June 29, 2022
- Add extra pressure levels for UKCP (CDDSO-146)
Release 2.3.0, May 24, 2022
-
Development moved to github
-
Duplicate coordinates error rased when producing certain variables
is now not raised (CDDSO-109)
Release 2.2.5, May 4, 2022
- No changes
Release 2.2.4, April 22, 2022
- No changes
Release 2.2.3, April 7, 2022
- No changes
Release 2.2.2, March 18, 2022
-
CV checks for non-CMIP6 processing is now the same as for CMIP6
(#2539)
-
Additional mappings for UKCP (#2518)
Release 2.2.1, February 15, 2022
- No changes.
Release 2.2.0, February 9, 2022
-
Introduced plugin system for project information (e.g. CMIP6) and
model descriptions to enable use of CDDS outside of CMIP6 (#2460,
#2461, #2462, #2468, #2494, #2502, #2503, #2504, #2509,
#2510, #2512, #2513, #2514)
-
Update to use python 3.8 (#2438)
-
Allow for the use of CDDS beyond CMIP6 (#2449, #2469, #2470)
-
Retired umfilelist and all connected code (#2438)
Release 2.1.2, November 25, 2021
-
mip_convert
now can handleLBTIM
constraintscorrectly (#2455)
Release 2.1.1, October 26, 2021
- Added regional model variable mappings for CORDEX (#2442)
Release 2.1.0, September 6, 2021
- No changes.
Release 2.0.8, August 3, 2021
- Refactored
mip_convert
to improve performance (#2423)
Release 2.0.7, July 15, 2021
- No changes.
Release 2.0.6, June 29, 2021
- No changes.
Release 2.0.5, June 11, 2021
- No changes.
Release 2.0.4, May 17, 2021
-
Added approved mappings for depth integrated upper ocean (top 100m)
biogeochemistry variables (#2146)
Release 2.0.3, April 28, 2021
- No changes.
Release 2.0.2, April 22, 2021
-
Approved mappings for
E3hrPt/ts
,CFmon/ta
,CFday/ta
andCFday/ta700
diagnostics (#2303, #2326) -
Fixed a bug in MIP Convert which prevented it from providing CMOR
with correct Controlled Vocabulary file (#2317)
Release 2.0.1, March 25, 2021
- MIP Convert now allows seasonal mean data to be produced (#943)
Release 2.0, February 24, 2021
- Updated CDDS codebase to Python 3.6.
Release 1.6.5, February 22, 2021
- No changes.
Release 1.6.4, February 11, 2021
- No changes.
Release 1.6.3, February 9, 2021
-
MIP Convert can now produce monthly mean diurnal cycle diagnostics
(#349)
-
Added processor for loaddust (#1823)
-
Approved several mappings (#2220)
Release 1.6.2, January 11, 2021
- Approved mappings for
mc
,mcd
andmcu
diagnostics (#2177)
Release 1.6.1, November 26, 2020
- No changes.
Release 1.6.0, November 05, 2020
-
Fixed processors for vertical integrals of ocean biogeochemical
variables (#1192)
-
Corrected
jpdftaure*
diagnostics related to the cloud areafraction in the atmosphere layer (#558, #2091)
-
Added several new mappings (#1822, #1845, #1846) and updated
review statuses (#2090)
Release 1.5.5, October 20, 2020
- No changes.
Release 1.5.4, October 7, 2020
- No changes.
Release 1.5.3, September 16, 2020
- No changes.
Release 1.5.2, September 4, 2020
- No changes.
Release 1.5.1, August 20, 2020
-
Corrections to vertical coordinate data in some CFsubhr radiation
mappings (#1946)
-
Approval of several mappings (#1975) and removal of ok status from
one (#1992)
Release 1.5.0, July 2, 2020
-
Corrected mappings for
wbptemp
andrsut*4co2
(#567, #1502) -
Added many new mappings (#848, #1691, #1803, #1820) and updated
review statuses (#1855)
-
Added mappings for CF sites variables (#1838)
-
zostoga
can now be produced for HadGEM3-GC31-MM (#1266) -
evs
can now be marked as active by CDDS Prepare followingalterations to the mapping, which avoids an issue when reading the
NEMO iodef.xml file (#1419)
-
Removed approved status of
sipr
,siflfwdrain
andsiflfwbot
mappings pending re-review (#1853)
Release 1.4.5, June 16, 2020
- No changes.
Release 1.4.4, June 1, 2020
- No changes.
Release 1.4.3, May 12, 2020
- CDDS can now process data for the model
UKESM1-ice-LL
(#1513)
Release 1.4.2, April 30, 2020
- No changes.
Release 1.4.1, April 28, 2020
- No changes.
Release 1.4.0, April 23, 2020
-
Added new approved mappings for sub-daily variables (#1704) ocean
biogeochemistry (#1575), and FAFMIP (#1504).
-
MIP Convert can now correctly produce sub-daily variables (#1577)
Release 1.3.4, March 27, 2020
- No changes.
Release 1.3.3, February 25, 2020
-
Processors using mask_copy routine do not now raise a TypeError
referring to the numpy copyto() function (#1537)
-
Corrected masking of polar row in data from CICE. Previously ORCA1
sea-ice data on T points and ORCA025 data on UV points was being
masked incorrectly (#1624)
Release 1.3.2, January 27, 2020
-
CRITICAL error messages from MIP Convert are correctly captured in
the
critical_issues.log
file, and known exceptions from within MIPConvert will no longer lead to task failure in CDDS Convert suites
(#1533).
Release 1.3.1, January 20, 2020
-
Moved to updated scitools environment production_legacy-os43-1;
python v2.7, iris v2.2 (#1512)
-
Added additional environmental variables setup in MIP Convert, and
implemented cube rechunking to avoid performance issues when
switching to Iris 2.2 (#1195)
Release 1.3.0, January 14, 2020
-
Added processor to avoid
ValueError
when processingrsusLut
(#889)
-
A number of radiation and ocean biogeochemistry are now available
(#1153)
-
Added processor for
vtem
to mask data below 700 hPa (#1411)
Release 1.2.3, November 26, 2019
-
The variable
wtem
can now be produced (#875) -
The
parent_activity_id
global attribute in the is now correctlydetermined based on the
parent_experiment_id
(#1409)
Release 1.2.2, November 13, 2019
-
multiply_cubes
processor foremibvoc
andemiisop
corrected toavoid \"No data available for {year}; please check run_bounds\"
errors when processing more than one year of data at a time (#1343)
Release 1.2.1, October 29, 2019
-
Correction of typo in mapping for
wetoa
(#1330) -
Approval of mappings for IPCC important variables
rlutcs
andrlutcsaf
(#1331)
Release 1.2.0, October 17, 2019
-
This operation cannot be performed as there are differing coordinates remaining which cannot be ignored
errors that occur when applying the expression have now been
resolved due to the addition of a
multiply_cubes
processor (#275) -
Warnings related to
invalid value encountered in divide
are nownot issued when processing that use the
divide_by_mask
processor(#391)
-
The duplication of constants in the
original_name
attribute in the(which described the expression) has now been removed (#1020)
-
The
parent_experiment_id
must now be specified in the whenever aparent exists (#1118)
-
on half levels (e.g.
phalf
) can now be produced (#899) -
Implemented compatibility with the 01.00.31 version of the (#1056)
-
A number of , including carbon, cftables, cloud and land are now
available (#990, #1016, #1257, #1259)
-
The for
drybc
,fgco2
andevspsblsoi
have now been corrected(#846, #1193, #1257)
Release 1.1.4, September 2, 2019
- No changes.
Release 1.1.3, July 31, 2019
-
The is now written to the global attributes in the to help with
identification (the
out_name
in the sometimes differs from the ;#1051)
Release 1.1.2, July 3, 2019
- No changes.
Release 1.1.1, June 27, 2019
- No changes.
Release 1.1.0, June 12, 2019
-
MIP Convert now preferentially uses
cftime
, falling back to usingnetcdftime
ifcftime
is not available in the environment (#249) -
When replacing constants in the expressions, sometimes a constant
would be replaced with the incorrect value when the constant has a
name that shares the same root as the name of another constant; the
constants are now replaced with the correct value and are explicitly
written to the (#928)
-
NEMO on different grid points can now be produced in the same call
to MIP Convert (#870)
-
Multiple are now validated correctly against the values in the CVs
(#904)
-
Surface ocean biogeochemistry can now be produced (#869)
-
Pseudo zonal mean can now be produced from NEMO
diaptr
files(#270)
-
The production of MEDUSA ocean biogeochemistry are now supported
(#582)
-
The issue related to data being set to zero due to integer division
is now resolved (#861)
-
A substantial number of , including carbon, land and ocean
biogeochemistry, are now available (e.g. #759, #843, #853)
Release 1.0.5, May 10, 2019
- No changes.
Release 1.0.4, April 30, 2019
- No changes.
Release 1.0.3, April 5, 2019
- No changes.
Release 1.0.2, April 5, 2019
- No changes.
Release 1.0.1, April 2, 2019
-
Substreams can now be specified in the (#198)
-
A workaround was implemented to deal with the bug in
iris.util.new_axis
, which causes thefill_value
to be reset tothe default value (#692)
-
The polar rows in NEMO are now masked prior to applying the
expression (#702)
-
The
type
parameter in the call tocmor.variable
is now available(#715)
-
The
activity_id
andsource_type
required global attributes arenow validated by comparing their values to those in the CV file
(#721)
-
The version of the CV file is now recorded in the (#763)
Release 1.0.0, February 1, 2019
-
First implementation of CDDS.
-
Implemented compatibility with v3.4.0 and the 01.00.29 version of
the .