.. (C) Crown Copyright 2026, Met Office.
.. The LICENSE.md file contains full licensing details.

Reusing pre-extracted raw data files from MASS
==============================================

.. include:: ../common.txt

It is possible to save non-standardised model output data (e.g. pp files) with |CMEW|,
to avoid having to extract them from MASS again in future.

This functionality is controlled by two variables in the `rose-suite.conf` file:

.. image:: images/raw_data_dir.png
   :alt: An image of the Rose GUI showing the template variables
         "RAW_DATA_DIR_MODE" and "RAW_DATA_DIR"
   :width: 600px

The label "Save new data" corresponds to a value of "save_new", and "Use saved data" to "use_saved".

To copy the data, the user must run |CMEW| specifying the location to which to save the files,
e.g.::

    RAW_DATA_DIR_MODE="save_new"
    RAW_DATA_DIR="$SCRATCH/raw_data"

The raw data files will be stored in subdirectories named by suite ID.

.. warning::
   If the suite ID's subdirectory in the specified parent directory is not empty,
   |CMEW| will deliberately fail to copy the data.

In future runs, to avoid extracting the same data,
specify the same location when skipping the extract from MASS step::

    RAW_DATA_DIR_MODE="use_saved"
    RAW_DATA_DIR="$SCRATCH/raw_data"

.. note::
   If only some of the necessary raw data files have already been extracted,
   for example data for one model run but not for another,
   then it is **not currently possible** to reuse raw data files with |CMEW|.