pipeline.h.cli.gotasks.h_restoredata

pipeline.h.cli.gotasks.h_restoredata = <pipeline.h.cli.gotasks.h_restoredata._h_restoredata object>

h_restoredata —- Restore flags and calibration state from a pipeline run

The h_restoredata task restores flagged and calibrated MeasurementSets from archived ASDMs and pipeline flagging and calibration date products.

The h_restoredata restores flagged and calibrated data from archived ASDMs and pipeline flagging and calibration data products. Pending archive retrieval support h_restoredata assumes that the required products are available in the rawdata_dir in the format produced by the h_exportdata task.

h_restoredata assumes that the following entities are available in the rawdata_dir directory

o the ASDMs to be restored o for each ASDM in the input list o a compressed tar file of the final flagversions file, e.g., uid___A002_X30a93d_X43e.ms.flagversions.tar.gz o a text file containing the applycal instructions, e.g., uid___A002_X30a93d_X43e.ms.calapply.txt o a compressed tar file containing the caltables for the parent session, e.g., uid___A001_X74_X29.session_3.caltables.tar.gz

h_restore data performs the following operations:

o imports the ASDM(s)) o removes the default MS.flagversions directory created by the filler o restores the final MS.flagversions directory stored by the pipeline o restores the final set of pipeline flags to the MS o restores the final calibration state of the MS o restores the final calibration tables for each MS o applies the calibration tables to each MS

——— parameter descriptions ———————————————

vis List of raw visibility data files to be restored. Assumed to

be in the directory specified by rawdata_dir.

example: vis=[‘uid___A002_X30a93d_X43e’]

Can only set when pipelinemode=’interactive’

session List of sessions, one per visibility file.

example: session=[‘session_3’]

Can only set when pipelinemode=’interactive’

products_dir Path to the data products directory, used to copy calibration

products from. The parameter is effective only when copytoraw=True. When copytoraw=False, calibration products in rawdata_dir will be used.

example: products_dir=’/path/to/my/products’

Can only set when pipelinemode=’interactive’

copytoraw Copy calibration and flagging tables from products_dir to

rawdata_dir directory.

example: copytoraw=False

Can only set when pipelinemode=’interactive’

rawdata_dir Path to the rawdata subdirectory.

example: rawdata_dir=’/path/to/my/rawdata’

Can only set when pipelinemode=’interactive’

lazy Use the lazy filler option

example: lazy=True

Can only set when pipelinemode=’interactive’

bdfflags Set the BDF flags

example: bdfflags=False

Can only set when pipelinemode=’interactive’

ocorr_mode Set correlation import mode

example: ocorr_mode=’ca’

Can only set when pipelinemode=’interactive’

asis Set list of tables to import as-is into the Measurement Set

example: ocorr_mode=’Source Receiver’

Can only set when pipelinemode=’interactive’

pipelinemode The pipeline operating mode. In ‘automatic’ mode the pipeline

determines the values of all context defined pipeline inputs automatically. In ‘interactive’ mode the user can set the pipeline context defined parameters manually. In ‘getinputs’ mode the user can check the settings of all pipeline parameters without running the task.

dryrun Run the commands (True) or generate the commands to be run

but do not execute (False).

Can only set when pipelinemode=’interactive’

acceptresults Add the results into the pipeline contextAdd the results of the task to the pipeline context (True) or

reject them (False).

——— examples ———————————————————–

1. Restore the pipeline results for a single ASDM in a single session

h_restoredata (vis=[‘uid___A002_X30a93d_X43e’], session=[‘session_1’], ocorr_mode=’ca’)