pipeline.hsd.tasks.exportdata package

Submodules

pipeline.hsd.tasks.exportdata.almasdaqua module

class pipeline.hsd.tasks.exportdata.almasdaqua.AlmaAquaXmlGenerator[source]

Bases: pipeline.h.tasks.exportdata.aqua.AquaXmlGenerator

Class for creating the AQUA pipeline report Note __init__ and get_project_structure are copies of the counterpart in almaifaqua

get_imaging_topic(context, topic_results)[source]

Get the XML for the imaging topic.

Parameters
  • context – pipeline context

  • topic_results – list of Results for this topic

Returns

XML for imaging topic

Return type

xml.etree.cElementTree.Element

get_project_structure(context)[source]

Get the project structure element.

Given the current data flow it is unclear how the report generator generator will acquire the entity id of the original processing request.

The processing procedure name is known but not yet passed to the pipeline processing request.

Parameters

context – pipeline context

Returns

XML for project structure

Return type

xml.etree.cElementTree.Element

pipeline.hsd.tasks.exportdata.exportdata module

The exportdata for SD module provides base classes for preparing data products on disk for upload to the archive.

To test these classes, register some data with the pipeline using ImportData, then execute:

import pipeline # Create a pipeline context and register some data context = pipeline.Pipeline().context output_dir = “.” products_dir = “./products” inputs = pipeline.tasks.singledish.SDExportData.Inputs(context,output_dir,products_dir) task = pipeline.tasks.singledish.SDExportData (inputs) results = task.execute (dry_run = True) results = task.execute (dry_run = False)

class pipeline.hsd.tasks.exportdata.exportdata.SDExportData(inputs)[source]

Bases: pipeline.h.tasks.exportdata.exportdata.ExportData

SDExportData is the base class for exporting data to the products subdirectory. It performs the following operations:

  • Saves the pipeline processing request in an XML file

  • Saves the images in FITS cubes one per target and spectral window

  • Saves the final flags and bl coefficient per ASDM in a compressed / tarred CASA flag versions file

  • Saves the final web log in a compressed / tarred file

  • Saves the text formatted list of contents of products directory

Inputs

alias of SDExportDataInputs

prepare()[source]

Prepare and execute an export data job appropriate to the task inputs.

class pipeline.hsd.tasks.exportdata.exportdata.SDExportDataInputs(context, output_dir=None, session=None, vis=None, exportmses=None, pprfile=None, calintents=None, calimages=None, targetimages=None, products_dir=None, imaging_products_only=None)[source]

Bases: pipeline.h.tasks.exportdata.exportdata.ExportDataInputs

Module contents