Implementing a new data archive paradigm to face HST increased data flow
Benoît Pirenne
ST-ECF, ESO
Piero Benvenuti, Rudolf Albrecht
ST-ECF, ESO, ESA
Session ID: P6.04 Type: poster
Abstract:
The HST Archive at the ST-ECF has undergone several refurbishments in order
to cope with user requirements and with the advances in storage technology.
In preparation for the installation of the Near Infrared Camera and Multi-
Object Spectrometer (NICMOS) and Space Telescope Imaging Spectrograph
(STIS) instruments during the 1997 Servicing Mission, it is necessary to
again upgrade the archive.
The alternatives are:
- Continue the present mode of operation and move to higher capacity
optical disks to cope with the additional data volume. This option would
require a considerable hardware investment and we would continue to incur
a very high (
US$) annual media expense level.
Risk elements of this first approach are minimal.
- Discontinue the transfer of engineering data and of calibrated
data, but rather rely on the recently implemented On-the-Fly
Re-calibration technology to only transfer compressed raw data. Cheaper
and more widely available CD-ROMS technology for data storage is therefore
within reach, pending the availability of future DVD-ROMs. This is
obviously the preferred solution.
Risk elements of the second approach are:
- necessity rely on the on-the-fly re-calibration
pipeline. This entails: software maintenance and processing performance
issues.
- necessity to copy the data on the new medium, not supported by the
STScI.
This paper describes the considerations which enter in the decision making,
as well as the planned implementation of alternative no. 2, along with the
safeguards, fall back solutions, and software procedures designed to
maximize efficiency while keeping operational risks to a minimum.
Patrick P. Murphy
Wed Sep 11 14:03:55 EDT 1996