LUNAR CRATER OBSERVATION AND SENSING SATELLITE
(LCROSS)
ARCHIVE VOLUME
SOFTWARE INTERFACE SPECIFICATION
Version 1.1
April 2, 2010
Mark Shirley
TABLE OF CONTENTS
1. Introduction................................................................................................................................... 1
1.1. Purpose and Scope................................................................................................................ 1
1.2. Content Overview.................................................................................................................. 1
1.3. Applicable Documents and Constraints................................................................................... 3
1.4. Relationships with Other Interfaces......................................................................................... 3
2. Archive Volume Contents.............................................................................................................. 3
2.1. Root Directory Contents........................................................................................................ 3
2.2. Data Directory Contents and Naming..................................................................................... 4
2.3. Index Directory Contents....................................................................................................... 7
2.4. Document Directory Contents................................................................................................ 9
2.5. Catalog Directory Contents.................................................................................................... 9
2.6. Calib Directory Contents...................................................................................................... 10
2.7. Extras Directory Contents.................................................................................................... 11
3. Archive Volume Format............................................................................................................... 11
3.1. File Formats........................................................................................................................ 11
3.1.1. Document File Format............................................................................................... 11
3.1.2. Tabular File Format................................................................................................... 12
3.1.3. PDS Label Format.................................................................................................... 12
3.1.4. Catalog File Format................................................................................................... 12
3.1.5. Science Data File Formats......................................................................................... 12
4. Archive Volume Generation......................................................................................................... 14
4.1. Data Transfer and Validation Methods................................................................................. 14
4.2. Data Product Sizes and Delivery Rates................................................................................. 14
4.3. Interface Media Characteristics............................................................................................ 14
4.4. Backup and Duplicates........................................................................................................ 14
4.5. Labeling and Identification.................................................................................................... 15
5. Support Staff and Cognizant Persons........................................................................................... 15
5.1. Data Providers..................................................................................................................... 15
5.2. PDS Contacts...................................................................................................................... 15
DOCUMENT CHANGE LOG
Change |
Date |
Affected Portions |
First draft |
2/05/2008 |
|
Review and revisions by S. Slavney, PDS |
2/12/2008 |
All sections |
Review and revision by M. Shirley, LCROSS |
4/2/2010 |
Reflect final release structure |
ACRONYMS AND ABBREVIATIONS
ASCII |
American Standard Code for Information Interchange |
CD-ROM |
Compact Disk - Read-Only Memory |
CD-WO |
Write-Once Compact Disk |
ISO |
International Standards Organization |
JPL |
Jet Propulsion Laboratory |
NSSDC |
National Space Science Data Center |
PDS |
Planetary Data System |
PSG |
Project Science Group |
SDVT |
Science Data Validation Team |
SIS |
Software Interface Specification |
TBD |
To Be Determined |
GLOSSARY
Archive – An archive consists of one or more data sets along with all the documentation and ancillary information needed to understand and use the data. An archive is a logical construct independent of the medium on which it is stored.
Archive Volume, Archive Volume Set – A volume is a unit of media on which data products are stored; for example, one CD-ROM or DVD-ROM. An archive volume is a volume containing all or part of an archive; that is, data products plus documentation and ancillary files. When an archive spans multiple volumes, they are called an archive volume set. Usually the documentation and some ancillary files are repeated on each volume of the set, so that a single volume can be used alone.
Catalog Information – Descriptive information about a data set (e.g. mission description, spacecraft description, instrument description), expressed in Object Description Language (ODL) which is suitable for loading into a PDS catalog.
Data Product – A labeled grouping of data resulting from a scientific observation, usually stored in one file. A product label identifies, describes, and defines the structure of the data. An example of a data product is a planetary image, a spectrum table, or a time series table.
Data Set – An accumulation of data products. A data set together with supporting documentation and ancillary files is an archive.
Standard Data Product – A data product generated in a predefined way using well-understood procedures, processed in "pipeline" fashion. Data products that are generated in a nonstandard way are sometimes called special data products.
This Software Interface Specification is intended to be used by those who wish to understand the format and content of the Lunar Crater Observation and Sensing Satellite (LCROSS) Science Data Archive. Typically, these individuals would be software engineers, data analysts, or planetary scientists.
The specifications in this document apply to all LCROSS standard product archive volumes that are generated by the LCROSS Project.
The LCROSS instruments were selected to provide multiple, complementary observations. These instruments are:
Name |
Type |
Observations of |
Data Products |
VIS |
Visible Camera |
Context, plume morphology |
Raw images only w/ metadata |
NIR1 |
Near-IR Camera |
Context, plume morphology |
Raw and calibrated images w/ metadata |
NIR2 |
Near-IR Camera |
Context, plume morphology; impact location |
|
MIR1 |
Mid-IR Camera |
Pre-impact terrain; Ejecta Blanket; impact location |
Raw and calibrated images w/ metadata |
MIR2 |
Mid-IR Camera |
Pre-impact terrain; Ejecta Blanket |
|
NSP1 |
Near-IR Spectrometer |
Ice, Vapor, Grain Size, Hydrates |
Raw and calibrated reflectance spectra w/ metadata; flash (high speed, low spectral resolution) spectra |
NSP2 |
Near-IR Spectrometer |
Ice, Vapor, Grain Size, Hydrates |
Raw and calibrated absorption spectra w/ metadata |
VSP |
Visible & UV Spectrometer |
H2O+ (619 nm); OH (308nm); Search organics |
Raw and calibrated reflectance spectra w/ metadata |
TLP |
Photometer |
Flash light curve |
Raw and calibrated voltage history w/ metadata |
The resulting images and spectra will be delivered as an integrated archive by the LCROSS Science Team, facilitated by the LCROSS Principle Investigator, Payload Scientist and Software Lead.
The LCROSS data sets have the following data set identifiers assigned by PDS.
Data Set Contents |
PDS Data Set ID |
Raw visible camera (VIS) images |
LCROSS-E/L-VIS-2-RAW-V1.0 |
Raw near infrared camera 1 (NIR1) images |
LCROSS-E/L-NIR1-2-RAW-V1.0 |
Calibrated near infrared camera 1 (NIR1) images |
LCROSS-E/L-NIR1-3-CAL-V1.0 |
Raw near infrared camera 2 (NIR2) images |
LCROSS-E/L-NIR2-2-RAW-V1.0 |
Calibrated near infrared camera 2 (NIR2) images |
LCROSS-E/L-NIR2-3-CAL-V1.0 |
Raw mid infrared camera 1 (MIR1) images |
LCROSS-E/L-MIR1-2-RAW-V1.0 |
Calibrated mid infrared camera 1 (MIR1) images |
LCROSS-E/L-MIR1-3-CAL-V1.0 |
Raw mid infrared camera 2 (MIR2) images |
LCROSS-E/L-MIR2-2-RAW-V1.0 |
Calibrated mid infrared camera 2 (MIR2) images |
LCROSS-E/L-MIR2-3-CAL-V1.0 |
Raw, pre-hadamard transformation NSP1 data |
LCROSS-E/L-NSP1-2-PREHAD-V1.0 |
Raw near infrared spectrometer 1 (NSP1) spectra |
LCROSS-E/L-NSP1-2-RAW-V1.0 |
Calibrated near infrared spectrometer 1 (NSP1) spectra Raw near infrared spectrometer 1 (NSP1) flash spectra Calibrated near ir spectrometer 1 (NSP1) flash spectra |
LCROSS-E/L-NSP1-3-CAL-V1.0 LCROSS-E/L-NSP1-FL-2-RAW-V1.0 LCROSS-E/L-NSP1-FL-3-CAL-V1.0 |
Raw, pre-hadamard transformation NSP2 data |
LCROSS-X-NSP2-2-PREHAD-V1.0 |
Raw near infrared spectrometer 2 (NSP2) spectra |
LCROSS-X-NSP2-2-RAW-V1.0 |
Calibrated near infrared spectrometer 2 (NSP2) spectra Raw near infrared spectrometer 1 (NSP1) flash spectra Calibrated near ir spectrometer 1 (NSP1) flash spectra |
LCROSS-X-NSP2-3-CAL-V1.0 LCROSS-X-NSP2-FL-2-RAW-V1.0 LCROSS-X-NSP2-FL-3-CAL-V1.0 |
Raw visible and UV spectrometer (VSP) spectra |
LCROSS-E/L-VSP-2-RAW-V1.0 |
Calibrated visible and UV spectrometer (VSP) spectra |
LCROSS-E/L-VSP-3-CAL-V1.0 |
Raw total luminance photometer (TLP) data |
LCROSS-L-TLP-2-RAW-V1.0 |
Calibrated total luminance photometer (TLP) data |
LCROSS-L-TLP-3-CAL-V1.0 |
This Software Interface Specification (SIS) describes the format, content, and generation of the LCROSS Science Data Archive. Section 2, Archive Volume Generation, describes the procedure for transferring data products to archive media. Section 3, Archive Volume Contents, describes the structure of the archive volumes and the contents of each file. Section 4, Archive Volume Format, describes the file formats used on the archive volumes. Finally, Section 5, Support Staff and Cognizant Persons, lists the individuals responsible for generating the archive volumes.
This Archive Volume SIS is intended to be consistent with the following documents:
1. LCROSS Project Archive Generation, Validation and Transfer Plan, 04.05.PDSArchivePlan.01.v1.
2. LCROSS Science Team and PDS Geosciences, Imaging, and NAIF Nodes Interface Control Document (ICD), Version 1.1, October 18, 2007.
3. Lunar CRater Observation and Sensing Satellite (LCROSS) Project Planetary Data System Data Product Software Interface Specification, 02.01.MP.01.v12.
4. Planetary Data System Archive Preparation Guide, August 29, 2006, Version 1.1, JPL D-31224.
5. Planetary Data System Standards Reference, March 20, 2006, Version 3.7. JPL D-7669, Part 2.
6. ISO 9660-1988, Information Processing - Volume and File Structure of CD-ROM for Information Exchange, April 15, 1988.
This document describes the output of the LCROSS Science Data Processing Pipeline, and changes to this document could impact tools implementing that pipeline. Due to the relatively low volume of data produced by LCROSS, this pipeline will be implemented partially by automation and partially by hand.
This Archive Volume SIS could be affected by changes to the design of the LCROSS Science standard data products (Applicable Document #3).
This section describes the contents of the LCROSS Science Data Archive volumes, including the file names, file contents, file types, and organization responsible for providing the files.
Files in the Root Directory include an overview of the archive, a description of the volume for the PDS Catalog, and a list of errata or comments about the archive. The following files are contained in the Root Directory.
File Name |
File Contents |
File Provided By |
AAREADME.TXT |
Volume content and format information |
LCROSS |
AAREADME.LBL |
A PDS detached label that describes both AAREADME.TXT and AAREADME.HTM (optional, could be attached to AAREADME.TXT). |
LCROSS |
ERRATA.TXT |
A cumulative listing of comments and updates concerning all archive volumes published to date |
PDS Node |
VOLDESC.CAT |
A description of the contents of this volume in a PDS format readable by both humans and computers |
LCROSS |
DATA |
Directory containing data files. There may be more than one data directory. |
LCROSS |
DOCUMENT |
Directory containing the Data Product SIS, Archive Volume SIS, and other documentation |
LCROSS |
CATALOG |
Directory containing text descriptions of the data set, instrument, spacecraft, mission, personnel, and references, which will become part of the PDS Catalog |
LCROSS |
CALIB |
Directory containing calibration plans, reports, and data (optional) |
LCROSS |
The Data directory contains one subdirectory for each payload data collection period during the mission. These are[SHS1] :
Directory |
Description |
20090620022900_QUICKLOOK |
Initial payload activation and instrument checkout |
20090622034600_STARFIELD |
Telescope aperture door deployment and confirmation of gross instrument orientation before the lunar swingby |
20090623121800_SWINGBY |
Calibration data collection for all instruments except TLP |
20090801094900_EARTHLOOK1 |
Observations of the Earth |
20090817074500_MIRLOOK |
Observations of the Moon and Earth intended primarily to generate a point-spread function to evaluate and correct MIR2 focus |
20090918180600_EARTHLOOK2 |
Observations of the Earth |
20091009015100_SEPARATION
|
Images of the Centaur immediately after separation from the LCROSS Shepherding Spacecraft. |
20091009104100_PREIMPACT
|
Pre-impact instrument checkout and calibration |
20091009113022_IMPACT
|
Data collection from 1 minute before centaur impact to shepherding spacecraft impact and the end of the mission |
Where the numbers at the start of each directory name describes the start of the data collection period in UTC as <year><month><day><hour><minute><second>.
Each payload activation directory contains a PDS data set collection, one per instrument, like so:
Directory |
Description |
VIS |
Directory containing data collected by the Visible Light Camera |
NIR1 |
Directory containing data collected by Near Infrared Camera 1 |
NIR2 |
Directory containing data collected by Near Infrared Camera 2 |
MIR1 |
Directory containing data collected by Mid Infrared Camera 1 |
MIR2 |
Directory containing data collected by Mid Infrared Camera 2 |
NSP1 |
Directory containing data collected by Near Infrared Spectrometer 1 |
NSP2 |
Directory containing data collected by Near Infrared Spectrometer 2 |
VSP |
Directory containing data collected by the Visible and UV Spectrometer |
TLP |
Directory containing data collected by the Photometer |
Each data set directory contains one or more subdirectories. Each subdirectory differs from the others by the level of processing of the files contained in them. The following table describes each of these directories. Note <Timestamp> is the UTC time when the image was captured.
Directory |
Description |
Sample Filename(s) |
VIS/ |
Directory containing data collected by the Visible Light Camer |
|
RAW/ |
Level 0 images in PDS format (integer pixels); 3 channels (RGB) |
VIS_RAW_<timestamp>.img |
CAL/ |
Level 1 (calibrated) images in PDS format (floating point pixels); 3 channels (RGB) |
VIS_CAL_<timestamp>.img |
NIR1/ |
Directory containing data collected by Near Infrared Camera 1 |
|
RAW/ |
Level 0 images in PDS format (integer pixels); 3 channels (RGB) |
LCROSS_NIR1_RAW_<timestamp>.img |
CAL/ |
Level 1 (calibrated) images in PDS format (floating point pixels); 3 channels (RGB); pixel values represent radiance |
LCROSS_NIR1_CAL_<timestamp>.img |
NIR2/ |
Directory containing data collected by Near Infrared Camera |
|
RAW/ |
Level 0 images in PDS format (integer pixels); 3 channels (RGB) |
LCROSS_NIR2_RAW_<timestamp>.img |
CAL/ |
Level 1 (calibrated) images in PDS format (floating point pixels); 3 channels (RGB); pixel values represent radiance |
LCROSS_NIR2_CAL_<timestamp>.img |
MIR1/ |
Directory containing data collected by Mid Infrared Camera 1 |
|
RAW/ |
Level 0 images in PDS format (integer pixels); single channel |
LCROSS_MIR1_RAW_<timestamp>.img |
CAL/ |
Level 1 (calibrated) images in PDS format (floating point pixels); 1 channel; pixel value represent temperature. |
LCROSS_MIR1_CAL_<timestamp>.img |
MIR2/ |
Directory containing data collected by Mid Infrared Camera 2 |
|
RAW/ |
Level 0 images in PDS format (integer pixels); single channe |
LCROSS_MIR2_CAL_<timestamp>.img |
CAL/ |
Level 1 (calibrated) images in PDS format (floating point pixels); 1 channel; pixel value represent temperature |
LCROSS_MIR2_CAL_<timestamp>.img |
NSP1/ |
Directory containing data collected by Near Infrared Spectrometer 1 |
|
CAL/ |
Level 1 spectra after hadamard transform in an ascii table format |
LCROSS_NSP1_CAL_<timestamp>.tab |
PREHAD/ |
Level 0 spectra before hadamard transform in an ascii table format |
NSP1_DNL_<timestamp>.tab |
FL_CAL/ |
Level 1 low resolution spectra in an ascii table format |
LCROSS_NSP1_FL_CAL_*.TAB |
FL_RAW/ |
Level 0 low resolution spectra in an ascii table format |
LCROSS_NSP1_FL_RAW_*.TAB |
RAW/ |
Level 0 spectra after hadamard transform in an ascii table format |
NSP1_RAW_<timestamp>.tab |
NSP2/ |
Directory containing data collected by Near Infrared Spectrometer 2 |
|
CAL/ |
Level 1 spectra after hadamard transform in an ascii table format |
LCROSS_NSP2_CAL_<timestamp>.tab |
DNL/ |
Level 0 spectra before hadamard transform in an ascii table format |
NSP2_DNL_<timestamp>.tab |
FL_CAL/ |
Level 1 low resolution spectra in an ascii table format |
LCROSS_NSP2_FL_CAL_<timestamp>.TAB |
FL_RAW/ |
Level 0 low resolution spectra in an ascii table format |
LCROSS_NSP2_FL_RAW_<timestamp>.TAB |
RAW/ |
Level 0 spectra after hadamard transform in an ascii table format |
NSP2_RAW_<timestamp>.tab |
VSP/ |
Directory containing data collected by the Visible and UV Spectrometer |
|
RAW/ |
Level 0 spectra in an ascii table format |
VSP_RAW_<timestamp>.tab |
CAL/ |
Level 1 spectra in an ascii table format |
VSP_CAL_<timestamp>.tab |
TLP/ |
Directory containing data collected by the Photometer |
|
RAW/ |
Single file containing raw, level 0 values |
TLP_RAW_<timestamp>.tab |
CAL/ |
Single file containing raw, level 1 values representing temperature-corrected detector voltage |
TLP_CAL_<timestamp>.tab |
Here’s an example to tie these tables together. The first image in the Near Infrared Camera #1 dataset taken during the impact period is LCROSS_NIR1_CAL_20091009113033466.IMG. The image was taken at 11:30:33.466 on 10/9/2009, which is encoded in the filename, and it’s a calibrated image. Both of these are apparent from the filename. This file has a corresponding label file called LCROSS_NIR1_CAL_20091009113033466.LBL.
This file appears within the DATA\20091009113022_IMPACT\NIR1\CAL directory within the volume. Note that the directory name contains the data collection period (IMPACT) proceeded by a timestamp indicating when that data collection period started. That start time is just before the time the image was taken, which is consistent. Within the 20091009113022_IMPACT directory, there is a NIR1 directory containing only NIR1 images and all of them. Within that, there are two directories, CAL and RAW.
Files in the Index Directory are provided to help the user locate products on this archive volume and on previously released volumes in the archive. An index table lists information about all the data products for a data set on the archive volume. The following files are contained in the Index Directory.
File Name |
File Contents |
File Provided By |
INDXINFO.TXT |
A description of the contents of this directory |
LCROSS |
VIS_RAW_INDEX.TAB, .LBL |
List of all raw VIS data products, with PDS label |
LCROSS |
NIR1_RAW_INDEX.TAB, .LBL |
List of all raw NIR1 data products, with PDS label |
LCROSS |
NIR1_CAL_INDEX.TAB, .LBL |
List of all calibrated NIR1 data products, with PDS label |
LCROSS |
NIR2_RAW_INDEX.TAB, .LBL |
List of all raw NIR2 data products, with PDS label |
LCROSS |
NIR2_CAL_INDEX.TAB, .LBL |
List of all calibrated NIR2 data products, with PDS label |
LCROSS |
MIR1_RAW_INDEX.TAB, .LBL |
List of all raw MIR1 data products, with PDS label |
LCROSS |
MIR1_CAL_INDEX.TAB, .LBL |
List of all calibrated MIR1 data products with PDS label |
LCROSS |
MIR2_RAW_INDEX.TAB, .LBL |
List of all raw MIR2 data products, with PDS label |
LCROSS |
MIR2_CAL_INDEX.TAB, .LBL |
List of all calibrated MIR2 data products, with PDS label |
LCROSS |
NSP1_RAW_INDEX.TAB, .LBL |
List of all raw NSP1 data products, with PDS label |
LCROSS |
NSP1_CAL_INDEX.TAB, .LBL |
List of all calibrated NSP1 data products, with PDS label |
LCROSS |
NSP2_RAW_INDEX.TAB, .LBL |
List of all raw NSP2 data products, with PDS label |
LCROSS |
NSP2_CAL_INDEX.TAB, .LBL |
List of all calibrated NSP2 data products, with PDS label |
LCROSS |
VSP_RAW_INDEX.TAB, .LBL |
List of all raw VSP data products, with PDS label |
LCROSS |
VSP_CAL_INDEX.TAB, LBL |
List of all calibrated VSP data products, with PDS label |
LCROSS |
TLP_RAW_INDEX.TAB, LBL |
List of all raw TLP data products, with PDS label |
LCROSS |
TLP_CAL_INDEX.TAB, .LBL |
List of all calibrated TLP data products, with PDS label |
LCROSS |
Each index table will include at minimum the following columns.
· VOLUME_ID
· PATH_NAME
· FILE_NAME (name of PDS label that points to data)
· PRODUCT_ID
· PRODUCT_CREATION_TIME
· MISSION_PHASE_NAME
· START_TIME
· STOP_TIME
· SPACECRAFT_CLOCK_START_COUNT
· SPACECRAFT_CLOCK_STOP_COUNT
The Document Directory contains documentation to help the user understand and use the archive data. The following files are contained in the Document Directory.
File Name |
File Contents |
File Provided By |
DOCINFO.TXT |
A description of the contents of this directory |
LCROSS |
DPSIS..HTM |
The Data Product SIS as text or hypertext |
LCROSS |
DPSIS.PDF |
The Data Product SIS as a PDF file |
LCROSS |
DPSIS.LBL |
A PDS label that describes both DPSIS.HTM and DPSIS.PDF |
PDS |
ARCHSIS.HTM |
The Archive Volume SIS (this document) as text or hypertext |
LCROSS |
ARCHSIS.PDF |
The Archive Volume SIS (this document) as a PDF file |
LCROSS |
ARCHSIS.LBL |
A PDS label that describes both ARCHSIS.HTM and ARCHSIS.PDF. |
PDS |
OPS.HTM |
LCROSS Measurement and Operations Specification as hypertext |
LCROSS |
OPS.PDF |
LCROSS Measurement and Operations Specification as PDF |
LCROSS |
OPS.LBL |
A PDS label that describes both OPS.HTM and OPS.PDF. |
PDS |
CALRPT.HTM |
Instrument Calibration Summary as hypertext |
LCROSS |
CALRPT.PDF |
Instrument Calibration Summary as PDF |
LCROSS |
CALRPT.LBL |
A PDS detached label that describes both CALRPT.HTM and CALRPT.PDF. |
PDS |
SCIPLAN.HTM |
Mission Science Plan as hypertext |
LCROSS |
SCIPLAN.PDF |
Mission Science Plan as PDF |
LCROSS |
SCIPLAN.LBL |
A PDS detached label that describes both SCIPLAN.HTM and SCIPLAN.PDF. |
PDS |
The files in the Catalog Directory provide a top-level understanding of the mission, spacecraft, instruments, and data sets. The files in this directory are coordinated with the PDS data engineer, who is responsible for loading them into the PDS catalog. PDS provides a template for each type of catalog file, but the contents are provided by instrument and mission personnel. The following files are found in the Catalog Directory.
File Name |
File Contents |
File Provided By |
CATINFO.TXT |
A description of the contents of this directory |
PDS Node |
VIS_RAW_DS.CAT |
Raw VIS data set description |
LCROSS |
NIR1_RAW_DS.CAT |
Raw NIR1 data set description |
LCROSS |
NIR1_CAL_DS.CAT |
Calibrated NIR1 data set description |
LCROSS |
NIR2_RAW_DS.CAT |
Raw NIR2 data set description |
LCROSS |
NIR2_CAL_DS.CAT |
Calibrated NIR2 data set description |
LCROSS |
MIR1_RAW_DS.CAT |
Raw MIR1 data set description |
LCROSS |
MIR1_CAL_DS.CAT |
Calibrated MIR1 data set description |
LCROSS |
MIR2_RAW_DS.CAT |
Raw MIR2 data set description |
LCROSS |
MIR2_CAL_DS.CAT |
Calibrated MIR2 data set description |
LCROSS |
NSP1_RAW_DS.CAT |
Raw NSP1 data set description |
LCROSS |
NSP1_CAL_DS.CAT |
Calibrated NSP1 data set description |
LCROSS |
NSP1_FL_RAW_DS.CAT |
Raw flash mode spectra |
LCROSS |
NSP1_FL_CAL_DS.CAT |
Calibrated flash mode spectra |
LCROSS |
NSP1_PREHAD_DS.CAT |
Raw mask data used to generate NSP1_RAW_DS |
LCROSS |
NSP2_RAW_DS.CAT |
Raw NSP2 data set description |
LCROSS |
NSP2_CAL_DS.CAT |
Calibrated NSP2 data set description |
LCROSS |
NSP2_FL_RAW_DS.CAT |
Raw flash mode spectra |
LCROSS |
NSP2_FL_CAL_DS.CAT |
Calibrated flash mode spectra |
LCROSS |
NSP2_PREHAD_DS.CAT |
Raw mask data used to generate NSP2_RAW_DS |
LCROSS |
VSP_RAW_DS.CAT |
Raw VSP data set description |
LCROSS |
VSP_CAL_DS.CAT |
Calibrated VSP data set description |
LCROSS |
TLP_RAW_DS.CAT |
Raw TLP data set description |
LCROSS |
TLP_CAL_DS.CAT |
Calibrated TLP data set description |
LCROSS |
INSTHOST.CAT |
LCROSS instrument host (i.e., spacecraft) description |
LCROSS |
VIS_INST.CAT |
VIS instrument description |
LCROSS |
NIR1_INST.CAT |
NIR1 instrument description |
LCROSS |
NIR2_INST.CAT |
NIR2 instrument description |
LCROSS |
MIR1_INST.CAT |
MIR1 instrument description |
LCROSS |
MIR2_INST.CAT |
MIR2 instrument description |
LCROSS |
NSP1_INST.CAT |
NSP1 instrument description |
LCROSS |
NSP2_INST.CAT |
NSP2 instrument description |
LCROSS |
VSP_INST.CAT |
VSP instrument description |
LCROSS |
TLP_INST.CAT |
TLP instrument description |
LCROSS |
MISSION.CAT |
LCROSS mission description |
LCROSS |
PERSON.CAT |
Personnel information (Team and PDS personnel responsible for generating the archive) |
LCROSS |
REF.CAT |
Complete citations of references mentioned in other *.CAT files |
PDS Node |
The Calib Directory contains calibration files used to process the data products, or calibration data needed to use the data products. The following files are contained in the Calib Directory.
File Name |
File Contents |
File Provided By |
CALINFO.TXT |
A description of the contents of this directory |
LCROSS |
DARKS/ |
A directory containing image files for all cameras of a dark target; spectra for each spectrometer of the same target; LBL files for each image and spectra |
LCROSS |
The Extras Directory contains documentation, utility programs, or other materials that the user may find helpful, but that are beyond the scope of the required elements of the archive. The contents of this directory are exempt from PDS requirements for labeling, etc. The following files are contained in the Extras Directory.
File Name |
File Contents |
File Provided By |
EXTRINFO.TXT |
A description of the contents of this directory |
LCROSS |
CALIB/ |
Extra calibration files |
LCROSS |
FITS/ |
FITS versions of all image files |
LCROSS |
MOVIES/ |
Movies and animations intended help explain the context of the observations |
LCROSS |
This section describes the format of LCROSS Science Data Archive Volumes. Data that comprise the Archive will be formatted in accordance with Planetary Data System specifications [Applicable Documents 4 and 5].
This section describes file formats for the kinds of files contained on Archive Volumes.
Document files with the .TXT suffix exist in the Root, Index, Software, Catalog, Document and Label directories. They are ASCII files which may have embedded PDS labels. Lines in a .TXT file end with a carriage return character (ASCII 13) and a line feed character (ASCII 10). This allows the files to be readable under various operating systems.
Documents in the Document directory may contain formatting and figures that cannot be rendered as ASCII text. Therefore each document is given in two formats, hypertext and PDF. The hypertext file contains ASCII text plus hypertext markup language (HTML) commands that enable it to be viewed in a Web browser such as Netscape Navigator or Microsoft Internet Explorer. The hypertext file may be accompanied by ancillary files such as images and style sheets that are incorporated into the document by the Web browser. The second format, PDF (Portable Document Format) is a proprietary format of Adobe Systems Incorporated that is frequently used for distributing documents. Adobe offers free software, Acrobat Reader, for viewing PDF files (http://www.adobe.com).
Tabular files (.TAB suffix) exist in the Index and Data directories. Tabular files are ASCII files formatted for direct reading into many database management systems on various computers. All fields are separated by commas, and character fields are enclosed in double quotation marks ("). (Character fields are padded with spaces to keep quotation marks in the same columns of successive records.) Character fields are left justified, and numeric fields are right justified. The "start byte" and "bytes" values listed in the labels do not include the commas between fields or the quotation marks surrounding character fields. The records are of fixed length, and the last two bytes of each record contain the ASCII carriage return and line feed characters. This allows a table to be treated as a fixed length record file on computers that support this file type and as a text file with embedded line delimiters on those that don't.
All tabular files are described by PDS labels, either embedded at the beginning of the file or detached. If detached, the PDS label file has the same name as the data file it describes, with the extension .LBL; for example, the file INDEX.TAB is accompanied by the detached label file INDEX.LBL in the same directory.
All data files in the archive have PDS labels, either embedded at the beginning of the file or detached in a separate file. For examples of PDS labels for each type of data product, see the Data Product SIS [Applicable Document 3].
A PDS label, whether embedded or detached from its associated file, consists of lines of ASCII text in the form of keyword = value statements that provide descriptive information about the data file. The label is intended to be readable both by humans and by software. Details of the syntax and semantics of PDS labels can be found in the PDS Standards Reference (Applicable Document 5), and definitions of the keywords used in the label can be found by using the PDS Data Dictionary Lookup web service at http://pds.jpl.nasa.gov/tools/data_dictionary_lookup.cfm. Lines of text in detached labels end with a carriage return character (ASCII 13) and a line feed character (ASCII 10). This allows the files to be read under various operating systems.
Catalog files (suffix .CAT) exist in the Root and Catalog directories. Like PDS labels, they are text files formatted as keyword = value statements. They contain descriptions of the data set, instrument, spacecraft, and mission, as well as personnel contact information and references to published literature. They are called Catalog Files because they are loaded into the PDS online catalog to make the information available to users searching for data.
Science data from the VIS, NIR1, NIR2, MIR1, and MIR2 cameras are stored as PDS images with detached labels. Data from the NSP1, NSP2, and VSP spectrometers and from the TLP are stored as ASCII tables with integer and single-precision floating-point data and with detached PDS labels.
For the VIS, NIR1 and NIR2 cameras, the data products are all 720x486 RGB images expressed in PDS IMG format with a detached label. The uncalibrated images will be 24-bit RGB (8 bits per channel) images, pixel interleaved. The calibrated images will be single-precision floating point per channel, with the same resolution.
The VIS camera is intrinsically color, and the RGB channels are independent. The NIR cameras are black-and-white, but are transmitting their images to the DHU across a color NTSC channel. Therefore, the RGB channels should be identical except for NTSC transmission and A-to-D noise between the camera and the DHU.
The MIR1 and MIR2 images are single channel, 160x120, and 14 bits per pixel. The uncalibrated images will be 16 bits per pixel (the lower 14 bits of which hold data). The calibrated images are single precision floating point.
The NSP1, NSP2 and VSP spectrometer files are ASCII table (comma-separated value) files holding integers (uncalibrated) and single-precision floating point (calibrated) data.
The TLP files are ASCII TBL files holding integers (uncalibrated) and single-precision floating point (calibrated) data. ]
For more information about the format and content of the data products, see the Data Product SIS [Applicable Document 3].
Science data provided by the LCROSS science team will meet the specifications detailed in the Data Product SISs.
The LCROSS science team, with the assistance of the PDS Geosciences Node, are responsible for the assembly and production not only of PDS formatted data, but of a complete PDS-compliant archive.
Before final delivery of the archive, the PDS will conduct both peer review and validation on the single submitted volume. The purpose of the peer review is to confirm that the archive will be useable by members of the science community, both present and future, who are not familiar with the mission and/or instruments. Reviewers include members of the PDS, representatives of the LCROSS science team, and members of the science community not associated with the mission.
Validation consists of two parts, science validation and PDS standards validation. The LCROSS team will perform validation for science content of the data. The PDS Nodes that receive the data products will perform validation for compliance with PDS standards, including checking for correct PDS syntax, for accepted standard values of keywords, and for internal consistency of label items.
Data from all LCROSS instruments will be delivered to the PDS in one integrated archive that is expected to be approximately 30 Gb. This delivery will occur 6 months after the LCROSS impact, so the delivery is currently planned for 4/9/2010.
All volumes in the LCROSS Science Data Archive conform to ISO 9660 standards [ISO 9660, 1988].
The LCROSS Science Team will deliver science data products to the Imaging and Geosciences Node and SPICE data products to the NAIF Node by electronic (FTP) transfer initiated by the receiving Node. It is expected that there will be only one delivery to PDS for this mission, as discussed in the Archive Plan. Until the electronic transfer has been received by PDS, it is the responsibility of the LCROSS Project to ensure that the archive volume contents are stored on electronic media with a reliable backup copy. Subsequent to the transfer, it is the responsibility of the PDS to ensure a reliable backup copy exists.
The PDS is responsible for ensuring that a copy of the LCROSS archive is delivered to the National Space Science Data Center (NSSDC) for permanent storage, in accordance with agreements in place between the PDS and NSSDC.
There is a single archive labeled USA_NASA_ARC_LCRO_XXXX containing data from all mission phases for all instruments.
Anthony Colaprete
NASA Ames Research Center, M/S 245-3
Moffett Field, CA 94035-1000
Kimberly Ennico Smith
NASA Ames Research Center, M/S 245-6
Moffett Field, CA 94035-1000
Mark Shirley
NASA Ames Research Center, M/S 269-2
Moffett Field, CA 94035-1000
Susan Slavney
PDS Geosciences Node
Washington University
1 Brookings Drive, Campus Box 1169
St. Louis, MO 63130
slavney@wunder.wustl.edu
[SHS1]The directory scheme is complicated, so some example file names would be helpful, with complete directory paths.