Help for NASA Proposal Writers

For information related to opportunities to obtain funded research via NASA's Science Mission Directorate Research Announcement (NRA) visit NASA's Grant Solicitations and related pages (https://science.nasa.gov/researchers). One such opportunity for Planetary Scientists, the omnibus Research Opportunities in Space and Earth Sciences (ROSES), is updated annually and it includes NASA programs such as Mars Data Analysis (MDAP) and Planetary Data Archiving, Restoration, and Tools (PDART).

Since 2011 (https://pds.nasa.gov/datastandards/documents/policy/PolicyOnTransitionFromPDS3toPDS411162010.pdf), NASA requires that data be archived according to PDS4 standards (see https://pds.nasa.gov/datastandards/about/, and https://pds.nasa.gov/datastandards/documents/sr/current/StdRef_1.12.0.pdf). The PDS4 Concepts document is a good place to find an introduction to this standard (https://pds.nasa.gov/datastandards/documents/policy/format_policies_final.pdf). To be compliant with the PDS4 standard, data must be archived in one of several basic formats: https://pds.nasa.gov/datastandards/documents/policy/format_policies_final.pdf. See also further information on PDS4, data formats, and PDS Policies below.

Guidance on PDS4 Archiving Requirements:

If you are representing a mission (https://pds.nasa.gov/home/proposers/proposing-missions.shtml) that plans to seek NASA funds to acquire and deliver an archival dataset to PDS, please refer to the summary called the Mission Proposer's Archiving Guide (MPAG) for guidance (see latest version linked here https://pds.nasa.gov/home/proposers/).

If you are an individual (https://pds.nasa.gov/home/proposers/proposing-programs.shtml) that plans to propose to NASA for funds to create an archive for PDS, please refer to the Individual Proposer's Archive Guide (IPAG) for guidance (see latest version linked here https://pds.nasa.gov/home/proposers/).

Data Management Plans (DMPs) are often required components of NASA proposals and must be included as part of the proposal package. Because the requirements may vary for different NASA missions and programs, you are encouraged to read the call for proposals carefully and follow any instructions specific to that program. Find more information on DMPs and a template, look here: https://science.nasa.gov/researchers/sara/faqs/dmp-faq-roses/.

Letters of Support:

*** PLEASE ALLOW AT LEAST ONE WEEK BEFORE YOUR DEADLINE FOR US TO RESPOND TO YOUR REQUEST! ***

Many NASA programs require that a proposer include a Letter of Support from a PDS discipline node for their proposed archive. If you need such a letter, contact the primary node that manages the data (see https://pds.nasa.gov/contact/contact.shtml) at least one week prior to your proposal deadline. This timeline is from a formal PDS policy (see https://pds.nasa.gov/datastandards/documents/policy/FINAL_PDS_Policy_Letters_of_Support_2019_10_08.pdf). The node manager may ask to see a draft DMP and/or may have questions about the number and volume of data products expected, their format, delivery schedule, etc. Please be prepared to answer these questions before a letter is needed; ideally you will provide this information on the initial request. The goal is to help ensure that the node is aware of your proposed effort and can support the archiving of your data. Also note that nodes are required to report to PDS management at the Project Office and NASA Headquarters on the status of all archives on a monthly and/or (in more detail) a quarterly basis, so please be prepared to provide at least annual updates on your plans, progress and any schedule updates.

If you are uncertain which node is relevant or if you may need to work with more than one data set that is held at different nodes, contact any node lead and we will route your inquiry appropriately; the nodes often work together to support archive development in such cases.

*** PLEASE ALLOW AT LEAST ONE WEEK BEFORE YOUR DEADLINE FOR US TO RESPOND TO YOUR REQUEST! ***

Tasks for Creation of a New PDS4 Archival Data Set:

  • Contact PDS. If you intend to archive your data in PDS, discuss it with PDS before submitting your proposal. Request a letter of support if needed (see above). We can tell you what is required to make your data into a compliant archive, and make sure you are connected with the right PDS node to handle your data. To contact the Imaging Node, send email to thare@usgs.gov.

  • Which PDS node? Links to all the PDS nodes are found at left on the PDS Home page (https://pds.nasa.gov/) and at the bottom of this page. To determine if a node is the right one to archive your data, look at the node's web site to see the types of data already archived there. Contact information for all PDS nodes is available on their web sites and on the main PDS web site Contact page. To contact the Imaging Node, send email to thare@usgs.gov and/or bob.deen@jpl.nasa.gov.

  • What is PDS4? Most data in PDS archives is in PDS3 formats, but the nodes are both supporting new archives in PDS4 formats and working to migrate PDS3 to PDS4 formats. You can find examples of PDS4 archives here: https://pds.nasa.gov/datastandards/documents/examples/ These are supported by extensive documentation, especially the Data Provider's Handbook (linked here https://pds.nasa.gov/datastandards/documents/). Here is an example of a simple PDS4 archive package that includes image data: https://astrogeology.usgs.gov/search/map/Mars/MarsReconnaissanceOrbiter/MARCI/MARS-MRO-MARCI-Mars-Daily-Global-Maps
    • What the proposer (Principle Investigator or P.I.) does (see also tasks described in the Archiving Brochure, https://atmos.nmsu.edu/pub/download/Archiving@PDS_Brochure_V2r.pdf):

      • Produces data products in acceptable PDS format (currently PDS4)
      • Produces PDS labels, which are XML files under PDS4
      • Writes supporting documentation
      • Organizes data, labels, documentation, etc. into an archive package
      • Validates labels using PDS provided tools
      • Participates in peer review (typically done via web, email and phone; no travel necessary)
      • Makes updates, as necessary, based on peer review recommendations
      • Delivers final package to PDS

      What the PDS Node does (at no cost to the proposer):

      • Provides advice on PDS standards and requirements
      • Helps in designing PDS labels and the archive package, if needed
      • Provides available PDS tools
      • Sets up and conducts a peer review
      • Accepts the final package and integrates the data into its archives, including making it available on the             Cartography and Imaging Science's (IMG) Node web site

  • Estimation of Effort. If you need help estimating the effort needed to develop a PDS4 archive, discuss the scope of the work with your PDS representative and be sure to include the tasks described in the Archiving Brochure (https://atmos.nmsu.edu/pub/download/Archiving@PDS_Brochure_V2r.pdf).

    Even if you are a seasoned PDS veteran, it's unlikely that you can simply deliver an archive-ready package to PDS at the end of your work. Your PDS representative will help you define your PDS4 archival data structures, design PDS labels and components of the archive (data, documentation, index tables, supporting materials), and prepare for the peer review.

  • Peer Review. Every data set archived in PDS must pass a peer review. The review committee consists of a small number of scientists who have relevant expertise, along with PDS representatives. The review results in a list of recommendations called liens that must be addressed before the data set can be accepted. When you're proposing for archiving support from NASA, you will need to commit to fully supporting the development and validation, delivery, review and lien resolution for your archive.

    Use of Existing PDS Data Sets:

    Check the instructions for the program to which you are proposing for any rules about which PDS data sets are acceptable. Some programs have specific requirements about the status of PDS data sets for use in proposals. You may want to refer to the PDS Data Release Calendar (https://pds.nasa.gov/datasearch/subscription-service/data-release-calendar.shtml).

    The archive status of each data set at the PDS Cartography and Imaging Sciences Node set listed on the page All Data Holdings (https://pds-imaging.jpl.nasa.gov/holdings/).

    When mentioning a PDS data set in your proposal, cite the PDS Data Set ID, which uniquely identifies the data set in all of PDS. Many data sets have similar names, so specifying the Data Set ID avoids any ambiguity.

    Tools and Information:

    PDS provides a variety of tools for developing new PDS4 archives (see https://pds.nasa.gov/tools/about/). IMG also supports several tools and tutorials for data users and providers (https://pds-imaging.jpl.nasa.gov/software/).

  • The Annex: As of January 2017, the Annex of IMG (https://www.usgs.gov/centers/astrogeology-science-center/science/annex-pds-cartography-imaging-sciences-node) is considered PDS-Equivalent by NASA as a long-term data repository for geospatial products. This service is managed by the USGS Astrogeology Science Center staff in support of NASA and the PDS to host products developed by NASA scientists but which may not be natively PDS4 compliant. Any new products accepted after this time will be archived in the PDS in PDS4-compliant formats by working with IMG node members, and these are supported at USGS by development of public Annex product pages. All products are required to 1) have been derived from data in the PDS archive, 2) be delivered with extensive metadata that meet PDS archive documentation standards, and 3) be reviewed by PDS for PDS4 compliance and by science peers for validity and usability. Annex product pages may include links to associated publications, supplemental information and/or to files such as related data archival products in the PDS and the original GIS databases, shapefiles, point clouds, etc. used to create the archival products. Please contact us if you are interested in using this service (see contact info below).

  • GDAL (Geospatial Data Abstraction Library): GDAL is an open-source computer software library for reading and writing raster and vector geospatial data formats (https://gdal.org/about.html). IMG has been working with GDAL developers to add functionality to support users and developers of PDS4-compliant archives (see Hare et al., 2018, https://www.hou.usra.edu/meetings/lpsc2018/pdf/1703.pdf). Please refer to the pages linked below for more up-to-date information on our progress:

    https://gdal.org/drivers/raster/pds4.html

  • GeoCSV format for GIS Shapefiles: If you are working with (and thinking of archiving) data products derived from Geographic Information Systems (GIS) software, please note that these data formats and structures are proprietary (e.g., ArcMap geodatabases, shapefiles) and are not PDS4-compliant in their native formats. However, such geodatabase components and/or layers can typically be archived in PDS in PDS4-compliant formats as tables, 2- or 3-D binary image arrays, etc. Fortunately, GDAL excels at such transformations, and we will show you how to reformat these. For archiving GIS vector data (e.g., shapefiles), PDS recommends use of a particular GeoCSV format (see white paper below) for archiving GIS shapefiles in a PDS4-compliant format.

  • GeoCSV White Paper: https://pds-imaging.jpl.nasa.gov/help/PDSandGIS_GeoCSV_v4.pdf

  • GeoTIFF format for images: PDS has approved use of a specific GeoTIFF format (a simple raw binary stream) and data standard for use as a compliant operational image format (see p. 12 of the Data Providers Handbook, https://pds.nasa.gov/datastandards/documents/dph/current/PDS4_DataProvidersHandbook_1.11.0.pdf#page=12). The TIFF format has a three-level hierarchy including a (1) Image File Header (IFH), (2) one or more directories called Image File Directories containing codes and their data, or a pointer to the data, and (3) the image data. This use of TIFF/GeoTIFF provides both a compliant archival format and an immediately "usable" format supported by hundreds of graphics-based and scientific applications (including popular applications like Photoshop, Matlab, ENVI, IDL, multitudes of GIS applications, and image libraries; see white paper below).

  • GeoTIFF White Paper: https://pds-imaging.jpl.nasa.gov/help/PDSandGIS_GeoTiff_v8.pdf

  • OpenPlanetary: The OpenPlanetary Forum (https://openplanetary.discourse.group/) is intended for sharing information on working with planetary data for research professionals, educators, students and science communicators across planetary science disciplines and communities. There you will find a wide variety of information on topics such as datasets, tools and web services, software and workflows, data access and discovery, GDAL and PDS4. For example, see this page, prepared by IMG:
  • GDAL for PDS4 Introduction (Demo for PDW4)

  • Planetary Data Workshops (PDW): IMG is the primary organizer of the Planetary Data Workshops (https://astrogeology.usgs.gov/groups/planetary-data-workshop). These are typically held every other year in Flagstaff, AZ (e.g., the 4th PDW was in June of 2019). Abstracts and presentations from previous meetings are linked here, and they cover a wide variety of topics designed for data providers, users, developers, and communicators working with planetary data.
  • More Information:

    Please refer to the PDS Home page (https://pds.nasa.gov/) for more information on all aspects of archiving data with the PDS. Note that there's a handy "Need Help" function there if you have specific questions, as well as Contact Us and Feedback links. When in doubt, ask anyone involved with PDS---we'll help you get to the right place!