Data Systems to Enable Open Science: The Joint ESA-NASA Multi-Mission Algorithm and Analysis Platform’s Data Ecosystem
Explore the source record for details and available documents.
Kaylin Bugbee↗
SEARCH · Search NASA
Results for “Open Data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Preservation of Provenance and Context to Ensure Future Understandability of Airborne Earth Observations and Derived Data Products
Open-source science goes beyond making data from scientific projects (e.g., on-orbit/satellite missions, airborne and field investigations, and other data producing activities) openly available after they are generated, but involves and open sharing of information throughout the project lifecycle. Preservation of the data and associated information required for understanding and reusing the data well after the scientific projects is a contributor to open-source science as well. Considering the high investment in the on-orbit/satellite missions, we had developed a document titled “NASA Earth Science Data Preservation Content Specification (PCS)” in 2011. This document has been used as a requirement for recent on-orbit/satellite missions by NASA. Recently it became clear that the specifications should be applied to other scientific projects as well. Therefore, the document was revised to cover other types of projects, and a Preservation Content Implementation Guidance (PCIG) document was also developed. The revised PCS, and the PCIG, were published in 2022. The purpose of this presentation is to highlight the contents of these documents as they apply to suborbital/airborne investigations. The PCS calls for content preservation in eight general categories - Measuring Instrument/Platform Description, Instrument and Science Data Products and Metadata, Science Raw Data, Product and Algorithm Documentation, Instrument Calibration, Science Algorithm Software, Science Data Product Algorithm Inputs, Science Data Product Validation, and Science Data Access and Analysis Tools. While all these categories apply to various types of projects, a few clarifying sentences have been added to the descriptions of contents in each of the categories to show which categories are especially important to airborne and field investigations and where some contents are not applicable (or difficult to obtain). The PCIG document provides some general guidance applicable to all types of projects and specific guidance in a separate section for airborne and field investigations. This section calls out typical artifacts produced during such investigations that can meet the spirit of the various PCS categories.
remote sensing↗
Breaking Barriers: Integrating Geo-Leo Aerosol Data with an Open-Source Approach
The scientific community is still examining the novel data from geostationary satellite observations and evaluating methods for effectively fusing the polar observations with various spatial and temporal resolutions. However, the merged data will present a significant ""Big Data"" challenge, including processing, storage, data discoverability, accessibility, and migration within cloud computing environments. We have developed an open-source package to fuse aerosol optical depths (AOD) products from six satellite sensors in the past four years (2019~2023), and this presentation will update our recent progress. Using this Python-based package, we produced a level 3 global (AOD) product in a quarter-degree spatial resolution every half-hour, fusing the Level 2 AOD data with the Dark Target aerosol retrieval algorithm from six satellites: three geostationary (GOES-16/17 and Himawari-8) with high temporal resolution, and three polar orbiting (TERRA/MODIS, AQUA/MODIS, and SNPP-VIIRS) with global coverage. By integrating these observations, the diurnal cycle of global AOD in this fused product can be characterized at local, regional, and global scales. Furthermore, we are committed to openness and transparency by providing our package and its associated functionalities as open-source. Our dedication to adhering to the FAIR, CARE, and TRUST principles ensures that our users can rely on the integrity and ethical standards of our work. For instance of Interoperability, this package fuses remote sensing products on demand into desired temporal and spatial domains. It can be run in a central processing unit (CPU) or a Graphics processing unit (GPU) mode. This package will empower researchers and practitioners to use satellite and sensor data efficiently in various applications and research.
Xiaohua Pan↗
Development of WMS Capabilities to Support NASA Disasters Applications and App Development
During the last year several significant disasters have occurred such as Superstorm Sandy on the East coast of the United States, and Typhoon Bopha in the Phillipines, along with several others. In support of these disasters NASA's Short‐term Prediction Research and Transition (SPoRT) Center delivered various products derived from satellite imagery to help in the assessment of damage and recovery of the affected areas. To better support the decision makers responding to the disasters SPoRT quickly developed several solutions to provide the data using open Geographical Information Service (GIS) formats. Providing the data in open GIS standard formats allowed the end user to easily integrate the data into existing Decision Support Systems (DSS). Both Tile Mapping Service (TMS) and Web Mapping Service (WMS) were leveraged to quickly provide the data to the end‐user. Development of the deliver methodology allowed quick response to rapidly developing disasters and enabled NASA SPoRT to bring science data to decision makers in a successful research to operations transition.
Bell, Jordan R.↗
Development of WMS Capabilities to Support NASA Disasters Applications and App Development
During the last year several significant disasters have occurred such as Superstorm Sandy on the East coast of the United States, and Typhoon Bopha in the Phillipines, along with several others. In support of these disasters NASA's Short‐term Prediction Research and Transition (SPoRT) Center delivered various products derived from satellite imagery to help in the assessment of damage and recovery of the affected areas. To better support the decision makers responding to the disasters SPoRT quickly developed several solutions to provide the data using open Geographical Information Service (GIS) formats. Providing the data in open GIS standard formats allowed the end user to easily integrate the data into existing Decision Support Systems (DSS). Both Tile Mapping Service (TMS) and Web Mapping Service (WMS) were leveraged to quickly provide the data to the end‐user. Development of the deliver methodology allowed quick response to rapidly developing disasters and enabled NASA SPoRT to bring science data to decision makers in a successful research to operations transition.
Bell, Jordan R.↗
Development of Web Mapping Service Capabilities to Support NASA Disasters Applications / App Development
During the last year several significant disasters have occurred such as Superstorm Sandy on the East coast of the United States, and Typhoon Bopha in the Phillipines, along with several others. In support of these disasters NASA's Short‐term Prediction Research and Transition (SPoRT) Center delivered various products derived from satellite imagery to help in the assessment of damage and recovery of the affected areas. To better support the decision makers responding to the disasters SPoRT quickly developed several solutions to provide the data using open Geographical Information Service (GIS) formats. Providing the data in open GIS standard formats allowed the end user to easily integrate the data into existing Decision Support Systems (DSS). Both Tile Mapping Service (TMS) and Web Mapping Service (WMS) were leveraged to quickly provide the data to the end‐user. Development of the deliver methodology allowed quick response to rapidly developing disasters and enabled NASA SPoRT to bring science data to decision makers in a successful research to operations transition.
Burks, Jason E.↗
Development of Web Mapping Service Capabilities to Support NASA Disasters Applications/App Development
During the last year several significant disasters have occurred such as Superstorm Sandy on the East coast of the United States, and Typhoon Bopha in the Phillipines, along with several others. In support of these disasters NASA's Short‐term Prediction Research and Transition (SPoRT) Center delivered various products derived from satellite imagery to help in the assessment of damage and recovery of the affected areas. To better support the decision makers responding to the disasters SPoRT quickly developed several solutions to provide the data using open Geographical Information Service (GIS) formats. Providing the data in open GIS standard formats allowed the end user to easily integrate the data into existing Decision Support Systems (DSS). Both Tile Mapping Service (TMS) and Web Mapping Service (WMS) were leveraged to quickly provide the data to the end‐user. Development of the deliver methodology allowed quick response to rapidly developing disasters and enabled NASA SPoRT to bring science data to decision makers in a successful research to operations transition.
Burks, Jason E.↗
Uncovering Unique Molecular Adaptations in the Arabidopsis Thaliana Cvi-0 Ecotype
This research proposal aims to investigate the unique molecular adaptations exhibited by Arabidopsis Thaliana, specifically focusing on the Cape Verde Islands (Cvi-0) ecotype, in response to microgravity conditions. The study examines data from NASA’s Open Science Data Repository and applies a multifaceted RNAseq analysis pipeline using tools in the UseGalaxy.org open platform. Through transcriptomic analysis, differential gene expression patterns were identified in Cvi-0, revealing an absence of heat shock protein (HSP) upregulation and an upregulation of Rubisco Activase (RCA) and chloroplast-related pathways. To test the hypothesis that these adaptations may contribute to Cvi-0’s increased adaptability in microgravity, a three-fold experimental design is proposed. Four experimental groups will be cultivated under simulated microgravity and ground control conditions, including Cvi-0, Col-0, and genetically modified Col-0 with silenced HSP genes, and genetically modified Col-0 with upregulated RCA gene. Growth parameters will be measured to assess plant resilience, and RNA sequencing will provide transcriptomic data for pathway analysis. Anticipated outcomes include improved markers of plant health (mass, growth, etc.) of Cvi-0 in simulated microgravity and enhanced resilience in genetically altered Col-0 variants, providing insights into potential mechanisms of adaptation. This research would bear significance for space agriculture, nutrition for extended space missions, and sustainable terrestrial crop enhancement. Moreover, the insights gained could reshape crop engineering on Earth, enhancing robustness to climate induced stresses and bolstering global food security. The proposal’s trajectory blends scientific curiosity with practical applicability, forging a path towards sustainable food production and improving human exploration beyond our planet.
GL4HS↗
Big-data Efficient Automated Science Transfer (BEAST): an open-source software architecture for arc jet data management, modeling, and automation
Big-data Efficient and Automated Science Transfer (BEAST) was conceived to address the existing ground testing data management of the NASA Ames arc jet facilities (e.g., manually entered Excel files and USB drive data transfers). These data management practices were seen as a choke point for future thermal protection system (TPS) development as they limit statistical tracking, resolution of diagnostics, coordination between video/time series, data throughput, and data processing speed/efficiency. Consequently, BEAST was developed to provide a new data infrastructure with streamlined data collection, processing, transfer, and analysis. This new framework also seeks to implement the FAIR principles of data stewardship: Findable, Accessible, Interoperable, and Reusable. The BEAST framework is based on a combination of the Python Django web framework and the Python data stack to provide a monolithic, open-source platform for data management, automation, and machine learning. This architecture was chosen for maintainability and scalability for a small, in-house development team. This paper will describe the application framework, deployment, and discuss the benefits and future plans for the system.
Data management↗
An Overview of NASA’s Catalog of Archived Suborbital Earth Science Investigations (CASEI): Supporting FAIR and Open Access to Airborne and Field Data
Since 2019, NASA’s Airborne Data Management Group (ADMG) within the Interagency Implementation and Advanced Concepts Team (IMPACT) has worked to promote and ensure the discoverability and accessibility of the agency’s non-satellite Earth science observations. A primary component of this effort is the development of NASA’s Catalog of Archived Suborbital Earth Science Investigations (CASEI) and the vetting of key contextual details required to sustain this unique inventory of airborne and field metadata. CASEI provides information on the science objectives motivating data collection, key events/time periods in the observational record aligned with the science objectives, complementary simultaneous observations, programmatic details, and much more. The diverse set of data formats and disciplines served by CASEI have required the implementation of a common data model to organize suborbital observation metadata and efficiently connect appropriate campaigns, platforms, and instruments. The CASEI inventory provides a single entry point for users to search and browse NASA’s airborne and field data archives, regardless of which repository is responsible for their stewardship. This presentation will provide a summary of the motivations for and the development of the CASEI system. Particular attention will be granted to how CASEI facilitates discovery and reuse of these lesser-known NASA data, supporting the Open Science vision and enhancing the return on investments made to collect these unique and varied observations. An up-to-date summary of CASEI inventory content and initial metrics will be provided. Current and future avenues ADMG is pursuing to enhance both CASEI and specific components of suborbital data stewardship at various stages of the data life cycle will also be discussed.
Stephanie M. Wingo↗
Automated Collection of Scientific Publications Linked to NASA Earth Science Datasets
NASA's Earth Observing System Data and Information System (EOSDIS) began dataset Digital Object Identifier (DOI) registration in 2012. The number of dataset DOIs registered as of January of 2023 exceeds 11,000. As the research community becomes aware of the importance of sharing data through Open Science and optimizing data reuse through Findability, Accessibility, Interoperability, and Reuse (FAIR) data management principles, datasets are increasingly being cited in scientific publications. When datasets are cited explicitly by DOI within published works, automated methods can be developed for collecting these published works from a variety of bibliometric sources. The coverage of the sources varies, so each source can collect citations that are only available within it. Using major citation databases such as Scopus and Web of Science, the Google Scholar search engine, the CrossRef Open Citation Index, and the dataset DOI registry DataCite, we present an automated workflow for dataset citation collection. By harvesting citations automatically, a citation library is created explicitly linking EOSDIS datasets to publications that cite them. Using Zotero, a free and open-source citation manager, we demonstrate how to access and browse this library by the tags indicating bibliometric sources, dataset DOI, and the dataset archive center. We also demonstrate temporary trends in the number of publications harvested from bibliometric sources.
Infometrics↗
Phase I for the Use of TOPEX-Poseidon and Jason-1 Radar Altimetry to Monitor Coastal Wetland Inundation and Sea Level Rise in Coastal Louisiana
The objective of the first phase of this project was to determine the feasibility of applying satellite altimetry data to monitor sea level rise and inundation within coastal Louisiana. Global sea level is rising, and coastal Louisiana is subsiding. Therefore, there is a need to monitor these trends over time for coastal restoration and hazard mitigation efforts. TOPEX/POSEIDON and Jason-data are used for global sea level estimates and have also been demonstrated successfully in water level studies of lakes, river basins, and floodplains throughout the world. To employ TOPEX/POSEIDON and Jason-1 data in coastal regions, the numerous steps involved in processing the data over non-open ocean areas must be assessed. This project outlined the appropriate methodology for processing non-open ocean data, including retracking and atmospheric corrections. It also inventoried the many factors in coastal land loss including subsidence, sea level rise, coastal geomorphology, and salinity levels, among others, through a review of remote sensing and field methods. In addition, the project analyzed the socioeconomic factors within the Coastal Zone as compared to the rest of Louisiana. While sensor data uncertainty must be addressed, it was determined that it is feasible to apply radar altimetry data from TOPEX/POSEIDON and Jason 1 to see trends in change within Coastal Louisiana since
Brozen, Madeline↗
Demystifying Kepler Data: A Primer for Systematic Artifact Mitigation
The Kepler spacecraft has collected data of high photometric precision and cadence almost continuously since operations began on 2009 May 2. Primarily designed to detect planetary transits and asteroseismological signals from solar-like stars, Kepler has provided high quality data for many areas of investigation. Unconditioned simple aperture time-series photometry are however affected by systematic structure. Examples of these systematics are differential velocity aberration, thermal gradients across the spacecraft, and pointing variations. While exhibiting some impact on Kepler's primary science, these systematics can critically handicap potentially ground-breaking scientific gains in other astrophysical areas, especially over long timescales greater than 10 days. As the data archive grows to provide light curves for 10(exp 5) stars of many years in length, Kepler will only fulfill its broad potential for stellar astrophysics if these systematics are understood and mitigated. Post-launch developments in the Kepler archive, data reduction pipeline and open source data analysis software have occurred to remove or reduce systematic artifacts. This paper provides a conceptual primer for users of the Kepler data archive to understand and recognize systematic artifacts within light curves and some methods for their removal. Specific examples of artifact mitigation are provided using data available within the archive. Through the methods defined here, the Kepler community will find a road map to maximizing the quality and employment of the Kepler legacy archive.
Kinemuchi, K.↗
Developing a Standard for Earth Observation Data Preservation Content - A Path to Future Usability
For datasets to be usable, many pieces of information in addition to the data themselves are essential. During the active parts of the lifecycle of dataset generating projects, the needed information is usually accessible through individuals familiar with the various aspects of the projects. However, the utility of datasets tends to outlive the lives of projects, by several decades in many cases. Thus it is essential to capture all the relevant information about the datasets, data, metadata and associate knowledge that is sufficient to read, understand, interpret and reuse the datasets, while the projects are still active. The capture and preservation should be such that the data are usable when no consultation is available from the original project participants. Identification of specific categories of content through an international standard is beneficial to the user communities of the future, so that projects involving Earth observations and generating data products can consistently plan for preservation and future usability of the project outcomes. While there are existing standards that address archival and preservation in general, there are no existing international standards or specifications today to address what content should be preserved. The standard, ISO 19165-1, titled "Geographic Information - Preservation of digital data and metadata Part 1: Fundamentals" considers geographic information preservation in general. It acknowledges that "specific content items needed to preserve the full provenance and context of the data and associated metadata depend on the needs of the designated community and types of datasets (e.g., maps, remotely sensed data from satellites and airborne instruments, physical samples). Follow-up parts to this standard may be developed detailing content items appropriate to individual disciplines." NASA proposed an extension to this standard, titled "Geographic information -- Preservation of digital data and metadata -- Part 2: Content specifications for Earth observation data and derived digital products." The development of this extension is in progress with participation by an international team representing nine countries. The purpose of this paper is to introduce this standard and report on its status.
Remote Sensing; Data Systems; Open Data;↗
NASA’s Earth Observation System Data and Information System (EOSDIS) and FAIR – A Self-Assessment
Explore the source record for details and available documents.
Remote Sensing↗
FAIR-ness Assessment of NASA’s Earth Observation System Data and Information System (EOSDIS)
This presentation addresses the challenge of evaluating a multi-disciplinary institutional network of data repositories in operation since 1994 against the relatively recent criteria that constitute FAIR (Findable, Accessible, Interoperable, Reusable) data. NASA’s Earth Observation System Data and Information System (EOSDIS), with its 12 discipline-based Distributed Active Archive Centers (DAACs), preceded the definition and popularization of FAIR by over two decades. An assessment is very useful to describe how well the FAIR principles are met and to identify any improvements needed. In 2020, A “self-assessment” of EOSDIS and DAACs was performed by the ESDIS Project staff and the DAACs from the points of view of human actionability and machine actionability. More recently, a draft of a Science Mission Directorate (SMP) Program Directive (SPD-41a) has been released by NASA Headquarters for comment, where it is recommended that all SMD-funded data should follow the FAIR principles. This presentation is timely to initiate community discussion within the Information Quality Cluster (IQC) of the Earth Science Information Partners (ESIP) and help strategize and develop implementation guidelines for EOSDIS and DAACs to conform to FAIR principles.
Remote sensing↗
Opening Loads Analyses for Various Disk-Gap-Band Parachutes
Detailed opening loads data is presented for 18 tests of Disk-Gap-Band (DGB) parachutes of varying geometry with nominal diameters ranging from 43.2 to 50.1 ft. All of the test parachutes were deployed from a mortar. Six of these tests were conducted via drop testing with drop test vehicles weighing approximately 3,000 or 8,000 lb. Twelve tests were conducted in the National Full-Scale Aerodynamics Complex 80- by 120-foot wind tunnel at the NASA Ames Research Center. The purpose of these tests was to structurally qualify the parachute for the Mars Exploration Rover mission. A key requirement of all tests was that peak parachute load had to be reached at full inflation to more closely simulate the load profile encountered during operation at Mars. Peak loads measured during the tests were in the range from 12,889 to 30,027 lb. Of the two test methods, the wind tunnel tests yielded more accurate and repeatable data. Application of an apparent mass model to the opening loads data yielded insights into the nature of these loads. Although the apparent mass model could reconstruct specific tests with reasonable accuracy, the use of this model for predictive analyses was not accurate enough to set test conditions for either the drop or wind tunnel tests. A simpler empirical model was found to be suitable for predicting opening loads for the wind tunnel tests to a satisfactory level of accuracy. However, this simple empirical model is not applicable to the drop tests.
Cruz, J. R.↗
Transforming NASA Earth Science Data Systems: A Journey from Big Earth Data Initiative (BEDI) to Open-Source Science Initiative (OSSI)
NASA's Earth Science Data and Information Systems (ESDIS) have undergone a significant evolution, particularly with the introduction of the Big Earth Data Initiative (BEDI) and the Open-Source Science Initiative (OSSI). In this talk, I will provide an overview of NASA's Earth Science Data and Information systems, highlighting key components such as EOSDIS, ESDIS, and ESDS. Moving forward, I will delve into the BEDI initiative, discussing its objectives, key players, and lessons learned. The second part of the talk will cover the OSSI initiative, exploring its objectives, strategy, and innovative solutions. Throughout the presentation, I will provide insights into the requests, strategies, and solutions behind both BEDI and OSSI. By the end, you will gain a comprehensive understanding of how NASA's Earth Science Data Systems have evolved over the years and witness the organization's commitment to advancing an open-source and collaborative approach to data science. Join me for an enlightening exploration into the future of Earth science data and the pivotal role played by NASA in shaping this transformative landscape.
Jennifer Wei↗