Not Just Omics: The Space Biology Open Science Data Repository (OSDR) Enables Access to High Quality Space Life Sciences Phenotypic Data from Microbes to Humans
Explore the source record for details and available documents.
Rachel Gilbert↗
SEARCH · Search NASA
Results for “open data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
NASA Open Science Data Repository (OSDR) for Space Biology and Precision Health
Explore the source record for details and available documents.
Sylvain V. Costes↗
NASA Open Science for Life in Space: Open-Access Data and Training Opportunities
Explore the source record for details and available documents.
Sylvain V Costes↗
Investigating the Long-term Tropospheric NO2 Change and Trend over the Environmental Justice Neighborhoods using the NASA Open-source Data and Tools
Explore the source record for details and available documents.
GES DISC↗
TPSAS-NF1676L-32493-DND
The Committee on Earth Observation Satellites (CEOS) System Engineering Office (SEO) has supported the Open Data Cube (ODC) initiative to provide a data architecture solution that has value to its global users and increases the impact of EO satellite data. ODC is an open-source platform for processing satellite data. We have developed software products and tools around the core ODC that would help users perform machine learning on EO satellite data. The recent United Nations (UN) Sustainable Development Agenda provides a shared blueprint for peace and prosperity for people and for the planet, considering our current situation and helping to create a plan. The core of this agenda is a set of seventeen Sustainable Development Goals (SDGs), which represent an urgent call for action by all countries - both developed and developing - in a global partnership. The CEOS SEO team has recently developed and released a set of innovative Jupyter notebooks addressing UN SDGs 6.6.1 (spatial extents of water-related ecosystems), 11.3.1 (ratio of land consumption rate to population growth rate), and 15.3.1 (proportion of land that is degraded over total land area). These notebooks empower users by providing features that will assist with streamlining analysis ready data retrieval, processing, and visualization. We have recently incorporated several machine learning techniques in these notebooks. In this paper, we present the lessons learned from our experience on classifying land using supervised and unsupervised machine learning techniques using ODC framework for UN SDGs. We identify the current limitations of ODC to seamlessly support machine learning techniques. We propose features that would help machine learning, specifically within the ODC framework. We propose a thematic indexing/loading of data for both unsupervised learning as well as data annotation/labeling pipeline. Currently, ODC supports machine learning by separating data-management from the analysis process. It works as a mechanism to load cubes of data. ODC does not natively support features that are vital in machine learning such as validation splits, fair/balanced sampling, establishing load size constraints, etc. We believe that our proposed features will empower users by providing features that bring machine learning techniques closed to ODC. Enhancements to ODC to better accommodate machine learning techniques can assist in fulfilling UN SDGs such as 6.3.2, 6.4.2, 6.6.1, 11.3.1, 14.1.1, 15.1.1, 15.3.1, and 15.4.2.
Syed R Rizvi↗
Advancing Open Science Through Innovative Data System Solutions: The Joint ESA-NASA Multi-Mission Algorithm and Analysis Platform (MAAP)'s Data Ecosystem
Collaborative open science practices are changing the way research is conducted. These changes affect how scientists work together on data, code and information. Data systems enhance open science by offering forward thinking technological solutions, such as providing data and computation on the cloud, to enable collaboration, sharing and analysis. In this paper, we present our vision for a conceptual data system on the cloud that enables open science. We also present our work on the Multi-Mission Algorithm and Analysis Platform (MAAP)which has served as a pathfinder data system for this conceptual approach.
Kaylin Bugbee↗
TRUST, Trustworthiness and EOSDIS
In recent years there has been considerable attention by the international scientific research and applications community to ensure high quality of data and information management. The terms FAIR (Findable, Accessible, Interoperable, Reusable) data, TRUST (Transparency, Responsibility, User Community, Sustainability, and Technology) principles, and CARE (Collective Benefit, Authority to Control, Responsibility, and Ethics) principles have come into vogue during the last decade. NASA has been managing data and information for over 60 years. NASA’s Earth Observing System Data and Information System (EOSDIS) has been in operation for over 25 years, managing most of NASA’s Earth science data. Trustworthiness is a goal that NASA has always strived to achieve or exceed, because it: enables the success of any NASA science mission; inspires general science research and applications; justifies the cost of operations; contributes to the value of NASA’s Open Data Policy; and influences the long term, historical view for the data collection. Given the recent growth of interest in TRUST principles, it is useful to assess and show how NASA’s attention to trustworthiness maps into those principles. This presentation addresses shows how the various steps that have been taken by the Earth Science Data and Information System (ESDIS) Project in the implementation and evolution of EOSDIS map into the TRUST principles.
Remote Sensing↗
Rhode Island Ecological Conservation: Methods for Monitoring Rhode Island Habitats: Contributing to a Framework for Targeted Conservation and Management
Global avian population decline since the 1970s is largely attributable to habitat loss and degradation from anthropogenic disturbances. NASA DEVELOP’s Rhode Island Ecological Conservation team partnered with the Audubon Society of Rhode Island to compute land use land cover (LULC) maps of Rhode Island to aid in the conservation of the state’s 140 bird species. This project aimed to support the partner’s land acquisition strategies with updated and specific LULC classifications showing potential bird-habitat locations across the state. We incorporated remotely sensed data from Landsat 8 and 9 Operational Land Imager (OLI) into LULC maps using unsupervised classification techniques in ArcGIS Pro and supervised classification in Google Earth Engine. We generated six land classifications for 2023, which showed land cover dominated by upland habitats (forests, scrub/shrub, and grasslands), followed by development. We used TerrSet’s Land Change Modeler to forecast LULC change through 2043, using 2011 and 2021 National Land Cover Database (NLCD) land cover maps derived from Landsat 8 and 9 imagery. Project results suggest that non-urban upland and wetland habitats will decrease over time, while development will continue to encroach on non-urban avian habitats. Our maps and associated data will allow for more efficient land acquisition and management efforts to support avian habitat conservation across Rhode Island. Our study shows that data acquisition and processing from open data sources is feasible and further analysis can be done through GIS classification tools. More analysis is needed beyond this study to obtain more detailed land cover maps, though Audubon can aid its targeted conservation efforts with our current, historic, and forecasted LULC maps.
Remote sensing↗
High School Citizen Scientists Use AI/ML to Predict Intra-Ocular Pressure From Gene Expression Data for Spaceflown Mice
Artificial Intelligence (AI) and Machine Learning (ML) have increasingly become pivotal in biological and biomedical research, largely due to the culture of open data sharing and its associated benefits. The methodologies inherent in AI/ML are particularly adept at identifying and forecasting biological phenotypes from the vast amounts of data generated by next-generation sequencing technologies. These techniques offer substantial promise for advancing research in space biosciences and for the development of automated systems for monitoring space health. Nevertheless, there are crucial aspects to consider when training, validating, and testing machine learning models in both biological research and clinical contexts. It is essential that Open Science principles, including data sharing and the availability of open-source code, are complemented by high-quality, publicly accessible training resources. These resources should focus on best practices and include modules based on real-world scientific cases and data to ensure that future AI/ML practitioners gain practical experience with genuine problems. Addressing this knowledge gap, we have designed, developed, and delivered both interactive and self-paced training programs for citizen scientists worldwide, enabling them to utilize AI/ML for space biology research. This initiative was made possible through generous funding from a Transformation to Open Science Training grant. The interactive training sessions, conducted this summer, utilized AI/ML techniques to analyze data from the Open Science Data Repository, specifically targeting the effects of spaceflight on ocular structure and function. The dataset OSD-583, from the Rodent Research 9 mission, provides experimental data detailing the ocular responses of mice subjected to a 35-day spaceflight, compared with ground control counterparts. Using OSD-583 as observational data, our summer training participants applied AI/ML methods to predict intraocular pressure from RNA-seq data and identify the genes most predictive of the observed responses. Further analysis through pathway enrichment and gene set enrichment revealed that these genes are involved in molecular and cellular processes contributing to retinal degeneration.
James Casaletto↗
NASA's Earth Science Data Systems: A "Bit of History" and Observations
NASA has significantly improved its Earth Science Data Systems over the last two decades. Open data policy and inexpensive (or free) availability of data has promoted data usage by broad research and applications communities. Flexibility, accommodation of diversity, evolvability, responsiveness to community feedback are key to success.
Ramapriyan, H. K.↗
Multitemporal Cross-Calibration of the Terra MODIS and Landsat 7 ETM+ Reflective Solar Bands
In recent years, there has been a significant increase in the use of remotely sensed data to address global issues. With the open data policy, the data from the Moderate Resolution Imaging Spectroradiometer (MODIS) and Enhanced Thematic Mapper Plus (ETM+) sensors have become a critical component of numerous applications. These two sensors have been operational for more than a decade, providing a rich archive of multispectral imagery for analysis of mutitemporal remote sensing data. This paper focuses on evaluating the radiometric calibration agreement between MODIS and ETM+ using the near-simultaneous and cloud-free image pairs over an African pseudo-invariant calibration site, Libya 4. To account for the combined uncertainties in the top-of-atmosphere (TOA) reflectance due to surface and atmospheric bidirectional reflectance distribution function (BRDF), a semiempirical BRDF model was adopted to normalize the TOA reflectance to the same illumination and viewing geometry. In addition, the spectra from the Earth Observing-1 (EO-1) Hyperion were used to compute spectral corrections between the corresponding MODIS and ETM+ spectral bands. As EO-1 Hyperion scenes were not available for all MODIS and ETM+ data pairs, MODerate resolution atmospheric TRANsmission (MODTRAN) 5.0 simulations were also used to adjust for differences due to the presence or lack of absorption features in some of the bands. A MODIS split-window algorithm provides the atmospheric water vapor column abundance during the overpasses for the MODTRAN simulations. Additionally, the column atmospheric water vapor content during the overpass was retrieved using the MODIS precipitable water vapor product. After performing these adjustments, the radiometric cross-calibration of the two sensors was consistent to within 7%. Some drifts in the response of the bands are evident, with MODIS band 3 being the largest of about 6% over 10 years, a change that will be corrected in Collection 6 MODIS processing.
MODIS↗
The BioMole Facility: Advancement of In Situ Microbiome Analysis for the International Space Station
Characterization of the International Space Station (ISS) microbiome has been enabled by sample return and Earth-based analysis. As human exploration pushes beyond low-Earth orbit, microbial-related crew health, planetary protection, and space research requires in situ capabilities. Steps toward reducing Earth-dependence for complex sample analysis began in 2016 with the amplification of DNA within the miniPCR thermal cycler and DNA sequencing with the MinION sequencer onboard the ISS; for both, samples were prepared on Earth. In 2017, these platforms synergistically enabled the in-situ identification of unknown bacteria collected and cultured from ISS surfaces, thereby shifting the paradigm that microbial cultures had to be returned to Earth. The following year, a culture-independent, swab-to-sequencer method further advanced spaceflight microbiology, demonstrating that culturing could be excluded and provided enhanced insight into the bacterial profile of ISS surfaces. Based on the success of these payloads in confirming the ability to meet crew health identification requirements and the benefits accompanying a culture-independent method, the BioMole Facility was established by the medical operations Crew Health Care Systems team. BioMole is the set of hardware, consumables, and procedures required to support sample preparation and nanopore sequencing onboard the ISS. BioMole goals include expanding sample sources, comparing data to previous methods, demonstrating onboard data analytics, and validating new hardware. To date, comparative surface analysis, molecular- and culture-based, has been completed. Additionally, the demonstration of a sample-to-answer process was achieved when BioMole data was processed onboard using the IBM Open Data and AI Edge software platform installed on the ISS-residing Spaceborne Computer-2. The taxonomic profiles generated from the edge analysis were as expected and paralleled that of the downlinked processed data. Future BioMole efforts involve microbial profiling of the ISS water system, ISS validation of the MinION Mk1C, and an expansion to a research facility available to investigators.
Sarah L. Castro-Wallace↗
Digital Twin Technology for Aviation
As technology progresses, so have the tools for data visualization. This project presents a digital twin model of the San Francisco airport displaying a 10-minute window of historical flight data, visualizing the trajectory data of airplanes and vehicles in three dimensions. Multiple different cameras where implemented to fully utilize the 3D visualization. This is a 100:1 feet scale model created in Autodesk Maya, using the airport center as the origin and recalculating all coordinates accordingly featuring the airport, some surrounding buildings, and the bay. For this project, six different models of airplanes were modeled at a 50:1 feet scale with texturing to mimic real-world aircraft models along with certain airlines. The animation is driven through archived data captured from NASA’s Sherlock Open-Data Portal, cleaned of noisy data points, processed into useable data formats, and implemented into a Maya ASCII file of animation paths with the corresponding previously-stated airplane models attached all using Java based conversion program.
Aleksander Schade↗
NASA EOSDIS Data Usage Metrics- Insight and Assessment
NASA's Earth Science Data and Information System (ESDIS) Project collects Earth science data usage metrics on a daily basis through the ESDIS Metrics System (EMS). This includes metrics on distribution of data products, users, data volumes, and number of files, which are key parameters in evaluating system-level performance of any of the Distributed Active Archive Centers (DAACs) encompassed by NASA's Earth Observing System (EOS) Data and Information System (EOSDIS). EOSDIS data usage metrics illustrate the benefits of making NASA data openly available to the public and show a rapid growth in data distribution to a worldwide user community. In fact, each year since 2014 the EOSDIS has distributed over one billion data files of products from EOS satellite, airborne, and in situ observations. An assessment of the long-term trends of data usage metrics and user characterization provides insights into data usability.This study will focus on describing the EMS as a metrics collection tool and will provide a comprehensive analysis of EOSDIS data usage metrics over the last 10 years. This study will also characterize the product distribution metrics by various tools and services, such as Giovanni, the Open-source Project for a Network Data Access Protocol (OPeNDAP), and subsets, to address how these tools/services have extended the usage of data in the EOSDIS collection. Data usage patterns based on discipline and study area will further assist in understanding how EOSDIS data user needs have evolved over time. Results from this study will provide useful information for the DAACs that can help them improve the functionality of their tools and services as well as more efficiently allocate the resources necessary for enhanced access and availability of their data products. Knowledge of these metrics may also benefit user discovery of data in the EOSDIS collection, promote research collaboration, and stimulate new ideas from work and research conducted using specific datasets and data collections.
Kafle, Durga N.↗
ISSLive!
The ISSLive! project is a JSC innovation award- winning, combined MOD/Education project to publish export control and PAO-approved ISS telemetry, and simplified and scrubbed crew timelines. The publication of this data will be real-time or near real time and will include links to the crew's social media feeds and existing streaming public video/audio feeds, via public-friendly website, mobile devices and tablet applications. Additionally, the project will offer interactive virtual 3D views of an ISS model based on real-time telemetry and a 3D virtual mission control center based on existing Front Room console positions in made for public displays. The ISSLive! project is MOD-managed and includes collaborations with subject-matter expertise from the ISS flight controllers regarding daily operations and planning, education program specialists from the JSC Office of Education, instructional designers, human computer interface experts, and software/hardware experts from MOD facility organization, and senior web designers. In support of the Agency s Strategic Goal #6 with respect to using the ISS National Laboratory for education activities, ISSLive! uses the Station itself as STEM education subject matter and provides data for STEM-based lessons plans using national standards. Specifically, ISSLive! supports and enables the National Laboratory Education (NLE) project to address the Agency s Strategic Goal #6. This goal mandates, sharing NASA with the public, educators, and students to provide opportunities to participate in our Mission, foster innovation .. ISSLive! satisfies the Agency s outcomes of Strategic Goal; that is, engages the public in NASA's missions by providing new pathways for participation (Outcome 6.3) and it informs, engages, and inspires the public by sharing NASA s missions, challenges, and results (Outcome 6.4). Additionally, ISSLive! enables MOD s support of JSC Outreach and NASA's Open Data and Open Government Initiatives. The audience for the ISSLive! website and its application(s) are: teachers, students, citizen scientists, and the general public who will be given new and interactive insights on how the ISS Operates.
Price, Jennifer B.↗
An Evolving Worldview: Making Open Source Easy
NASA Worldview is an interactive interface for browsing full-resolution, global satellite imagery. Worldview supports an open data policy so that academia, private industries and the general public can use NASA's satellite data to address Earth science related issues. Worldview was open sourced in 2014. By shifting to an open source approach, the Worldview application has evolved to better serve end-users. Project developers are able to have discussions with end-users and community developers to understand issues and develop new features. New developers are able to track upcoming features, collaborate on them and make their own contributions. Getting new developers to contribute to the project has been one of the most important and difficult aspects of open sourcing Worldview. A focus has been made on making the installation of Worldview simple to reduce the initial learning curve and make contributing code easy. One way we have addressed this is through a simplified setup process. Our setup documentation includes a set of prerequisites and a set of straight forward commands to clone, configure, install and run. This presentation will emphasis our focus to simplify and standardize Worldview's open source code so more people are able to contribute. The more people who contribute, the better the application will become over time.
open dat↗
Stewardship of NASA's Earth Science Data and Ensuring Long-Term Active Archives
Program, NASA has followed an open data policy, with non-discriminatory access to data with no period of exclusive access. NASA has well-established processes for assigning and or accepting datasets into one of 12 Distributed Active Archive Centers (DAACs) that are parts of EOSDIS. EOSDIS has been evolving through several information technology cycles, adapting to hardware and software changes in the commercial sector. NASA is responsible for maintaining Earth science data as long as users are interested in using them for research and applications, which is well beyond the life of the data gathering missions. For science data to remain useful over long periods of time, steps must be taken to preserve: (1) Data bits with no corruption, (2) Discoverability and access, (3) Readability, (4) Understandability, (5) Usability' and (6). Reproducibility of results. NASAs Earth Science data and Information System (ESDIS) Project, along with the 12 EOSDIS Distributed Active Archive Centers (DAACs), has made significant progress in each of these areas over the last decade, and continues to evolve its active archive capabilities. Particular attention is being paid in recent years to ensure that the datasets are published in an easily accessible and citable manner through a unified metadata model, a common metadata repository (CMR), a coherent view through the earthdata.gov website, and assignment of Digital Object Identifiers (DOI) with well-designed landing product information pages.
Data Management↗
Assessing the Needs of NASA's Near Real-Time Earth Observation Products
"The 2017-2027 Decadal Survey for Earth Science and Applications from Space stated that NASA's Earth Science with planned implementation of applications provides sustained earth observations for societal benefits [1]. The Decadal Survey indicated that data latency is invaluable for time-sensitive applications including disaster risk reduction, wildland fire carbon emissions quantification, real-time measurements of the state of the hydrologic systems and many more. Data latency refers to the time between earth observation and data products available to users. During the past 13 years, NASA's Land, Atmosphere Near Real-Time Capability for Earth Observing Systems (LANCE) continues to provide free access to earth observation products that are made available much quicker than routine processing allows. The latency of most LANCE data products is Near Real-time (NRT) which is defined as less than three hours from satellite observations [2]. LANCE is managed by the Earth Science Data and Information System (ESDIS) Project at NASA Goddard Space Flight Center [3], and a User Working Group (UWG) is responsible for providing guidance to LANCE. LANCE data are used by direct users and brokers who add value to the data [4]. NASA Earth Applied Sciences Program (ASP) is one of the primary users of LANCE, which collaborates with partner organizations and provides support to scientists to solve problems in applications of earth observations. ASP promotes the use of LANCE NRT data products to demonstrate applications in decision making, facilitates end-user feedback to the science team to improve data products, and provides information on future demands for research. LANCE supports applications that need a rapid response including detecting wildland fires and volcanic eruptions, tracking smoke, ash and dust plumes, monitoring air quality and tracking extreme weather events such as hurricanes, landslides, and floods. To gather feedback regarding the availability, accessibility and actionability of NASA's NRT data products for societal benefit, three surveys and a few discussions with experts involved in the topic within ASP were conducted from the perspective of users. Feedback has been collected from users who are interested in using low latency NASA data within application communities of agriculture, disasters, water resources, health and air quality, ecological conservation, wildland fires and capacity building. Analysis-ready NRT data products in a variety of formats have been mentioned many times in the collected feedback, especially for applied users with little to no experience using research-grade earth observation products. Users prefer to have products that can be easily integrated into their existing workflows and take their analysis to the data. HDF5 is a commonly used data format for research, but typically requires some conversion to a more friendly format for applications and regular use in decision-making. Users prefer the GeoTIFF data format that can be directly ingested into a GIS mapping software and platform for data analysis and visualization. For example, LANCE’s fire, flood, SO2 and Black Marble Nighttime Blue/Yellow Composite data products have been integrated into NASA Disasters Mapping Portal, which is an GIS-based open data portal, for users in the disaster management community. There are 291 LANCE NRT layers available through GIBS and Worldview, where users can download a snapshot in GeoTIFF format. Operational users expect data to be processed as close to the user as possible. The collected feedback indicates that LANCE fire products within 3 hours latency would meet the needs of the wildland fire community. The ideal latency for volcanic application is 10-15 minutes. Users in Volcanic Ash Advisory Centers (VAAC) reported that the first forecast volcanic product should be issued within 75 minutes from the volcano eruption [5]. Overall, for disaster applications, data latency within 3 hours is useful while latency greater than 12 hours is not timely enough for operational use. Capacity building and training are critical for users to be able to access, interpret and use data products and tools for their decision making, especially for applied users with limited experience using earth observation products. LANCE data products have been used in a number of capacity building projects domestically and internationally [6]. As LANCE continues to bring new products into the system, users request training to utilize LANCE new and upcoming data products and capabilities in their applications. Due to the limitation of bandwidth and downstream flow paths, users in some developing countries need tools to select and download data for a specific area of interest instead of bulk downloads. The collected feedback also shows the lack of available SAR satellite low latency data products. The advantages of SAR to monitor conditions and changes on the ground through darkness, clouds, volcanic ash, and other atmospheric conditions, are appealing to low latency users. For example, terabytes of low latency but cloudy optical images are not helpful in rapidly identifying the extent of flood or fire impacts. LANCE could be complemented with low latency measurements via the upcoming NASA-ISRO Synthetic Aperture Radar (NISAR) mission [7]. Requests for higher spatial resolution products are expressed. A user from the wildland fire management community reported that products with 30-m spatial resolution could be used to detect small fires. The 30-m Landsat OLI fire data is now part of NASA’s Fire Information for Resource Management System (FIRMS) US/Canada [8]. Within the open and free NASA resources, LANCE disseminates NRT data products in a manner that allows them to be accessible and understandable to both scientific and applied users. In many application areas, latency plays an important or even decisive role where low latency earth observations help people to observe areas of interest, detect and track changes in the environment and make timely decisions. NASA’s Earth Applied Sciences Program promotes the use of LANCE NRT products and builds a bridge between application users and research teams. The collected feedback indicates data latency within 3 hours is useful for most of the applications, and shows the needs of user-friendly, analysis-ready products, and requests training on LANCE’s new and upcoming data products. User feedback has been provided to LANCE UWG for guidance and recommendations, and for translating findings into something actionable.
Tian Yao↗