SEARCH · Search NASA

Results for “Open data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Measurement of Charged-Current $ν_μ$ and $ν_e$ Interactions Towards a Search for Low-Energy $ν_Ε$ Excess Using Wire-Cell In Microboone

This technote summarizes the existing work in searching for $ν_e$ low-energy excess (eLEE) in MicroBooNE Booster Neutrino Beam (BNB) data stream based on the Wire-Cell event reconstruction paradigm. The charged-current $ν_μ$ and $ν_e$ events are selected from the 5.3e19 POT open data from the BNB beam, 6.37e20 POT far sideband from the BNB beam data, and 2.10e20 POT data from Neutrinos at the Main Injector (NuMI) beam. The charged-current $ν_e$ selection results from the BNB data that are sensitive to the eLEE search are not included. Various comparisons between data and Monte Carlo predictions are performed to validate the overall model and demonstrate the power of the analysis techniques. Physics sensitivities in terms of the exclusion and the discovery potential are presented.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS2018

The Planetary Materials Database

NASA provides funds for a variety of research programs whose principal focus is to collect and analyze terrestrial analog materials. These data are used to (1) understand and interpret planetary geology; (2) identify and characterize habitable environments and pre-biotic/biotic processes; (3) interpret returned data from present and past missions; and (4) evaluate future mission and instrument concepts prior to selection for flight. Data management plans are now required for these programs, but the collected data are still not generally available to the community. There is also little possibility to re-analyze the collected materials by other techniques, since there is no requirement to archive collected samples. The Planetary Materials Database (PMD) is a central, high-quality, long-term data repository, which aims to promote the field of astrobiology and increase scientific returns from NASA funded research by enabling data sharing, collaboration and exposure of non-NASA scientists to NASA research initiatives and missions. The PMD is a linked collection of databases developed using the Open Data Repository (ODR) system. The PMD will include detailed descriptions of terrestrial analog planetary materials as well as data from the instruments used in their analysis. The goal is to provide example patterns/spectra/analyses, etc. and background information suitable for use by the Space Science community. An early example showing the utility of these databases (although not in the ODR format) is the RRUFF mineral database. RRUFF, comprising 4,000+ pure mineral standards, is the most popular and widely used dataset of minerals and receives more than 180,000 queries per week from geologists and mineralogists worldwide. The PMD will be patterned after the CheMin database [3], a resource that contains all of the data collected by the MSL CheMin XRD instrument on Mars. Raw and processed CheMin data can be viewed, downloaded, reprocessed and reanalyzed using cloud-based “applications” linked to the data.

Blake, David↗

NASA NTRSDate not supplied

Advancing Open Science in Atmospheric Research: Integrating Data Usability and Machine Learning

In the dynamic realm of atmospheric sciences, the convergence of data science methodologies and open data marks a transformative era, driving research advancements and nurturing aspiring scientists. This abstract highlights two pivotal projects that epitomize open science principles, aligning seamlessly with the session's objective of interdisciplinary synergy and the cultivation of emerging talent. As a NASA-certified data center, our foremost endeavor focuses on enhancing the visibility and traceability of NASA datasets within atmospheric science research. This initiative not only elevates these datasets' prominence but also establishes a robust framework ensuring their credibility in scholarly discourse. By bridging the gap between data sources and research publications, this project serves as an educational catalyst, nurturing a new generation of scholars in open collaboration and dataset authenticity. Concurrently, our second project pioneers an early warning system for flooding events, utilizing machine learning algorithms to predict flooded fractions. Through multi-source data fusion and predictive modeling, this initiative goes beyond forecasting; it embodies the core of open science by enabling proactive risk mitigation strategies. This project not only advances atmospheric sciences but also fosters an environment where young scholars engage in practical, data-driven solutions. These intertwined projects exemplify the fusion of data science with open data solutions, ensuring both the usability of quality datasets and the cultivation of scientific knowledge among emerging scholars. By spotlighting these impactful use cases, our aim is to foster discussions emphasizing the importance of open collaboration, data integrity, and the nurturing of scientific talent in atmospheric sciences." "In the dynamic realm of atmospheric sciences, the convergence of data science methodologies and open data marks a transformative era, driving research advancements and nurturing aspiring scientists. This abstract highlights two pivotal projects that epitomize open science principles, aligning seamlessly with the session's objective of interdisciplinary synergy and the cultivation of emerging talent. As a NASA-certified data center, our foremost endeavor focuses on enhancing the visibility and traceability of NASA datasets within atmospheric science research. This initiative not only elevates these datasets' prominence but also establishes a robust framework ensuring their credibility in scholarly discourse. By bridging the gap between data sources and research publications, this project serves as an educational catalyst, nurturing a new generation of scholars in open collaboration and dataset authenticity. Concurrently, our second project pioneers an early warning system for flooding events, utilizing machine learning algorithms to predict flooded fractions. Through multi-source data fusion and predictive modeling, this initiative goes beyond forecasting; it embodies the core of open science by enabling proactive risk mitigation strategies. This project not only advances atmospheric sciences but also fosters an environment where young scholars engage in practical, data-driven solutions. These intertwined projects exemplify the fusion of data science with open data solutions, ensuring both the usability of quality datasets and the cultivation of scientific knowledge among emerging scholars. By spotlighting these impactful use cases, our aim is to foster discussions emphasizing the importance of open collaboration, data integrity, and the nurturing of scientific talent in atmospheric sciences.

Jennifer Wei↗

DOE OSTI2021

SoDaH: the SOils DAta Harmonization database, an open-source synthesis of soil data from research networks, version 1.0

Data collected from research networks present opportunities to test theories and develop models about factors responsible for the long-term persistence and vulnerability of soil organic matter (SOM). Synthesizing datasets collected by different research networks presents opportunities to expand the ecological gradients and scientific breadth of information available for inquiry. Synthesizing these data is challenging, especially considering the legacy of soil data that have already been collected and an expansion of new network science initiatives. To facilitate this effort, here we present the SOils DAta Harmonization database (SoDaH; https://lter.github.io/som-website, last access: 22 December 2020), a flexible database designed to harmonize diverse SOM datasets from multiple research networks. SoDaH is built on several network science efforts in the United States, but the tools built for SoDaH aim to provide an open-access resource to facilitate synthesis of soil carbon data. Moreover, SoDaH allows for individual locations to contribute results from experimental manipulations, repeated measurements from long-term studies, and local- to regional-scale gradients across ecosystems or landscapes. Finally, we also provide data visualization and analysis tools that can be used to query and analyze the aggregated database. The SoDaH v1.0 dataset is archived and available at https://doi.org/10.6073/pasta/9733f6b6d2ffd12bf126dc36a763e0b4 (Wieder et al., 2020).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Pseudonymization at Scale: OLCF’s Summit Usage Data Case Study

The analysis of vast amounts of data and the processing of complex computational jobs have traditionally relied upon high performance computing (HPC) systems, which offer reliable and efficient management of large-scale computational and data resources. Understanding these analyses’ needs is paramount for designing solutions that can lead to better science, and similarly, understanding the characteristics of the user behavior on those systems is important for improving user experiences on HPC systems. A common approach to gathering data about user behavior is to extract workload characteristics from system log data available only to system administrators. Recently at Oak Ridge Leadership Computing Facility (OLCF), however, we unveiled user behavior about the Summit supercomputer by collecting data from a user’s point of view with ordinary Unix commands.In this paper, we discuss the process, challenges, and lessons learned while preparing this dataset for publication and submission to an open data challenge. The original dataset contains personal identifiable information (PII) about the users of OLCF which needed be masked prior to publication, and we determined that anonymization, which scrubs PII completely, destroyed too much of the structure of the data to be interesting for the data challenge. We instead chose to pseudonymize the dataset, which reduced the linkability of the dataset to the users’ identities. Pseudonymization is significantly more computationally expensive than anonymization, and the size of our dataset, which is approximately 175 million lines of raw text, necessitated the development of a parallelized workflow that could be reused on different HPC machines. We demonstrate the scaling behavior of the workflow on two leadership class HPC systems at OLCF, and we show that we were able to bring the overall makespan time from an impractical 20+ hours on a single node down to around 2 hours. As a result of this work, we release the entire pseudonymized dataset and make the workflows and source code publicly available.

Maheshwari, Ketan↗

DOE OSTI2024

Quantum Vision Transformers for Quark–Gluon Classification

We introduce a hybrid quantum-classical vision transformer architecture, notable for its integration of variational quantum circuits within both the attention mechanism and the multi-layer perceptrons. The research addresses the critical challenge of computational efficiency and resource constraints in analyzing data from the upcoming High Luminosity Large Hadron Collider, presenting the architecture as a potential solution. In particular, we evaluate our method by applying the model to multi-detector jet images from CMS Open Data. The goal is to distinguish quark-initiated from gluon-initiated jets. We successfully train the quantum model and evaluate it via numerical simulations. Using this approach, we achieve classification performance almost on par with the one obtained with the completely classical architecture, considering a similar number of parameters.

Comajoan Cara, Marçal (ORCID:0009000126263752)↗

DOE OSTI2020

GBCGE Subsurface Database Explorer and APIs

This submission defines a DOI for the Great Basin Center for Geothermal Energy's (GBCGE) Subsurface Database Explorer web application and underlying data services, and acknowledges the INGENIOUS project as a major source of funding for data compilation and quality assurance. The GBCGE Subsurface Database Explorer is an interactive web mapping application that provides public access to the GBCGE Subsurface Database, and its collection of datasets pertinent to geothermal exploration, oil and gas exploration, critical mineral exploration, and other subsurface characterization for the Great Basin Region, western US. This is a living database, and will be continuously updated with new data and datasets as funding and motivations allow. The underlying database views that populate the web application are on an automated refresh schedule. Data sources and acknowledgements: We thank our partners with the Nevada Division of Minerals (NDOM), the Southern Methodist University (SMU), and Great Basin State Geological Surveys for their active efforts in data curation, schema design, and quality assurance. We also thank contributors among the USGS, Oregon Institute of Technology, State Divisions of Water Resources, State Divisions of Oil, Gas, and Minerals, and State Geological Surveys for open data availability and direct contributions made under the National Geothermal Data System (NGDS).

15 GEOTHERMAL ENERGY↗

DOE OSTI2022

Hierarchical Conceptual Model Event and Activity Domains for Forecasting State-Sponsored Civil Nuclear Power Activities

In FY20, the Savannah River National Laboratory and the Sanghani Center for Artificial Intelligence and Data Analytics (Virginia Tech) entered a collaboration funded by the Department of Energy’s Office of Defense Nuclear Nonproliferation Research and Development to develop a machine learning based modeling pipeline to extract proliferation events of interest from open data sources. The prototype modeling pipeline that was developed relies on the use of time dependent word embedding models to identify contextual shifts in key words and phrases that act as indicators of events of interest. The FY20- 21 efforts were focused on a narrow topical domain of forecasting “fissile core fabrication” at the Savannah River Site prior to its official announcement in 2018. In FY22, the research team was funded to continue development of the modeling pipeline by applying it to the problem of forecasting new, and/or significant changes to existing, civil nuclear power reactors around the world. In this effort, the development will focus on proving applicability to a broader topical domain and in data environments that may contain more sparse information, relative to the United States. In this report, the worldwide landscape of civil nuclear reactors is outlined, the timeline of interest is defined, and a hierarchical conceptual model is established to identify the activity domains of interest and the event domains of interest. This preliminary effort will guide the curation of a glossary of key terms for data acquisition, as well as the downstream modeling efforts.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2025

Open Source Intelligence for Cybersecurity Events via Twitter Data

Open-Source Intelligence (OSINT) is largely regarded as a necessary component for cybersecurity intelligence gathering to secure network systems. With the advancement of artificial intelligence (AI) and increasing usage of social media, like Twitter, we have a unique opportunity to obtain and aggregate information from social media. In this study, we propose an AI-based scheme capable of automatically pulling information from Twitter, filtering out security-irrelevant tweets, performing natural language analysis to correlate the tweets about each cybersecurity event (e.g., a malware campaign), and validating the information. This scheme has many applications, such as providing a means for security operators to gain insight into ongoing events and helping them prioritize vulnerabilities to deal with. To give examples of the possible uses, we present three case studies demonstrating the event discovery and investigation processes. We also examine the potential of OSINT for identifying the network protocols associated with specific events, which can aid in the mitigation procedures by informing operators if the vulnerability is exploitable given their system’s network configurations.

Dale, Dakota↗

NASA NTRSDate not supplied

Improving Satellite-Based Hotspot Detection Through Deep Learning-Enabled Smoke Recognition

While geostationary satellites, such as the GOES-R series, provide wildland fire hotspot readings at a high temporal resolution, they are prone to false negative readings and decreased confidence. One cause of decreased hotspot confidence is cloud contamination. Smoke produced from wildfire is often misinterpreted as cloud contamination, resulting in inaccurate and unsure sensor readings. To this end, we built a deep learning image segmentation model to identify smoke and cloud in true color satellite images. The model is pre-trained using self-supervised learning on over 10,000 GOES-R images to learn the underlying structure of satellite imagery. Then, the model is fine-tuned on a set of 130 labeled documents using supervised learning. The resulting model performs multi-class image segmentation with 85% accuracy and runs in under a minute on a standard personal computer. When paired alongside hotspot data, the model’s outputs can help increase confidence in wildfire location by identifying cases of cloud contamination that are due to smoke. The resulting model can be deployed in a stand-alone application or bundled in an Open Data Integration for wildland fire management (ODIN) application.

Earth observation↗

DOE OSTI2024

An Accurate and Automated Convective Vortex Detection Method for Long-Duration Infrasound Microbarometer Data

Heating of the surficial layer of the atmosphere often generates convective vortices, known as “dust devils” when they entrain visible debris. Convective vortices are common on both Earth and Mars, where they affect the climate via dust loading, contribute to wind erosion, impact the efficiency of photovoltaic systems, and potentially result in injury and property damage. However, long-duration terrestrial convective vortex activity records are rare. We have developed a high-precision and high-recall method to extract convective vortex signatures from infrasound microbarometer data streams. The techniques utilizes a wavelet-based detector to capture potential events and then a template matching system to extract the duration of the vortex. Since permanent and temporary infrasound sensors networks are present throughout the globe (many with open data), our method unlocks a vast new convective vortex dataset without requiring the deployment of specialized instrumentation.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

A FAIR and AI-ready Higgs boson decay dataset

Abstract To enable the reusability of massive scientific datasets by humans and machines, researchers aim to adhere to the principles of findability, accessibility, interoperability, and reusability (FAIR) for data and artificial intelligence (AI) models. This article provides a domain-agnostic, step-by-step assessment guide to evaluate whether or not a given dataset meets these principles. We demonstrate how to use this guide to evaluate the FAIRness of an open simulated dataset produced by the CMS Collaboration at the CERN Large Hadron Collider. This dataset consists of Higgs boson decays and quark and gluon background, and is available through the CERN Open Data Portal. We use additional available tools to assess the FAIRness of this dataset, and incorporate feedback from members of the FAIR community to validate our results. This article is accompanied by a Jupyter notebook to visualize and explore this dataset. This study marks the first in a planned series of articles that will guide scientists in the creation of FAIR AI models and datasets in high energy particle physics.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

MicroBooNE Public Data Sets: a Collaborative Tool for LArTPC Software Development

Among liquid argon time projection chamber (LArTPC) experiments MicroBooNE is the one that continually took physics data for the longest time (2015-2021), and represents the state of the art for reconstruction and analysis with this detector. Recently published analyses include oscillation physics results, searches for anomalies and other BSM signatures, and cross section measurements. LArTPC detectors are being used in current experiments such as ICARUS and SBND, and being planned for future experiments such as DUNE. MicroBooNE has recently released to the public two of its data sets, with the goal of enabling collaborative software developments with other LArTPC experiments and with AI or computing experts. These data sets simulate neutrino interactions on top of off-beam data, which include cosmic ray background and noise. The data sets are released in two formats: the native art/ROOT format used internally by the collaboration and familiar to other LArTPC experts, and the HDF5 format which contains reduced and simplified content and is suitable for usage by the broader community. This contribution presents the open data sets, discusses their motivation, the technical implementation, and the extensive documentation -- all inspired by FAIR principles. Finally, opportunities for collaborations are discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

Fossil fuel CO 2 emissions over metropolitan areas from space: A multi-model analysis of OCO-2 data over Lahore, Pakistan

Urban areas, where gathering more than 55% of the global population, alone contributed to more than 70% of anthropogenic fossil fuel carbon dioxide (CO 2ff ) emissions. Accurate quantification of CO 2ff emissions from urban areas is of great importance to the formulation of global warming mitigation policies to achieve carbon neutrality by 2050. Satellite-based inversion techniques are unique among “top-down” approaches, potentially allowing us to track CO 2ff emission changes over cities globally. However, its accuracy is still limited by incomplete background information, cloud blockages, aerosol contaminations, and uncertainties in models and emission inventories used as prior. To evaluate the current potential of space-based quantification techniques, we present the first attempt to monitor long-term changes in CO 2ff emissions based on the OCO-2 satellite measurements of column-averaged dry-air mole fractions of CO 2 (X CO2 ) over a fast-growing Asian metropolitan area: Lahore, Pakistan. We first examined the OCO-2 data availability at global scale. About 17% of OCO-2 soundings are marked as high-quality soundings by quality flags over the global 70 most populated cities over the period 2014-2019. Cloud blockage and aerosol contamination are the two main causes of data loss. As an attempt to recover additional soundings, we evaluated the effectiveness of OCO-2 quality flags at the city level by comparing three flux quantification methods (WRF-Chem, X-STILT, and flux cross-sectional integration method), all based on the Open-Data Inventory for Anthropogenic Carbon dioxide (ODIAC) product. The satellite/bottom-up emissions (OCO-2/ODIAC) ratios of the high-quality tracks better converged across the three methods compared to the all-data tracks with reduced uncertainties in emissions. Thus, OCO-2 quality flags are useful filters of low-quality OCO-2 retrievals at local scales, although originally designed for global-scale studies. All three methods consistently suggested that the ratio medians are greater than 1, which implies that the ODIAC slightly underestimated the CO2ff emissions over Lahore. Additionally, our estimation of the a posteriori CO2ff emission trend was about 734 kt C/year (i.e., an annual 6.7% increase). 10,000 Monte Carlo simulations of the Mann-Kendall upward trend test showed that less than 10% prior uncertainty for 8 tracks (or less than 20% prior uncertainty for 25 tracks) is required to achieve a greater-than-50% trend significant possibility at a 95% confidence level. It implies that the trend is driven by the prior and not due to the assimilation of OCO-2 retrievals. The key to improving the role of satellite data in CO 2 emission trend detection lies in collecting more frequent high-quality tracks near metropolitan areas to achieve significant constraints from X CO2 retrievals.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Second Report of the Nuclear Data Subcommittee of the Nuclear Science Advisory Committee

The central importance of the nuclear data curated by the US Nuclear Data Program (USNDP) for clean energy generation, national security, nonproliferation, medical applications, and space exploration as well as basic science was described in a prior report issued by the DOE/NSF Nuclear Science Advisory Committee subcommittee on Nuclear Data (NSAC-ND) in September 2022. In this report, we present a set of fourteen (14) recommendations that will enhance and advance DOE-NP's stewardship of nuclear data. The first three recommendations focus on the existing core USNDP capabilities, namely: 1) Support the nuclear structure evaluation workforce to improve the currency, consistency, and accessibility of the Evaluated Nuclear Structure Data File (ENSDF); 2) Enhance nuclear reaction evaluation within the USNDP in support of the Evaluated Nuclear Data File (ENDF) through expansion of the workforce and integration of high-performance computing, automation, and machine learning and; 3) Continue atomic mass evaluation in support AME and NUBASE databases. This is followed by eight (8) recommendations representing new cross-cutting initiatives involving both measurement and evaluation to address outstanding nuclear data needs. These new initiatives require a highly trained, diverse workforce that includes personnel with expertise from both inside and outside the nuclear physics community from which evaluators have traditionally been recruited. As such, many of these initiatives are accomplished via a Topical Nuclear Data Collaborations (TNDC). A TNDC is made up of domestic and international stakeholders, subject matter and nuclear data experts, and nuclear data evaluators and features a workforce development plan to ensure that nuclear data evaluators maintain currency in the relevant applications and are seen as equity partners in the endeavor. These include: 1) Establish a coordinated effort to improve evaluation and modeling in nuclear astrophysics for stellar dynamics, multi-messenger astronomy and nucleosynthesis; 2) Initiate a TNDC to develop and maintain nuclear structure evaluation beyond discrete states, including nuclear level densities, photon strength functions and photonuclear data for improved reaction modeling, and exploring nuclear structure at finite temperature; 3) Create a TNDC to perform correlated fission data evaluation, including cross sections, fragment yields, v(A), v(E n ) for nuclear energy, national security, nonproliferation and basic science; 4) From a panel of subject matter experts to establish and annually update a roster of key decay data to nurture its accelerated dissemination including both measurement and evaluation for targeted high-value nuclides for national security, nonproliferation and medical applications; 5) Comprehensive, consistent neutron-induced structure and reaction data for nuclear energy, national security, nonproliferation and planetary nuclear spectroscopy; 6) Charged-particle stopping powers for detector design, space effects and ion beam therapy; 7) High-energy reactions for space exploration and medical nuclide production, and; 8) The creation of an infrastructure for open data and data preservation for use by the entire nuclear physics community. All told, these initiatives require approximately $6.5M increase in NP support of the USNDP in fiscal year 2023 dollars and would require at least 3-5 years to carry out due to the length of time needed to recruit and train new nuclear data researchers. This relatively modest investment would help ensure that the fruits of the nuclear data research carried out by DOE-NP and its collaborators would be brought to bear to address some of the most important needs of our nation and the world. To ensure effective execution of this plan, we present an overview of recruitment, training, and retention goals for the USNDP, the centerpiece of which is a mutually agreed upon code of conduct. Finally, we identify the facility and instrumentation needed to perform the recommended experimental activities. This includes a short review of target fabrication capabilities, reactors, neutron beam, light- and heavy-stable ion, gamma-ray, high-energy and radioactive ion beam facilities. Lastly, a more complete appendix of experimental facilities previously compiled is included with new input provided for 6 facilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS2016

Toward a New Generation of Agricultural System Data, Models, and Knowledge Products: State of Agricultural Systems Science

We review the current state of agricultural systems science, focusing in particular on the capabilities and limitations of agricultural systems models. We discuss the state of models relative to five different Use Cases spanning field, farm, landscape, regional, and global spatial scales and engaging questions in past, current, and future time periods. Contributions from multiple disciplines have made major advances relevant to a wide range of agricultural system model applications at various spatial and temporal scales. Although current agricultural systems models have features that are needed for the Use Cases, we found that all of them have limitations and need to be improved. We identified common limitations across all Use Cases, namely 1) a scarcity of data for developing, evaluating, and applying agricultural system models and 2) inadequate knowledge systems that effectively communicate model results to society. We argue that these limitations are greater obstacles to progress than gaps in conceptual theory or available methods for using system models. New initiatives on open data show promise for addressing the data problem, but there also needs to be a cultural change among agricultural researchers to ensure that data for addressing the range of Use Cases are available for future model improvements and applications. We conclude that multiple platforms and multiple models are needed for model applications for different purposes. The Use Cases provide a useful framework for considering capabilities and limitations of existing models and data.

Livestock models↗

NASA NTRSDate not supplied

Building a Real-Time Flood Prediction Model for Improving Early Warning Systems in Ellicott City, Maryland

As flood events in the United States grow in frequency and intensity, the use of applied remote sensing analyses is increasingly necessary for effective flood monitoring and warning systems. The NASA DEVELOP National Program partnered with the local government of Howard County, Maryland, to investigate the use of machine learning for advanced flood risk detection, and to test the feasibility of integrating this approach into the county’s flood early warning system. To strengthen the efforts of the Howard County Office of Emergency Management (OEM), the project developed a statistical model capable of hindcasting the two severe flash flood events that devastated Ellicott City and transitioned to a ‘Long Short-Term Memory’ based sequence-to-sequence deep learning model with 8-hour forecast capability. The team combined data inputs from public sources including river and precipitation gauges, NASA and NOAA Earth observations, and numerical weather model products using scripts written in the Google Colaboratory Python scripting environment. In addition to designing the deep learning architecture, the team trained and tested the model, and evaluated its performance using Nash-Sutcliffe Efficiency. The final product, the Sequentially Trained Real-time EstimAted Model (STREAM) predicts stage height for the Hudson Branch gauge in Ellicott City using data products available in near real-time, including the High-Resolution Rapid Refresh model’s accumulated precipitation forecasts supplemented by stream gauge data from the OEM and the U.S. Geological Survey. STREAM was incorporated into an online dashboard in a user-friendly interface capable of triggering the alarms that initiate emergency response protocols up to 8 hours in advance of a predicted severe flood event. The project demonstrated the potential for the integration of open data and Earth observations into a flood risk forecasting tool capable of informing near real-time decision making.

NASA DEVELOP↗

NASA NTRS2015

The Role and Evolution of NASA's Earth Science Data Systems

One of the three strategic goals of NASA is to Advance understanding of Earth and develop technologies to improve the quality of life on our home planet (NASA strategic plan 2014). NASA's Earth Science Data System (ESDS) Program directly supports this goal. NASA has been launching satellites for civilian Earth observations for over 40 years, and collecting data from various types of instruments. Especially since 1990, with the start of the Earth Observing System (EOS) Program, which was a part of the Mission to Planet Earth, the observations have been significantly more extensive in their volumes, variety and velocity. Frequent, global observations are made in support of Earth system science. An open data policy has been in effect since 1990, with no period of exclusive access and non-discriminatory access to data, free of charge. NASA currently holds nearly 10 petabytes of Earth science data including satellite, air-borne, and ground-based measurements and derived geophysical parameter products in digital form. Millions of users around the world are using NASA data for Earth science research and applications. In 2014, over a billion data files were downloaded by users from NASAs EOS Data and Information System (EOSDIS), a system with 12 Distributed Active Archive Centers (DAACs) across the U. S. As a core component of the ESDS Program, EOSDIS has been operating since 1994, and has been evolving continuously with advances in information technology. The ESDS Program influences as well as benefits from advances in Earth Science Informatics. The presentation will provide an overview of the role and evolution of NASAs ESDS Program.

Remote Sensing↗