SEARCH · Search NASA

Results for “DATASETS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

NASA NTRS2015

The Quick Fire Emissions Dataset (QFED): Documentation of Versions 2.1, 2.2 and 2.4: Technical Report Series on Global Modeling and Data Assimilation - Volume 38

Biomass burning is an important source of particulates and trace gases and a major element of the terrestrial carbon cycle. Well constrained emissions from vegetation fires are needed to model direct and indirect effects of biomass burning aerosols, to model homogeneous and heterogeneous chemistry in the atmosphere, and to perform credible Earth system analysis, and climate and air pollution studies. To improve the performance of NASA Goddard Earth Observing System Model (GEOS) in the areas of atmospheric constituent modeling with a focus on biomass burning we developed the Quick Fire Emissions Dataset (QFED). The QFED emissions are based on the fire radiative power (top-down) approach and draw on the cloud correction method developed in the Global Fire Assimilation System (GFAS). Location and fire radiative power of fires are obtained from the Moderate Resolution Imaging Spectroradiometer (MODIS) Level 2 fire products (MOD14 and MYD14) and the MODIS Geolocation products (MOD03 and MYD03). QFED strengths are high spatial and temporal resolutions and near-real time availability. Daily mean emissions are available at 0.3125 times 0.25 degrees and in recent versions also at 0.1 times 0.1 degrees. QFED provides emissions of black carbon, organic carbon, sulfur dioxide, carbon monoxide, carbon dioxide, PM2.5, ammonia, nitrogen oxides, methyl ethyl ketone, propylene, ethane, propane, n- and i-butane, acetaldehyde, formaldehyde, acetone and methane. Two QFED product systems are maintained by the NASA Global Modeling and Assimilation Office (GMAO): one that produces near real-time daily emissions used operationally in the GEOS-5 Data Assimilation System, and one that produces an extended historical dataset with daily emissions from March 2000 to the present. The historical dataset also provides monthly mean and monthly climatological emissions.

Koster, Randal D.↗

NASA NTRS2019

Google Dataset Search and CMR

Searching for earth science data from scratch has, traditionally, been a non-trivial process. Using commercial search engines a starting point, it has not been trivial to locate information and services related to a science users needs. The advent of Google Dataset Search has improved that process. CMR has leveraged the schema.org dataset feature to provide semantic markup on our collection landing pages that are used by Google Dataset Search to provide results that map directly to a scientist's needs and provide an intuitive gateway in to the NASA Earthdata environment.

CMR↗

NASA NTRS2019

Google Dataset Search and CMR

Discovery↗

NASA NTRS2020

High Spectral Resolution Datasets of in Situ Aquatic Inherent and Apparent Optical Properties

Light emerging from natural water bodies and measured by remote sensing radiometers contains information about the local type and concentrations of phytoplankton, non-algal particles and colored dissolved organic matter in the underlying waters. An increase in spectral resolution in forthcoming satellite and airborne remote sensing missions is expected to lead to new or improved capabilities to characterize aquatic ecosystems. Such upcoming missions include NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem PACE Mission; the NASA Surface Biology and Geology observable mission; and NASA Airborne Visible / Infrared Imaging Spectrometer (AVIRIS) - Next Generation airborne missions. In anticipation of these missions, we present a dataset of geographically diverse, quality-controlled, high spectral resolution inherent and apparent optical property (IOP/AOP) aquatic data. The data are intended to be of use to increase our understanding of aquatic optical properties, to develop aquatic remote sensing data product algorithms, and to perform calibration and validation activities for forthcoming aquatic-focused imaging spectrometry missions. The dataset is comprised of contributions from several investigators and investigating teams collected over a range of geographic areas and water types, including inland water, estuaries and oceans. Specific in situ measurements include particulate absorption, particulate attenuation, non-algal particulate or detritus absorption, colored dissolved organic matter absorption, phytoplankton absorption, total absorption, total attenuation, particulate backscattering, total backscatter, remote sensing reflectance, and irradiance reflectance. The dataset can be downloaded from PANGAEA: (https://www.pangaea.de/TBD ).

K A Casey↗

NASA NTRS2022

Microstructure Segmentation with Deep Learning Encoders Pre-Trained on a Large Microscopy Dataset

This study examined the improvement of microscopy segmentation accuracy by transfer learning from a large dataset of microscopy images called MicroNet. Many neural network encoder architectures, including VGG, Inception, and ResNet, were trained on over 100,000 labelled microscopy images from 54 classes. These pre-trained encoders were then embedded into multiple segmentation architectures including U-Net and DeepLabV3+ to evaluate segmentation performance on newly created benchmark microscopy datasets. Compared to ImageNet pre-training, models pre-trained on MicroNet generalized better to out-of-distribution micrographs taken under different imaging and sample conditions and were more accurate with less training data. When training with only a single Ni-superalloy image, pre-training on MicroNet produced a 72.2 percent reduction in relative segmentation error. These results suggest that transfer learning from large in-domain datasets generate models with learned feature representations that are more useful for downstream tasks and will likely improve any microscopy image analysis technique that can leverage pre-trained encoders.

machine learning↗

NASA NTRS2021

Scaling photosynthetic function and CO2 dynamics from leaf to canopy level for maize – dataset combining diurnal and seasonal measurements of vegetation fluorescence, reflectance and vegetation indices with canopy gross ecosystem productivity

Recent advances in leaf fluorescence measurements and canopy proximal remote sensing currently enable the non-destructive collection of rich diurnal and seasonal time series, which are required for monitoring vegetation function at the temporal and spatial scales relevant to the natural dynamics of photosynthesis. Remote sensing assessments of vegetation function have traditionally used actively excited foliar chlorophyll fluorescence measurements, canopy optical reflectance data and vegetation indices (VIs), and only recently passive solar induced chlorophyll fluorescence (SIF) measurements. In general, reflectance data are more sensitive to the seasonal variations in canopy chlorophyll content and foliar biomass, while fluorescence observations more closely relate to the dynamic changes in plant photosynthetic function. With this dataset we link leaf level actively excited chlorophyll fluorescence, canopy proximal reflectance and SIF, with eddy covariance measurements of gross ecosystem productivity (GEP). The dataset was collected during the 2017 growing season on maize, using three automated systems (i.e., Monitoring Pulse-Amplitude-Modulation fluorimeter, Moni-PAM; Fluorescence Box, FloX; and from eddy covariance tower). The data were quality checked, filtered and collated to a common 30 minutes timestep. We derived vegetation indices related to canopy functioning (e.g., Photochemical Reflectance Index, PRI; Normalized Difference Vegetation Index, NDVI; Chlorophyll Red-edge, Clre) to investigate how SIF and VIs can be coupled for monitoring vegetation photosynthesis. The raw datasets and the filtered and collated data are provided to enable new processing and analyses.

Petya Campbell↗

NASA NTRS2021

AI4MARS: A Dataset for Terrain-Aware Autonomy on Mars

Deep learning has quickly become a necessity for selfdriving vehicles on Earth. In contrast, the self-driving vehicles on Mars, including NASA’s latest rover, Perseverance, which is planned to land on Mars in February 2021, are still driven by classical machine vision systems. Deep learning capabilities, such as semantic segmentation and object recognition, would substantially benefit the safety and productivity of ongoing and future missions to the red planet. To this end, we created the first large-scale dataset, AI4Mars, for training and validating terrain classification models for Mars, consisting of ~326K semantic segmentation full image labels on 35K images from Curiosity, Opportunity, and Spirit rovers, collected through crowdsourcing. Each image was labeled by ~10 people to ensure greater quality and agreement of the crowdsourced labels. It also includes ~1.5K validation labels annotated by the rover planners and scientists from NASA’s MSL (Mars Science Laboratory) mission, which operates the Curiosity rover, and MER (Mars Exploration Rovers) mission, which operated the Spirit and Opportunity rovers. We trained a DeepLabv3 model on the AI4Mars training dataset and achieved over 96% overall classification accuracy on the test set. The dataset is made publicly available.1

Ono, Hiro↗

NASA NTRS2022

Microstructure Segmentation With Deep Learning Encoders Pre-Trained on a Large Microscopy Dataset

This study examined the improvement of microscopy segmentation intersection over union accuracy by transfer learning from a large dataset of microscopy images called MicroNet. Many neural network encoder architectures were trained on over 100,000 labeled microscopy images from 54 material classes. These pre-trained encoders were then embedded into multiple segmentation architectures including UNet and DeepLabV3+ to evaluate segmentation performance on created benchmark microscopy datasets. Compared to ImageNet pre-training, models pre-trained on MicroNet generalized better to out-of-distribution micrographs taken under different imaging and sample conditions and were more accurate with less training data. When training with only a single Ni-superalloy image, pre-training on MicroNet produced a 72.2% reduction in relative intersection over union error. These results suggest that transfer learning from large in-domain datasets generate models with learned feature representations that are more useful for downstream tasks and will likely improve any microscopy image analysis technique that can leverage pre-trained encoders.

machine learning↗

NASA NTRSDate not supplied

Making Dataset Quality Information FAIR: Supporting Open-Source Science and Enhancing (Re)Use and Trustworthiness of Scientific Data

- Quality information should be documented and readily shared within and across domains. - Sharing of dataset quality information supports open science and trustworthiness of scientific data. - Dataset quality is more than data quality. - Quality tends to be domain-specific and context-dependent. - Community guidelines provide practical steps towards FAIR dataset quality information.

Ge Peng↗

NASA NTRS2022

Recommendations on Funding Mission Operations and Historical Datasets

The Heliophysics Low Cost Access to Space (H-LCAS) and Flight Opportunities in Research and Technology (H-FORT) grant budgets primarily fund the development and construction of instrumentation. A side effect of this approach is that mission operations, including data collection and data processing, tend to be severely under budget (or unfunded). In order to satisfy the requirements of modern missions, we recommend a new funding source for mission operations. This funding source is increasingly vital going forward as new missions collect exponentially more data compared to past missions. Similarly, to take full advantage of underutilized historical datasets, we recommend adding another funding source to analyze these valuable datasets. Without these funding sources, mission datasets will, in the best case, be significantly underdeveloped and underutilized, and more likely, will fall dramatically short of their required scope.

Mykhaylo Shumko↗

NASA NTRSDate not supplied

The Multiplatform Precipitation Feature (MPF) Database: Synthesizing Satellite and Ground-Based Precipitation and Lightning Datasets for Convective Studies

NASA’s Lightning Imaging Sensor (LIS) and the Global Precipitation Measurement (GPM) mission have contributed a wealth of data toward global lightning and precipitation studies, respectively. Combining lightning and precipitation datasets leverages their unique insights into deep convective processes that inform about characteristics of convection and its intensity. Recent efforts to synthesize the LIS and GPM datasets prepare the opportunity for unprecedented large-scale, value-added multiplatform analyses of convection. This data synthesis proof-of-concept study elaborates on the creation of a database of reflectivity-based multiplatform precipitation features (MPFs) that capture a combination of information extracted from spatiotemporally coincident lightning and precipitation data within individual storm features. The space-based GPM Dual-frequency Precipitation Radar (DPR) provides a record of precipitation data, while the GPM Validation Network (VN) additionally incorporates ground-based polarimetric Doppler radar data to provide microphysical and kinematic context to DPR data. The LIS instrument onboard the International Space Station has contributed lightning observations since 2017. MPFs encapsulating information from these datasets are created from isolated regions of filtered, smoothed DPR reflectivity data to which ellipses are fit. Each MPF includes feature location, size, and eccentricity information as well as summary reflectivity characteristics. They also include summaries of precipitation microphysics and derived three-dimensional wind available from ground-based radar data. LIS data provides standard lightning characteristics such as flash count and density to each MPF as well as other informative metrics such as flash area and radiance. Each MPF file includes information about the original data from which the MPF and its characteristics were determined, allowing end-user reconstruction of the ellipse and deeper “level I” analysis of captured data. This database of VN-LIS MPFs enables broad statistical analysis of the relationships between the microphysical, kinematic, and electrical properties of convection. Preliminary results from a demonstration of the database will be described as well as ongoing efforts and avenues for future work.

Lightning↗

NASA NTRSDate not supplied

Low Latency Flux and Concentration Datasets in Support of Greenhouse Gas Monitoring Based on NASA's GEOS Modeling and Data Assimilation System

We present efforts to develop space-based greenhouse gas monitoring systems that can provide low latency information and traceability to independent observations. Through support from its Carbon Monitoring System program, NASA has developed the capability to assimilate XCO2 retrievals from the Orbiting Carbon Observatory, 2 (OCO-2) into the Goddard Earth Observing System (GEOS) Constituent Data Assimilation System (CoDAS) to create gap-filled, three-dimensional (3D) estimates of CO2 mixing ratio. When OCO-2 data are not available, concentration fields are further informed by a bottom-up flux package based on remotely sensed fire radiative power, nighttime lights, and vegetation reflectance combined with estimates of atmospheric growth rate based on surface in situ data. The 3D nature of this dataset supports evaluation with independent aircraft data, helping to ensure transparency of remotely sensed data products. These quasi-operational data are currently produced 2-3 months behind real time and are distributed via NASA and international dashboard services to a variety of end users. In this presentation, we provide an overview of the system as well as remaining data gaps and modeling challenges. We also highlight the application of this dataset for detecting emissions anomalies associated with COVID-19 and comparing against independent emissions estimates. Finally, we highlight a new NASA initiative called the Earth Information System (EIS), which aims to support open science and applications by leveraging emerging cloud computing capabilities to increase access to NASA’s greenhouse gas datasets, opportunities for co-development, and transparency in methods for analysis and flux attribution.

Lesley Ott↗

NASA NTRSDate not supplied

Curating AI-Ready Datasets for Equity and Environmental Justice: A Data-Centric AI Case Study

An equitable and environmentally just community is essentialin order to avoid disproportionate burden borne by vulnerablecommunities. This need becomes pressing in the aftermathof an extreme event such as disaster or hazard when it is diffi-cult for the governing bodies to implement resource allocationas per the need. Artificial Intelligence (AI) algorithms canhelp surface Equity and Environmental Justice (EEJ) issueswhen trained on EEJ datasets. However, curating AI-readyEEJ training datasets is challenging due to differences in fac-tors such as heterogeneity, resolution, modality, and level ofexpertise in labeling. Additionally, EEJ issues involve sensi-tive information where uncertainties and errors could degradethe performance of AI algorithms. For eg. Error in seasonalcrop yield information can highly affect the prediction of an-nual crop yield. To address these challenges, Data-centricAI (DCAI) methods are employed, which enhance AI algo-rithm performance even with limited training samples. DCAIprioritizes data quality, thereby reducing the adverse effectsof uncertainties and errors during the model training process.This research proposes a novel dataset and benchmark for an-alyzing the effect of the Maui Wildfire of 2023 for Equityand Environmental Justice (EEJ) issues. The proposed datasetaligns with the concepts of DCAI such as annotation quality,data preprocessing, privacy, feature engineering, governanceand provenance. We firmly believe that the proposed datasetwould lay a foundation to implement robust and reliable mod-ern AI algorithms for addressing EEJ issues.

Paridhi Parajuli↗

DOE OSTI2017

Age, Gender, and Fine-Grained Ethnicity Prediction using Convolutional Neural Networks for the East Asian Face Dataset

This paper examines the difficulty associated with performing machine-based automatic demographic prediction on a sub-population of Asian faces. We introduce the Wild East Asian Face dataset (WEAFD), a new and unique dataset to the research community. This dataset consists primarily of labeled face images of individuals from East Asian countries, including Vietnam, Burma, Thailand, China, Korea, Japan, Indonesia, and Malaysia. East Asian turk annotators were uniquely used to judge the age and fine grain ethnicity attributes to reduce the impact of the other race effect and improve quality of annotations. We focus on predicting age, gender and fine-grained ethnicity of an individual by providing baseline results with a convolutional neural network (CNN). Finegrained ethnicity prediction refers to predicting ethnicity of an individual by country or sub-region (Chinese, Japanese, Korean, etc.) of the East Asian continent. Performance for two CNN architectures is presented, highlighting the difficulty of these tasks and showcasing potential design considerations that ease network optimization by promoting region based feature extraction.

Srinivas, Nisha↗

DOE OSTI2021

Physics-Based Feature Extraction from Bulk Time-Series PMU Datasets for Event Detection

In this work, two physics-based feature extraction techniques are developed for bulk time-series phasor measurement unit (PMU) datasets collected from the field to train the machine learning model for anomaly detection. Two approaches have been developed to extract useful features for different types of events. An admittance-based feature extraction technique is developed to detect events that involve line outages and system topology variations. The developed algorithm extracts the system equivalent admittance variation. Additionally, Fielder’s Theory is utilized to further reduce the potential computation burden by sectionalizing large-scale grids and datasets into smaller areas. Second, an oscillation-based feature extraction technique is developed to detect low-frequency oscillations in power grids. The dominant oscillation modes in the grids are extracted using energy-sorted Prony analysis. The extracted dominant oscillation modes by the developed work exhibit a high fitting resolution. Finally, the developed techniques have been validated using large-scale and real-world datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Building-Level Comparison of Microsoft and Google Open Building Footprints Datasets

Large-scale datasets of building footprints are a crucial source of information for a variety of efforts. In 2023, the general public benefits from open access to multiple sources of building footprints at the country scale or larger, such as those produced by Microsoft and Google. However, none of the available datasets have attained complete global coverage, and researchers and analysts may need to combine multiple sources to assemble a complete set of building footprints for their area of interest or choose between overlapping sources, requiring an understanding of the differences between different building sources. This paper presents a method to closely examine the quality of different building footprint sources by matching corresponding buildings across datasets, using building footprints in Ethiopia published by Microsoft and Google as an example set.

Gonzales, Jack↗

DOE OSTI2018

Recharge estimation from discrete water-table datasets in a coastal shallow aquifer in a humid subtropical climate

A time-series approach to the estimation of recharge rate in unconfined aquifers of highly variable water level is proposed. The approach, which is based on the water-table fluctuation method (WTF), utilizes discrete water-level measurements. Other similar techniques require continuous measurements, which makes them impossible to apply in cases where no data from automatic loggers are available. The procedure is deployed at the Ressacada Farm site, southern Brazil, on a coastal shallow aquifer located in a humid subtropical climate where diurnal water-level variations of up to 1 m can follow a precipitation event. The effect of tidal fluctuations on the groundwater levels is analyzed using a harmonic component builder, while a time-variable drainage term is evaluated through an independent analysis and included in the assessment. The estimated recharge values are compared with those obtained from the continuous measurements showing a good agreement with the approaches for discrete dataset intervals of up to 15 days. Subsequently, the estimated recharge rates are incorporated into a transient groundwater-flow model and the water levels are compared showing a good match. Henceforth, the approach extends the applicability of WTF to noncontinuous water-level datasets in groundwater recharge studies.

58 GEOSCIENCES↗

DOE OSTI2021

Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets

A novel extension of the Probabilistic Learning on Manifolds (PLoM) is presented. It makes it possible to synthesize solutions to a wide range of nonlinear stochastic boundary value problems described by partial differential equations (PDEs) for which a stochastic computational model (SCM) is available and which depend on a vector-valued random control parameter. The cost of a single numerical evaluation of this SCM is assumed to be such that only a limited number of points can be computed for constructing the training dataset (small data). Each point of the training dataset is made up of realizations from a vector-valued stochastic process (the stochastic solution) and the associated random control parameter on which it depends. The presented PLoM constrained by PDE allows for generating a large number of learned realizations of the stochastic process and its corresponding random control parameter. These learned realizations are generated so as to minimize the vector-valued random residual of the PDE in the mean-square sense. Appropriate novel methods are developed to solve this challenging problem. Three applications are presented. The first one is a simple uncertain nonlinear dynamical system with a nonstationary stochastic excitation. The second one concerns the 2D nonlinear unsteady Navier–Stokes equations for incompressible flows in which the Reynolds number is the random control parameter. Here, the last one deals with the nonlinear dynamics of a 3D elastic structure with uncertainties. The results obtained make it possible to validate the PLoM constrained by stochastic PDE but also provide further validation of the PLoM without constraint.

Machine learning↗