Search NASA⌕ Search

SEARCH · Search NASA

Results for “synthetic data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Application of the DNAS framework expansion to occupant population synthesis

Research in occupant behaviour is now using a more elaborate framework of building occupant interaction. Researchers often face challenges in collecting data, particularly for the data to meet the minimum number of required data points and the data interoperability requirements. Researchers address the first issue with the synthetic population and the latter with data ontologies. While synthetic population is commonly used to address the first issue, data ontology development is used to address the latter. The two solutions are complementary to each other. One of the known ontologies in building occupant behaviour research is the Drivers-Needs-Actions-Systems (DNAS) ontology, which has been used by building modelers to describe energy-related occupant behaviour. This paper describes the ontology-based synthetic population generation that can be used in the agent-based modeling (ABM) applications. This paper considers multiple data sources, including ASHRAE Thermal Comfort DB II and IEA Annex 66 data sets. A case study of an office building is used to present the workflow of DNAS framework expansion, synthetic population generation, and agent-based modeling.

Chandra Putra, Handi↗
NASA NTRS1987

A critical review of measurements of water vapor absorption in the 840 to 1100 cm(-1) spectral region

A set of eleven measurements of the water vapor continuum absorption in the 840 to 1100 sq cm spectral region is reviewed and compared with spectral models maintained by the Air Force Geophysics Laboratory. The measurements were made in four different ways: spectrometer with a White cell, CO2 laser with a White cell, CO2 laser with a spectrophone, and broadband radiation source over a long atmospheric path. Where possible, the data were selected at a water vapor partial pressure of ten torr buffered to 760 torr with N2 or synthetic air and a temperature of between 296 and 300 K. The intercomparison of the data leads to several observations and conclusions. First, there are four sets of laboratory data taken with nitrogen as the buffer gas which generally agree well mutually and with AFGL's HITRAN code. Second, there is one set of laboratory data that shows that using air as the buffer gas gives a few percent decrease in the water vapor continuum compared with using nitrogen as the buffer gas. Third, the atmospheric long-path measurements for water vapor partial pressure below about 12 torr are roughly grouped within 20 percent of the HITRAN values. Fourth, there are three sets of spectrophone data for water vapor in synthetic air which are significantly higher than any of the other measurements. This discrepancy is attributed to the effects of impurity gases in the cell.

Grant, William B.↗
DOE OSTI2024

Three-dimensional cooperative inversion of airborne magnetic and gravity gradient data using deep-learning techniques

Using multiple geophysical methods has become a prevailing approach in numerous geophysical applications to investigate subsurface structures and parameters. These multimethod-based exploration strategies have the potential to greatly diminish uncertainties and ambiguities encountered during geophysical data analysis and interpretation. One of the applications is the cooperative inversion of airborne magnetic and gravity gradient data for the interpretation of data obtained in mineral, oil and gas, and geothermal explorations. In this paper, a unified cooperative inversion framework is designed by combining the standard separate inversions with a deep neural network (DNN), which serves as the link between different types of data. A well-trained DNN takes the separately inverted susceptibility and density models as the inputs and provides improved models that will be used as the initial models of deterministic inversions. A two-round iteration strategy is adopted to guarantee the reasonability of the recovered models and overall efficiency of the inversion. In addition, this deep-learning (DL)-based framework demonstrates excellent generalization abilities when tested on models that are entirely distinct from the training data sets. The framework can easily incorporate multiphysics without necessitating any structural changes to the network. Synthetic experiments validate that our DL-based method outperforms conventional separate inversions and cross-gradient-based joint inversion in view of the accuracy of the recovered models and inversion efficiency. Successful application to field data further verifies the effectiveness of our DL-based method.

Geochemistry & Geophysics↗
NASA NTRSDate not supplied

Mapping Inundation from Hurricane Florence (2018) with L-Band Synthetic Aperture Radar, Commercial Imagery, and Ancillary Data via Machine Learning Classification

During and after flooding events, mapping the extent of floodwaters aids in the distribution of resources, recovery efforts, and damage assessment practices. Development of a land cover classification system focused on mapping inundation after major hurricane events using synthetic aperture radar (SAR) data could allow for the production of near-real-time inundation mapping, enabling government and emergency response entities to get a preliminary idea of a developing situation. Complimentary optical and SAR images from domestic and foreign entities are brought together through activations of the International Charter: Space and Major Disasters to support response efforts, from true-color, near-infrared, and thermal remote sensing data obtained by NASA, NOAA, and international satellites to the collection of high-resolution true color aerial photography by NOAA and the National Geodetic Survey. In response to Hurricane Florence of 2018, NASA JPL collected numerous swaths of quad-pol L-band SAR data with the Uninhabited Aerial Vehicle Synthetic Aperture Radar (UAVSAR) instrument observing the record-setting river stages across North and South Carolina. The resulting fully-polarized SAR images allow for mapping of inundation extent at a high spatial resolution with a unique advantage over optical imaging stemming from the sensor’s ability to penetrate cloud cover and dense vegetation. In this study, true-color NOAA aerial and commercial satellite imagery are used in conjunction with four UAVSAR data swaths centered on the Lumberton and Cape Fear River basins in southeastern North Carolina to develop a Random Forest classification model focused on mapping open water and floodwater otherwise obscured by vegetation or lingering cloud cover. Ancillary building footprint, transportation route, and population data will also be incorporated into the classification scheme to estimate the societal impacts of flooding based on the proximity of features to detected inundation. Preliminary results from the Hurricane Florence case study will be discussed in addition to the limitations of available validation data for assessment of the classifier’s accuracy.

Alexander M Melancon↗
NASA NTRS1983

SEASAT synthetic-aperture radar data user's manual

The SEASAT Synthetic-Aperture Radar (SAR) system, the data processors, the extent of the image data set, and the means by which a user obtains this data are described and the data quality is evaluated. The user is alerted to some potential problems with the existing volume of SEASAT SAR image data, and allows him to modify his use of that data accordingly. Secondly, the manual focuses on the ultimate focuses on the ultimate capabilities of the raw data set and evaluates the potential of this data for processing into accurately located, amplitude-calibrated imagery of high resolution. This allows the user to decide whether his needs require special-purpose data processing of the SAR raw data.

Pravdo, S. H.↗
NASA NTRS2000

Estimates of Ground Temperature and Atmospheric Moisture from CERES Observations

A method is developed to retrieve surface ground temperature (T(sub g)) and atmospheric moisture using clear sky fluxes (CSF) from CERES-TRMM observations. In general, the clear sky outgoing longwave radiation (CLR) is sensitive to upper level moisture (q(sub l)) over wet regions and (T(sub g)) over dry regions The clear sky window flux from 800 to 1200/cm (RadWn) is sensitive to low level moisture (q(sub t)) and T(sub g). Combining these two measurements (CLR and RadWn), Tg and q(sub h) can be estimated over land, while q(sub h) and q(sub l) can be estimated over the oceans. The approach capitalizes on the availability of satellite estimates of CLR and RadWn and other auxiliary satellite data. The basic methodology employs off-line forward radiative transfer calculations to generate synthetic CSF data from two different global 4-dimensional data assimilation products. Simple linear regression is used to relate discrepancies in CSF to discrepancies in T(sub g), q(sub h) and q(sub l). The slopes of the regression lines define sensitivity parameters that can be exploited to help interpret mismatches between satellite observations and model-based estimates of CSF. For illustration, we analyze the discrepancies in the CSF between an early implementation of the Goddard Earth Observing System Data Assimilation System (GEOS-DAS) and a recent operational version of the European Center for Medium-Range Weather Prediction data assimilation system. In particular, our analysis of synthetic total and window region SCF differences (computed from two different assimilated data sets) shows that simple linear regression employing Delta(T(sub g)) and broad layer Delta(q(sub l) from .500 hPa to surface and Delta(q(sub h)) from 200 to .300 hPa provides a good approximation to the full radiative transfer calculations. typically explaining more than 90% of the 6-hourly variance in the flux differences. These simple regression relations can be inverted to "retrieve" the errors in the geophysical parameters. Uncertainties (normalized by standard deviation) in the monthly mean retrieved parameters range from 7% for Delta(T(sub g)) to about 20% for Delta(q(sub l)). Our initial application of the methodology employed an early CERES-TRMM data set (CLR and Radwn) to assess the quality of the GEOS2 data. The results showed that over the tropical and subtropical oceans GEOS2 is, in general, too wet in the upper troposphere (mean bias of 0.99 mm) and too dry in the lower troposphere (mean bias of -4.7 min). We note that these errors, as well as a cold bias in the T(sub g). have largely been corrected in the current version of GEOS-2 with the introduction of a land surface model, a moist turbulence scheme and the assimilation of SSM/I total precipitable water.

Wu, Man Li C.↗
NASA NTRS2000

Estimates of Ground Temperature and Atmospheric Moisture from CERES Observations

A method is developed to retrieve surface ground temperature (Tg) and atmospheric moisture using clear sky fluxes (CSF) from CERES-TRMM observations. In general, the clear sky outgoing long-wave radiation (CLR) is sensitive to upper level moisture (q(sub h)) over wet regions and Tg over dry regions The clear sky window flux from 800 to 1200 /cm (RadWn) is sensitive to low level moisture (q(sub j)) and Tg. Combining these two measurements (CLR and RadWn), Tg and q(sub h) can be estimated over land, while q(sub h) and q(sub t) can be estimated over the oceans. The approach capitalizes on the availability of satellite estimates of CLR and RadWn and other auxiliary satellite data. The basic methodology employs off-line forward radiative transfer calculations to generate synthetic CSF data from two different global 4-dimensional data assimilation products. Simple linear regression is used to relate discrepancies in CSF to discrepancies in Tg, q(sub h) and q(sub t). The slopes of the regression lines define sensitivity parameters that can be exploited to help interpret mismatches between satellite observations and model-based estimates of CSF. For illustration, we analyze the discrepancies in the CSF between an early implementation of the Goddard Earth Observing System Data Assimilation System (GEOS-DAS) and a recent operational version of the European Center for Medium-Range Weather Prediction data assimilation system. In particular, our analysis of synthetic total and window region SCF differences (computed from two different assimilated data sets) shows that simple linear regression employing (Delta)Tg and broad layer (Delta)q(sub l) from 500 hPa to surface and (Delta)q(sub h) from 200 to 500 hPa provides a good approximation to the full radiative transfer calculations, typically explaining more than 90% of the 6-hourly variance in the flux differences. These simple regression relations can be inverted to "retrieve" the errors in the geophysical parameters. Uncertainties (normalized by standard deviation) in the monthly mean retrieved parameters range from 7% for (Delta)T to about 20% for (Delta)q(sub t). Our initial application of the methodology employed an early CERES-TRMM data set (CLR and Radwn) to assess the quality of the GEOS2 data. The results showed that over the tropical and subtropical oceans GEOS2 is, in general, too wet in the upper troposphere (mean bias of 0.99 mm) and too dry in the lower troposphere (mean bias of -4.7 mm). We note that these errors, as well as a cold bias in the Tg, have largely been corrected in the current version of GEOS-2 with the introduction of a land surface model, a moist turbulence scheme and the assimilation of SSTM/I total precipitable water.

Wu, Man Li C.↗
DOE OSTI2024

Combining compositional data sets introduces error in covariance network reconstruction

Microbial communities are diverse biological systems that include taxa from across multiple kingdoms of life. Notably, interactions between bacteria and fungi play a significant role in determining community structure. However, these statistical associations across kingdoms are more difficult to infer than intra-kingdom associations due to the nature of the data involved using standard network inference techniques. We quantify the challenges of cross-kingdom network inference from both theoretical and practical points of view using synthetic and real-world microbiome data. We detail the theoretical issue presented by combining compositional data sets drawn from the same environment, e.g. 16S and ITS sequencing of a single set of samples, and we survey common network inference techniques for their ability to handle this error. We then test these techniques for the accuracy and usefulness of their intra- and inter-kingdom associations by inferring networks from a set of simulated samples for which a ground-truth set of associations is known. We show that while the two methods mitigate the error of cross-kingdom inference, there is little difference between techniques for key practical applications including identification of strong correlations and identification of possible keystone taxa (i.e. hub nodes in the network). Furthermore, we identify a signature of the error caused by transkingdom network inference and demonstrate that it appears in networks constructed using real-world environmental microbiome data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Combining compositional data sets introduces error in covariance network reconstruction

Microbial communities are diverse biological systems that include taxa from across multiple kingdoms of life. Notably, interactions between bacteria and fungi play a significant role in determining community structure. However, these statistical associations across kingdoms are more difficult to infer than intra-kingdom associations due to the nature of the data involved using standard network inference techniques. We quantify the challenges of cross-kingdom network inference from both theoretical and practical points of view using synthetic and real-world microbiome data. We detail the theoretical issue presented by combining compositional data sets drawn from the same environment, e.g. 16S and ITS sequencing of a single set of samples, and we survey common network inference techniques for their ability to handle this error. We then test these techniques for the accuracy and usefulness of their intra- and interkingdom associations by inferring networks from a set of simulated samples for which a ground-truth set of associations is known. We show that while the two methods mitigate the error of cross-kingdom inference, there is little difference between techniques for key practical applications including identification of strong correlations and identification of possible keystone taxa (i.e. hub nodes in the network). Furthermore, we identify a signature of the error caused by transkingdom network inference and demonstrate that it appears in networks constructed using real-world environmental microbiome data.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1984

The p-wave upper mantle structure beneath an active spreading centre - The Gulf of California

Over 1400 seismograms of earthquakes in Mexico are analyzed and data sets for the travel time, apparent phase velocity, and relative amplitude information are utilized to produce a tightly constrained, detailed model for depths to 900 km beneath an active oceanic ridge region, the Gulf of California. The data are combined by first inverting the travel times, perturbing that model to fit the p-delta data, and then performing trial and error synthetic seismogram modelling to fit the short-period waveforms. The final model satisfies all three data sets. The ridge model is similar to existing upper mantle models for shield, tectonic-continental, and arc-trench regimes below 400 km, but differs significantly in the upper 350 km. Ridge model velocities are very low in this depth range; the model 'catches up' with the others with a very large velocity gradient from 225 to 390 km.

Walck, M. C.↗
NASA NTRS1991

Multifrequency polarimetric synthetic aperture radar observations of sea ice

The present study introduces a fully polarimetric airborne SAR data set of sea ice. Images were acquired in the Beaufort, Bering, and Chukchi seas in March 1988. Statistics of the magnitude, phase, and polarization of complex backscattered signals recorded by three-frequency SAR are examined for various scenes with different ice characteristics. Results indicate that combinations of frequency and polarization enhance current capability to distinguish ice of different properties using single-frequency fixed-polarization-microwave radar. A specific example is the polarimetric identification of new ice formation which may not be easily distinguished in ERS-1 5.3-GHz VV polarization of SAR data. Such findings are consistent with theoretical model simulations of scattering characteristics of sea ice.

Drinkwater, Mark R.↗
NASA NTRSDate not supplied

HydroSAR: A Cloud-based SAR Data Analysis Service to Monitor Hydrological Disasters and their Impact on Population and Agriculture

Weather-related hazards are ubiquitous around the world including: 1) hurricane storm surges, 2) rapid snowmelt and heavy rainfall, 3) severe weather leading to flash floods, and 4) seasonal freeze and thaw of rivers that may lead to ice jams. Each of these hazards affects human settlements and has the potential to impact agricultural productivity. In each setting, end-users in disaster management need access to data processing tools helpful in mapping past and current disasters. Analysis of past events supports risk mitigation by understanding what has already occurred and how to alleviate those impacts in the future. Having capabilities to generate the same products in a response setting means that lessons learned from risk analysis will carry forward to event response. Synthetic aperture radar (SAR) data are particularly useful for these activities due to their all-weather 24/7 monitoring capabilities. In this effort we present HydroSAR, a cloud-based SAR data analysis service for the mapping of meteorological and hydrological disasters as well as their impact on population and agriculture. As part of this project we have developed a series of SAR-based value added products for the monitoring of surface hydrology (image time series, change detection, flood extent, flood depth) and the assessment of impacts on population (flood depth) and agriculture (active agriculture, inundated agriculture, flood duration). We also developed a cloud-based platform for generating these products over affected areas and are working with end-users to integrate derived product into decision-making workflows The paper will briefly introduce the SAR-based products that were developed for this effort. We describe the cloud-based production pipeline that was built to automatically generate these products in near-real time over extended regions. The integration of SAR-based information into hazard preparation and response activities is described for a number of recent disasters including the 2019 forest fires in Alaska, 2019 flooding in the U.S. Midwest, the 2020 U.S. severe weather easter outbreak, 2020 tropical storm Christobal, 2020 cyclone Amphan, 2020, Alaska Spring breakup flooding, and the 2020 flood season in Eastern India, Bangladesh, and Nepal.

Franz Josef Meyer↗
NASA NTRS1990

Synthetic Aperture Radar Imagery of Airports and Surrounding Areas: Denver Stapleton International Airport

This is the third in a series of three reports which address the statistical description of ground clutter at an airport and in the surrounding area. These data are being utilized in a program to detect microbursts. Synthetic aperture radar (SAR) data were collected at the Denver Stapleton Airport using a set of parameters which closely match those which are anticipated to be utilized by an aircraft on approach to an airport. These data and the results of the clutter study are described. Scenes of 13 x 10 km were imaged at 9.38 GHz and HH-, VV-, and HV-polarizations, and contain airport grounds and facilities (up to 14 percent), cultural areas (more than 50 percent), and rural areas (up to 6 percent). Incidence angles range from 40 to 84 deg. At the largest depression angles the distributed targets, such as forest, fields, water, and residential, rarely had mean scattering coefficients greater than -10 dB. From 30 to 80 percent of an image had scattering coefficients less than -20 dB. About 1 to 10 percent of the scattering coefficients exceeded 0 dB, and from 0 to 1 percent above 10 dB. In examining the average backscatter coefficients at large angles, the clutter types cluster according to the following groups: (1) terminals (-3 dB), (2) city and industrial (-7 dB), (3) warehouse (-10 dB), (4) urban and residential (-14 dB), and (5) grass (-24 dB).

Onstott, Robert G.↗
NASA NTRS1992

Synergistic use of active and passive microwave in soil moisture estimation

Data gathered during the MACHYDRO experiment in central Pennsylvania in July 1990 have been utilized to study the synergistic use of active and passive microwave systems for estimating soil moisture. These data sets were obtained during an eleven-day period with NASA's Airborne Synthetic Aperture Radar (AIRSAR) and Push-Broom Microwave Radiometer (PBMR) over an instrumented watershed which included agricultural fields with a number of different crop covers. Simultaneous ground truth measurements were also made in order to characterize the state of vegetation and soil moisture under a variety of meteorological conditions. A combination algorithm is presented as applied to a representative corn field in the MACHYDRO watershed.

O'Neill, P.↗
NASA NTRS2006

Model Calculations of Solar Spectral Irradiance in the 3.7 Micron Band for Earth Remote Sensing Applications

Since the launch of the first Advanced Very High Resolution Radiometer (AVHRR) instrument aboard TIROS-N, measurements in the 3.7 micron atmospheric window have been exploited for use in cloud detection and screening, cloud thermodynamic phase and surface snow/ice discrimination, and quantitative cloud particle size retrievals. The utility of the band has led to the incorporation of similar channels on a number of existing satellite imagers and future operational imagers. Daytime observations in the band include both reflected solar and thermal emission energy. Since 3.7 micron channels are calibrated to a radiance scale (via onboard blackbodies), knowledge of the top-of-atmosphere solar irradiance in the spectral region is required to infer reflectance. Despite the ubiquity of 3.7 micron channels, absolute solar spectral irradiance data comes from either a single measurement campaign (Thekaekara et al. 1969) or synthetic spectra. In this study, we compare historical 3.7 micron band spectral irradiance data sets with the recent semi-empirical solar model of the quiet-Sun by Fontenla et al. (2006). The model has expected uncertainties of about 2 % in the 3.7 pm spectral region. We find that channel-averaged spectral irradiances using the observations reported by Thekaekara et al. are 3.2-4.1% greater than those derived from the Fontenla et al. model for MODIS and AVHRR instrument bandpasses; the Kurucz spectrum (1995) as included in the MODTRAN4 distribution, gives channel-averaged irradiances 1.2-1.5 % smaller than the Fontenla model. For the MODIS instrument, these solar irradiance uncertainties result in cloud microphysical retrievals uncertainties comparable with other fundamental reflectance error sources.

Platnick, Steven↗
DOE OSTI2020

How Low Can You Go? Using Synthetic 3D Imagery to Drastically Reduce Real-World Training Data for Object Detection

Deep convolutional neural networks (DCNNs) currently provide state-of-the-art performance on image classification and object detection tasks, and there are many global security mission areas where such models could be extremely useful. Crucially, the success of these models is driven in large part by the widespread availability of high-quality open source data sets such as Image Net, Common Objects in Context (COCO), and KITTI, which contain millions of images with thousands of unique labels. However, global security relevant objects-of-interest can be difficult to obtain: relevant events are low frequency and high consequence; the content of relevant images is sensitive; and adversaries and proliferators seek to obscure their activities. For these cases where exemplar data is hard to come-by, even fine-tuning an existing model with available data can be effectively impossible. Recent work demonstrated that models can be trained using a combination of real-world and synthetic images generated from 3D representations; that such models can exceed the performance of models trained using real-world data alone; and that the generated images need not be perfectly realistic (Tremblay, et al., 2018). However, this approach still required hundreds to thousands of real-world images for training and fine tuning, which for sparse, global security-relevant datasets can be an unrealistic hurdle. In this research, we validate the performance and behavior of DCNN models as we drive the number of real-world images used for training object detection tasks down to a minimal set. We perform multiple experiments to identify the best approach to train DCNNs from an extremely small set of real-world images. In doing so, we: Develop state-of-the-art, parameterized 3D models based on real-world images and sample from their parameters to increase the variance in synthetic image training data; Use machine learning explainability techniques to highlight and correct through targeted training the biases that result from training using completely synthetic images; and Validate our results by comparing the performance of the models trained on synthetic data to one another, and to a control model created by fine-tuning an existing ImageNet-trained model with a limited number (hundreds) of real-world images.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Asynchronous and Load-Balanced Union-Find for Distributed and Parallel Scientific Data Visualization and Analysis

We present a novel distributed union-find algorithm that features asynchronous parallelism and k-d tree based load balancing for scalable visualization and analysis of scientific data. Applications of union-find include level set extraction and critical point tracking, but distributed union-find can suffer from high synchronization costs and imbalanced workloads across parallel processes. In this study, we prove that global synchronizations in existing distributed union-find can be eliminated without changing final results, allowing overlapped communications and computations for scalable processing. We also use a k-d tree decomposition to redistribute inputs, in order to improve workload balancing. We benchmark the scalability of our algorithm with up to 1,024 processes using both synthetic and application data. Here, we demonstrate the use of our algorithm in critical point tracking and super-level set extraction with high-speed imaging experiments and fusion plasma simulations, respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Perspectives for self-driving labs in synthetic biology

Self-driving labs (SDLs) combine fully automated experiments and data collection with artificial intelligence (AI) and control algorithms that decide not only the set of parameters for the next experiment, but also potentially which scientific hypotheses to test. Taken to their ultimate expression, SDLs could usher a new paradigm of scientific research, where the world is probed, interpreted, and explained by machines for human benefit. Whereas there are functioning SDLs in the fields of chemistry and materials science, we contend that synthetic biology provides a unique opportunity since the genome provides a single, easily accessible, target for affecting the incredibly wide repertoire of biological cell behavior. Since they can provide large amounts of high-quality data, SDLs can be a platform for AI to develop approaches to systematically convert data into scientific knowledge systems. These knowledge systems can be used both to understand the biological world and to design bioengineered systems to fit a desired specification (inverse design). However, the level of investment required for the creation of biological SDLs is only warranted if directed towards solving difficult and enabling biological questions. Here, we discuss challenges and opportunities in creating SDLs for synthetic biology.

59 BASIC BIOLOGICAL SCIENCES↗