Search NASA⌕ Search

SEARCH · Search NASA

Results for “data representation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99
All sourcesNASA NTRSDOE OSTI
NASA NTRS1990

Neuromorphic learning of continuous-valued mappings from noise-corrupted data. Application to real-time adaptive control

The ability of feed-forward neural network architectures to learn continuous valued mappings in the presence of noise was demonstrated in relation to parameter identification and real-time adaptive control applications. An error function was introduced to help optimize parameter values such as number of training iterations, observation time, sampling rate, and scaling of the control signal. The learning performance depended essentially on the degree of embodiment of the control law in the training data set and on the degree of uniformity of the probability distribution function of the data that are presented to the net during sequence. When a control law was corrupted by noise, the fluctuations of the training data biased the probability distribution function of the training data sequence. Only if the noise contamination is minimized and the degree of embodiment of the control law is maximized, can a neural net develop a good representation of the mapping and be used as a neurocontroller. A multilayer net was trained with back-error-propagation to control a cart-pole system for linear and nonlinear control laws in the presence of data processing noise and measurement noise. The neurocontroller exhibited noise-filtering properties and was found to operate more smoothly than the teacher in the presence of measurement noise.

Troudet, Terry↗
DOE OSTI2025

A Robust Data-Driven Approach for Mechanical Serial Sectioning

Mechanical serial sectioning (MSS) provides detailed microstructural information across large length scales. By repeatedly removing thin layers of material and imaging the exposed surface, a 3D representation of a specimen’s internal structure can be constructed, enabling failure analysis and feature identification that are otherwise inaccessible via conventional 2D or nondestructive evaluation techniques. Achieving consistent and accurate material removal can be challenging due to system variability, requiring an experienced operator to manually adjust parameters, prolonging data collection times and necessitating post-processing routines to standardize the data. Here, to address these challenges, this paper presents the employment of a one-step model predictive control (MPC) framework tailored to a run-to-run (R2R) controller. The R2R-MPC controller automates the parameter selection process, improving the consistency of material removal through iterative feedback for disturbance rejection and accurate tracking of the target removal rate. Using a data-driven approach, the controller robustly adapts to changing material characteristics. The effectiveness of the R2R-MPC controller is demonstrated through simulation and experimental results and compared to previous data collection procedures.

3D Materials Science↗
NASA NTRS1973

Analysis of stratified and closely spaced jets exhausting into a crossflow

Procedures have been developed for determining the flow field about jets with velocity stratification exhausting into a crossflow. Jets with three different types of exit velocity stratification have been considered: (1) jets with a relatively high velocity core; (2) jets with a relatively low velocity core; and (3) jets originating from a vaned nozzle. The procedure developed for a jet originating from a high velocity core nozzle is to construct an equivalent nozzle having the same mass flow and thrust but having a uniform exit velocity profile. Calculations of the jet centerline and induced surface static pressures have been shown to be in good agreement with test data for a high velocity core nozzle. The equivalent ideal nozzle has also been shown to be a good representation for jets with a relatively low velocity core and for jets originating from a vaned nozzle in evaluating jet-induced flow fields. For the singular case of a low velocity core nozzle, namely a nozzle with a dead air core, and for the vaned nozzle, an alternative procedure has been developed. The internal mixing which takes place in the jet core has been properly accounted for in the equations of motion governing the jet development. Calculations of jet centerlines and induced surface static pressures show good agreement with test data these nozzles.

Ziegler, H.↗
DOE OSTI2019

Bayesian inference and predictive performance of soil respiration models in the presence of model discrepancy

Bayesian inference of microbial soil respiration models is often based on the assumptions that the residuals are independent (i.e., no temporal or spatial correlation), identically distributed (i.e., Gaussian noise), and have constant variance (i.e., homoscedastic). In the presence of model discrepancy, as no model is perfect, this study shows that these assumptions are generally invalid in soil respiration modeling such that residuals have high temporal correlation, an increasing variance with increasing magnitude of CO 2 efflux, and non-Gaussian distribution. Relaxing these three assumptions stepwise results in eight data models. Data models are the basis of formulating likelihood functions of Bayesian inference. This study presents a systematic and comprehensive investigation of the impacts of data model selection on Bayesian inference and predictive performance. We use three mechanistic soil respiration models with different levels of model fidelity (i.e., model discrepancy) with respect to the number of carbon pools and the explicit representations of soil moisture controls on carbon degradation; therefore, we have different levels of model complexity with respect to the number of model parameters. The study shows that data models have substantial impacts on Bayesian inference and predictive performance of the soil respiration models such that the following points are true: (i) the level of complexity of the best model is generally justified by the cross-validation results for different data models; (ii) not accounting for heteroscedasticity and autocorrelation might not necessarily result in biased parameter estimates or predictions, but will definitely underestimate uncertainty; (iii) using a non-Gaussian data model improves the parameter estimates and the predictive performance; and (iv) accounting for autocorrelation only or joint inversion of correlation and heteroscedasticity can be problematic and requires special treatment. Although the conclusions of this study are empirical, the analysis may provide insights for selecting appropriate data models for soil respiration modeling.

58 GEOSCIENCES↗
DOE OSTI2021

Validating deep learning inference during chest X-ray classification for COVID-19 screening

Abstract The new coronavirus unleashed a worldwide pandemic in early 2020, and a fatality rate several times that of the flu. As the number of infections soared, and capabilities for testing lagged behind, chest X-ray (CXR) imaging became more relevant in the early diagnosis and treatment planning for patients with suspected or confirmed COVID-19 infection. In a few weeks, proposed new methods for lung screening using deep learning rapidly appeared, while quality assurance discussions lagged behind. This paper proposes a set of protocols to validate deep learning algorithms, including our ROI Hide-and-Seek protocol, which emphasizes or hides key regions of interest from CXR data. Our protocol allows assessing the classification performance for anomaly detection and its correlation to radiological signatures, an important issue overlooked in several deep learning approaches proposed so far. By running a set of systematic tests over CXR representations using public image datasets, we demonstrate the weaknesses of current techniques and offer perspectives on the advantages and limitations of automated radiography analysis when using heterogeneous data sources.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1999

Hard X-Ray Detection of the High Redshift Quasar 4C 71.07

BATSE/OSSE observations of the high redshift quasar 4C 71.07 indicate that this is the brightest and furthest AGN so far detected 20 keV. BATSE Earth occultation data have been used to search for emission from 4C 71.07 from nearly 3 years of observation. The mean source flux over the- whole period in the BATSE energy range 20-100 keV is (13.2 +/- 1.06) x 10(exp -11) erg/square cm/s corresponding to a luminosity of 2 x 10(exp 48 erg/s. The BATSE light curve over the 3 years of observations shows several flare-like events, one of which (in January 1996) is associated with an optical flare (R=16.1) but with a delay of 55 days. The OSSE/BATSE spectral analysis indicates that the source is characterized by a flat power spectrum (Gamma is approximately 1.1- 1.3) when in a low state: this spectral form is consistent within errors with the ASCA and ROSAT spectra. This means that the power law observed from 0.1 to 10 keV extends up to at least 1 MeV but steepens soon after to meet EGRET high energy data. BATSE data taken around the January 1996 flare suggests that the spectrum could be steeper when the source is in a bright state. The upsilon-F-upsilon representation of the source is typical of a low frequency peaked/ gamma- ray dominated blazar, with the synchrotron peak in the mm-FIR band and the Compton peak in the MeV band. The BATSE and OSSE spectral data seem to favour a model in which the high energy - flux is due to the sum of the synchrotron self-Compton and the external Compton contributions: this is also supported by the- variability behaviour of the source.

Malizia, A.↗
NASA NTRS1987

Evaluation of flow topology from numerical data

Results obtained from numerical calculations and modern (optical) diagnostics are often too complicated for manual inspection, manipulation and display. A simpler but still accurate description of these results is needed to facilitate data understanding. The paper discusses preliminary investigations into methods for the decomposition of 2-D and 3-D fluid flow data bases into elementary structures for purposes of description, analysis and comparison. An approach which involves the development of scene-like representation of the flow topology is presented. Using features such as critical points and dividing streamlines as a basis, a representation of the global topology of the flow is generated. The topology is then represented by a graph with the various structures represented by the nodes and their relationships in the flow by the connecting lines of the graph. Once the flow field has been placed in this form, it can be studied and compared with other data sets using techniques of syntactic pattern recognition or displayed using 3-D graphics techniques.

Hesselink, Lambertus↗
DOE OSTI2025

Physics-informed latent neural operator for real-time predictions of time-dependent parametric PDEs

Deep operator network (DeepONet) has shown significant promise as surrogate models for systems governed by partial differential equations (PDEs), enabling accurate mappings between infinite-dimensional function spaces. However, when applied to systems with high-dimensional input-output mappings arising from large numbers of spatial and temporal collocation points, these models often require heavily overparameterized networks, leading to long training times. Latent DeepONet addresses some of these challenges by introducing a two-step approach: first learning a reduced latent space using a separate model, followed by operator learning within this latent space. While efficient, this method is inherently data-driven and lacks mechanisms for incorporating physical laws, limiting its robustness and generalizability in data-scarce settings. Here, in this work, we propose PI-Latent-NO, a physics-informed latent neural operator framework that integrates governing physics directly into the learning process. Our architecture features two coupled DeepONets trained end-to-end: a Latent-DeepONet that learns a low-dimensional representation of the solution, and a Reconstruction-DeepONet that maps this latent representation back to the physical space. By embedding PDE constraints into the training via automatic differentiation, our method eliminates the need for labeled training data and ensures physics-consistent predictions. The proposed framework is both memory and compute-efficient, exhibiting near-constant scaling with problem size and demonstrating significant speedups over traditional physics-informed operator models. We validate our approach on a range of parametric PDEs, showcasing its accuracy, scalability, and suitability for real-time prediction in complex physical systems.

Latent representations↗
NASA NTRS1993

Conservative force model performance for TOPEX/Poseidon precision orbit determination

The TOPEX/Poseidon spacecraft was launched on August 10, 1992 to study the Earth's oceans. To achieve maximum benefit from the altimetric data collected, mission requirements dictate that TOPEX/Poseidon's orbit must be computed at an unprecedented level of accuracy. In order to satisfy these requirements, a model which accounts for the satellite's complex geometry, attitude, and surface properties has been developed. This `box-wing' representation treats the spacecraft as the combination of flat plates arranged in the shape of a box and a connecetd solar array. The nonconservative forces acting on each of the eight surfaces are computed independently, yielding vector accelerations which are summed to compute the total aggregate effect on the satellite center-of-mass. Parameters associated with each flat plate were derived from a finite element analysis of the spacecraft. Certain parameters can be inferred from tracking data and have been adjusted to obtain a better representation of the satellite acceleration history. Changes in the nominal mission profile and the presence of an `anomalistic' force have complicated this tuning process. Model performance, parameter sensitivities, and the `anomalistic' force will be discussed.

Marshall, J. Andrew↗
DOE OSTI2022

Nonnegative canonical tensor decomposition with linear constraints: nnCANDELINC

Abstract There is an emerging interest for tensor factorization applications in big‐data analytics and machine learning. To speed up the factorization of extra‐large datasets, organized in multidimensional arrays (also known as tensors), easy to compute compression‐based tensor representations, such as, Tucker and tensor train formats, are used to approximate the initial large‐tensor. Further, tensor factorization is used to extract latent features that can facilitate discoveries of new mechanisms and signatures hidden in the data, where the explainability of the latent features is of principal importance. Nonnegative tensor factorization extracts latent features that are naturally sparse and parts of the data, which makes them easily interpretable. However, to take into account available domain knowledge and subject matter expertise, often additional constraints need to be imposed, which lead us to canonical decomposition with linear constraints (CANDELINC), a canonical polyadic decomposition with rank deficient factors. In CANDELINC, Tucker compression is used as a preprocessing step, which lead to a larger residual error but to more explainable latent features. Here, we propose a nonnegative CANDELINC (nnCANDELINC) accomplished via a specific nonnegative Tucker decomposition; we refer to as minimal or canonical nonnegative Tucker. We derive several results required to understand the specificity of nnCANDELINC, focusing on the difficulties of preserving the nonnegative rank of a tensor to its Tucker core and comparing the real valued to nonnegative case. Finally, we demonstrate nnCANDELINC performance on synthetic and real‐world examples.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Long‐Term Large‐Scale Atmospheric Forcing Data From Three‐Dimensional Constrained Variational Analysis for the ARM SGP Site

Here, this study presents a long‐term three‐dimensional large‐scale forcing data set (VARANAL3D) derived from the three‐dimensional constrained variational analysis (3DCVA) method at the Atmospheric Radiation Measurement (ARM) program Southern Great Plains (SGP) site from 2004 to 2018. Building on the same input data sets as the conventional continuous forcing data set (VARANAL), VARANAL3D maintains overall consistency in domain‐averaged fields while introducing spatial variability, offering critical insights into the influence of mesoscale synoptic systems on cloud‐related processes. Evaluations are conducted across four cloud and precipitation regimes: Clear‐sky, Shallow‐clouds, Afternoon‐precipitation, and Nocturnal‐precipitation, presenting high consistency of the domain‐mean forcing data sets while emphasizing the role of subdomain forcing variability particularly in precipitating regimes. Single column model (SCM) simulations demonstrate that subdomain VARANAL3D forcing improves cloud and precipitation representation, with the ensemble outperforming domain‐mean forcing in three cloudy and precipitating regimes. Overall, these results highlight VARANAL3D's value for investigating the impacts of spatial variability of large‐scale forcing on atmospheric processes. The VARANAL3D data set provides new opportunities for evaluating model physics, advancing the development of scale‐aware parameterizations and deepening our understanding of cloud and precipitation dynamics.

Environmental sciences↗
DOE OSTI2025

Perspectives on Systematic Cloud Microphysics Scheme Development With Machine Learning

Cloud microphysics—the collection of processes that govern the small‐scale formation, evolution, and interactions of liquid droplets and ice crystals in clouds and precipitation—remains a major source of uncertainty in weather and climate models. Although too small in scale to be explicitly resolved in any large‐eddy simulation, weather, or climate model, the representation of cloud microphysical processes has significant impact at the climate scale. Current microphysical schemes are limited by both parametric uncertainty, linked to uncertainty in physical parameter values, and structural uncertainty, arising from incomplete physical understanding of the processes at play or approximations made for computational efficiency. Recent advances in the application of machine learning (ML) to the physical sciences show significant potential for minimizing these limitations by leveraging high‐fidelity simulations and observations. Here we outline the challenges that must be addressed to apply ML toward cloud microphysics scheme development. This perspectives paper synthesizes recent progress in using data‐driven methods, including ML, to improve cloud microphysics parameterizations and highlights opportunities to address key uncertainties. We discuss the roles of aleatoric (irreducible, or statistical) and epistemic (reducible, or systematic) errors in contributing to microphysics parameterization uncertainty. ML can leverage observations to improve microphysical schemes via bottom‐up and top‐down constraints. Methods such as differentiable programming and ML‐enhanced sampling strategies and the creation of large scale benchmark data sets promise to bridge the gap between observations and models and to improve the consistency of cloud microphysical representation across temporal and spatial scales.

Lamb, Kara D. [Columbia Univ., New York, NY (Unite↗
NASA NTRSDate not supplied

Interoperable Map Services with Performance Tuning for Earth Science Data through API-Tiles and Dynamic API-Styles

NASA’s Goddard Earth Sciences Data and Information Services Center (GES DISC) provides access to a wide range of global climate data from various satellite missions and models. However, the visualization and analysis of these data can be challenging due to their large volume, complex structure, and diverse formats. This study presents the implementation of interoperable map services (API-Maps) with performance tuning using API-Tiles and dynamic API-Styles. API-Maps is a standard for defining and exposing map services through RESTful (representational state transfer) APIs (application programming interfaces). API-Tiles is a technique for generating and delivering map tiles on demand from any data source. API-Styles is a method for dynamically applying styles to map tiles based on user preferences or data attributes. The use of API-Tiles and dynamic API-Styles enhances the performance and scalability of the map services, allowing for smooth and interactive visualization of large datasets. Two types of Earth Science data sources from the NASA GES DISC are used in the experiment: regularly gridded data, such as Global Precipitation Measurement (GPM) precipitation data, and low processing level data, such as low-level data of atmospheric composite measurements from the TROPOspheric Monitoring Instrument (TROPOMI) mission. Re-gridding of swath data (low level data - e.g. Level 2) of atmospheric composites (e.g. TROPOMI products, such as nitrogen dioxide, ozone and aerosol optical depth) is applied to enable the Web-based, interoperable, tiled, and styled mapping (rendering) services of such data. The results demonstrate the effectiveness of the proposed approach in providing fast and efficient access to Earth science data through interoperable map services.

Geographic Information System↗
DOE OSTI2019

Adversarial uncertainty quantification in physics-informed neural networks

Here, we introduce a deep learning framework for quantifying and propagating uncertainty in systems governed by non-linear differential equations using physics-informed neural networks. Specifically, we employ latent variable models to construct probabilistic representations for the system states, and put forth an adversarial inference procedure for training them on data, while constraining their predictions to satisfy given physical laws expressed by partial differential equations. Such physics-informed constraints provide a regularization mechanism for effectively training deep generative models as surrogates of physical systems in which the cost of data acquisition is high, and training data-sets are typically small. This provides a flexible framework for characterizing uncertainty in the outputs of physical systems due to randomness in their inputs or noise in their observations that entirely bypasses the need for repeatedly sampling expensive experiments or numerical simulators. Moreover, we demonstrate the effectiveness of our approach through a series of examples involving uncertainty propagation in non-linear conservation laws, and the discovery of constitutive laws for flow through porous media directly from noisy data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Decoding the proton’s gluonic density with lattice QCD-informed machine learning

We present a first machine learning-based decoding of the gluonic structure of the proton from lattice QCD using a variational autoencoder inverse mapper (VAIM). Harnessing the power of generative AI, we predict the parton distribution function (PDF) of the gluon given information on the reduced pseudo-Ioffe-time distributions (RpITDs) as calculated from an ensemble with lattice spacing a ≈ 0.09 fm and a pion mass of M π ≈ 310 MeV. The resulting gluon PDF is consistent with phenomenological global fits within uncertainties, particularly in the intermediate-to-high-x region where lattice data are most constraining. A subsequent correlation analysis confirms that the VAIM learns a meaningful latent representation, highlighting the potential of generative AI to bridge lattice QCD and phenomenological extractions within a unified analysis framework.

Gluon parton distribution function↗
DOE OSTI2023

The materials experiment knowledge graph

Graph representations of hierarchical knowledge, including experiment provenances, will help usher in a new era of data-driven materials science.

Statt, Michael J.↗
DOE OSTI2018

Uncertainty analysis for infrasound waveform inversion: Application to explosion yield estimation

While the acoustic waveform inversion method is increasingly used in geophysical acoustics to constrain source parameters, the inversion results are often provided without any uncertainty analysis. Here, this study presents a probabilistic representation for acoustic waveform inversion and method to evaluate the inversion uncertainty using ground-truth data. A posteriori probability distribution of source estimate is described by a priori waveform misfit covariance and the variance of acoustic source model. The probabilistic framework is applied to local explosion infrasound to estimate the yields of explosions and uncertainty. Estimated yields showed overall good agreement with the true yields (less than 25% errors). The uncertainty of the estimated yield is represented by the sum of the waveform inversion uncertainty and source model uncertainty. It is shown that the yield uncertainty attributed to local infrasound inversion (within 10 km) is as small as the uncertainty caused by 10% prediction errors in the acoustic source model. Finally, these results indicate that the acoustic source model uncertainty should also be considered for accurate yield estimation and that local infrasound can be a valuable tool to understand the magnitude of the source uncertainty.

58 GEOSCIENCES↗
DOE OSTI2016

Transcriptome analysis in switchgrass discloses ecotype difference in photosynthetic efficiency

Background: Switchgrass, a warm-season perennial grass studied as a potential dedicated biofuel feedstock, is classified into two main taxa – lowland and upland ecotypes – that differ in morphology and habitat of adaptation. But there is limited information on their inherent molecular variations. Results: Transcriptome analysis by RNA-sequencing (RNA-Seq) was conducted for lowland and upland ecotypes to document their gene expression variations. Mapping of transcriptome to the reference genome (Panicum virgatum v1. 1) revealed that the lowland and upland ecotypes differ substantially in sets of genes transcribed as well as levels of expression. Differential gene expression analysis exhibited that transcripts related to photosynthesis efficiency and development and photosystem reaction center subunits were upregulated in lowlands compared to upland genotype. On the other hand, catalase isozymes, helix-loop-helix, late embryogenesis abundant group I, photosulfokinases, and S-adenosyl methionine synthase gene transcripts were upregulated in the upland compared to the lowlands. At ≥100x coverage and ≥5% minor allele frequency, a total of 25,894 and 16,979 single nucleotide polymorphism (SNP) markers were discovered for VS16 (upland ecotype) and K5 (lowland ecotype) against the reference genome. The allele combination of the SNPs revealed that the transition mutations are more prevalent than the transversion mutations. Conclusions: The gene ontology (GO) analysis of the transcriptome indicated lowland ecotype had significantly higher representation for cellular components associated with photosynthesis machinery controlling carbon fixation. In addition, using the transcriptome data, SNP markers were detected, which were distributed throughout the genome. The differentially expressed genes and SNP markers detected in this study would be useful resources for traits mapping and gene transfer across ecotypes in switchgrass breeding for increased biomass yield for biofuel conversion.

09 BIOMASS FUELS↗