Search NASA⌕ Search

SEARCH · Search NASA

Results for “DATA REDUCTION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

The Early Data Release of the Dark Energy Spectroscopic Instrument

The Dark Energy Spectroscopic Instrument (DESI) completed its 5 month Survey Validation in 2021 May. Spectra of stellar and extragalactic targets from Survey Validation constitute the first major data sample from the DESI survey. This paper describes the public release of those spectra, the catalogs of derived properties, and the intermediate data products. In total, the public release includes good-quality spectral information from 466,447 objects targeted as part of the Milky Way Survey, 428,758 as part of the Bright Galaxy Survey, 227,318 as part of the Luminous Red Galaxy sample, 437,664 as part of the Emission Line Galaxy sample, and 76,079 as part of the Quasar sample. In addition, the release includes spectral information from 137,148 objects that expand the scope beyond the primary samples as part of a series of secondary programs. Here, we describe the spectral data, data quality, data products, Large-Scale Structure science catalogs, access to the data, and references that provide relevant background to using these spectra.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Lifting MGARD: Construction of (pre)wavelets on the interval using polynomial predictors of arbitrary order

MGARD (MultiGrid Adaptive Reduction of Data) is an algorithm for compressing and refactoring scientific data, based on the theory of multigrid methods. The core algorithm is built around stable multilevel decompositions of conforming piecewise linear $C^0$ finite element spaces, enabling accurate error control in various norms and derived quantities of interest. In this work, we extend this construction to arbitrary order Lagrange finite elements $\mathbb{Q}_p$, $p \geq 0$, and propose a reformulation of the algorithm as a lifting scheme with polynomial predictors of arbitrary order. Additionally, a new formulation using a compactly supported wavelet basis is discussed, and an explicit construction of the proposed wavelet transform for uniform dyadic grids is described.

Reshniak, Viktor [Oak Ridge National Laboratory (O↗
DOE OSTI2024

Propulsion Electrification Architecture Selection Process and Cost of Carbon Abatement Analysis for Heavy-Duty Off-Road Material Handler

The heavy-duty off-road industry continues to expand efforts to reduce fuel consumption and CO 2 e (carbon dioxide equivalent) emissions. Many manufacturers are pursuing electrification to decrease fuel consumption and emissions. Future policies will likely require electrification for CO2e savings, as seen in light-duty on-road vehicles. Electrified architectures vary widely in the heavy-duty off-road space, with parallel hybrids in some applications and series hybrids in others. The diverse applications for different types of equipment mean different electrified configurations are required. Companies must also determine the value in pursuing electrified architectures; this work analyzes a range of electrified architectures, from micro hybrids to parallel hybrids to series hybrids to a BEV, looking at the total cost, total CO 2 e, and cost per CO 2 e (cost of carbon abatement, or cost of carbon reduction) using data for the year 2021. This study is focused on a heavy-duty off-road material handler, the Pettibone Cary-Lift 204i. This machine’s specialty application, including events like unloading large oil pipes from a railcar, requires a unique electrified architecture that suits its specific needs. However, the results from this study may be extrapolated to similar machinery to inform fuel savings options across the heavy-duty off-road industry. In this study, a unique electrified architecture is determined for the Cary-Lift. This architecture is informed by multiple rounds of a Pugh matrix decision analysis to select a shortened list of desirable electrified architectures. The shortened list is modeled and simulated to determine CO 2 e, cost, and cost per CO 2 e. A final architecture is determined as a plug-in series hybrid that reduces fuel consumption by 65%, targeting the large fuel and CO 2 e savings that are likely to be required for the future of the heavy-duty off-road industry.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Embedded FPGA developments in 130 nm and 28 nm CMOS for machine learning in particle detector readout

Embedded field programmable gate array (eFPGA) technology allows the implementation of reconfigurable logic within the design of an application-specific integrated circuit (ASIC). This approach offers the low power and efficiency of an ASIC along with the ease of FPGA configuration, particularly beneficial for the use case of machine learning in the data pipeline of next-generation collider experiments. An open-source framework called "FABulous" was used to design eFPGAs using 130 nm and 28 nm CMOS technology nodes, which were subsequently fabricated and verified through testing. The capability of an eFPGA to act as a front-end readout chip was assessed using simulation of high energy particles passing through a silicon pixel sensor. A machine learning-based classifier, designed for reduction of sensor data at the source, was synthesized and configured onto the eFPGA. A successful proof-of-concept was demonstrated through reproduction of the expected algorithm result on the eFPGA with perfect accuracy. Finally, further development of the eFPGA technology and its application to collider detector readout is discussed.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Real-time charged track reconstruction for CLAS12

Abstract This paper presents the results of charged particle track reconstruction in CLAS12 using artificial intelligence. In our approach, we use machine learning algorithms to reconstruct tracks, including their momentum and direction, with high accuracy from raw hits of the CLAS12 drift chambers. The reconstruction is performed in real-time, with the rate of data acquisition, and allows for the identification of event topologies in real-time. This approach revolutionizes the Nuclear Physics experiments' data processing, allowing us to identify and categorize the experimental data on the fly, and will lead to a significant reduction in experiment data processing. It can also be used in streaming readout applications leading to more efficient data acquisition and post-processing.

Instruments & Instrumentation↗
DOE OSTI2024

A flexible class of priors for orthonormal matrices with basis function-specific structure

Statistical modeling of high-dimensional matrix-valued data motivates the use of a low-rank representation that simultaneously summarizes key characteristics of the data and enables dimension reduction. Low-rank representations commonly factor the original data into the product of orthonormal basis functions and weights, where each basis function represents an independent feature of the data. However, the basis functions in these factorizations are typically computed using algorithmic methods that cannot quantify uncertainty or account for basis function correlation structure a priori. While there exist Bayesian methods that allow for a common correlation structure across basis functions, empirical examples motivate the need for basis function-specific dependence structure. We propose a prior distribution for orthonormal matrices that can explicitly model basis function-specific structure. The prior is used within a general probabilistic model for singular value decomposition to conduct posterior inference on the basis functions while accounting for measurement error and fixed effects. We discuss how the prior specification can be used for various scenarios and demonstrate favorable model properties through synthetic data examples. Finally, we apply our method to two-meter air temperature data from the Pacific Northwest, enhancing our understanding of the Earth system’s internal variability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Biogeochemical controls on iron speciation and cycling across upland to shoreline gradients in freshwater and estuarine coastal soils (Lake Erie and Chesapeake Bay, United States)

Coastal environments are dynamic interfaces that mediate carbon and nutrient exchanges between terrestrial landscapes and open waters, and understanding the biogeochemical factors controlling these exchanges, particularly iron (Fe) redox transformations, is crucial for predicting coastal ecosystem functions. Here, we investigated the mechanisms controlling Fe speciation changes across upland-to-shoreline gradients in freshwater and estuarine soils using Fe K-edge X-ray absorption spectroscopy, solid and porewater composition analysis, and 16S rRNA sequencing analysis. We show that Fe transformations depend primarily on inundation patterns. In unsaturated uplands, Fe occurs as Fe(III) oxyhydroxides, mainly goethite (9–35 %), Fe(II,III)-phyllosilicates (39–89 %), and Fe(III)-organic species (0–61 %). Soils influenced by estuarine waters exhibit porewater sulfide concentrations reaching up to 221 μM, Fe- and S-cycling bacteria, and up to 81 % pyrite (FeS 2 ), indicating that sulfur-driven redox dynamics control Fe transformations. In lacustrine wetlands, Fe(III) reduction is indicated by porewater Fe(II) concentrations increasing to 1.0–2.1 mM, and ~10–15 % of Fe as Fe(II,III)-(hydr)oxides (green rust), vivianite (Fe 3 (PO 4 ) 2 ·8H 2 O), and/or adsorbed Fe(II) species. EXAFS data also indicate reduction of structural Fe(III) to Fe(II) in phyllosilicates. The presence of Fe- and S-cycling bacteria, as well as sulfide (0–10 μM), suggests that Fe-cycling is microbially driven and potentially coupled with cryptic S-cycling. Fe(II) oxidation was indicated above/near the water table by the presence of Fe(III) oxyhydroxides (ferrihydrite, lepidocrocite). Furthermore, negligible Fe(III) or sulfate reduction was observed at some water-saturated sites located at the upland-wetland transition, likely due to oxic (sub-)surface water inputs. Overall, our results highlight the importance of considering both Fe-speciation and hydro-biogeochemical dynamics when predicting Fe-cycling at coastal interfaces.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Rapid detection of rare events from in situ X-ray diffraction data using machine learning

High-energy X-ray diffraction methods can non-destructively map the 3D microstructure and associated attributes of metallic polycrystalline engineering materials in their bulk form. These methods are often combined with external stimuli such as thermo-mechanical loading to take snapshots of the evolving microstructure and attributes over time. However, the extreme data volumes and the high costs of traditional data acquisition and reduction approaches pose a barrier to quickly extracting actionable insights and improving the temporal resolution of these snapshots. This article presents a fully automated technique capable of rapidly detecting the onset of plasticity in high-energy X-ray microscopy data. The technique is computationally faster by at least 50 times than the traditional approaches and works for data sets that are up to nine times sparser than a full data set. This new technique leverages self-supervised image representation learning and clustering to transform massive data sets into compact, semantic-rich representations of visually salient characteristics ( e.g. peak shapes). These characteristics can rapidly indicate anomalous events, such as changes in diffraction peak shapes. It is anticipated that this technique will provide just-in-time actionable information to drive smarter experiments that effectively deploy multi-modal X-ray diffraction methods spanning many decades of length scales.

Zheng, Weijian↗
DOE OSTI2025

Reduction in Nuclear Size and Quadrupole Deformation of High-Spin Isomers of 127,129 In

We employed laser spectroscopy of atomic transitions to measure the nuclear charge radii and electromagnetic properties of the high-spin isomeric states in neutron-rich indium isotopes (𝑍 =49) near the closed proton and neutron shells at 𝑍 = 50 and 𝑁 = 82. Our data reveal a reduction in the nuclear charge radius and intrinsic quadrupole moment when protons and neutrons are fully aligned in 129 In ⁢(𝑁 = 80), to form the high spin isomer. Such a reduction is not observed in 127 In ⁢(𝑁 = 78), where more complex configurations can be formed by the existence of four neutron holes. These observations are not consistently described by nuclear theory.

high spin states↗
DOE OSTI2025

Data for Wilson and Megonigal (2025), "Nitrate reduction across soils transitioning from coastal forest to wetland are hotspots for denitrification"

Sea level rise drives spatial migration of coastal ecosystems and can lead to the accelerated replacement of coastal forests with tidal wetlands. Soil biogeochemical cycles in steady-state upland and wetland ecosystems are well studied, but pathways and rates in rapidly changing ecosystems are largely unconstrained. Wilson and Megonigal (2025) performed a one-time sampling and a subsequent incubation experiment, and characterized the reduction of reactive nitrogen (N) via denitrification and dissimilatory nitrate reduction to ammonia. Sampling was done at four sites where coastal deciduous forest is undergoing ecosystem state change and becoming wetland throughout the Chesapeake Bay, USA. The COMPASS-FME project (http://compass.pnnl.gov) established the sites sampled in this study in 2022–2023.This dataset consists of:* Isotope-labeled incubation results comparing nitrate reduction rates across transects spanning upland, transition, and wetland; and* Ancillary porewater chemistry data.All files in this dataset are plain text, comma-separated value (CSV), and no special software is required to read them.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Quantification of Swelling in Hematite Pellets Reduced Using Hydrogen–Nitrogen Gas Mixture

Iron ore pellets are reduced in a 50%H 2 –50%N 2 1 atm gas mixture at 750, 800, 850, 900, and 950 °C while simultaneously documenting swelling (change in pellet radius) and weight change. Swelling increases with increasing temperature, with catastrophic swelling (>20% of reduction swelling index) observed at 850, 900, and 950 °C. As the pellet is reduced, the pellet radius increases until 40–50% reduction is achieved, followed by a decrease in diameter beyond 40–50% reduction at 750 and 850 °C. At 950 °C, the pellet radius continues to increase with additional pellet reduction without any subsequent decrease in diameter. Scanning electron microscopy (SEM) analysis shows that the neighboring grains inside the pellet sinter together at 750 and 850 °C, whereas the individual grains sinter internally at 950 °C. SEM analysis and observations suggest that the reduction process at 750 and 850 °C can be approximated as a topochemical reaction process, while the reduction process at 950 °C can no longer be approximated as a topochemical reaction process. In conclusion, an empirical equation for the radius of the pellet is derived with fitting parameters dependent on temperature and the degree of reduction of the pellet undergoing reduction based on the experimental data.

08 HYDROGEN↗
DOE OSTI2025

Transfer learning nonlinear plasma dynamic transitions in low dimensional embeddings via deep neural networks

Deep learning algorithms provide a new paradigm to study high-dimensional dynamical behaviors, such as those in fusion plasma systems. Development of novel, data-driven model reduction methods, coupled with detection of abnormal modes with plasma physics, opens a unique opportunity to identify plasma instabilities through automated construction of parsimonious models that can be tuned to balance accuracy and cost. Our fusion transfer learning (FTL) model demonstrates success in rapidly reconstructing nonlinear kink mode structures by learning from a limited amount of nonlinear simulation data. The knowledge transfer process leverages a pre-trained neural encoder–decoder network, initially trained on linear simulations, to effectively capture nonlinear dynamics. The low-dimensional embeddings extract the coherent structures of interest, while preserving the inherent dynamics of the complex system. Experimental results highlight FTL’s capacity to capture transitional behaviors and dynamical features in plasma dynamics—a task often challenging for conventional methods. The model developed in this study is generalizable and can be extended broadly through transfer learning to address various magnetohydrodynamics modes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

Multidimensional scaling informed by F -statistic: Visualizing grouped microbiome data with inference

Multidimensional scaling (MDS) is a widely used dimensionality reduction technique in microbial ecology data analysis that captures the multivariate structure of the data while preserving pairwise distances between samples. While improvements in MDS have enhanced the ability to reveal group-specific data patterns, these MDS-based methods require prior assumptions for inference, limiting their application in general microbiome analysis. Here, in this study, we introduce a new MDS-based ordination method, “F-informed MDS,” which configures the data distribution based on the F-statistic, the ratio of dispersion between groups sharing common and different characteristics. Using semisynthetic datasets, we demonstrate that the proposed method is robust to hyperparameter selection while maintaining statistical significance throughout the ordination process. Various quality metrics for evaluating dimensionality reduction confirm that F-informed MDS is comparable to state-of-the-art methods in preserving both local and global data structures. Its application to a diatom-associated bacterial community suggests the role of this new method in interpreting the community’s response to the host. Our approach offers a well-founded refinement of MDS that aligns with statistical test results, which can be beneficial for broader multidimensional data analyses in microbiology and ecology. This new visualization tool can be incorporated into standard microbiome data analyses.

Biological and medical sciences↗
DOE OSTI2026

A Generalized Grain-Scale Model for the Non-Plasma and Plasma-Assisted Hydrogen Direct Reduction of Iron Ore

Direct Reduction of Iron ore using hydrogen (H-DRI) is a promising pathway towards efficient steelmaking and accurate predictive models are a necessity for scale-up and optimization of this technology. However, accurate models of this process remain limited because existing models oversimplify grain-scale phenomena, such as nonlinearity inside grain, self-sufficient porosity, surface reactions, and the role of plasma species. These phenomena are important for flash steelmaking and plasma-assisted H-DRI processes. To address this need, we present a phenomenological model for simulating H-DRI at the scale of a single micron-sized grain of the iron ore. We call this the Transient Reactive Grain Model (TRGM). TRGM incorporates key physical process: gas species transport, a chemical kinetics of material conversion, nanopore structural evolution and, adsorption-desorption surface kinetics at the reactive nanopore surface. The important contribution of this work is that the model provides a dependence on different reductant species, specifically hydrogen atoms versus molecules, so that role of hydrogen plasma reduction can be clarified compared to the use of pure hydrogen gas reduction. TRGM predictions agree well with experimental data for both molecular H2 reduction of Fe2O3 and plasma hydrogen reduction of Fe3O4. Results reveal species concentration gradients with a diffuse reaction zone, and enhanced hydrogen diffusion at the grain outer surface due to evolving porosity. These findings challenge common assumptions in existing models, including sharp reaction fronts, quasi-steady diffusion and kinetics, and the neglect of surface chemistry. As a generalized grain-scale model for H-DRI processes, TRGM has practical applications in flash steelmaking and in-flight reduction using both molecular and plasma hydrogen.

08 HYDROGEN↗
DOE OSTI2025

Personalized and uncertainty-aware coronary hemodynamics simulations: From Bayesian estimation to improved multi-fidelity uncertainty quantification

Non-invasive simulations of coronary hemodynamics have improved clinical risk stratification and treatment outcomes for coronary artery disease, compared to relying on anatomical imaging alone. However, simulations typically use empirical approaches to distribute total coronary flow amongst the arteries in the coronary tree, which ignores patient variability, the presence of disease, and other clinical factors. Further, uncertainty in the clinical data often remains unaccounted for in the modeling pipeline. We present an end-to-end uncertainty-aware pipeline to (1) personalize coronary flow simulations by incorporating vessel-specific coronary flows as well as cardiac function; and (2) predict clinical and biomechanical quantities of interest with improved precision, while accounting for uncertainty in the clinical data. We assimilate patient-specific measurements of myocardial blood flow from clinical CT myocardial perfusion imaging to estimate branch-specific coronary artery flows. Simulated noise in the clinical data is used to estimate the joint posterior distributions of the model parameters using adaptive Markov Chain Monte Carlo sampling. Additionally, the posterior predictive distribution for the relevant quantities of interest is determined using a new approach combining multi-fidelity Monte Carlo estimation with non-linear, data-driven dimensionality reduction. This leads to improved correlations between high- and low-fidelity model outputs. Our framework accurately recapitulates clinically measured cardiac function as well as branch-specific coronary flows under measurement noise uncertainty. We observe substantial reductions in confidence intervals for estimated quantities of interest compared to single-fidelity Monte Carlo estimation and state-of-the-art multi-fidelity Monte Carlo methods. This holds especially true for quantities of interest that showed limited correlation between the low- and high-fidelity model predictions. In addition, the proposed multi-fidelity Monte Carlo estimators are significantly cheaper to compute than traditional estimators, under a specified confidence level or variance. The proposed pipeline for personalized and uncertainty-aware predictions of coronary hemodynamics is based on routine clinical measurements and recently developed techniques for CT myocardial perfusion imaging. The proposed pipeline offers significant improvements in precision and reduction in computational cost.

Bayesian parameter estimation↗
DOE OSTI2024

Scalable Tensor Methods for Nonuniform Hypergraphs

While multilinear algebra appears natural for studying the multiway interactions modeled by hypergraphs, tensor methods for general hypergraphs have been stymied by theoretical and practical barriers. A recently proposed adjacency tensor is applicable to nonuniform hypergraphs, but is prohibitively costly to form and analyze in practice. We develop tensor times same vector (TTSV) algorithms for this tensor which improve complexity from $O(n^r)$ to a low-degree polynomial in $r$, where $n$ is the number of vertices and $r$ is the maximum hyperedge size. Our algorithms are implicit, avoiding formation of the order $r$ adjacency tensor. Here, we demonstrate the flexibility and utility of our approach in practice by developing tensor-based hypergraph centrality and clustering algorithms. We also show these tensor measures offer complementary information to analogous graph-reduction approaches on data, and are also able to detect higher-order structure that many existing matrix-based approaches provably cannot.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Impact of Color Space and Color Resolution on Vehicle Recognition Models

In this study, we analyze both linear and nonlinear color mappings by training on versions of a curated dataset collected in a controlled campus environment. We experiment with color space and color resolution to assess model performance in vehicle recognition tasks. Color encodings can be designed in principle to highlight certain vehicle characteristics or compensate for lighting differences when assessing potential matches to previously encountered objects. The dataset used in this work includes imagery gathered under diverse environmental conditions, including daytime and nighttime lighting. Experimental results inform expectations for possible improvements with automatic color space selection through feature learning. Moreover, we find there is only a gradual decrease in model performance with degraded color resolution, which suggests the need for simplified data collection and processing. By focusing on the most critical features, we could see improved model generalization and robustness, as the model becomes less prone to overfitting to noise or irrelevant details in the data. Such a reduction in resolution will lower computational complexity, leading to quicker training and inference times.

47 OTHER INSTRUMENTATION↗