Search NASA⌕ Search

SEARCH · Search NASA

Results for “Statistical techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Evaluation of data driven low-rank matrix factorization for accelerated solutions of the Vlasov equation

Low-rank methods have shown success in accelerating simulations of a collisionless plasma described by the Vlasov equation, but still rely on computationally costly linear algebra every time step. We propose a data-driven factorization method using artificial neural networks, specifically with convolutional layer architecture, that trains on existing simulation data. At inference time, the model outputs a low-rank decomposition of the distribution field of the charged particles, and we demonstrate that this step is faster than the standard linear algebra technique. Numerical experiments show that the method achieves comparable reconstruction accuracy for interpolation tasks, generalizing to unseen test data in a manner beyond just memorizing training data; patterns in factorization also inherently followed the same numerical trend as those within algebraic methods (e.g., truncated singular-value decomposition). However, when training on the first 70% of a time-series data and testing on the remaining 30%, the method fails to meaningfully extrapolate. Despite this limiting result, the technique may have benefits for simulations in a statistical steady-state or otherwise showing temporal stability. These results suggest that while the model offers a computationally efficient alternative for datasets with temporal stability, its current formulation is best suited for interpolation rather than for predicting future states in time-evolving systems. This study thus lays the groundwork for further refinement of neural network-based approaches to low-rank matrix factorization in high-dimensional plasma simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Two-pion contribution to the hadronic vacuum polarization with staggered quarks

We present results from the first lattice QCD calculation of the two-pion contributions to the light-quark connected vector-current correlation function obtained from staggered-quark operators. We employ the MILC Collaboration’s gauge-field ensemble with 2 + 1 + 1 flavors of highly improved staggered sea quarks at a lattice spacing of a ≈ 0.15 fm with a light sea-quark mass at its physical value. The two-pion contributions allow for a refined determination of the noisy long-distance tail of the vector-current correlation function, which we use to compute the light-quark connected contribution to hadronic vacuum polarization (HVP) with improved statistical precision. We compare our results with traditional noise-reduction techniques used in lattice QCD calculations of the light-quark connected HVP, namely, the so-called fit and bounding methods. We observe a factor of roughly 3 improvement in the statistical precision in the determination of the HVP contribution to the muon’s anomalous magnetic moment over these approaches. We also lay the group theoretical groundwork for extending this calculation to finer lattice spacings with increased numbers of staggered two-pion taste states.

Lahert, Shaun [Utah U.; Illinois U., Urbana] (ORCI↗
DOE OSTI2025

Testing convolutional neural network based deep learning systems: a statistical metamorphic approach

Machine learning technology spans many areas and today plays a significant role in addressing a wide range of problems in critical domains,i.e., healthcare, autonomous driving, finance, manufacturing, cybersecurity,etc. Metamorphic testing (MT) is considered a simple but very powerful approach in testing such computationally complex systems for which either an oracle is not available or is available but difficult to apply. Conventional metamorphic testing techniques have certain limitations in verifying deep learning-based models (i.e., convolutional neural networks (CNNs)) that have a stochastic nature (because of randomly initializing the network weights) in their training. In this article, we attempt to address this problem by using a statistical metamorphic testing (SMT) technique that does not require software testers to worry about fixing the random seeds (to get deterministic results) to verify the metamorphic relations (MRs). We propose seven MRs combined with different statistical methods to statistically verify whether the program under test adheres to the relation(s) specified in the MR(s). We further use mutation testing techniques to show the usefulness of the proposed approach in the healthcare space and test two CNN-based deep learning models (used for pneumonia detection among patients). The empirical results show that our proposed approach uncovers 85.71% of the implementation faults in the classifiers under test (CUT). Furthermore, we also propose an MRs minimization algorithm for the CUT, thus saving computational costs and organizational testing resources.

Computer Science↗
DOE OSTI2025

Using the optimal combined index weight ratio to improve the probability of anomaly detection in big area additive manufacturing

Big Area Additive Manufacturing (BAAM) of composites requires significant time, energy, and material, so it is critical to reduce production inefficiencies to make functional parts without multiple iterations. Statistical process control coupled with Principal Component Analysis (PCA) is a powerful technique that provides a quick, computationally inexpensive, and intuitive way for operators to detect defects that form in a manufacturing process without massive datasets. Recently, a combined index that is a weighted sum of the Hotelling's T 2 and squared residual error statistics has been proposed that can be monitored in one chart, improving interpretation accuracy and simplicity. However, the literature does not offer a formal method to optimise the weights. Here, we introduce two new approaches to the traditional weight selection approach using simulated and BAAM image data. Approach 1 uses a theoretically motivated optimum inspired by probabilistic principal component analysis. Approach 2 systematically varies the ratio of the weights to find the optimum. We show that approach 1 delivers optimal anomaly detection performance in select cases while approach 2 fares better in practice. Surprisingly, we also show that choosing a more complex PCA model has a minimal negative impact on anomaly detection performance compared to a more simplistic model.

3-dimensional printing↗
DOE OSTI2026

Emerging anomaly detection techniques for electronic health records: A survey

Background Anomaly detection in electronic health records (EHRs) is a cornerstone of biomedical informatics, with direct implications for patient safety, clinical decision-making, and the prevention of healthcare fraud. Once guided primarily by simple rule-based methods, the field has advanced rapidly, driven by increased computing power, richer and more detailed health data, and the rise of machine learning and deep learning techniques. The objective of this paper is to provide a comprehensive overview of modern approaches to detecting anomalies in EHRs, outlining their strengths, limitations, and relevance to key healthcare challenges. We review traditional statistical methods alongside newer ML- and DL-based strategies and hybrid models, with particular attention to how these techniques support transparency and build clinical trust. Methods This paper presents a thorough and critical survey through systematic review (PRISMA-based) of the latest anomaly detection strategies in time-sequence data domains within electronic health record systems. Results We explore a broad spectrum of methodologies, including statistical models, supervised and unsupervised learning approaches, hybrid frameworks, and state-of-the-art ML-based techniques that collectively advance the precision and scalability of detecting anomalies in complex clinical datasets. In addition to mapping current capabilities, we address the enduring challenges that hinder widespread implementation and provide a forward-looking perspective on the future of anomaly detection in the data-rich landscape of modern healthcare. Summary The advancement in AI-based approaches is reported along with the basic principles of the individual approaches and their applicability. The increased availability of high-quality data, advancements in DL approaches, and enhanced computation power are leading to more frequent adaptation of DL-based approaches. Emerging DL-based approaches that have been adapted in other domains or recently applied in the EHR domain are also discussed in detail. Although DL-based approaches can improve model predictions by incorporating comorbidities, their application is limited in low-frequency data domains (e.g., when the total available data remains in the single digits). Therefore, the user must carefully consider the application based on data availability.

Anomaly detection↗
DOE OSTI2026

Multidimensional scaling informed by F -statistic: Visualizing grouped microbiome data with inference

Multidimensional scaling (MDS) is a widely used dimensionality reduction technique in microbial ecology data analysis that captures the multivariate structure of the data while preserving pairwise distances between samples. While improvements in MDS have enhanced the ability to reveal group-specific data patterns, these MDS-based methods require prior assumptions for inference, limiting their application in general microbiome analysis. Here, in this study, we introduce a new MDS-based ordination method, “F-informed MDS,” which configures the data distribution based on the F-statistic, the ratio of dispersion between groups sharing common and different characteristics. Using semisynthetic datasets, we demonstrate that the proposed method is robust to hyperparameter selection while maintaining statistical significance throughout the ordination process. Various quality metrics for evaluating dimensionality reduction confirm that F-informed MDS is comparable to state-of-the-art methods in preserving both local and global data structures. Its application to a diatom-associated bacterial community suggests the role of this new method in interpreting the community’s response to the host. Our approach offers a well-founded refinement of MDS that aligns with statistical test results, which can be beneficial for broader multidimensional data analyses in microbiology and ecology. This new visualization tool can be incorporated into standard microbiome data analyses.

Biological and medical sciences↗
DOE OSTI2024

Rapid measurement of soluble xylo-oligomers using near-infrared spectroscopy (NIRS) and multivariate statistics: calibration model development and practical approaches to model optimization

Rapid monitoring of biomass conversion processes using techniques such as near-infrared (NIR) spectroscopy can be substantially quicker and less labor-, resource-, and energy-intensive than conventional measurement techniques such as gas or liquid chromatography (GC or LC) due to the lack of solvents and preparation methods, as well as removing the need to transfer samples to an external lab for analytical evaluation. The purpose of this study was to determine the feasibility of rapid monitoring of a biomass conversion process using NIR spectroscopy combined with multivariate statistical modeling, and to examine the impact of (1) subsetting the samples in the original dataset by process location and (2) reducing the spectral range used in the calibration model on model performance. We develop multivariate calibration models for the concentrations of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids at multiple points in a biomass conversion process which produces and then purifies XOS compounds from sugar cane bagasse. A single model using samples from multiple locations in the process stream showed acceptable performance as measured by standard statistical measures. However, compared to the single model, we show that separate models built by segregating the calibration samples according to process location show improved performance. We also show that combining an understanding of the sample spectra with simple multivariate analysis tools can result in a calibration model with a substantially smaller spectral range that provides essentially equal performance to the full-range model. We demonstrate that real-time monitoring of soluble xylo-oligosaccharides (XOS), monomeric xylose, and total solids concentration at multiple points in a process stream using NIR spectroscopy coupled with multivariate statistics is feasible. Segregation of sample populations by process location improves model performance. Models using a reduced spectral range containing the most relevant spectral signatures show very similar performance to the full-range model, reinforcing the importance of performing robust exploratory data analysis before beginning multivariate modeling.

09 BIOMASS FUELS↗
DOE OSTI2026

Transformative Impacts of Laser-Induced Breakdown Spectroscopy on Environmental and Biological Research at Oak Ridge National Laboratory

This manuscript will present an advancement of transformative research that has been conducted at Oak Ridge National Laboratory (ORNL) over a 25-year period (2000–2025) on a variety of environmental and biological matrices. These investigations derived a fundamental understanding of how elemental detection and analysis of these matrices led to the knowledge and discovery of natural processes in plants and the environment. Each project led to the initiation of a new research area which unearthed awesome and novel breakthroughs. Highlights are listed below: 1. The preliminary research at ORNL centered on the detection of aerosols utilizing Laser-induced Breakdown Spectroscopy (LIBS) technology. The Clean Air Act Amendment (CAAA) of 1990 highlighted the importance of identifying hazardous air pollutants (HAPs) due to their impact on environmental and human health, thereby underscoring the need to detect various toxic elements. Research in aerosol chemistry aimed to identify these harmful elements released by factories during periods of increased emissions in their manufacturing processes. LIBS emerged as the most effective method for real-time, in situ measurements of metal species in both gaseous and aerosol phases. 2. An understanding of the presence of total carbon in soils gives perspective on how to develop carbon sequestration strategies. The recognition that carbon sinks can evolve back to carbon sources to emit back to the atmosphere was an important consideration. Also, the concentration of carbon in soil indicates the health of land areas for growing crops successfully. 3. The direct detection of most of the elements in a wood sample in a single emission spectrum, without sample preparation, encouraged the research to use the LIBS technique for preservative treated wood coupled with use of multivariate statistical methodology. Additionally, it encouraged the researchers to try to differentiate natural woods from different parts of the country, and it was successfully demonstrated that LIBS coupled with MVA analysis could differentiate wood of different species from each other and of similar species grown in different environments based on their elemental spectra. This was a breakthrough since it revealed a systematic approach to connect elemental scarcity and abundance to either drought or typical rainfall conditions for the hardwood trees grown in specific areas. 4. Furthermore, the research progressed to reveal physiological and developmental processes contributing to biomass production such that the variation in leaf elemental composition increases our understanding of terrestrial nutrient cycles, as well as tracking the transfer of toxic elements from soils to living organisms. 5. Recently another breakthrough viz., ionomics initiated the correlation of elements to specific genes, uncovering the function that the element performed in the plant. More recently, this has been extended from plants to fungi as well as fungi growing in symbiotic relations with plants.

09 BIOMASS FUELS↗
DOE OSTI2024

A Causal Approach to Model Validation and Calibration

This poster presents a novel method for validation and verification that focuses on identifying causal relationships between data elements, moving beyond traditional statistical and machine learning approaches. These methods employ causal discovery techniques to reveal the underlying mechanisms of data generation. The research utilizes structural causal models and directed acyclic graphs to depict causal relationships. This approach assists in achieving alignment between simulation models and reality.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Feasibility of an Accelerometer-Based Structural Health Monitoring System for the LANL Blast Tube

A modeling- and simulation-based study was conducted on the feasibility of implementing an accelerometer-based SHM system on the Los Alamos National Laboratory blast tube. A blast tube experiment was modeled using the Abaqus explicit finite element solver. A custom user subroutine was written to apply test-like pressure loading to the inside surface of the blast tube. The subroutine applies analytically defined pressure loads derived from tracer output taken from a Compressible Flow Computational Fluid Dynamics Solver model of the blast tube. Five unique versions of the model were created: an undamaged reference model at 65°F was used as the baseline and compared to equivalent models at 10°F and 100°F. These three models were compared to models with small damage at the reference temperature. The two types of damage considered were a radial (circumferential) crack in the main tube body and a longitudinal crack in the supports. Acceleration outputs were extracted from accelerometer bodies included in the model and were post processed using a variety of standard SHM techniques. Different potential features signaling failure were extracted and compared using statistical methods in the time and frequency domains. A method was identified that clearly shows that differences in structural response resulting from the modeled damage can be differentiated from the structural response resulting from changing environmental conditions. However, the amount of damage applied to create observable differences in the accelerometer data was so large that simpler methods of damage detection would be more cost effective in locating damage.

42 ENGINEERING↗
DOE OSTI2025

Bayesian Statistical Analysis for Mass Spectrometric Data Processing

• Thermal ionization mass spectrometry (TIMS) is a “gold standard’ technique for actinide isotope amount ratio and assay measurements. • Ubiquitously used in: • Nuclear Nonproliferation • Nuclear Safeguards • Nuclear Forensics • Basic Science • Savannah River National Laboratory (SRNL) installed a new Thermo Scientific TRITON Plus TIMS in early 2024.

McLarty, Ellis C. [Savannah River National Laborat↗
DOE OSTI2025

Bayesian Statistical Analysis for Mass Spectrometric Data Processing

Thermal ionization mass spectrometry (TIMS) is a “gold standard’ technique for actinide isotope amount ratio and assay measurements. • Ubiquitously used in: • Nuclear Nonproliferation • Nuclear Safeguards • Nuclear Forensics • Basic Science • Savannah River National Laboratory (SRNL) installed a new Thermo Scientific TRITON Plus TIMS in early 2024.

McLarty, Ellis C. [Savannah River National Laborat↗
DOE OSTI2025

Ensemble Simulation Techniques and Fast Randomized Algorithms

The major goals of the project were to develop and analyze new ensemble simulation techniques, including trajectory stratification and preconditioned MCMC techniques, as well as develop fast numerical linear algebra techniques closely related to ensemble simulation ideas. The trajectory stratification techniques involve simulating in parallel short trajectory fragments of a Markov process confined to a specific region of space‐time and then patching together the statistics gathered to assemble estimates of very general dynamical properties. We have also developed this approach for rare event simulation and extended the techniques to applications requiring a more general framework (such as electronic structure calculations). The preconditioned MCMC techniques involve simulating multiple Markov chains in parallel and then using information from the ensemble to speed the mixing of each individual chain. The fast randomized linear algebra methods are motivated by the diffusion Monte Carlo technique, but are applicable to finding the dominant eigenvalue of (almost) general matrices. For most non‐negative matrices, the schemes result in an error (compared to the power method) that is constant in the dimension of the problem. For more general matrices, we see a very clear sublinear cost trend in computational tests.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Bridging the gap between experiments and simulations using machine learning

The physics of inertial confinement fusion is rich and complex. Simulation codes that are used to design experiments are computationally expensive and lack the predictive capability required for extensive parameter exploration in search of a high-performing design for laser direct drive. In this work we use deep learning to build a fast emulator of experiments. To facilitate the development of the deep-learning model, an autoencoder is used to reduce the dimensionality of the input space. Two deep learning models are developed. One model is trained on a vast array of simulation data and is subsequently calibrated to expensive and limited experimental data using a technique known as “transfer learning.” The other model is trained on a statistical model and is subsequently calibrated using experimental data. A comparative study of the two predictive models is carried out. The models potentially reproduce key experimental observables with high accuracy and unprecedented inference times relative to those achieved with simulation codes. These models facilitate rapid exploration of a high dimensional input parameter space.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Hydrogen Leak Modeling for Development of Smart Distributed Monitoring Under Unintended Releases

Hydrogen is a versatile and clean energy carrier that can be produced from various renewable sources such as wind, solar, and hydropower. Hydrogen has the potential to play a crucial role in decarbonizing industrial processes that are currently reliant on fossil fuels and provide long-duration and/or seasonal energy storage to enable electricity decarbonization. Hydrogen can also be used as a fuel for fuel cell vehicles, providing a zero-emission alternative to traditional internal combustion engines. DOE launched the Hydrogen Energy Earthshot (Hydrogen Shot) in June 2021 to reduce the cost of clean hydrogen by 80% to $1 per 1 kilogram in 1 decade ("1 1 1"). While promising, Hydrogen is highly-flammable, and in the presence of oxygen, it can form explosive mixtures. . Therefore, understanding leak scenarios is essential to evaluate and mitigate the safety risks associated with potential hydrogen leaks. An increased understanding of leak behavior, and having tools to model leaks, can help assess how hydrogen would disperse in different environments, influencing emergency response plans and safety measures, and identify potential issues with materials and design systems that can withstand the challenges posed by hydrogen. Recently, researchers have attempted to study hydrogen leaks for development of risk management strategies. However, the focus has been on closed or semi-closed spaces like storage rooms, vehicles, garages, and fueling stations - all promising locations for future hydrogen infrastructure. In this presentation, the modeling environment extends the span of research further by modeling hydrogen leak in an outdoor, open space. We will present the key challenges with modeling hydrogen leaks in an uncontrollable environment, how they were handled, and how modeling results informed sensor selection and placement. A Hydrogen research facility at the National Renewable Energy Laboratory (NREL) was used as a case study to model hydrogen leaks. In the future, Hydrogen wide area detection methodologies will be developed and tested at this site to monitor for unintended and operational hydrogen releases. The data generated from modeling will be used to develop a predictive model to detect hydrogen leak location based on concentration measured by sensors in this open space. Furthermore, the facility was also chosen because controlled hydrogen releases can be performed. A computational fluid dynamics (CFD) based modeling approach was taken to model hydrogen leak. The full-scale hydrogen facility was modeled with a large ambient domain. The electrolyzer at the facility can produce a controlled release rate of 27 kg-H2/hr. Site-specific atmospheric and weather condition data such as wind direction, wind speed at various altitudes, and temperature were used as inputs to the model. To capture the variability of weather conditions, a subset of the weather conditions experienced during daytime hours without precipitation over the course of three months was generated; using established data clustering techniques, a total of 100 condition sets were chosen. The results show statistical distributions and ranges of hydrogen concentrations at locations throughout the domain. These distributions are compared to experimental data from a constant mass flow, controlled hydrogen release at the facility. The stochastic wind conditions of the release make direct validation difficult, therefore, statistical comparison approaches were used. Wind conditions are found to significantly impact the release behavior, including direction and concentration. Sensor selection and placement is proposed for the facility and is now based on release behavior predicted for the facility given its weather patterns; this is much more informed than without the modeling results. The methodology and analysis procedure can be translated to other facilities using modified geometries and site-specific weather conditions. Hydrogen holds great promise as a renewable energy fuel, but ensuring safety in its production, storage, and use is paramount. Studying potential leak scenarios in an open space will help develop sensors to detect hydrogen on a large spectrum of concentration and eventually build a smart distributed monitoring system.

CFD↗
DOE OSTI2025

Rare events and Griffiths phases in topological quantum error correction

The performance of quantum error correcting (QEC) codes is often studied under the assumption of spatiotemporally uniform error rates. On the other hand, experimental implementations almost always produce heterogeneous error rates, in either space or time, as a result of effects such as imperfect fabrication and/or cosmic rays. It is therefore important to understand if and how their presence can affect the performance of QEC in qualitative ways. Here, in this work, we study the effects of nonuniform error rates in the representative examples of the 1D repetition code and the 2D toric code, focusing on when they have extended spatiotemporal correlations; these may arise, for instance, from rare events (such as cosmic rays) that temporarily elevate error rates over the entire code patch. These effects can be described in the corresponding statistical mechanics models for decoding, where long-range correlations in the error rates lead to extended rare regions of weaker coupling. For the 1D repetition code where the rare regions are linear, we find two distinct decodable phases: a conventional ordered phase in which logical failure rates decay exponentially with the code distance, and a rare-region dominated Griffiths phase in which failure rates are parametrically larger and decay as a stretched exponential. In particular, the latter phase is present when the error rates in the rare regions are above the bulk threshold. For the 2D toric code where the rare regions are planar, we find no decodable Griffiths phase: rare events which boost error rates above the bulk threshold lead to an asymptotic loss of threshold and failure to decode. Unpacking the failure mechanism implies that techniques for suppressing extended sequences of repeated rare events (which, without intervention, will be statistically present with high probability) will be crucial for QEC with the toric code.

classical statistical mechanics↗
DOE OSTI2025

The Surface-Topography Challenge: A Multi-Laboratory Benchmark Study to Advance the Characterization of Topography

Surface performance is critically influenced by topography in virtually all real-world applications. The current standard practice is to describe topography using one of a few industry-standard parameters. The most commonly reported number is Ra, the average absolute deviation of the height from the mean line (at some, not necessarily known or specified, lateral length scale). However, other parameters, particularly those that are scale-dependent, influence surface and interfacial properties; for example the local surface slope is critical for visual appearance, friction, and wear. The present Surface-Topography Challenge was launched to raise awareness for the need of a multi-scale description, but also to assess the reliability of different metrology techniques. In the resulting international collaborative effort, 153 scientists and engineers from 64 research groups and companies across 20 countries characterized statistically equivalent samples from two different surfaces: a “rough” and a “smooth” surface. The results of the 2088 measurements constitute the most comprehensive surface description ever compiled. We find wide disagreement across measurements and techniques when the lateral scale of the measurement is ignored. Consensus is established through scale-dependent parameters while removing data that violates an established resolution criterion and deviates from the majority measurements at each length scale. Our findings suggest best practices for characterizing and specifying topography. The public release of the accumulated data and presented analyses enables global reuse for further scientific investigation and benchmarking.

42 ENGINEERING↗