Search NASA⌕ Search

SEARCH · Search NASA

Results for “ERROR ANALYSIS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Quantifying motion blur by imaging shock front propagation with broadband and narrowband X-ray sources

Time-integrated radiography using MeV Bremsstrahlung X-ray sources is the norm for imaging during system-level testing of components and structures under dynamic condition. One source of error in the analysis of the time-integrated radiography data sets stems from motion blur which smears out sharp interfaces to a greater degree with longer exposure times, which become necessary to provide sufficient signal-to-noise with low X-ray penetration of objects of interest. To quantify motion blur, a 1D shock wave through PMMA was investigated experimentally at The Dynamic Compression Sector at The Advanced Photon Source (DCS@APS) with tapered broadband and 25.46 ± 1.06 keV narrowband X-rays. Four cameras with different exposure times were used for each experiment to compare the effect that exposure time has on motion blur. In addition, our methodology to accurately simulate motion blur in terms of transmission and shape is presented and compared to our experimental results and quantified. There is a high level of agreement between the experimental and simulation results across the range of data sets investigated in this study with a percent difference range of 0.29–1.31% for the four shots. The methodology of this work serves as a steppingstone towards a physically validated model that could be used in conjunction with experimental results to deconvolve physical parameters, densities, and interfaces of interest in a way that would not be possible with experimental results alone.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Prediction challenge: First principles simulation of the ultrafast electron diffraction spectrum of cyclobutanone

Computer simulation has long been an essential partner of ultrafast experiments, allowing the assignment of microscopic mechanistic detail to low-dimensional spectroscopic data. However, the ability of theory to make a priori predictions of ultrafast experimental results is relatively untested. Herein, as a part of a community challenge, we attempt to predict the signal of an upcoming ultrafast photochemical experiment using state-of-the-art theory in the context of preexisting experimental data. Specifically, we employ ab initio Ehrenfest with collapse to a block mixed quantum–classical simulations to describe the real-time evolution of the electrons and nuclei of cyclobutanone following excitation to the 3s Rydberg state. The gas-phase ultrafast electron diffraction (GUED) signal is simulated for direct comparison to an upcoming experiment at the Stanford Linear Accelerator Laboratory. Following initial ring-opening, dissociation via two distinct channels is observed: the C3 dissociation channel, producing cyclopropane and CO, and the C2 channel, producing CH2CO and C2H4. Direct calculations of the GUED signal indicate how the ring-opened intermediate, the C2 products, and the C3 products can be discriminated in the GUED signal. We also report an a priori analysis of anticipated errors in our predictions: without knowledge of the experimental result, which features of the spectrum do we feel confident we have predicted correctly, and which might we have wrong?

Chemistry↗
DOE OSTI2020

Quantum approximate optimization of the long-range Ising model with a trapped-ion quantum simulator

Quantum computers and simulators may offer significant advantages over their classical counterparts, providing insights into quantum many-body systems and possibly improving performance for solving exponentially hard problems, such as optimization and satisfiability. Here, we report the implementation of a low-depth Quantum Approximate Optimization Algorithm (QAOA) using an analog quantum simulator. We estimate the ground-state energy of the Transverse Field Ising Model with long-range interactions with tunable range, and we optimize the corresponding combinatorial classical problem by sampling the QAOA output with high-fidelity, single-shot, individual qubit measurements. We execute the algorithm with both an exhaustive search and closed-loop optimization of the variational parameters, approximating the ground-state energy with up to 40 trapped-ion qubits. We benchmark the experiment with bootstrapping heuristic methods scaling polynomially with the system size. We observe, in agreement with numerics, that the QAOA performance does not degrade significantly as we scale up the system size and that the runtime is approximately independent from the number of qubits. We finally give a comprehensive analysis of the errors occurring in our system, a crucial step in the path forward toward the application of the QAOA to more general problem instances.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Complete quantification of parametric uncertainties in ( d , p ) transfer reactions

Deuteron-induced transfer reactions are a popular probe in nuclear structure and nuclear astro physics studies. The interpretation of these transfer measurements relies on reaction theory that takes as input effective interactions between the nucleons and the target nucleus. Previous work quantified the uncertainty associated with the optical potentials between the nucleons and the target. In this study, we extend that work by also including the parameters of the mean field associated with the overlap function of the final bound state, thus obtaining the full parametric uncertainty on transfer observables. We use Bayesian Markov Chain Monte Carlo simulations to obtain parameter posterior distributions. We use elastic-scattering cross sections to constrain the optical potential parameters and use the asymptotic normalization coefficient of the final state to constrain the bound state interaction. We then propagate these posteriors to the transfer angular distributions and obtain confidence intervals for this observable. We study (d,p) reactions on 14 C, 16 O, and 48 Ca at energies in the range $E$ $d$ = 7 - 24 MeV. Our results show a strong reduction in uncertainty by using the asymptotic normalization coefficient as a constraint, particularly for those reactions most sensitive to ambiguities in the mean field. For those reactions, the importance of constraining the bound state interaction is equal to that of constraining the optical potentials. Furthermore, the case of 14 C is an outlier because the cross section is less sensitive to the nuclear interior. When minimal constraints are used on the parameters of the nucleon-target interaction, the 1σ uncertainties on the differential cross sections are large (~ 500-100%). However, if elastic-scattering data and the asymptotic normalization coefficient are used in the analysis, with an error of 10% (5%), this uncertainty reduces to ~ 30% (~ 15%).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Visual Analytics of Performance of Quantum Computing Systems and Circuit Optimization

Driven by potential exponential speedups in business, security, and scientific scenarios, interest in quantum computing is surging. This interest feeds the development of quantum computing hardware, but several challenges arise in optimizing application performance for hardware metrics (e.g., qubit coherence and gate fidelity). In this work, we describe a visual analytics approach for analyzing the performance properties of quantum devices and quantum circuit optimization. Our approach allows users to explore spatial and temporal patterns in quantum device performance data and it computes similarities and variances in key performance metrics. Detailed analysis of the error properties characterizing individual qubits is also supported. We also describe a method for visualizing the optimization of quantum circuits. The resulting visualization tool allows researchers to design more efficient quantum algorithms and applications by increasing the interpretability of quantum computations.

Chae, Junghoon↗
DOE OSTI2024

Taylor-Expansion-Based Robust Power Flow in Unbalanced Distribution Systems: A Hybrid Data-Aided Method

Traditional power flow methods often adopt certain assumptions designed for passive balanced distribution systems, thus lacking practicality for unbalanced operation. moreover, their computation accuracy and efficiency are heavily subject to unknown errors and bad data in measurements or prediction data of distributed energy resources (ders). to address these issues, this paper proposes a hybrid data-aided robust power flow algorithm in unbalanced distribution systems, which combines taylor series expansion knowledge with a data-driven regression technique. the proposed method initiates a linearization power flow model to derive an explicitly analytical solution by modified taylor expansion. to mitigate the approximation loss that surges due to the der integration and bad data, we further develop a data-aided robust support vector regression approach to estimate the errors efficiently. comparative analysis in the 13-bus and 123-bus ieee unbalanced feeders shows that the proposed hybrid algorithm achieves superior computational efficiency, with guaranteed accuracy and robustness against outliers.

data-driven↗
DOE OSTI2023

zPerf: A Statistical Gray-Box Approach to Performance Modeling and Extrapolation for Scientific Lossy Compression

With the scaling up of simulation-based scientific discovery on high-performance computing systems, the disparity between compute and I/O has increased, forcing domain scientists to save only a small amount of simulation data to persistent storage. This can result in the loss of essential physics fields that are needed for data analysis. While error-bounded lossy compression has made tremendous progress in bridging the gap between compute and I/O, the lack of understanding of compression performance remains a key hurdle to its wide adoption. Here, in this work, we present zPerf, a statistical gray-box performance modeling approach for scientific lossy compression. Our contributions are threefold: 1) We develop zPerf to estimate the performance of lossy compression techniques, based on in-depth understanding and statistical modeling for data features and core compression metrics; 2) We demonstrate the in-detailed implementation of zPerf using two case studies, where we derive the performance modeling for SZ and ZFP, two leading lossy compressors; 3) We evaluate the effectiveness of zPerf on real-world datasets across various domains. Based on the evaluation, we demonstrate the efficacy of the zPerf performance model; 4) We further discuss three case studies where zPerf is applied to extrapolate the compression ratio of SZ and ZFP with alternative encoding schemes as well as ZFP with an alternative transform scheme. Through the case studies, we demonstrate the potential of zPerf for exploring the design space of lossy compression, which has hardly been studied in the literature.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Artificial Neural Network Models for Octane Number and Octane Sensitivity: A Quantitative Structure Property Relationship Approach to Fuel Design

Octane sensitivity (OS), defined as the research octane number (RON) minus the motor octane number (MON) of a fuel, has gained interest among researchers due to its effect on knocking conditions in internal combustion engines. Compounds with a high OS enable higher efficiencies, especially within advanced compression ignition engines. RON/MON must be experimentally tested to determine OS, requiring time, funding, and specialized equipment. Thus, predictive models trained with existing experimental data and molecular descriptors (via quantitative structure-property relationships (QSPRs)) would allow for the preemptive screening of compounds prior to performing these experiments. Here, the present work proposes two methods for predicting the OS of a given compound: using artificial neural networks (ANNs) trained with QSPR descriptors to predict RON and MON individually to compute OS (derived octane sensitivity (dOS)), and using ANNs trained with QSPR descriptors to directly predict OS. Twenty-five ANNs were trained for both RON and MON and their test sets achieved an overall 6.4% and 5.2% error, respectively. Twenty-five additional ANNs were trained for both dOS and OS; dOS calculations were found to have 15.3% error while predicting OS directly resulted in 9.9% error. A chemical analysis of the top QSPR descriptors for RON/MON and OS is conducted, highlighting desirable structural features for high-performing molecules and offering insight into the inner mathematical workings of ANNs; such chemical interpretations study the interconnections between structural features, descriptors, and fuel performance showing that connectivity, structural diversity, and atomic hybridization consistently drive fuel performance.

09 BIOMASS FUELS↗
DOE OSTI2023

A Predictor-Corrector Strategy for Adaptivity in Dynamical Low-Rank Approximations

Here, in this paper, we present a predictor-corrector strategy for constructing rank-adaptive, dynamical low-rank approximations (DLRAs) of matrix-valued ODE systems. The strategy is a compromise between (i) low-rank step-truncation approaches that alternately evolve and compress solutions and (ii) strict DLRA approaches that augment the low-rank manifold using subspaces generated locally in time by the DLRA integrator. The strategy is based on an analysis of the error between a forward temporal update into the ambient full-rank space, which is typically computed in a step-truncation approach before recompressing, and the standard DLRA update, which is forced to live in a low-rank manifold. We use this error, without requiring its full-rank representation, to correct the DLRA solution. A key ingredient for maintaining a low-rank representation of the error is a randomized SVD, which introduces some degree of stochastic variability into the implementation. The strategy is formulated and implemented in the context of discontinuous Galerkin spatial discretizations of PDEs and applied to several versions of DLRA methods found in the literature as well as a new variant. Numerical experiments comparing the predictor-corrector strategy to other methods demonstrate robustness to overcome shortcomings of step truncation or strict DLRA approaches: The former may require more memory than is strictly needed, while the latter may miss transients solution features that cannot be recovered. The effect of randomization, tolerances, and other implementation parameters is also explored.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Case Study Investigating the Low Summertime CAPE Behavior in the Global Forecast System

Convective available potential energy (CAPE) is an important index for storm forecasting. Recent versions (v15.2 and v16) of the Global Forecast System (GFS) predict lower values of CAPE during summertime in the continental United States than analysis and observation. We conducted an evaluation of the GFS in simulating summertime CAPE using an example from the Unified Forecast System Case Study collection to investigate the factors that lead to the low CAPE bias in GFS. Specifically, we investigated the surface energy budget, soil properties, and near-surface and upper-level meteorological fields. Results show that the GFS simulates smaller surface latent heat flux and larger surface sensible heat flux than the observations. This can be attributed to the slightly drier-than-observed soil moisture in the GFS that comes from an offline global land data assimilation system. The lower simulated CAPE in GFS v16 is related to the early drop of surface net radiation with excessive boundary layer cloud after midday when compared with GFS v15.2. A moisture-budget analysis indicates that errors in the large-scale advection of water vapor does not contribute to the dry bias in the GFS at low levels. Common Community Physics Package single-column model (SCM) experiments suggest that with realistic initial vertical profiles, SCM simulations generate a larger CAPE than runs with GFS IC. SCM runs with an active LSM tend to produce smaller CAPE than that with prescribed surface fluxes. Note that the findings are only applicable to this case study. Including more warm-season cases would enhance the generalizability of our findings.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

PELICAN Status Report for Year 2021

The Pressure Drop Experimental Loop for Investigations of Core Assemblies in Advanced Nuclear Reactors, PELICAN, is a novel experimental facility designed and constructed to recreate the prototypic full scale hydraulic flow conditions for the Versatile Test Reactor (VTR) currently under development by the U.S. Department of Energy. To support VTR design efforts, PELICAN is used to replicate VTR’s primary heat transport system (PHTS) in the core assembly region. The measurement objectives for data generated from this test facility are to mimic the prototypic VTR assembly and to meet the validation needs for code calculations and simulations of the reference design for the VTR core. These objectives focus on the need to validate pressure drop results across the various segments of the fuel assembly, including the axial reflectors, fuel, and transition regions, as they relate directly to the pumping power and safety behavior of the reactor. In the following sections, the major milestones for the experimental work performed on PELICAN over the calendar year (CY) 2021 are presented. In the next section, we discuss the assembly and shakedown testing of the facility. In Section 3, an analysis of the errors in the major measurements is performed. In Section 4 and 5 we present the results from the first set of test articles placed inside the loop. The design of the remaining test articles as part of the full assembly are shown in Section 6 and the conclusion and path forward for the following year, CY22 is given in the final section.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

Examining the Characteristics of the Cropland Data Layer in the Context of Estimating Land Cover Change

The United States Department of Agriculture (USDA) Cropland Data Layer (CDL) provides spatially explicit information about crop production area and has served as a prevalent data source for characterizing cropland change in the U.S. in the last decade. Understanding the accuracy of the CDL is paramount because of the reliance on it for management and policy making. This study examined the characteristics of the CDL from 2007 to 2017 using comparisons to other USDA datasets. The results showed when examining the cropland area for the same year, the CDL produced comparable trends with other datasets (R 2 > 0.95), but absolute area differed. The estimated area of cropland changes from 2007 to 2012, 2008 to 2012 and 2012 to 2017 varied from weak to moderate correlation between the CDL and the tabular data (R 2 = 0.005~0.63). Differences in area of cropland change varied widely between data sources with the CDL estimating much larger change area. A series of image processing techniques designed to improve the confidence in cropland change estimated using the CDL reduced the area of estimated cropland change. The techniques also, unexpectedly, lowered the correlation in change estimated between the CDL and the tabular datasets. Estimated land cover change area varied widely based on analyses applied and could reverse from increasing to declining area in cropland. Further analyses showed unlikely change scenarios when comparing different year combinations. The authors recommend the CDL only be used for land cover change analysis if the error can be estimated and is within change estimates.

58 GEOSCIENCES↗
DOE OSTI2025

A 1 km soil moisture dataset over eastern CONUS generated by assimilating SMAP data into the Noah-MP land surface model

An improved fine-scale soil moisture (SM) dataset at 1 km grid spacing, covering much of the eastern continental US, was generated by assimilating 9 km Soil Moisture Active Passive (SMAP) SM data into the v4.0.1 Noah-MP land surface model. With 12 ensemble members, the assimilation was carried out using the ensemble Kalman filter algorithm within NASA's Land Information System. The SM analysis for 2016 was fully validated against in situ observations from four different networks and compared with four other existing datasets. Results indicate that this SM analysis surpasses other datasets in top-layer SM distribution, including a machine-learning-based product, despite all SM estimates being less heterogeneous than observed. The analysis of anomalous errors suggests that large similarity in intrinsic errors is likely due to overlapping data sources among the selected SM datasets. More detailed evaluations were performed over two geographic areas. The observations collected by the Atmospheric Radiation Measurement facility in Oklahoma suggest that soil temperature and surface heat fluxes are concurrently simulated with good accuracy. Investigation into the 2016 southeastern US drought response further indicates drier conditions and higher evapotranspiration estimates compared to GLEAMv4.1. Notably, large errors are associated with grids having clay soil textures, underscoring the need for refined model treatments for specific soil types to further improve SM estimates. The dataset is publicly available on Zenodo at https://doi.org/10.5281/zenodo.14370563 (Tai et al., 2024).

Tai, Sheng-Lun [Pacific Northwest National Laborat↗
DOE OSTI2022

A Summary of Validation Studies for the Integrated TIGER Series Performed on ACORN Plus-up 218468/99

The Integrated TIGER Series (ITS) transport code is a valuable tool for photon-electron transport. A seven-problem validation suite exists to make sure that the ITS transport code works as intended. It is important to ensure that data from benchmark problems is correctly compared to simulated data. Additionally, the validation suite did not previously make use of a consistent quantitative metric for comparing experimental and simulated datasets. To this end, the goal of this long-term project was to expand the validation suite both in problem type and in the quality of the error assessment. To accomplish that, the seven validation problems in the suite were examined for potential drawbacks. When a drawback was identified, the problems were ranked based on severity of the drawback and approachability of a solution. We determined that meaningful improvements could be made to the validation suite by improving the analysis for the Lockwood Albedo problem and by introducing the Ross dataset as an eighth problem to the suite. The Lockwood error analysis has been completed and will be integrated in the future. The Ross data is unfinished, but significant progress has been made towards analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

MS25: Materials Science-Focused Benchmark Data Set for Machine Learning Interatomic Potentials

Here, we present MS25, a benchmark data set for evaluating machine learning interatomic potentials (MLIPs) across diverse materials-relevant systems including MgO surfaces, liquid water, zeolites, a catalytic Pt surface reaction, high-entropy alloys (HEAs), and disordered Zr-oxides. Five MLIP architectures (MACE, NequIP, Allegro, MTP, and Torch-ANI) are trained and tested, focusing not only on traditional metrics (energies, forces, and stresses) but also explicitly validating derived physical observables such as lattice constants, volumes, and reaction barriers. We find that most models reach comparable accuracy on standard error metrics across the simple systems, although equivariant MLIPs offer 1.5–2× improvements over nonequivariant MLIPs in energy and force error for structurally complex or compositionally disordered environments such as HEAs and Zr–O systems. Our analysis highlights that low errors in energy and force predictions do not guarantee reliable observables, emphasizing the necessity of explicit validation. We demonstrate limitations in cross-framework transferability, as models trained on one zeolite framework (CHA) fail to reliably generalize to predictions of structurally distinct frameworks (e.g., MFI). Size-extensive tests show some dependence on system size for MgO, resulting from forced periodicity. The HEA and Zr–O data sets are identified as challenging tests for future benchmarks and MLIP model architecture developments as they show significant differentiation in error between MLIP architectures and are still relatively difficult at 1000 training images. Moving forward, we recommend that benchmarking efforts shift their focus from marginal accuracy improvements in energy and force errors toward identifying and understanding model failure modes, rigorously assessing transferability, and evaluating how their errors affect observable predictions. For researchers looking to choose an MLIP architecture, we suggest selecting equivariant MLIP architectures if the complexity of the system is a challenge. For simple materials problems, auxiliary features such as integration with molecular dynamics engines, trade-offs between computational data set generation cost vs MLIP inference speed, and framework integration may play a more important decision factor than small differences in error metrics that are unlikely to matter for production-level research.

chemical structure↗
DOE OSTI2022

Behavior and mechanisms of Doppler wind lidar error in varying stability regimes

Abstract. Wind lidars are widespread and important tools in atmospheric observations. An intrinsic part of lidar measurement error is due to atmospheric variability in the remote-sensing scan volume. This study describes and quantifies the distribution of measurement error due to turbulence in varying atmospheric stability. While the lidar error model is general, we demonstrate the approach using large ensembles of virtual WindCube V2 lidar performing a profiling Doppler-beam-swinging scan in quasi-stationary large-eddy simulations (LESs) of convective and stable boundary layers. Error trends vary with the stability regime, time averaging of results, and observation height. A systematic analysis of the observation error explains dominant mechanisms and supports the findings of the empirical results. Treating the error under a random variable framework allows for informed predictions about the effect of different configurations or conditions on lidar performance. Convective conditions are most prone to large errors (up to 1.5 m s−1 in 1 Hz wind speed in strong convection), driven by the large vertical velocity variances in convective conditions and the high elevation angle of the scanning beams (62∘). Range-gate weighting induces a negative bias into the horizontal wind speeds near the surface shear layer (−0.2 m s−1 in the stable test case). Errors in the horizontal wind speed and direction computed from the wind components are sensitive to the background wind speed but have negligible dependence on the relative orientation of the instrument. Especially during low winds and in the presence of large errors in the horizontal velocity estimates, the reported wind speed is subject to a systematic positive bias (up to 0.4 m s−1 in 1 Hz measurements in strong convection). Vector time-averaged measurements can improve the behavior of the error distributions (reducing the 10 min wind speed error standard deviation to <0.3 m s−1 and the bias to <0.1 m s−1 in strong convection) with a predictable effectiveness related to the number of decorrelated samples in the time window. Hybrid schemes weighting the 10 min scalar- and vector-averaged lidar measurements are shown to be effective at reducing the wind speed biases compared to cup measurements in most of the simulated conditions, with time averages longer than 10 min recommended for best use in some unstable conditions. The approach in decomposing the error mechanisms with the help of the LES flow field could be extended to more complex measurement scenarios and scans.

17 WIND ENERGY↗
DOE OSTI2025

Robust measurement of microbial reduction of graphene oxide nanoparticles using image analysis

ABSTRACT Shewanella oneidensis ( S. oneidensis ) has the capacity to reduce electron acceptors within a medium and is thus used frequently in microbial fuel generation, pollutant breakdown, and nanoparticle fabrication. Microbial fuel setups, however, often require costly or labor-intensive components, thus making optimization of their performance onerous. For rapid optimization of setup conditions, a model reduction assay can be employed to allow simultaneous, large-scale experiments at lower cost and effort. Since S. oneidensis uses different extracellular electron transfer pathways depending on the electron acceptor, it is essential to use a reduction assay that mirrors the pathways employed in the microbial fuel system. For microbial fuel setups that use nanoparticles to stimulate electron transfer, reduction of graphene oxide provides a more accurate model than other commonly used assays as it is a bulk material that forms flocculates in solutions with a large ionic component. However, graphene oxide flocculates can interfere with traditional absorbance-based measurement techniques. This study introduces a novel image analysis method for quantifying graphene oxide reduction, showing improved performance and statistical accuracy over traditional methods. A comparative analysis shows that the image analysis method produces smaller errors between replicates and reveals more statistically significant differences between samples than traditional plate reader measurements under conditions causing graphene oxide flocculation. Image analysis can also detect reduction activity at earlier time points due to its use of larger solution volumes, enhancing color detection. These improvements in accuracy make image analysis a promising method for optimizing microbial fuel cells that use nanoparticles or bulk substrates. IMPORTANCE Shewanella oneidensis ( S. oneidensis ) is widely used in reduction processes such as microbial fuel generation due to its capacity to reduce electron acceptors. Often, these setups are labor-intensive to operate and require days to produce results, so use of a model assay would reduce the time and expenses needed for optimization. Our research developed a novel digital analysis method for analysis of graphene oxide flocculates that may be utilized as a model assay for reduction platforms featuring nanoparticles. Use of this model reduction assay will enable rapid optimization and drive improvements in the microbial fuel generation sector.

Bennett, Danielle T. (ORCID:0009000188748827)↗