Search NASA⌕ Search

SEARCH · Search NASA

Results for “ERROR ANALYSIS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

HPC Network Simulation Tuning via Automatic Extraction of Hardware Parameters

Popular HPC network interconnection simulators such as SST/macro provide a variety of configurable parameters to explore the design space of hardware components such as network interface cards (NIC), switches, and links among them. While such knobs provide flexibility to explore design trade-offs for novel hardware, manually configuring simulations for matching configurations of the existing hardware to focus on topology exploration can be cumbersome and error-prone, leading to widely inaccurate simulations. This challenge is compounded when specifications of various (proprietary) technologies are not readily available or intentionally omitted. In this work, we propose a framework to autotune the multiple network models’ simulation configurations within SST/macro using Tree-structured Parzen Estimator-based Bayesian optimization to observe the effect on simulation accuracy across different message regimes. These regimes consist of small to large message sizes and latency to bandwidth-bound messages. We provide a detailed analysis of the simulation error for four representative HPC systems. Our Bayesian optimization based autotuning framework for network models achieves a maximum of 5x improvement in accuracy over best-effort manual configurations based on available hardware specifications.

Simulation, autotuning↗
DOE OSTI2025

Co-Firing Switchgrass and Waste Coal in A Power Plant: A Techno-Economic and Life Cycle Evaluation for The Ohio River Valley (SWITCH) (Final Technical Report for Ohio State/FE0032204)

Abandoned coal mine lands (AMLs) represent one of the most persistent environmental challenges in the United States. Prior to the enactment of the Surface Mining Control and Reclamation Act (SMCRA) in 1977, coal mining operations were not legally required to reclaim disturbed lands, leaving behind approximately 500,000 AML sites nationwide. These sites pose severe environmental and health risks, including acid mine drainage, soil and water contamination, and spontaneous combustion of waste coal piles. Millions of Americans live within one mile of these AMLs, underscoring the urgency of remediation. Traditional reclamation practices, such as planting cool-season grasses, often fail to fully restore ecological function or leverage the economic potential of these lands. This project addressed these challenges by developing integrated strategies for resource recovery, land reclamation, and sustainable energy production. This project evaluated an integrated strategy to convert this liability into an opportunity by recovering waste coal and co-firing it with switchgrass (Panicum virgatum L.) cultivated on reclaimed or marginal AML areas in existing coal-fired power plants. Switchgrass not only provides a renewable feedstock but also aids in land reclamation and carbon sequestration. 1) Remote Sensing and Machine Learning for Waste Coal Identification Using Sentinel-2 satellite imagery and supervised classification, we applied four machine learning models to detect historical waste coal piles. Random Forest achieved the highest accuracy (precision: 86%, recall: 77%). Time-series analysis revealed gradual vegetation recovery since 1986, indicating natural reclamation processes in historical sites, while active mining areas showed ongoing disturbance. This workflow enables scalable monitoring and prioritization of reclamation efforts. 2) UAS-Based Stockpile Volume Estimation To quantify recoverable waste coal, we evaluated Unmanned Aerial Systems (UAS) equipped with Light Detection and Ranging (LiDAR) and multispectral sensors. Structure-from-Motion (SfM) photogrammetry combined with interpolated Digital Terrain Models (DTMs) achieved strong agreement with LiDAR reference volumes (Root Mean Square Error (RMSE) ≈147 m 3 , Mean Absolute Percentage Error (MAPE) ≈2%). Sensitivity analysis confirmed that spatial resolution significantly influences accuracy, emphasizing the need for high-resolution data for precise volume estimation. This approach offers a scalable, cost-effective, and accurate alternative to conventional ground-based surveys. 3) Switchgrass Cultivation for Bioenergy and Water Quality Improvement We assessed the hydrological and water quality impacts of converting AMLs to switchgrass production areas using the Soil and Water Assessment Tool (SWAT). Results showed that converting 10% of the watershed area into the switchgrass production zone reduced streamflow by 3.1%, total suspended solids by 18.1%, total nitrogen by 7.6%, and total phosphorus by 6.2%, while achieving biomass yields of 8.6–9.2 metric tons per hectare. These findings highlight switchgrass as a dual-benefit strategy for land reclamation and bioenergy feedstock production. 4) Integrated Co-Firing and CCS for Carbon-Negative Power Generation We modeled co-firing scenarios using the Power Plant Flexible Model (PPFM) to evaluate plant efficiency, greenhouse gas (GHG) emissions, and levelized cost of electricity (LCOE). Without carbon capture and storage (CCS), increasing switchgrass co-firing ratios reduced LCOE from $\$$150/MWh at 0% biomass to $\$$110/MWh at full substitution. Under CCS, costs remained higher (~$\$$250/MWh at 0% biomass) but decreased to $\$$200/MWh at 100% biomass, while enabling net-zero or carbon-negative electricity due to switchgrass sequestration benefits. Although CCS introduced efficiency penalties, pairing it with biomass co-firing offset these impacts and maximized climate benefits. Overall, optimizing co-firing ratios between 60-100%, supported by reliable logistics and storage strategies, emerged as a practical pathway to balance affordability, sustainability, and net-zero or negative GHG emissions while promoting productive reuse of AMLs.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2020

Accurate contrast determination for X-ray speckle visibility spectroscopy

X-ray speckle visibility spectroscopy using X-ray free-electron lasers has long been proposed as a probe of fast dynamics in noncrystalline materials. In this paper, numerical modeling is presented to show how the data interpretation of visibility spectroscopy can be impacted by the nonidealities of real-life X-ray detectors. Using simulated detector data, this work provides a detailed analysis of the systematic errors of several contrast extraction algorithms in the context of low-count-rate X-ray speckle visibility spectroscopy and their origins are discussed. Here, it was found that the finite detector charge cloud and pixel size lead to an unavoidable `degeneracy' in photon position determination, and that the contrasts extracted using different algorithms can all be corrected by a simple linear model. The results suggest that experimental calibration of the correction coefficient at the count rate of interest is possible and essential. This allows computationally lightweight algorithms to be implemented for on-the-fly analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Fluorescent amplification for next generation sequencing (FA-NGS) library preparation

BACKGROUND: Next generation sequencing (NGS) has become a universal practice in modern molecular biology. As the throughput of sequencing experiments increases, the preparation of conventional multiplexed libraries becomes more labor intensive. Conventional library preparation typically requires quality control (QC) testing for individual libraries such as amplification success evaluation and quantification, none of which occur until the end of the library preparation process. RESULTS: In this study, we address the need for a more streamlined high-throughput NGS workflow by tethering real-time quantitative PCR (qPCR) to conventional workflows to save time and implement single tube and single reagent QC. We modified two distinct library preparation workflows by replacing PCR and quantification with qPCR using SYBR Green I. qPCR enabled individual library quantification for pooling in a single tube without the need for additional reagents. Additionally, a melting curve analysis was implemented as an intermediate QC test to confirm successful amplification. Sequencing analysis showed comparable percent reads for each indexed library, demonstrating that pooling calculations based on qPCR allow for an even representation of sequencing reads. To aid the modified workflow, a software toolkit was developed and used to generate pooling instructions and analyze qPCR and melting curve data. CONCLUSIONS: We successfully applied fluorescent amplification for next generation sequencing (FA-NGS) library preparation to both plasmids and bacterial genomes. As a result of using qPCR for quantification and proceeding directly to library pooling, the modified library preparation workflow has fewer overall steps. Therefore, we speculate that the FA-NGS workflow has less risk of user error. The melting curve analysis provides the necessary QC test to identify and troubleshoot library failures prior to sequencing. While this study demonstrates the value of FA-NGS for plasmid or gDNA libraries, we speculate that its versatility could lead to successful application across other library types.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Adaptive hyperparameter updating for training restricted Boltzmann machines on quantum annealers

Restricted Boltzmann Machines (RBMs) have been proposed for developing neural networks for a variety of unsupervised machine learning applications such as image recognition, drug discovery, and materials design. The Boltzmann probability distribution is used as a model to identify network parameters by optimizing the likelihood of predicting an output given hidden states trained on available data. Training such networks often requires sampling over a large probability space that must be approximated during gradient based optimization. Quantum annealing has been proposed as a means to search this space more efficiently which has been experimentally investigated on D-Wave hardware. D-Wave implementation requires selection of an effective inverse temperature or hyperparameter (β) within the Boltzmann distribution which can strongly influence optimization. Here, we show how this parameter can be estimated as a hyperparameter applied to D-Wave hardware during neural network training by maximizing the likelihood or minimizing the Shannon entropy. We find both methods improve training RBMs based upon D-Wave hardware experimental validation on an image recognition problem. Neural network image reconstruction errors are evaluated using Bayesian uncertainty analysis which illustrate more than an order magnitude lower image reconstruction error using the maximum likelihood over manually optimizing the hyperparameter. The maximum likelihood method is also shown to out-perform minimizing the Shannon entropy for image reconstruction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Comparison of Human Performance between Operators and Students Using Rancor Microworld Simulator: A Preliminary Result

This paper describes an experiment using the Rancor Microworld simulator to probe into differences in human performance between students and actual operators. Six human performance measures – 1) time, 2) error, 3) workload, 4) situational awareness, 5) attention patterns, and 6) number of manipulations – are measured from experiments. The experiment has been conducted for 11 operators and 20 students so far. More experiments and analyses will be continued. Further experimental studies using Rancor Microworld are expected to be able to collect additional data that may be missing from full-scope studies and contribute to items that can support human reliability data.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

Human Performance Analysis Depending on Operator Expertise (Student vs. Operator) and Simulator Complexity (Rancor Microworld vs. Compact Nuclear Simulator)

Human reliability analysis (HRA) evaluates human errors and provides human error probabilities (HEPs) for application in probabilistic safety assessment (PSA), which is a comprehensive safety assessment method for nuclear power plants (NPPs). Generally, HRA methods estimate HEPs based on human reliability data collected from actual historical measurement, simulator experiments, or expert judgement. Most recent HRA data collection studies focus on collecting data via full-scope main control room (MCR) simulators with actual licensed reactor operators. Contrary to this, Idaho National Laboratory (INL) has adopted a different approach, which attempts to collect HRA data based on experiment using simplified simulators and student participants by following the Simplified Human Error Experimental Program (SHEEP). This approach has a couple of advantages compared to full-scope data collection. Representatively, it has relatively low entry point for collecting HRA data, and secures large sample sizes with reasonable cost and labor. In the previous studies, we developed the SHEEP framework, then verified whether the data collected through the framework could support a representative full-scope data collection study, i.e., the Human Reliability Data Extraction (HuREX) study. Also, we analyzed human performance measurements depending on participant type (i.e., student vs. operator). In this paper, we analyze human performance data collected from an experiment comparing operator expertise and simulator complexity when using the more simplified simulator developed by INL, i.e., Rancor Microworld and the less simplified simulator, i.e., Compact Nuclear Simulator (CNS) developed by Korea Atomic Energy Research Institute (KAERI). Analysis of variance (ANOVA) tests and correlation analysis are used for analyzing the experimental data.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

SpotSDC: Revealing the Silent Data Corruption Propagation in High-Performance Computing Systems

We report the trend of rapid technology scaling is expected to make the hardware of high-performance computing (HPC) systems more susceptible to computational errors due to random bit flips. Some bit flips may cause a program to crash or have a minimal effect on the output, but others may lead to silent data corruption (SDC), i.e., undetected yet significant output errors. Classical fault injection analysis methods employ uniform sampling of random bit flips during program execution to derive a statistical resiliency profile. However, summarizing such fault injection result with sufficient detail is difficult, and understanding the behavior of the fault-corrupted program is still a challenge. In this article, we introduce SpotSDC, a visualization system to facilitate the analysis of a program's resilience to SDC. SpotSDC provides multiple perspectives at various levels of detail of the impact on the output relative to where in the source code the flipped bit occurs, which bit is flipped, and when during the execution it happens. SpotSDC also enables users to study the code protection and provide new insights to understand the behavior of a fault-injected program. Based on lessons learned, we demonstrate how what we found can improve the fault injection campaign method.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Nucleon momentum fraction, helicity and transversity from 2+1-flavor lattice QCD

A detailed analysis of the systematic uncertainties in the calculation of the isovector momentum fraction, ( x ) u - d , helicity moment, ( x ) Δ u - Δ d , and the transversity moment, ( x ) δu - δd , of the nucleon is presented using high-statistics data on seven ensembles of gauge configurations generated by the JLab/W&M/LANL/MIT collaborations using 2 + 1-flavors of dynamical Wilson-clover quarks. The much higher statistics have facilitated better control over all systematics compared to previous lattice calculations. The least understood systematic — excited-state contamination — is quantified by studying the variation of the results as a function of different estimates of the mass gap of the first excited state, obtained from two- and three-point correlation functions, and as a function of the pion mass M π . The final results are obtained using a simultaneous fit in the lattice spacing a , pion mass M π and the finite volume parameter M π L keeping leading order corrections. The data show no significant dependence on the lattice spacing and some evidence for finite-volume corrections. Our final results, in the $ \overline{\mathrm{MS}} $ scheme at 2 GeV, are ( x ) u - d = 0 . 155(17)(20), ( x ) Δ u - Δ d = 0 . 183(14)(20) and ( x ) δu - δd = 0 . 220(18)(20), where the first error is the overall analysis uncertainty assuming excited-state contributions have been removed, and the second is an additional systematic uncertainty due to possible residual excited-state contributions. These results are consistent with phenomenological global fit values.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Understanding Calibration and Error Propagation in Longitudinal and Lateral Manganin Gauge Shock Experiments

Soda-lime glass remains elastic under shock pressures up to approximately 6.5 GPa. In this paper, soda lime glass shock experiments are used to understand the calibration and error propagation in longitudinal and lateral manganin gauge experiments. The errors in the calibration process for both longitudinal and lateral manganin gauge experiments are identified and discussed. Five soda-lime glass experiments up to 3 GPa are analyzed using this refined technique. The results show good agreement between the experimental data and the published calibration by Rosenberg and Moshel. Errors are propagated from the experimental data measurements and the assumptions that are made in the calibration, where the bulk of the error seems to come from uncertainty in the dynamic yield strength of manganin. Finally, the method presented in this paper allows for analysis of dynamic shock experiments with longitudinal and lateral manganin gauges including error propagation.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Probabilistic Look-ahead Contingency Analysis Integration with Commercial Tool and Practical Data

This paper presents an initial effort of integrating a smart sampling-based probabilistic look-ahead contingency analysis algorithm with General Electric (GE) Grid Solutions’ commercial energy management system (EMS) tool as a proof-of-concept for a seamless research tool integration using real world large-scale grid data. With the increasing impact of random forces such as variable generation and load, their stochastic behaviors cannot be ignored. However, the current practices are still dominated by deterministic tools. They are becoming increasingly inadequate for the future grid. The developed look-ahead contingency analysis algorithm incorporates forecast errors of variable energy and load to address the challenges brought by the increasing uncertainty of power system. The algorithm can reveal the potential violations caused by the variance of variable energy and load that are not normally detected by traditional deterministic approaches. To test its performance under practical environments ( real data with real commercial tool), significant efforts have been made to prepare test cases, modify GE EMS tool, and adapt an extreme value distribution algorithm to analyze the GE EMS’s violation-only outputs. The test results clearly demonstrate the effectiveness of the developed algorithm as new transformer violations that were not previously detected have been identified. This performance provides better situational awareness to engineers for their decision-making process under uncertainty. Moreover, with the discussion of computational performance and future work, this paper has shown a clear path for integrating the probabilistic algorithm with commercial tools to make us better equipped for the changing power system.

Modeling and simulation of power systems, constrai↗
DOE OSTI2021

A spatial evaluation of Arctic sea ice and regional limitations in CMIP6 historical simulations

The Arctic sea ice response to a warming climate is assessed in a subset of models participating in Phase 6 of the Coupled Model Intercomparison Project (CMIP6), using several metrics in comparison with satellite observations and results from the Pan-Arctic Ice Ocean Modeling and Assimilation System and the Regional Arctic System Model. Our study examines the historical representation of sea ice extent, volume, and thickness using spatial analysis metrics, such as the integrated ice-edge error, Brier score, and Spatial Probability Score. We find that the CMIP6 multi-model mean captures the mean annual cycle and 1979-2014 sea ice trends remarkably well. However, individual models experience a wide range of uncertainty in the spatial distribution of sea ice when compared against satellite measurements and reanalysis data. Our metrics expose common and individual regional model biases, which sea ice temporal analyses alone do not capture. We identify large ice edge and ice thickness errors in Arctic sub-regions, implying possible model specific limitations in or lack of representation of some key physical processes. We postulate that many of them could be related to the oceanic forcing, especially in the marginal and shelf seas, where seasonal sea ice changes are not adequately simulated. We therefore conclude that an individual model’s ability to represent the observed/reanalysis spatial distribution still remains a challenge. We propose the spatial analysis metrics as useful tools to diagnose model limitations, narrow down possible processes affecting them, and guide future model improvements critical to the representation and projections of Arctic climate change.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

The continuum and leading twist limits of parton distribution functions in lattice QCD

In this study, we present continuum limit results for the unpolarized parton distribution function of the nucleon computed in lattice QCD. This study is the first continuum limit using the pseudo-PDF approach with Short Distance Factorization for factorizing lattice QCD calculable matrix elements. Our findings are also compared with the pertinent phenomenological determinations. Inter alia, we are employing the summation Generalized Eigenvalue Problem (sGEVP) technique in order to optimize our control over the excited state contamination which can be one of the most serious systematic errors in this type of calculations. A crucial novel ingredient of our analysis is the parameterization of systematic errors using Jacobi polynomials to characterize and remove both lattice spacing and higher twist contaminations, as well as the leading twist distribution. This method can be expanded in further studies to remove all other systematic errors.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Deep Koopman learning of nonlinear time-varying systems

Here this paper presents a data-driven approach to approximate the dynamics of a nonlinear time-varying system (NTVS) by a linear time-varying system (LTVS), which results from the Koopman operator and deep neural networks. Analysis of the approximation error between states of the NTVS and the resulting LTVS is presented. Simulations on a representative NTVS show that the proposed method achieves small approximation errors, even when the system changes rapidly. Furthermore, simulations in an example of quadcopters demonstrate the computational efficiency of the proposed approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

The Adjoint Petrov–Galerkin method for non-linear model reduction

Here, we formulate a new projection-based reduced-order modeling technique for non-linear dynamical systems. The proposed technique, which we refer to as the Adjoint Petrov–Galerkin (APG) method, is derived by decomposing the generalized coordinates of a dynamical system into a resolved coarse-scale set and an unresolved fine-scale set. A Markovian finite memory assumption within the Mori–Zwanzig formalism is then used to develop a reduced-order representation of the coarse scales. This procedure leads to a closed reduced-order model that displays commonalities with the adjoint stabilization method used in finite elements. The formulation is shown to be equivalent to a Petrov–Galerkin method with a non-linear, time-varying test basis, thus sharing some similarities with the Least-Squares Petrov–Galerkin method. Theoretical analysis examining a priori error bounds and computational cost is presented. Numerical experiments on the compressible Navier–Stokes equations demonstrate that the proposed method can lead to improvements in numerical accuracy, robustness, and computational efficiency over the Galerkin method on problems of practical interest. Improvements in numerical accuracy and computational efficiency over the Least-Squares Petrov–Galerkin method are observed in most cases.

42 ENGINEERING↗
DOE OSTI2025

Computing material volume fractions on a superimposed mesh as applied to Monte Carlo particle transport simulations

Here, we present a newly implemented ray tracing algorithm in OpenMC for efficiently computing material volume fractions on superimposed meshes in complex geometries. By firing rays along each coordinate direction through the geometry, the approach accumulates track-length data in each mesh element, thereby determining the fractional composition of each material. Scaling studies on three different models—a random tetrahedra configuration, the Frascati Neutron Generator ITER dose rate benchmark, and a stellarator design—show excellent parallel performance, with nearly linear speedup on modern multi-threaded and distributed-memory systems. An analysis of the residual error relative to high-resolution reference solutions demonstrated that under optimal conditions it decreases as 1/R, where R is the number of rays fired, making it straightforward to achieve user-prescribed accuracy. This new functionality enables practical, mesh-based approaches for detailed nuclear analyses in production Monte Carlo workflows without resorting to expensive, fully conformal or unstructured meshing.

Monte Carlo↗
DOE OSTI2025

Characterization of Gas-Phase Native(-like) Proteins Using Structures for Lossless Ion Manipulations

High-resolution mobility-based ion separations in Structures for Lossless Ion Manipulations (SLIM) have been useful for ion mobility separations for a variety of molecular classes in the gas phase. Here, in this study, we present multipass SLIM separations for gas-phase proteins in their near-native state exhibiting charge-state-dependent arrival time distributions using carbonic anhydrase (29 kDa), alcohol dehydrogenase (148 kDa), and apo-transferrin (79 kDa). The experimental CCS values were obtained from calibration curves for the arrival times of Agilent Tune Mix ions. For multipass separations, the ATDs were converted to CCS values by deconvoluting the multipass arrival times into accurate single-pass values amenable to the single-pass calibration curves. Mass spectra of carbonic anhydrase (CA) showed three different charge states (z = 9+ to 11+). Their corresponding mobility peaks were baseline-separated by using 8-m single-pass separations. When compared to the corresponding drift tube ion mobility (DTIMS) measurements, the CCS values obtained from DTIMS and SLIM were in agreement within experimental error. Single-pass analysis of alcohol dehydrogenase (ADH) exhibits three predominant charge states (z = 23+ to 25+) with mobility overlap between adjacent charge states. The mobility peak resolution for ADH improved with multipass separations (up to 24-m path length). In addition, CCS distributions obtained for charge states z = 16+ to 18+ of apo-transferrin reveal a transition from a compact unimodal form (z = 18+ and 19+) to broader multimodal CCS distributions for z = 16+. For apo-transferrin, 40-m multipass separations were performed allowing for complete isolation of the selected mobility range corresponding to z = 17+, leading to selective isolation of a narrow arrival time window. The extended mobility separations provided minimal alterations to the structure of the proteins, and the experimentally derived CCS values showed minimal change as a function of the separation time or number of passes. Mobility-based ion separations for native-like proteins, using SLIM, open opportunities for native-IMS applications as well as other manipulations enabled by SLIM-like mobility-selective isolation and collection.

charge state distribution↗