Search NASA⌕ Search

SEARCH · Search NASA

Results for “ERROR ANALYSIS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Short-lead seasonal precipitation forecast in northeastern Brazil using an ensemble of artificial neural networks

This study assesses the deterministic and probabilistic forecasting skill of a 1-month-lead ensemble of Artificial Neural Networks (EANN) based on low-frequency climate oscillation indices. The predictand is the February-April (FMA) rainfall in the Brazilian state of Ceará, which is a prominent subject in climate forecasting studies due to its high seasonal predictability. Additionally, the study proposes combining the EANN with dynamical models into a hybrid multi-model ensemble (MME). The forecast verification is carried out through a leave-one-out cross-validation based on 40 years of data. The EANN forecasting skill is compared with traditional statistical models and the dynamical models that compose Ceará’s operational seasonal forecasting system. A spatial comparison showed that the EANN was among the models with the smallest Root Mean Squared Error (RMSE) and Ranked Probability Score (RPS) in most regions. Moreover, the analysis of the area-aggregated reliability showed that the EANN is better calibrated than the individual dynamical models and has better resolution than Multinomial Logistic Regression for above-normal (AN) and below-normal (BN) categories. It is also shown that combining the EANN and dynamical models into a hybrid MME reduces the overconfidence of the extreme categories observed in a dynamically-based MME, improving the reliability of the forecasting system.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Galvanostatic Intermittent Titration Technique Reinvented: Part I. A Critical Review

The galvanostatic intermittent titration technique (GITT), introduced in 1977 by Weppner and Huggins, provided a readily accessible means to measuring the chemical diffusion coefficient of electrochemical electrode materials. The method continues to be widely used today, but the reported diffusivity values are highly inconsistent, ranging as much as four orders of magnitude for some Li layered oxide compositions. Even qualitative trends of diffusivity are inconsistent, suggesting significant flaws in the implementation of the method. Other variants of the GITT method also suffer from similar inconsistency problems. Here we identify numerous sources of significant error including composition-dependent reaction overpotentials, mathematical flaws in the relaxation analysis methods, finite-size and non-planar geometry effects, inter-particle inhomogeneity issues, early transient effects, and surface area uncertainties. We propose a simple relaxation analysis scheme using the time variable t relax + τ - t relax , where t relax is relaxation time and τ is the galvanostatic pulse duration. We also propose to use dense diffusion-limited samples to isolate the bulk-diffusion process in the time domain. Chemical diffusivity can be extracted much more reliably with this improved implementation of the GITT method.

25 ENERGY STORAGE↗
DOE OSTI2020

RAPTURE User's Manual

This User's Guide serves as a brief introduction to the RAPTURE radiation effects analysis code. It includes an overview of the input format, RAPTURE's error- and consistency-checking of the user-provided input files, the automatic-differentiation and convergce-checking schemes employed by RAPTURE, and the RAPTURE output files. A variety of example problems are included in this Guide which collectively demonstrate RAPTURE's current capabilities and provide a suite of test problems and template input files for the user. This Guide includes, for each problem, the problem description, RAPTURE input files, and comparison of the RAPTURE solution with solutiong generated with the Monte Carlo transport code ITS, the legacy deterministic code ADEPT, and, where possible, published experimental results. An appendix includes a description of all keywords and options in the RAPTURE input file.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Uncertainty in Experimental Data Analysis [Slides]

The talk was presented virtually to the Institute of Fundamental Technological Research, Polish Academy of Sciences in Warsaw, Poland, December 21, 2020. Astronomical observations, unusual medical cases, physics experiments too costly to repeat, natural events like earthquakes, hurricanes – all of them are impossible to repeat yet produce important scientific information not achievable in other way. This data should not be treated as qualitative, anecdotal evidence only. It should be analyzed in a mathematically rigorous way to produce quantitative experimental data. Analysis method for one-of-a-kind event data differs from analysis of a repeated experiment data. For a repeated experiments the experimental error includes a range of true values generated by repetitions of the experiment, and measurement uncertainty caused by detectors. They are independent. Repetitions of any experiment, as similar as achievable, always have built-in differences resulting in a range of the true values rather than in a single true experimental value. Measurement uncertainty depends on the measurement system only. Modern digital measurements have very small uncertainty, frequently smaller than the range of true experimental values resulting from built-in differences in the experiment repetitions. When data from one-of-a-kind experiment are analyzed, only the measurement uncertainty can be reported.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Saline: An API for Thermophysical Properties

An initial interface for thermophysical data was generalized for broader incorporation into modeling and simulation codes used for molten salt reactor analysis. A quality assurance review of the thermophysical properties data was conducted; errors were fixed, and improvements were made with consistency and accuracy to references. The Saline code application programming interface was created to facilitate access and integration of thermophysical properties. This report describes the thermophysical data, the quality assurance improvements, and the Saline interface.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2022

Data Assimilation using Non-invasive Monte Carlo Sensitivity Analysis of Reactor Kinetics Parameters [Slides]

Sensitivity coefficients of prompt neutron decay constant (α) and effective delayed neutron fraction (β eff ) to Pu-239 nuclear data were calculated using a newly available tool (ACEtk). Uncertainty calculations showed the following trends: (1) The prompt neutron decay constant can be used to reduce nuclear data-induced uncertainty in Pu-239(n,f) and (2) the effective delayed neutron fraction can be used to effectively reduce nuclear data-induced uncertainty in Pu-239 total fission $\tilde{v}$. Sensitivity/uncertainty analysis can be used to determine optimal experiment/detector setup to identify compensating errors in nuclear data. Upcoming work includes investigating other nuclide-reaction pairs and response sensitivities, such as Δ$\rho$, neutron leakage spectra, and reaction rate measurements to constrain nuclear data of interest.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Evaluating User Errors and Temporal Trends in Marine Fish Communities Using 360-Degree Underwater Photography

The use of environmental DNA (eDNA) sampling has been proposed as a complementary method to monitor fish species in marine environments, offering a non-invasive and potentially more efficient approach to marine species observations. eDNA monitoring could be especially useful in and around sites targeted for marine energy generation as these regions need regular monitoring that would be impractical with traditional techniques. Before we can fully rely upon eDNA, we must first verify its accuracy against other proven methods, such as the use of underwater photography. In this study, I deployed a 360-degree camera in the tidal channel of Sequim Bay once a month during several hours overlapping slack tide. I investigated how having multiple people identify and count fish on underwater images could affect the overall results. Using chi square tests in R, I compared my fish identifications and counts to those made by another intern on the same images recorded in August. I found significant differences in the number of species identified and the total individual counts between the two different datasets. I also tested the statistical differences in both Shannon diversity and Pielou evenness indices between the August, September, and November camera deployments using a Hutcheson t-test. Only one significant difference was found in the Shannon index comparisons, and none were found between the Pielou evenness comparisons. These findings show that if multiple identifiers are used to process underwater images, quality control checks must be made to reduce the potential for error. This also points toward the possibility to leverage more advanced image analysis processes, such as automated image analysis software. The findings from this study also show that the dynamics of marine fish communities can vary over a few months; however, further analysis is needed to determine the extent of the seasonal changes in Sequim Bay.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Comparing Outdoor to Indoor Performance for Bifacial Modules Affected by Polarization-Type Potential-Induced Degradation

Bifacial photovoltaic (PV) modules have the advantage of using light reflected off of the ground to contribute to power production. Predicting the energy gain is challenging and requires complex models to do so accurately. Often, module degradation over time is neglected in models for the sake of simplicity or is underestimated. Comparing outdoor and indoor current–voltage (I–V) performance for bifacial modules is more challenging than for monofacial modules, as there are additional variables to consider such as rear albedo non-uniformity, cell mismatch, and their effects on temperature. This challenge is compounded when heterogeneous degradation modes occur, such as polarization-type potential-induced degradation (PID-p). To examine the effects of PID-p on I–V predictions using an empirical data-driven approach, 16 bifacial PERC modules are installed outdoors on racks with different albedo conditions. A subset is exposed to high-voltage biases of −1500 V or +1500 V. Outdoor data are traced at irradiance ranges of 150–250 W/m 2 , 500–600 W/m 2 , and 900–1000 W/m 2 . These curves are corrected using control module temperature, wire resistivity, and module resistance measured indoors. We examine several methods to transform indoor I–V curves to accurately, and more simply than existing methods, approximate outdoor performance for bifacial modules without and with varying levels of PID-p degradation. This way, bifacial performance modeling can be more accessible and informed by fielded, degraded modules. Distributions of percent errors between indoor and outdoor performance parameters and Mean Absolute Percent Errors (MAPEs) are used to assess method quality. Results including low-irradiance data (150–250 W/m 2 ) are discussed but are filtered for quantifying method quality as these data introduce substantial errors. The method with the most optimal tradeoff between low MAPE and analysis simplicity involves measuring the front side of a module indoors at an irradiance equal to plane-of-array irradiance plus the product of module bifaciality and albedo irradiance. This method gives MAPE values of 1–6.5% for non-degraded and 1.6–5.9% for PID-p degraded module performance.

14 SOLAR ENERGY↗
DOE OSTI2024

The Active Optics System on the Vera C. Rubin Observatory: Optimal Control of Degeneracy among the Large Number of Degrees of Freedom

Abstract The Vera C. Rubin Observatory is a unique facility for survey astronomy that will soon be commissioned and begin operations. Crucial to many of its scientific goals is the achievement of sustained high image quality, limited only by the seeing at the site. This will be maintained through an active optics system that controls optical element misalignments and corrects mirror figure error to minimize aberrations caused by both thermal and gravitational effects. However, the large number of adjustment degrees of freedom available on the Rubin Observatory introduces a range of degeneracies, including many that are induced by noise due to imperfect measurement of the wave-front errors. We present a structured methodology for identifying these degeneracies through an analysis of image noise level. We also present a novel scaling strategy based on truncated singular value decomposition that mitigates the degeneracy and optimally distributes the adjustment over the available degrees of freedom. Our approach ensures the attainment of optimal image quality, while avoiding excursions around the noise-induced subspace of degeneracies, marking a significant improvement over the previous techniques adopted for Rubin, which were based on an optimal integral controller. This new approach is likely to also yield significant benefits for all telescopes that incorporate large numbers of degrees of freedom of adjustment.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Modeling protein structures from predicted contacts with modern molecular dynamics potentials: accuracy, sensitivity, and refinement

Protein structure prediction has become increasingly popular and successful in recent years. An essential step for fragment-free, template-free methods is the generation of a final three-dimensional protein model from a set of predicted amino acid contacts that are often described by interresidue pairwise atomic distances. Here we explore the use of modern, open-source molecular dynamics (MD) engines, which have been continually developed over the last three decades with all-atom Hamiltonians to model biomolecular structure and dynamics, to generate accurate protein structures starting from a set of inferred pairwise distances. Additionally, the ability of MD empirical physical potentials to correct inaccuracies in the predicted geometries is tested. We rigorously characterize the effect of modeling parameters on results, the effect of different amounts of error in the predicted distances on the final structures, and test the ability of post-processing analysis to sort the best models out of a set of statistical replicas. We find that with exact distances and with noisy distances, the method can produce excellent structural models, and that the molecular dynamics force field seems to help correct errors in distance predictions, resisting the effects of applied noise.

Davidson, Russ↗
DOE OSTI2024

Quantifying replication through repeated analysis of UVM-A, a liquid reference material for cosmogenic 10 Be and 26 Al studies

In this study, in-situ produced cosmogenic nuclide sample preparation and analysis is a complicated, multi-step process with numerous possible sources of error, many of which have not been robustly quantified. Here, we use a liquid reference material (UVM-A) to test whether the analytic precision associated with individual isotopic ratios (n = 96) measured at two Accelerator Mass Spectrometry facilities (Lawrence Livermore National Laboratory and Purdue Rare Isotope Measurement Laboratory) accurately represents the range of values determined for aliquots prepared in a single laboratory over a period of five years. We find that 10 Be/ 9 Be ratios measured at the different accelerator facilities (n = 26 and n = 70) have statistically indistinguishable central tendencies, matching to within 0.1 %. Based on this large dataset, we suggest preliminary consensus values for UVM-A of 1.45 ± 0.06 x 10 -13 for 10 Be/ 9 Be (mean, one standard deviation, n = 96) and 4.47 ± 0.22 x 10 -13 for 26 Al/ 27 Al (mean, one standard deviation, n = 27). For both 10 Be/ 9 Be and 26 Al/ 27 Al, the relative standard deviations of the measured ratios are similar to the reported analytic uncertainties of sample measurement, suggesting that sample preparation introduced little if any additional scatter beyond the uncertainty of isotopic analysis. This dataset demonstrates that robust sample preparation and measurement can generate isotope ratio data reproducible at the level of counting statistics.

58 GEOSCIENCES↗
DOE OSTI2020

Discrete element modeling of switchgrass particles under compression and rotational shear

Switchgrass is a perennial herbaceous plant regarded as a biomass energy crop in the United States for its highadaptability and yield potential. Processing and handling of switchgrass particles are challenging due to the erratic mechanical and flow behavior originating from their intrinsic particulate properties. Here, we present a bonded-sphere discrete element model designed specifically for switchgrass particles. The model simultaneously captures three key particulate features, i.e., fibrous particle shapes, a wide range of particle sizes, and particle deformability. Realistic yet computationally efficient particle shape templates are created based on the image analysis data of switchgrass specimens. A fitting procedure is proposed to ensure both the particle width and length distributions are captured, a unique requirement for fibrous particles. Two full-scale numerical models, i.e., a uniaxial compression model and a Schulze ring shear model, are developed using information fromphysical experiments. The model is calibrated using experimental data of chopped-small switchgrass specimens, and then, is validated using data of chopped-large specimens in both compression and ring-shear tests. Numerical results show that the numerical models capture bulk densities accurately (with an error of 3%) while slightly underestimate the bulk friction angle. Furthermore, an extensive sensitivity analysis reveals that (1) switchgrass particles with rougher edges (due to different processing techniques) exhibit a higher shear strength and a lower flowability; (2) stiffer particles yield a lower bulk density (up to 21% lower) compared to more deformable particles, indicating particle deformability should be incorporated when modeling biomass flow in a preprocessing system.

09 BIOMASS FUELS↗
DOE OSTI2022

Development of a leading simulator/trailing simulator methodology as part of an integrated safety-security analysis for nuclear power plants

Nuclear power plant (NPP) risk assessment is broadly separated into disciplines of nuclear safety, security, and safeguards. Different analysis methods and computer models have been constructed to analyze each of these as separate disciplines. However, due to the complexity of NPP systems, there are risks that can span all these disciplines and require consideration of safety-security (2S) interactions which allows a more complete understanding of the relationship among these risks. In this work, a novel leading simulator/trailing simulator (LS/TS) method is introduced to integrate multiple generic safety and security computer models into a single, holistic 2S analysis. A case study is performed using this novel method to determine its effectiveness. The case study shows that the LS/TS method avoided introducing errors in simulation, compared to the same scenario performed without the LS/TS method. A second case study is then used to illustrate an integrated 2S analysis which shows that different levels of damage to vital equipment from sabotage at a NPP can affect accident evolution by several hours.

42 ENGINEERING↗
DOE OSTI2020

Stability Analysis of Inline ZFP Compression for Floating-Point Data in Iterative Methods

Currently, the dominating constraint in many high performance computing applications is data capacity and bandwidth, in both internode communications and even moreso in intranode data motion. A new approach to address this limitation is to make use of data compression in the form of a compressed data array. Storing data in a compressed data array and converting to standard IEEE-754 types as needed during a computation can reduce the pressure on bandwidth and storage. However, repeated conversions (lossy compression and decompression) introduce additional approximation errors, which need to be shown to not significantly affect the simulation results. Here, we extend recent work that analyzed the error of a single use of compression and decompression of the ZFP compressed data array representation to the case of time-stepping and iterative schemes, where an advancement operator is repeatedly applied in addition to the conversions. We show that the accumulated error for iterative methods involving fixed-point and time evolving iterations is bounded under standard constraints. An upper bound is established on the number of additional iterations required for the convergence of stationary fixed-point iterations. An additional analysis of traditional forward and backward error of stationary iterative methods using ZFP compressed arrays is also presented. The results of several 1D, 2D, and 3D test problems are provided to demonstrate the correctness of the theoretical bounds.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Compressed baryon acoustic oscillation analysis is robust to modified-gravity models

Abstract We study the robustness of the baryon acoustic oscillation (BAO) analysis to the underlying cosmological model. We focus on testing the standard BAO analysis that relies on the use of a template. These templates are constructed assuming a fixed fiducial cosmological model and used to extract the location of the acoustic peaks. Such “compressed analysis” had been shown to be unbiased when applied to the ΛCDM model and some of its extensions. However, it has not been known whether this type of analysis introduces biases in a wider range of cosmological models where the template may not fully capture relevant features in the BAO signal. In this study, we apply the compressed analysis to noiseless mock power spectra that are based on Horndeski models, a broad class of modified-gravity theories specified with eight additional free parameters. We study the precision and accuracy of the BAO peak-location extraction assuming DESI, DESI II, and MegaMapper survey specifications. We find that the bias in the extracted peak locations is negligible; for example, it is less than 10% of the statistical error for even the proposed future MegaMapper survey. Our findings indicate that the compressed BAO analysis is remarkably robust to the underlying cosmological model.

Astronomy & Astrophysics↗
DOE OSTI2019

Identification of Performance Shaping Factor Lag and Linger Effects for Dynamic Human Reliability Analysis: Application of Experimental Data

Many researchers have emphasized the importance of dynamic probabilistic safety assessment (PSA), which highlights the necessity of studies for dynamic human reliability analysis (HRA). Dynamic HRA concentrates on a dynamic account of human actions or how performance shaping factors (PSFs) can dynamically modify the human error probability (HEP) over time. In contrast, existing static HRA does not consider human actions as changes over time or event progressions. Accordingly, previous research on dynamic HRA conceptually suggested PSF lag and linger effects to treat dependence between operator actions in dynamic HRA versus existing approaches. As follow-up research, this study attempted to identify PSF lag and linger effects for dynamic HRA on the basis of experimental data. Firstly, mathematical models for PSF lag and linger effects were developed based on a literature survey in the field of biology. Secondly, we analyzed experimental scenarios from a control room study to identify operator actions considered in PSA. Lastly, based on the experimental data, the effect of the stress PSF with lag and linger effects was compared to that without PSF lag and linger effects. This paper concludes with an overall discussion of PSF lag and linger effects based on the relation between the stress PSF and error occurrence.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

A Look Inside the Black Box: Using graph-theoretical descriptors to interpret a Continuous-Filter Convolutional Neural Network (CF-CNN) trained on the global and local minimum energy structures of neutral water clusters

A Continuous Filter Convolutional Neural Network (CF-CNN) was trained to predict the potential energy of water cluster networks \ce{(H2O)_{\textit{N}}}, \textit{N}=10--30, corresponding to local minima lying within 5 kcal/mol from the putative minima taken from a newly published database containing over 5 million unique networks. The chemical sampling space of the database was characterized using chemical descriptors derived from graph theory, which led to the identification of important trends in the topology, connectivity, polygon structures associated with the various networks as a function of cluster size. The resulting graphs are available alongside the original database at \url{https://sites.uw.edu/wdbase/}. The CF-CNN trained on a subset of 500,000 networks for (\textit{N}=10, 30) yielded a mean absolute error of 0.002$\pm$0.002 kcal/mol per water molecule, giving the trained CF-CNN the highest accuracy of any neural network-based surrogate model to date. In addition, clusters of sizes not included in the training set exhibited errors of the same magnitude, indicating that the CF-CNN ptotocol is general enough to accurately predict energies of networks for both smaller and larger sizes than those used during training. The graph-theoretical descriptors were developed in order to analyze the properties of the full database and interpret the predictive power of the CF-CNN. Using topology measures, such as the Wiener index and the average shortest path length along with two similarity measures, we showed that all networks from the test set were within the range of the ones from the training set, suggesting that the training set covered the chemical space of interest quite well. Our graph analysis suggests that the mean degree and number of polygons for networks with larger errors tend to lie further from the mean than those with lower errors. The generality of the used CF-CNN was thus demonstrated, while the use of the graph-theoretical descriptors assisted in interpreting the predicted results.

Bilbrey, Jenna A.↗
DOE OSTI2020

Benchmark calculations of radiative forcing by greenhouse gases

Changes in concentrations of greenhouse gases lead to changes in radiative fluxes throughout the atmosphere. The value of this change, the instantaneous radiative forcing, varies across climate models, due partly to differences in the distribution of clouds, humidity, and temperature across models, and partly due to errors introduced by approximate treatments of radiative transfer. This paper describes an experiment within the Radiative Forcing Model Intercomparision Project that uses benchmark calculations made with line–by–line models to identify parameterization error in the representation of absorption and emission by greenhouse gases. Clear–sky instantaneous forcing by greenhouse gases is computed using a set of 100 profiles, selected from a re–analysis of present–day conditions, that represent the global annual mean forcing from pre–industrial times to the present–day with sampling errors of less than 0.01 W m –2 . Six contributing line–by–line models agree in their estimate of this forcing to within 0.025 W m –2 while even recently–developed parameterizations have typical errors four or more times larger, suggesting both that the samples reveal true differences among line–by–line models and that parameterization error will be readily identifiable. Agreement among line–by–line models is better in the longwave than in the shortwave where differing treatments of the water vapor vapor continuum affect estimates of forcing by carbon dioxide and methane. The impacts of clouds on instantaneous radiative forcing are estimated from climate model simulations. Here, the adjustment due to stratospheric temperature change by assuming fixed dynamical heating. Adjustments are large only for ozone and for carbon dioxide, for which stratospheric cooling introduces modest non–linearity.

54 ENVIRONMENTAL SCIENCES↗