Search NASA⌕ Search

SEARCH · Search NASA

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Estimating Energy Market Schedules using Historical Price Data

The global climate crisis is expected to reshape the energy generation landscape in the coming decades. Increasing integration of non-dispatchable renewable energy resources into energy infrastructures and markets creates uncertainty as well as new opportunities for flexible energy systems. To conduct proper economic evaluation of flexible energy systems, such as integrated energy systems (IES), advancements in modelling of market interactions, such as bidding, is crucial. This work presents a shortcut algorithm which uses two mixed integer linear programs to compute dispatch schedules (e.g., hourly power production targets) that are constrained by the resource's bid information and characteristics (e.g., minimum up and down times) based on historical locational marginal price (LMP) data. The proposed algorithm is approximately 100 times faster and uses orders of magnitude less data than a full production cost model (PCM). We find the shortcut simulator recapitulates generator dispatch signals for the Prescient PCM with approximately 4% error for the RTS-GMLC test system.

electricity generation↗
DOE OSTI2021

Blending and obscuration in weak-lensing magnification

ABSTRACT We test the impact of some systematic errors in weak-lensing (WL) magnification measurements with the COSMOS 30-band photo-z Survey flux limited to Iauto < 25.0 using correlations of both source galaxy counts and magnitudes. Systematic obscuration effects are measured by comparing counts and magnification correlations. We use the Advanced Camera for Survey-Hubble Space Telescope catalogues to identify potential blending objects (close pairs) and perform the magnification analyses with and without blended objects. We find that blending effects start to be important (∼0.04-mag obscuration) at angular scales smaller than 0.1 arcmin. Extinction and other systematic obscuration effects can be as large as 0.10 mag (U band) but are typically smaller than 0.02 mag depending on the band. After applying these corrections, we measure a 3.9σ magnification signal that is consistent for both counts and magnitudes. The corresponding projected mass profiles of galaxies at redshift z ≃ 0.6 (MI ≃ −21) is Σ = 25 ± 6 M⊙ h3 pc–2 at 0.1 Mpc h–1, consistent with NFW type profile with M200 ≃ 2 × 1012 M⊙h pc–2. Tangential shear and flux-size magnification over the same lenses show similar mass profiles. We conclude that magnification from counts and fluxes using photometric redshifts has the potential to provide complementary WL information in future wide-field surveys once we carefully take into account systematic effects, such as obscuration and blending.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Implementation of a Model Predictive Control Strategy to Regulate Temperature Inside Plug-Flow Solar Reactor With Countercurrent Flow

Abstract Solar-driven thermochemical energy storage systems are proven to be promising energy carriers (solar fuels) to utilize solar energy by using reactive solid-state pellets. However, the production of solar fuel requires a quasi-steady-state process temperature, which represents the main challenge due to the transient nature of solar power. In this work, an adaptive model predictive controller (MPC) is presented to regulate the temperature inside a tubular solar reactor to produce solid-state solar fuel for long-term thermal storage systems. The solar reactor system consists of a vertical tube heated circumferentially over a segment of its length by concentrated solar power, and the reactive pellets (MgMn2O4) are fed from the top end and flow downwards through the heated tube. A countercurrent flowing gas supplied from the lower end interacts with flowing pellets to reduce it thermochemically at a temperature range of 1000—1500 °C. A low-order physical model was developed to simulate the dynamics of the solar reactor including the reaction kinetics, and the proposed model was validated numerically by using a 7-kW electric furnace. The numerical model then was utilized to design the MPC controller, where the control system consists of an MPC code linked to an adaptive system identification code that updates system parameters online to ensure system robustness against external disturbances (sudden change in the flow inside the reactor), model mismatches, and uncertainty. The MPC controller parameters are tuned to enhance the system performance with minimum steady-state error and overshoot. The controller is tested to track different temperature ranges between 500 °C and 1400 °C with different particles/gas mass flowrates and ramping temperature profiles. Results show that the MPC controller successfully regulated the reactor temperature within ± 1 °C of its setpoint and maintained robust performance with minimum input effort when subjected to sudden changes in the amount of flowing media and the presence of chemical reaction.

Engineering↗
DOE OSTI2021

Comparative Assessment of Data-driven Process Models in Health Information Technology

Process mining for conformance analysis consists of comparing a reference process model against a data-driven process model generated via log files from information technology systems. However, in the absence of a complete reference process model, we found no suggested approaches in the literature to address the need for evaluating process conformance among different healthcare facilities to assess standardization of care. Our goal is to find similarities and dissimilarities in data-driven process models among US Veterans Health Administration (VHA) facilities that can be indicative of patient safety issues. Our hypothesis was that the analysis would not produce statistically significant differences in outcome. We present a unique implementation of conformance analysis in process mining that consists of combining process mining, process mapping and statistical metrics. We illustrate our approach by applying it to the analysis of two clinical radiology order process models generated from healthcare data provided by two similar facilities in the VHA. The comparative assessment showed that about 70% of the orders completed successfully and 30% were not completed due to policy and duplications. Our analysis found a good statistical correlation between both facilities, as the Spearman’s correlation coefficient between facilities for the frequency of cases per total hours was 0.87879, for the frequency of cases by state transition was 0.79702 and for the throughput time per state transition was 0.63582. Additional statistical analyses using the Mann-Whitney U test and the root mean square error both produced values that were not significant. The foregoing approach validated our hypothesis by demonstrating a good statistical correlation of data describing the flow of clinical radiology orders absent a credible reference model. Finding good agreement between both facilities was important in confirming that the clinical orders flow in a similar manner, suggesting standardization of care.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Error Study of FlecSim Using the Method of Manufactured Solutions [Slides]

Error was calculated using exact solution chosen with the method of manufactured solutions. Hydrodynamics match expected order of accuracy for spatial error within 1.5% for all variables tested. Radiation transport matches expected order of temporal accuracy within 0.5% for all variables tested.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2026

The Art of Automation: Translating Electron Microscopy Workflows Into Automated Processes

Acquiring data using a scanning transmission electron microscope (STEM) is a complex, multi-step process. The intricacy of the process depends on the type of sample, composition of the material, desired results of the experiment, resolution requirement and other experimental factors. Each experiment presents unique complications, such as sample drift and contamination, that the microscopist must consider when acquiring data. All these challenges are handled fluidly and expertly by experienced microscopists, but to reach new levels of innovation in material development, including greater reproducibility, throughput, and precision, the automation of these workflows is essential. The initial phase of this work involved translating intuition-based workflows into discrete, programmable steps. Some common key stages in STEM workflows are the initial tuning, scanning the sample for areas of interest, and then acquiring the data. Each stage can be broken further into specific parameter adjustments, such as aberration correction and dwell time optimization, depending on the experiment. When deconstructing various experiments each step was assessed for automation feasibility based on the amount of real time operator decisions. There are steps that lend themselves to automation more readily than others, such as course focusing and sample screening, but there is potential for full automation of all stages with time. As an initial step, an automated montage routine was developed, allowing for the efficient acquisition of large portions of the sample without requiring continuous intervention from the operator. The automation of this small process of the procedure demonstrates the value of this capability. A major challenge in automation arises from discrepancies between commanded, reported and actual stage movements. Using systematic tests, stage movement was quantified. This error can be corrected algorithmically for more accurate workflows in the future. Expanding automation capabilities would result in larger, more efficient data acquisition which allows for more robust statistical analysis. Additionally, this work lays the groundwork for a closed loop system where machine learning algorithms would intake automatically acquired data and make real time decisions. By progressively automating this instrument, this work establishes the foundation for fully automated experimentation in transmission electron microscopy.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Eucalyptus – An Analysis Suite for Fault Trees with Uncertainty Quantification

Eucalyptus is a novel code developed at Lawrence Livermore National Laboratory to incorporate uncertainty quantification into Fault Tree Analysis (FTA). This tool addresses the challenge of imperfect knowledge in “grey-box” systems by allowing analysts to incorporate and propagate uncertainty from component-level assessments to system-level effects. Eucalyptus facilitates a consistent evaluation of the impact of subject matter expert judgment and knowledge gaps on overall system response by Monte Carlo generation of possible system fault trees, sampling probabilities of the existence of subsystems and components. Here, the code supports the specification of fault trees through text and allows export to various formats, including auto-generated images, easing analysis and reducing errors. It has undergone extensive verification testing, demonstrating its reliability and readiness for deployment, and leverages on-node parallelism for rapid analysis. Example analyses are shown that include the identification of system failure paths and quantification of the value of further information about system components.

Fault Tree Analysis↗
DOE OSTI2020

Full circle mechanical dynamic characterization including experimental modal analysis and finite element analysis

During operation, it was observed that a specific mechanical system experienced undesirable vibration and it became necessary to understand and mitigate this phenomenon. This document investigates the tools, methodology, and results of the dynamic characterization of the system. The characterization makes use of the experimental modal analysis (EMA) methods of single input multiple output (SIMO) and single input single output (SISO). The validity of the theory of reciprocity is confirmed to minimize measurement error, cost, and time of repeat testing. Finite element analysis (FEA) is used in choosing transducer and modal impact locations to adequately characterize the system. Single degree of freedom (SDOF) and multiple degree of freedom (MDOF) curve fitting is used to fully characterize the system’s mode shapes and natural frequencies. The EMA characterization results are used to modify and validate the FEA model so that FEA can be used to model potential structural modifications to the system to mitigate the undesirable vibration. Structural modifications are chosen, implemented, and their effectiveness is quantified using EMA. Finally, a qualitative evaluation of the methodology of FEA validation by EMA and tuning of the model to match the experimental results is discussed.

42 ENGINEERING↗
DOE OSTI2022

Estimating Energy Market Schedules Using Historical Price Data: Preprint

The global climate crisis is expected to reshape the energy generation landscape in the coming decades. Increasing integration of non-dispatchable renewable energy resources into energy infrastructures and markets increases uncertainty and creates new opportunities for flexible energy systems. To conduct proper economic evaluation of flexible energy systems, such as integrated energy systems (IES), advancements in modelling of market interactions, such as bidding, is crucial. This work presents a shortcut algorithm which uses two mixed integer linear programs to compute dispatch schedules (e.g., hourly power production targets) that are constrained by the resource's bid information and characteristics (e.g., minimum up and down times) based on historical locational marginal price (LMP) data. This is orders of magnitude less data than required for a market clearing calculation with a full production cost model (PCM). We find the shortcut simulator recapitulates generator dispatch signals for the Prescient PCM with approximately 4% error for the RTS-GMLC test system.

electricity generation↗
DOE OSTI2025

A DATA EFFICIENT SPARSE MODELING FRAMEWORK FOR POWER ESTIMATION IN WATER TREATMENT SENSING OPERATIONS

With increasing freshwater scarcity, advanced process design mechanisms such as Closed-Circuit Reverse Osmosis (CCRO) and Digital/Physical Twin systems are gaining traction in water treatment and reuse operations. While digital and physical twin models enable improved system insight and control, their development is often expensive and computationally intensive, requiring large volumes of synthetic or experimental data to characterize underlying process dynamics. This work introduces a sparse surrogate modeling framework to estimate power consumption from measured flow and pressure variables, along with their nonlinear polynomial and interaction expansions. To ensure model reliability and reduce overfitting, a two-stage pipeline is proposed. First, a dynamic data filtering algorithm is employed to remove uninformative observations and transient operational states. Second, a sparse penalized regression technique is applied to select a minimal set of parsimonious features. The proposed model achieves high sparsity, retaining only 7 out of 34 candidate features (≈79.41% sparsity) while delivering a root mean square error (RMSE) of 0.072 on the test dataset.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗
DOE OSTI2021

Modeling protein structures from predicted contacts with modern molecular dynamics potentials: accuracy, sensitivity, and refinement

Protein structure prediction has become increasingly popular and successful in recent years. An essential step for fragment-free, template-free methods is the generation of a final three-dimensional protein model from a set of predicted amino acid contacts that are often described by interresidue pairwise atomic distances. Here we explore the use of modern, open-source molecular dynamics (MD) engines, which have been continually developed over the last three decades with all-atom Hamiltonians to model biomolecular structure and dynamics, to generate accurate protein structures starting from a set of inferred pairwise distances. Additionally, the ability of MD empirical physical potentials to correct inaccuracies in the predicted geometries is tested. We rigorously characterize the effect of modeling parameters on results, the effect of different amounts of error in the predicted distances on the final structures, and test the ability of post-processing analysis to sort the best models out of a set of statistical replicas. We find that with exact distances and with noisy distances, the method can produce excellent structural models, and that the molecular dynamics force field seems to help correct errors in distance predictions, resisting the effects of applied noise.

Davidson, Russ↗
DOE OSTI2023

Low-pass spectral analysis of time-resolved serial femtosecond crystallography data

Low-pass spectral analysis (LPSA) is a recently developed dynamics retrieval algorithm showing excellent retrieval properties when applied to model data affected by extreme incompleteness and stochastic weighting. In this work, we apply LPSA to an experimental time-resolved serial femtosecond crystallography (TR-SFX) dataset from the membrane protein bacteriorhodopsin (bR) and analyze its parametric sensitivity. While most dynamical modes are contaminated by nonphysical high-frequency features, we identify two dominant modes, which are little affected by spurious frequencies. The dynamics retrieved using these modes shows an isomerization signal compatible with previous findings. We employ synthetic data with increasing timing uncertainty, increasing incompleteness level, pixel-dependent incompleteness, and photon counting errors to investigate the root cause of the high-frequency contamination of our TR-SFX modes. By testing a range of methods, we show that timing errors comparable to the dynamical periods to be retrieved produce a smearing of dynamical features, hampering dynamics retrieval, but with no introduction of spurious components in the solution, when convergence criteria are met. Using model data, we are able to attribute the high-frequency contamination of low-order dynamical modes to the high levels of noise present in the data. Finally, we propose a method to handle missing observations that produces a substantial dynamics retrieval improvement from synthetic data with a significant static component. Reprocessing of the bR TR-SFX data using the improved method yields dynamical movies with strong isomerization signals compatible with previous findings.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Adaptive shape control of wavefront-preserving X-ray mirrors with active cooling and heating

This article describes the development and testing of a novel, water cooled, active optic mirror system (called “REAL: Resistive Element Adjustable Length”) that combines cooling with applied auxiliary heating, tailored to the spatial distribution of the thermal load generated by the incident beam. This technique is theoretically capable of sub-nanometer surface figure error control even at high power density. Tests conducted in an optical metrology laboratory and at synchrotron X-ray beamlines showed the ability to maintain the mirror profile to the level needed for the next generation storage rings and FEL mirrors.

42 ENGINEERING↗
DOE OSTI2020

Sensor Drift Estimation for Reactor Systems by Fusing Multiple Sensor Measurements

A nuclear power plant is instrumented with a variety of sensors that monitor its variables to estimate the state and initiate safety actions, if needed. We address the problem of estimating drifts or errors in sensor measurements due to factors such as calibration changes. We propose an information fusion method that uses measurements from other sensors to generate an estimate of a sensor measurement, and its difference from an actual measurement provides an error estimate. We present two fusers based on the ensemble of trees and support vector machine that are trained using sensor measurements collected at an emulated test loop of a pressurized water reactor under no-drift conditions. We present error estimates for a differential pressure sensor of the heat exchanger of the primary coolant system, under twenty controlled scenarios using the test loop. Both positive and negative errors are captured by both methods in scenarios involving calibration drifts, blocking, air gap and electromagnetic interference. The root mean square errors of estimated drifts are typically within 2% percent of the maximum.

Rao, Nageswara↗
DOE OSTI2025

Synthetic spectra for Lyman- α forest analysis in the Dark Energy Spectroscopic Instrument

Synthetic data sets are used in cosmology to test analysis procedures, to verify that systematic errors are well understood and to demonstrate that measurements are unbiased. In this work we describe the methods used to generate synthetic datasets of Lyman-α quasar spectra aimed for studies with the Dark Energy Spectroscopic Instrument (DESI). In particular, we focus on demonstrating that our simulations reproduces important features of real samples, making them suitable to test the analysis methods to be used in DESI and to place limits on systematic effects on measurements of Baryon Acoustic Oscillations (BAO). We present a set of mocks that reproduce the statistical properties of the DESI early data set with good agreement. Additionally, we use a synthetic dataset to forecast the BAO scale constraining power of the completed DESI survey through the Lyman-α forest.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Smoothing tool design and performance during subaperture glass polishing

During subaperture tool grinding and polishing, overlaps of the tool influence function can result in undesirable mid-spatial frequency (MSF) errors in the form of surface ripples, which are often corrected using a smoothing polishing step. Here, in this study, flat multi-layer smoothing polishing tools are designed and tested to simultaneously (1) reduce or remove MSF errors, (2) minimize surface figure degradation, and (3) maximize the material removal rate. A time-dependent convergence model in which spatial material removal varies with a workpiece-tool height mismatch, combined with a finite element mechanical analysis to determine the interface contact pressure distribution, was developed to evaluate various smoothing tool designs as a function of tool material properties, thicknesses, pad textures, and displacements. An improvement in smoothing tool performance is achieved when the gap pressure constant, $\overline{h}$ (which describes the inverse rate at which the pressure drops with a workpiece-tool height mismatch), is minimized for smaller spatial scale length surface features (namely, MSF errors) and maximized for large spatial scale length features (i.e., surface figure). Five specific smoothing tool designs were experimentally evaluated. A two-layer smoothing tool using a thin, grooved IC1000 polyurethane pad (with a high elastic modulus, E pad =360 MPa ), thicker blue foam (with an intermediate modulus, E foam =5.3 MPa ) underlayer, and an optimized displacement (d t =1 mm ) provided the best overall performance (namely, high MSF error convergence, minimal surface figure degradation, and high material removal rate).

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

$\mathrm{SageNet}$: Fast Neural Network Emulation of the Stiff-amplified Gravitational Waves from Inflation

Accurate modeling of the inflationary gravitational waves (GWs) requires time-consuming, iterative numerical integrations of differential equations to take into account their backreaction on the expansion history. To improve computational efficiency while preserving accuracy, we present the Stiff-amplified Gravitational-wave Emulator Network (SageNet), a deep learning framework designed to replace conventional numerical solvers (code available at https://github.com/YifangLuo/SageNet). SageNet employs a long short-term memory architecture to emulate the present-day energy density spectrum of the inflationary GWs with possible stiff amplification, Ω GW (f). Trained on a data set of 25,689 numerically generated solutions, SageNet allows accurate reconstructions of Ω GW (f) and generalizes well to a wide range of cosmological parameters; 90.9% of the test emulations with randomly distributed parameters exhibit errors of under 4%. In addition, SageNet demonstrates its ability to learn and reproduce the artificial, adaptive sampling patterns in numerical calculations, which implement denser sampling of frequencies around changes in spectral indices in Ω GW (f). The dual capability of learning both physical and artificial features of the numerical GW spectra establishes SageNet as a robust alternative to exact numerical methods. Finally, our benchmark tests show that SageNet reduces the computation time from tens of seconds to milliseconds, achieving a speedup of ∼10 4 times over standard CPU-based numerical solvers with the potential for further acceleration on GPU hardware. These capabilities make SageNet a powerful tool for accelerating Bayesian inference procedures for extended cosmological models. In a broad sense, the SageNet framework offers a fast, accurate, and generalizable solution to modeling cosmological observables whose theoretical predictions demand costly differential equation solvers.

Astronomy data modeling↗
DOE OSTI2025

Weak Form Scientific Machine Learning: Test Function Construction for System Identification

Weak form Scientific Machine Learning (WSciML) is a recently developed framework for data-driven modeling and scientific discovery. It leverages the weak form of equation error residuals to provide enhanced noise robustness in system identification via convolving model equations with test functions, reformulating the problem to avoid direct differentiation of data. The performance, however, relies on wisely choosing a set of compactly supported test functions. In this work, we mathematically motivate a novel data-driven method for constructing Single-scale-Local reference functions for creating the set of test functions. Our approach numerically approximates the integration error introduced by the quadrature and identifies the support size for which the error is minimal, without requiring access to the model parameter values. Through numerical experiments across various models, noise levels, and temporal resolutions, we demonstrate that the selected supports consistently align with regions of minimal parameter estimation error. We also compare the proposed method against the strategy for constructing Multi-scale-Global (and orthogonal) test functions introduced in our prior work, demonstrating the improved computational efficiency.

FOS: Computer and information sciences↗