Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Integrated Tiger Series (ITS) Code Validation and Uncertainty Quantification for Electron Number Albedo in Various Materials

In the 1970’s and 1980’s, researchers at Sandia National Laboratories produced electron albedo data for a range of materials. Since that time, the electron albedo data has been used for a wide variety of purposes including the validation of Monte Carlo electron transport codes. This report was compiled to examine the electron albedo experiment results in the context of Integrated Tiger Series (ITS) validation. The report presents tables and figures that could provide insight into the underlying model form uncertainty present in the ITS code. Additionally, the report provides data on potential means to reduce these model form errors by highlighting potential refinements in the cross-section generation process.

97 MATHEMATICS AND COMPUTING↗

Large Language Model for Validation, Optical Calibration, and Learning (VOCAL) Distributed Temperature Sensing Interface

Distributed temperature sensing (DTS) using fiber optic sensors (FOS) offers a promising method for temperature measurements in advanced reactors, such as sodium fast reactors and molten salt cooled reactors. To support the calibration and validation of DTS measurements, Argonne National Laboratory developed the Validation, Optical Calibration, and Learning (VOCAL) software package. This report describes the integration of a local large language model (LLM) with a retrieval-augmented generation (RAG) system into the VOCAL interface to serve as an interactive user assistant. The LLM framework enhances the VOCAL platform’s accessibility to users by explaining interface components, clarifying inputs and outputs, and answering user queries dynamically in real-time. The accuracy of the LLM assistant performance was evaluated with 20 queries regarding the interface and its parameters using experimental data from the Thermal Hydraulic Experimental Test Article (THETA) facility. Results demonstrate that the LLM achieved a 95% accuracy rate, with a BERTScore of 0.8816 and SBERT value of 0.7417. Furthermore, validation of the RAG system within the LLM framework showed optimal accuracy with k-values between 1 and 2 using the k-refinement convergence test. The prompt perturbation analysis demonstrated good initial consistency for the RAG system, exhibiting the highest accuracy under punctuation variations and the greatest sensitivity under query reordering. Notably, the model’s errors were limited to data retrieval failures rather than factual hallucinations, reinforcing its baseline reliability. The integration of LLM provides a highly accurate, userfriendly enhancement to the VOCAL platform without disrupting its core computational capabilities for FOS calibration and validation.

Hong, Evan↗

Stability analysis of model-free control under constrained inputs for control of building HVAC systems

Recently introduced model-free control method has witnessed successful applications in various domains. While the framework of model-free control renders it simple and efficient, it imposes difficulties in implementing the method for complex applications under external constraints. Moreover, there is a lack of literature on the study and application of model-free control under constrained environments. This paper attempts to further the study of model-free control by employing it for monitoring indoor temperature of buildings through the control of building heating, ventilation and air conditioning (HVAC) system and studying the control design stability conditions under constrained inputs. Two kinds of constraints on the control input are considered and their stability conditions are investigated. The developed framework aims to highlight a potential path to analyze the stability under a given set of constraints. The results of employing model free control on the building HVAC system under unconstrained and constrained inputs are presented. The role of the model estimation error on the stability is also discussed.

Telsang, Bhagyashri↗

Indirect Validation of Probe Speed Data on Arterial Corridors

This study aimed to estimate the accuracy of probe speed data on arterial corridors on the basis of roadway geometric attributes and functional classification. It was assumed that functional class (medium and low) along with other road characteristics (such as weighted average of the annual average daily traffic, average signal density, average access point density, and average speed) were available as correlation factors to estimate the accuracy of probe traffic data. This study tested these factors as predictors of the fidelity of probe traffic data by using the results of an extensive validation exercise. This study showed strong correlations between these geometric attributes and the accuracy of probe data when they were assessed by using average absolute speed error. Linear models were regressed to existing data to estimate appropriate models for medium- and low-type arterial corridors. The proposed models for medium- and low-type arterials were validated further on the basis of the results of a slowdown analysis. These models can be used to predict the accuracy of probe data indirectly in medium and low types of arterial corridors.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Characterizing the elements of Earth s radiative budget: Applying uncertainty quantification to the CESM

Understanding and characterizing sources of uncertainty in climate modeling is an important task. Because of the ever increasing sophistication and resolution of climate modeling it is increasing important to develop uncertainty quantification methods that minimize the computational cost that occurs when these methods are added to climate modeling. This research explores the application of sparse stochastic collocation with polynomial edge detection to characterize portions of the probability space associated with the Earth s radiative budget in the Community Earth System Model (CESM). Specifically, we develop surrogate models with error estimates for a range of acceptable input parameters that predict statistical values of the Earth s radiative budget as derived from the CESM simulation. We extend these results in resolution from T31 to T42 and in parameter space increasing the degrees of freedom from two to three.

Archibald, Richard K↗

Parameter and Prediction uncertainty in an optimized terrestrial carbon cycle model: Effects of constraining variables and data record length

Many parameters in terrestrial biogeochemical models are inherently uncertain, leading to uncertainty in predictions of key carbon cycle variables. At observation sites, this uncertainty can be quantified by applying model-data fusion techniques to estimate model parameters using eddy covariance observations and associated biometric data sets as constraints. Uncertainty is reduced as data records become longer and different types of observations are added. We estimate parametric and associated predictive uncertainty at the Morgan Monroe State Forest in Indiana, USA. Parameters in the Local Terrestrial Ecosystem Carbon (LoTEC) are estimated using both synthetic and actual constraints. These model parameters and uncertainties are then used to make predictions of carbon flux for up to 20 years. We find a strong dependence of both parametric and prediction uncertainty on the length of the data record used in the model-data fusion. In this model framework, this dependence is strongly reduced as the data record length increases beyond 5 years. If synthetic initial biomass pool constraints with realistic uncertainties are included in the model-data fusion, prediction uncertainty is reduced by more than 25% when constraining flux records are less than 3 years. If synthetic annual aboveground woody biomass increment constraints are also included, uncertainty is similarly reduced by an additional 25%. When actual observed eddy covariance data are used as constraints, there is still a strong dependence of parameter and prediction uncertainty on data record length, but the results are harder to interpret because of the inability of LoTEC to reproduce observed interannual variations and the confounding effects of model structural error.

Post, Wilfred M↗

Remote Radiation Sensing Using Aerial and Ground Platforms

Remote sensing of ionizing radiation has a significant role in waste management, nuclear material management and nonproliferation, and radiation safety. Robotic platforms can surpass the number of tasks that are achieved by humans. With this technique, the operator's radiation exposure can be decreased. Remote sensing allows for the evaluation and monitoring of radiological contamination. Gamma-ray and neutron sensors were integrated onto the robotic platforms. This approach allows for the radiation sensor data to be dynamically tracked and mapped thus enabling further analysis of the radiation flux in temporal and spatial domains. The goal is to complete scheduled tasks while the robot is being irradiated. To achieve this, electronic components must be shielded and radiation hardened. CZT Detector: Cadmium Zinc Telluride (CZT) detector technology has been a promising solution for gamma-ray and x-ray measurements. Detector data is transferred to the Odroid minicomputer that controls and powers the module via the USB. Robot Operating System (ROS) was utilized for data acquisition and data fusion. The Mariscotti method was employed for the spectrum analysis. A function was programmed in ROS for the automatic identification of photopeaks. CLYC Detector: A Cs{sub 2}LiYCl{sub 6}:Ce{sup 3+} (CLYC) detector was used for simultaneous medium-resolution gamma-ray measurements and neutron counting. A 2.54 cm diameter photomultiplier tube (PMT) was equipped with a high voltage supply and a miniature digitizer. Gamma-ray excitation: fast core-to-valence luminescence (CVL) with 1 ns decay constant, and prompt Ce{sup 3+} emission with 50 ns decay constant. Neutron excitation: slow cerium self-trapped excitation (Ce{sup 3+} STE), 1000 ns decay constant. Radiation Source Localization: Maximum Likelihood Estimation (MLE) and gradient-based methods were used to locate the position of a radiation source based on measured radiation intensities. Multi-Particle Transport Code FLUKA: Estimation of radiation damage of the electronic components is important in order to optimize the robot's operational time while it is irradiated. Displacement per atom (DPA) represents the radiation damage in materials exposed to the ionizing radiation. Various shielding layers of different thickness t were analyzed (< 5% statistical error). The model of the controller of the UAS was designed in FLUKA. Conclusion: CZT and CLYC detectors were integrated onto the robotic platforms. Radiation source localization and contour mapping using robotic platforms were studied. Functions for data analysis and fusion were developed in ROS. FLUKA code was utilized to analyze DPA values. Layers of low-density and high-density materials were used to shield the UAS electronics.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Hadron production cross-sections at relativistic energies with large phase-space coverage - Paper 39

Accurate measurements of soft particle production in hadronic interactions at relativistic energies have long been an experimental challenge, in particular when the measurement is over a large final state phase-space, and when multiple combinations of beam and targets are investigated. Lacking quantitative predictions from the fundamental theory of quantum chromo-dynamics (QCD) in the non-perturbative sector, the study of soft hadronic physics needs to rely on precise, self-consistent, high-statistics data sets with full phase-space coverage and low systematic errors. Phenomenological models of particle production in hadronic collisions need such data to constrain their parameters, and possibly to discriminate among the underlying features of these models. In this article the 'soft' physics refers to production of particles with transverse momenta, pT, below 2 GeV/c, which comprises over 99% of the total production cross-section. It is also known as 'bulk' particle production, or the 'underlying event' in reference to the background of hard processes, particles produced with much larger transverse momentum which are usually described in the framework of perturbative QCD. Improving these models is of interest of the Radiation Protection and Shielding Division (RPSD) community, as well as the availability of accurate data with large phase space coverage. The NA49 collaboration has published new, high precision, and comprehensive sets of inclusive meson and baryon cross sections in p+p and p+C interactions over most of the available phase space with comparisons to past experimental results. The corresponding physics analysis presents a model-independent approach to soft hadronic physics and constitutes a novel approach to exploration of this non-perturbative sector of QCD. The precision study of p+A interactions may allow for differentiation between assumptions underlying different microscopic models of bulk particle production in relativistic hadronic collisions, and thus aid model development. The final data on inclusive particle production including the invariant double differential cross sections, the transversely integrated yields, and the developed interpolations, along with the published papers and other documents relevant to this work are conveniently available. (author)

61 RADIATION PROTECTION AND DOSIMETRY↗

Errors from approximation of ODE systems with reduced order models

This is a code to calculate the error from approximation of systems of ordinary differential equations (ODEs) by using Proper Orthogonal Decomposition (POD) Reduced Order Models (ROM) methods and to compare and analyze the errors for two POD ROM variants. The first variant is the standard POD ROM, the second variant is a modification of the method using the values of the time derivatives (a.k.a. time-derivative snapshots). The code compares the errors from the two variants under different conditions.

Vassilevska, Tanya↗

Logical error rates for the surface code under a mixed coherent and stochastic circuit-level noise model inspired by trapped ions

With fault-tolerant quantum computing (FTQC) on the horizon, it is critical to understand sources of logical errors in plausible hardware implementations of quantum error-correcting codes. Detailed error modeling of computational instructions on particular FTQC architectures will enable the better prediction of error propagation in FT-encoded quantum circuits while revealing where greater attention is needed in hardware design. In this work, we consider logical error rates for the surface code implemented on a hypothetical grid-based trapped-ion quantum charge-coupled device architecture. Specifically, we construct logical channels for the idling surface code and examine its diamond error under a mixed coherent and stochastic circuit-level noise model inspired by trapped ions. We include the coherent dephasing noise that is known to accumulate during physical qubit idling and transport in these systems, determining idling and transport durations using the time-resolved output of an open-source trapped-ion surface code compiler. To estimate expectation values of logical Pauli observables following hardware circuits containing non-Clifford sources of noise, we utilize a Monte Carlo technique to sample from an underlying quasiprobability distribution of Clifford circuits that we independently simulate in a phase-sensitive fashion. We verify error suppression up to code distance 𝑑 = 11 at coherent dephasing rates near and below those of current-generation trapped-ion quantum computers and find that logical error rates align with those of analogous fully stochastic simulations in this regime. Exploring higher dephasing rates at 𝑑 = 3−5, we find evidence for growing coherent rotations about all three logical Pauli axes, increased diagonal logical error process matrix elements relative to those of stochastic simulations, and a reduced dephasing rate threshold. Overall, our work paves a way toward realistic hardware emulation of small fault-tolerant quantum processes, e.g., members of an FTQC instruction set.

Quantum benchmarking↗

TU-EF-304-04: A Heart Motion Model for Proton Scanned Beam Chest Radiotherapy

Purpose: To model fast-moving heart surface motion as a function of cardiac-phase in order to compensate for the lack of cardiac-gating in evaluating accurate dose to coronary structures. Methods: Ten subjects were prospectively imaged with a breath-hold, cardiac-gated MRI protocol to determine heart surface motion. Radial and planar views of the heart were resampled into a 3-dimensional volume representing one heartbeat. A multi-resolution optical flow deformable image registration algorithm determined tissue displacement during the cardiac-cycle. The surface of the heart was modeled as a thin membrane comprised of voxels perpendicular to a pencil beam scanning (PBS) beam. The membrane’s out-of-plane spatial displacement was modeled as a harmonic function with Lame’s equations. Model accuracy was assessed with the root mean squared error (RMSE). The model was applied to a cohort of six chest wall irradiation patients with PBS plans generated on phase-sorted 4DCT. Respiratory motion was separated from the cardiac motion with a previously published technique. Volumetric dose painting was simulated and dose accumulated to validate plan robustness (target coverage variation accepted within 2%). Maximum and mean heart surface dose assessed the dosimetric impact of heart and coronary artery motion. Results: Average and maximum heart surface displacements were 2.54±0.35mm and 3.6mm from the end-diastole phase to the end-systole cardiac-phase respectively. An average RMSE of 0.11±0.04 showed the model to be accurate. Observed errors were greatest between the circumflex artery and mitral valve level of the heart anatomy. Heart surface displacements correspond to a 3.6±1.0% and 5.1±2.3% dosimetric impact on the maximum and mean heart surface DVH indicators respectively. Conclusion: Although heart surface motion parallel to beam’s direction was substantial, its maximum dosimetric impact was 5.1±2.3%. Since PBS delivers low doses to coronary structures relative to photon radiotherapy, it is unknown whether this variation would be clinically significant for late effects.

60 APPLIED LIFE SCIENCES↗

Convergence of Weak-SINDy Surrogate Models

In this paper, we give an in-depth error analysis for surrogate models generated by a variant of the Sparse Identification of Nonlinear Dynamics (SINDy) method. We start with an overview of a variety of nonlinear system identification techniques, namely SINDy, weak-SINDy, and the occupation kernel method. Under the assumption that the dynamics are a finite linear combination of a set of basis functions, these methods establish a linear system to recover coefficients. We illuminate the structural similarities between these techniques and establish a projection property for the weak-SINDy technique. Following the overview, we analyze the error of surrogate models generated by a simplified version of weak-SINDy. In particular, under the assumption of boundedness of a composition operator given by the solution, we show that (i) the surrogate dynamics converges towards the true dynamics and (ii) the solution of the surrogate model is reasonably close to the true solution. Finally, as an application, we discuss the use of a combination of weak-SINDy surrogate modeling and proper orthogonal decomposition (POD) to build a surrogate model for partial differential equations (PDEs).

97 MATHEMATICS AND COMPUTING↗

PROGRESS TOWARDS NEXT GENERATION, WAVEFORM BASED THREE-DIMENSIONAL MODELS AND METRICS TO IMPROVE NUCLEAR EXPLOSION MONITORING IN THE MIDDLE EAST

Efforts to update current wave speed models of the Middle East require a thoroughly tested database of sources and recordings. Recordings of seismic waves traversing the region from Tibet to the Red Sea will be the principal metric in guiding improvements to the current wave speed model. Precise characterizations of the earthquakes, specifically depths and faulting mechanisms, are essential to avoid mapping source errors into the refined wave speed model. Errors associated with the source are manifested in amplitude and phase changes. Source depths and paths near nodal planes are particularly error prone as small changes may severely affect the resulting wavefield. Once sources are quantified, regions requiring refinement will be highlighted using adjoint tomography methods based on spectral element simulations [Komatitsch and Tromp (1999)]. An initial database of 250 regional Middle Eastern events from 1990-2007, was inverted for depth and focal mechanism using teleseismic arrivals [Kikuchi and Kanamori (1982)] and regional surface and body waves [Zhao and Helmberger (1994)]. From this initial database, we reinterpreted a large, well recorded subset of 201 events through a direct comparison between data and synthetics based upon a centroid moment tensor inversion [Liu et al. (2004)]. Evaluation was done using both a 1D reference model [Dziewonski and Anderson (1981)] at periods greater than 80 seconds and a 3D model [Kustowski et al. (2008)] at periods of 25 seconds and longer. The final source reinterpretations will be within the 3D model, as this is the initial starting point for the adjoint tomography. Transitioning from a 1D to 3D wave speed model shows dramatic improvements when comparisons are done at shorter periods, (25 s). Synthetics from the 1D model were created through mode summations while those from the 3D simulations were created using the spectral element method. To further assess errors in source depth and focal mechanism, comparisons between the three methods were made. These comparisons help to identify problematic stations and sources which may bias the final solution. Estimates of standard errors were generated for each event's source depth and focal mechanism to identify poorly constrained events. A final, well characterized set of sources and stations will be then used to iteratively improve the wave speed model of the Middle East. After a few iterations during the adjoint inversion process, the sources will be reexamined and relocated to further reduce mapping of source errors into structural features. Finally, efforts continue in developing the infrastructure required to 'quickly' generate event kernels at the n-th iteration and invert for a new, (n+1)-th, wave speed model of the Middle East. While development of the infrastructure proceeds, initial tests using a limited number of events shows the 3D model, while showing vast improvement compared to the 1D model, still requires substantial modifications. Employing our new, full source set and iterating the adjoint inversions at successively shorter periods will lead to significant changes and refined wave speed structures of the Middle East.

58 GEOSCIENCES↗

Deployment of Traditional and Hybrid Machine Learning for Critical Heat Flux Prediction in the CTF Thermal-Hydraulics Code

Critical heat flux (CHF) marks the transition from nucleate to film boiling, where heat transfer to the working fluid can rapidly deteriorate. Accurate CHF prediction is essential for efficiency, safety, and preventing equipment damage, particularly in nuclear reactors. Although widely used, empirical correlations frequently exhibit discrepancies when compared to experimental data, limiting their reliability in diverse operational conditions. Traditional machine learning (ML) approaches have demonstrated potential for CHF prediction but often suffer from limited interpretability, data scarcity, and insufficient knowledge of physical principles. Hybrid model approaches, which combine data-driven ML with base models, mitigate these concerns by incorporating prior knowledge of the domain. This study integrates an externally trained purely data-driven ML model and two hybrid models (using the Biasi and Bowring CHF correlations) within the CTF subchannel code via a custom Fortran framework. Performance was evaluated using two validation cases: a subset of the Nuclear Regulatory Commission (NRC) CHF database and the Bennett dryout experiments. In both cases, the hybrid models demonstrated significantly lower error metrics compared to conventional empirical correlations, with the best models often reducing relative error by about 5 percentage points. The pure ML model achieved comparable accuracy, outperforming the hybrid Biasi model in the NRC test case (3.3% versus 5.5% relative error) but exhibiting slightly higher error against the hybrid Bowring model in the Bennett test case (7.7% versus 6.1%). Trend analysis of error parity indicated that ML-based models reduced the tendency for CHF overprediction, improving overall accuracy. These results demonstrate that ML-based CHF models can be effectively integrated into subchannel codes and could potentially increase performance compared to conventional methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Training models using forces computed by stochastic electronic structure methods

Abstract Quantum Monte Carlo (QMC) can play a very important role in generating accurate data needed for constructing potential energy surfaces. We argue that QMC has advantages in terms of a smaller systematic bias and an ability to cover phase space more completely. The stochastic noise can ease the training of the machine learning model. We discuss how stochastic errors affect the generation of effective models by analyzing the errors within a linear least squares procedure, finding that there is an advantage to having many relatively imprecise data points for constructing models. We then analyze the effect of noise on a model of many-body silicon finding that noise in some situations improves the resulting model. We then study the effect of QMC noise on two machine learning models of dense hydrogen used in a recent study of its phase diagram. The noise enables us to estimate the errors in the model. We conclude with a discussion of future research problems.

Ceperley, David M. (ORCID:0000000150826271)↗