Search NASASearch

SEARCH · Search NASA

Results for “Model Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

A comprehensive framework for validating simulation models of power system equipment using terminal measurements

Accurate simulation of power-plants is essential to the planning and operation of modern power grids. The current methods used to periodically check power-plant simulation models have many open questions about their limitations and accuracy. The research in this project explored using Monte-Carlo Experimentation (MCE) as a means for answering these important questions.

24 POWER TRANSMISSION AND DISTRIBUTION

Verification and Validation of Flow Confinement Modeling using OpenFAST Source Panel Method

Blockage or flow confinement effects in scale wind and water turbine testing in experimental facilities, including wind and water tunnels and tow tanks, can significantly alter incident aerodynamic and hydrodynamic loads, turbine performance (thrust, torque, power output), and wake dynamics compared to unconfined conditions. As scale model tests are key sources of OpenFAST model validation measurements, directly modeling flow confinement and its effects in OpenFAST enables improved model validat

Kim, Dongyoung [Sandia National Laboratories (SNL-

Capability in Theory, Modeling, and Validation for a Range of Innovative Fusion Concepts using High-Fidelity Moment-Kinetic Models

A computational modeling capability is created and available to the fusion community to understand and design lower-cost and innovative fusion concepts. The approach uses high- fidelity kinetic, moment-kinetic, and moment models and includes sophisticated plasma- boundary interactions. A majority of fusion-relevant simulations are performed with magnetohydrodynamic models and hybrid particle-in-cell codes, with limited-fidelity electron and kinetic physics. However, in fusion configurations like Z-pinches, field-reversed- configurations, plasma jet magneto-inertial fusion, spinning mirrors, and others, kinetic effects (both electron and ions) are critical to understand the physics and design scaling into the highly kinetic regime of a burning fusion plasma. Furthermore, as present fusion machines move towards a burning plasma regime, liquid-metal blankets are needed to handle first-wall heat- flux, reduce erosion, and eventually for energy conversion and fuel breeding. The work performed under this ARPA-E BETHE Capability Team advances the state-of-the-art in modeling and understanding plasma dynamics in fusion devices and its coupling with liquid-metal dynamics. These are critical areas of research for fusion energy to become realizable. To address these complex problems, we have leveraged and extended computational capabilities through the code, Gkeyll (developed jointly with Princeton Plasma Physics Laboratory and academic partners), for kinetic and moment modeling of fusion plasmas. The Concept Teams supported by this Capability Team include the Wisconsin High-field Axisymmetric Mirror (WHAM), Centrifugal Mirror Experiment (CFME), Plasma-Jet Magneto- Inertial Fusion (PJMIF), and solid and liquid wall plasma-material interaction studies relevant to a number of fusion concepts including Zap Energy’s Z-pinch. This software is open-source and available to the fusion community as a high-fidelity tool for the design of lower-cost fusion experiments. 3D gyrokinetic simulations of WHAM are now possible for long enough time scales to understand the evolution of interchange instabilities. 3D multi-fluid simulations of CMFE at higher Mach numbers are now possible for detailed design iterations with the goal of stability. The state-of-the-art in understanding shock formation and shock mitigation regimes in merging liners for PJMIF have been furthered by our kinetic simulations. Our novel models and frameworks studying plasma-material interaction by incorporating wall emission for various solid wall materials of relevance to pulsed and steady fusion concepts have advanced the state-of-the-art in our understanding of particle fluxes, heat fluxes, and other quantities at cathodes and anodes. The results from this work may explain discrepancies between experimental and theoretical predictions of achieved current densities in pulsed concepts such as Z-pinches. Another significant contribution of this Capability Team is the development and deployment of a novel experimental platform, LEX (Liquid Electrode eXperiment), at Virginia Tech to understand liquid metal free-surface response to electromagnetic pulses. The novel experiments along with model validation quantified the effect of different materials and sizes of liquid metal droplets on the radiative power balance of fusion plasmas for pulsed concepts. Furthermore, these experiments provided mitigation strategies for violent liquid metal response for high current pulses as would be expected in fusion regimes.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY

The Atacama Cosmology Telescope: DR6 power spectrum foreground model and validation

We discuss the model of astrophysical emission at millimeter wavelengths used to characterize foregrounds in the multi-frequency power spectra of the Atacama Cosmology Telescope (ACT) Data Release 6 (DR6), expanding on Louis et al. (2025) (2503.14452). We detail several tests to validate the capability of the DR6 parametric foreground model to describe current observations and complex simulations, and show that cosmological parameter constraints are robust against model extensions and variations. We demonstrate consistency of the model with pre-DR6 ACT data and observations from Planck and the South Pole Telescope. We evaluate the implications of using different foreground templates and extending the model with new components and/or free parameters. In all scenarios, the DR6 ΛCDM and ΛCDM+N eff cosmological parameters shift by less than 0.5σ relative to the baseline constraints. Some foreground parameters shift more; we estimate their systematic uncertainties associated with modeling choices. From our constraint on the kinematic Sunyaev-Zel'dovich power, we obtain a conservative limit on the duration of reionization of Δz rei < 4.4, assuming a reionization midpoint consistent with optical depth measurements and a minimal low-redshift contribution, with varying assumptions for this component leading to tighter limits. Finally, we analyze realistic non-Gaussian, correlated microwave sky simulations containing Galactic and extragalactic foreground fields, built independently of the DR6 parametric foreground model. Processing these simulations through the DR6 power spectrum and likelihood pipeline, we recover the input cosmological parameters of the underlying cosmic microwave background field, a new demonstration for small-scale CMB analysis. These tests validate the robustness of the ACT DR6 foreground model and cosmological parameter constraints.

CMBR experiments

Validating corrosion models: Influence of physical properties

In chloride containing environments, two metals in physical contact can undergo galvanic corrosion limiting the lifetime of components. Being able to accurately predict galvanic corrosion damage distributions over time has not been widely presented in literature. Therefore, Finite Element Method (FEM) corrosion models were experimentally validated for two galvanic couples as a function of governing equations, environment, anode material, anode:cathode ratio, and time. Carbon steel/stainless steel (CS/SS) and zinc/stainless steel (Zn/SS) galvanic couples were exposed to NaCl solutions at room temperatures for up to 14 days. For the galvanic couples and environments, the Laplace equation with variable conductivity and reactions was sufficient to model the experimental corrosion damage. Increasing the chloride concentration for the CS/SS galvanic couple, regardless of the anode:cathode ratio, decreased the observed and modeled corrosion damage. Decreasing the anode:cathode ratio (i.e., increasing the cathode length), increased the experimentally observed and modeled corrosion damage. For small anode:cathode ratios, the governing equations deviate over long time periods with the Nernst-Plank equation being conservative. For the Zn/SS galvanic couple, the cathode length controls the dominant cathodic reduction reaction. For small cathode lengths, the hydrogen evolution reaction is dominant. For larger cathode lengths, the oxygen reduction reaction is dominant. The results are discussed with regard to the influence of solution chemistry, ohmic drop, and governing reactions. Overall, validated FEM models were presented, and the resultant models, physics, and mechanisms can be applied to other corrosion scenarios with confidence.

Carbon steel

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES

Validation of Exploding Wire Tests Using Alegra-NG

Exploding wire tests are used to characterize materials undergoing high voltage loading and to validate computational models in a simple configuration. In this report, the materials emphasized are gold, aluminum, copper and nickel wires. Model validation is presented using the nominal model (no uncertainty) in the form of heat maps (per material) that show model bias across scalar quantities and initial voltage. Mesh convergence and uncertainty quantification is also presented.

36 MATERIALS SCIENCE

Uncertainty quantification of fireball features extracted from nuclear test films using computer vision

Films from the US’s historic nuclear testing era comprise the only extensive collection of imagery depicting high-yield detonations. These films offer unique insights into the characteristics of flows occurring on scales that are difficult to replicate experimentally, and they are a valuable source of data for the validation of models used to describe nuclear detonations. In recent work, we implemented modern computer vision and machine learning techniques to extract features of the fireball following nuclear detonation. With a training dataset of fireball films, we fine-tuned a You Only Look Once 11 (YOLO11) model to detect and track the fireball. Applied to a video, the outer bounding box produced in each frame by YOLO11 is used as an input prompt to Meta’s Segment Anything Model 2 (SAM2), which is shown to accurately predict the boundary of the fireball over time with high resolution. These state-of-the-art computer vision foundation models exhibit impressive visual accuracy in their results but lack an output of values that robustly quantify uncertainty in scientific applications. In this paper, we develop procedures for uncertainty quantification of extracted fireball features. We outline the application of a parallel attention mechanism to calculate uncertainty ranges that complement and better pose model validation data. This higher quality fireball validation data may serve to improve prognostic models describing nuclear detonations in support of nuclear forensic and emergency response activities.

Khristy, Joel [ORNL] (ORCID:0000000209963060)

Extraction of Vibration Data with Imaging

To date, the primary sensing technology used to measure the vibration response has been accelerometers and strain gages mounted directly to the structure and using either wired or, more recently, wireless telemetry. Cost issues with these sensors and the associated data acquisition systems typically limit the numbers that are deployed on in situ structures. Although there are a few structures with larger sensing counts that in some cases exceed over 1000 sensors, more typical numbers range from ten to one hundred sensors resulting in low spatial resolution when they are applied to physically large systems. When one considers that nuclear power plant structures usually have complex geometries, material properties, connectivity and boundary conditions, it is clear these current approaches to vibration measurements can only provide limited information about a system’s dynamics response characteristics. As an alternative, many non-contact measurement technologies have emerged, including point wise measurement methods such as Global Positioning System (GPS), microwave interferometry, and laser Doppler vibrometry (LDV), as well as simultaneous full-field measurement methods such as electronic speckle pattern interferometry, holography interferometry, and muon tomography, some of which can provide high spatial resolution measurements. Among these methods, digital video imaging techniques have emerged as a feasible solution for full-field vibration measurements that provide significantly more detailed dynamic response information because every pixel becomes a measurement point. Furthermore, recent advances in image processing and computer vision algorithms have been successfully used to process video data for experimental and operational modal analysis. Such full-field measurements have the potential to significantly improve many current structural assessment procedures including system identification (modal parameter estimation), structural health monitoring, load reconstruction, model validation, and model updating. Furthermore, more recent full-field imaging techniques can be accomplished with relatively low-cost, commercially-available off-the-shelf cameras. However, these measurement procedures have other limitations that must be considered such as the ability to only measure visibly accessible points on a structure and a more limited dynamic range and bandwidth than can be achieved with accelerometers or strain gages.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND

Modeling and Validation of Offset Cancellation for Hybrid Photonic-Electronic Transimpedance Amplifier Using All-Electronic Circuits

Hybrid photonic-electronic circuits involving crossdomain feedback signals are difficult to validate and troubleshoot. This paper describes an approach to model and validate an offset-cancellation loop for a hybrid transimpedance amplifier (TIA) using all-electronic circuits. An equivalent electrical model is developed for the tunable interferometer attenuators used for offset trimming, and it includes test features to extract the system performance. The stability analysis of the system shows 75 ◦ of phase margin and 102 dB of gain margin. Measurement results demonstrate good agreement with analysis and successful TIA offset cancellation.

Marchant, Jared

Validating corrosion models: A comparison of governing equations

Experimental validation of Finite Element Method (FEM) models varying electrochemical governing equations, inclusion of chemical reactions, and time on the resultant damage profile for two galvanic couples is explored. Two anode materials (Magnesium AZ31 and Carbon Steel) in contact with a cathode (Stainless Steel 304 L) were modeled in/exposed to NaCl (1 and 0.1 M respectively for the anode materials) for up to one week. The physics approach, inclusion of chemical reactions, and the boundary conditions required to accurately represent the damage profile in FEM models depended on the galvanic couple materials and, ultimately, the corrosion rate. For high rates of corrosion (i.e., magnesium anode), the Nernst-Planck equation with Electroneutrality was sufficient to describe the damage, while, for low rates of corrosion (i.e., carbon steel anode), the Laplace equation was sufficient. In all cases, the most complete governing equation (Nernst-Planck-Poisson Equation) was not necessary to accurately describe the damage. Precipitation reactions in solution also played a critical role in the predicted damage profile, especially for high corrosion rate systems. Finally, for short time periods (< 6 h), the choice of governing equations does not significantly influence damage profile results. Overall, the choice of physics to reduce error in simulations relies on the boundary conditions, geometry, conductivity of the solution, electrochemical potential differences, and time of exposure. The above results are discussed with regard to accuracy and computational savings.

Carbon steel