Search NASA⌕ Search

SEARCH · Search NASA

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Validation and Calibration of Energy Models with Real Vehicle Data from Chassis Dynamometer Experiments

Accurate estimation of vehicle fuel consumption typically requires detailed modeling of complex internal powertrain dynamics, often resulting in computationally intensive simulations. However, many transportation applications-such as traffic flow modeling, optimization, and control-require simplified models that are fast, interpretable, and easy to implement, while still maintaining fidelity to physical energy behavior. This work builds upon a recently developed model reduction pipeline that derives physics-like energy models from high-fidelity Autonomie vehicle simulations. These reduced models preserve essential vehicle dynamics, enabling realistic fuel consumption estimation with minimal computational overhead. While the reduced models have demonstrated strong agreement with their Autonomie counterparts, previous validation efforts have been confined to simulation environments. This study extends the validation by comparing the reduced energy model's outputs against real-world vehicle data. Focusing on the MidSUV category, we tune the baseline Autonomie model to closely replicate the characteristics of a Toyota RAV4. We then assess the accuracy of the resulting reduced model in estimating fuel consumption under actual drive conditions. Our findings suggest that, when the reference Autonomie model is properly calibrated, the simplified model produced by the reduction pipeline can provide reliable, semi-principled fuel rate estimates suitable for large-scale transportation applications.

42 ENGINEERING↗

Validation of the DESI-DR1 3x2-pt analysis: scale cut and shear ratio tests

Combined survey analyses of galaxy clustering and weak gravitational lensing (3x2-pt studies) will allow new and accurate tests of the standard cosmological model. However, careful validation is necessary to ensure that these cosmological constraints are not biased by uncertainties associated with the modelling of astrophysical or systematic effects. In this study we validate the combined 3x2-pt analysis of the Dark Energy Spectroscopic Instrument Data Release 1 (DESI-DR1) spectroscopic galaxy clustering and overlapping weak lensing datasets from the Kilo-Degree Survey (KiDS), the Dark Energy Survey (DES), and the Hyper-Suprime-Cam Survey (HSC). By propagating the modelling uncertainties associated with the non-linear matter power spectrum, non-linear galaxy bias and baryon feedback, we design scale cuts to ensure that measurements of the matter density and the amplitude of the matter power spectrum are biased by less than 30% of the statistical error. We also test the internal consistency of the data and weak lensing systematics by performing new measurements of the lensing shear ratio. We demonstrate that the DESI-DR1 shear ratios can be successfully fit by the same model used to describe cosmic shear correlations, and analyse the additional information that can be extracted about the source redshift distributions and intrinsic alignment parameters. This study serves as crucial preparation for the upcoming cosmological parameter analysis of these datasets.

Emas, N. [Swinburne U., Ctr. Astrophys. Supercompu↗

V1G Frequency Regulation: Algorithm Development, Validation & Analysis at Scale

Researchers at Argonne National Laboratory developed and validated a high-fidelity digital twin of a smart charging (V1G) ecosystem to model the participation of up to 1,000 unique electric vehicles (EVs) in the PJM frequency regulation market. Utilizing a discrete-event framework, the simulation models complex interactions, from dynamic grid signals (updated every 2 seconds) to individual EV charging dynamics. The simulation incorporates multiple EV models created from real-world lab test data. Researchers tested multiple control algorithms to balance the dual objectives of maximizing aggregator’s revenue and driver charging needs. Results demonstrate that aggregated EVs function as a controllable, highly effective grid resource, achieving high PJM Performance Scores (80–90%). Additionally, an optimized, market-aware bidding strategy was identified as key to profitability. The platform was shown to provide drivers with an average charging discount of nearly 50%. The algorithm was further validated in the lab using production EVs and charging stations to compare simulation results with real-world performance.

Manne, Nithin↗

Development and Validation of MALAMUTE model for Electric Field Assisted Sintering of Structural Materials

Fusion power plant designs feature extreme material performance requirements for structural material candidates. In addition to conventional alloys, more advanced composites and oxide dispersion strengthened (ODS) alloys are being explored, however, achieving the desired microstructures to maximize performance using traditional manufacturing methods can be challenging. The advanced manufacturing (AM) electric field-assisted sintering (EFAS) technique offers improved control over the final microstructure through higher heating and cooling rates and moderate pressures. Modeling and simulation tools show promise in elucidating the process-structure-property-performance (PSPP) correlation for AM-produced parts, including the EFAS process. An inherently multiscale process, the EFAS technique aligns well with the multiscale modeling capability of the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE)[cite]. We present here an electro-thermo-mechanical approach to modeling the EFAS process using the MOOSE Application Library for Advanced Manufacturing UTilitiEs (MALAMUTE) code. Prediction of the field and gradient distributions across the EFAS tooling is required to accurately describe the conditions for the lower-scale microstructural evolution models. In this work we present the MALAMUTE model developed to predict the electrical potential, temperature, and mechanical stress distribution across the EFAS graphite tooling and part at the larger engineering-scale. Validation of the MALAMUTE engineering-scale model is completed using data from experimental densification and pre-densified runs of iron powder via EFAS at 1000oC. These runs were conducted using a Thermal Technology DCS-5 EFAS system. Data collected during the experiment runs include the direct current (DC) supplied to the graphite tooling, the temperature of the graphite tooling as measured with a pyrometer, and the force applied to the top of the graphite tooling stack, and the data were recorded every 10 seconds. Our validation approach used the current and force data from the EFAS run as boundary condition inputs to the MAMALUTE simulation; the temperature data were used to evaluate the MALAMUTE EFAS model prediction. Results of the MALAMUTE simulations are employed to connect the external pyrometer temperature measurement to the temperature profile across the part undergoing consolidation. We investigate the impact of material property variation and mesh deformation on the temperature profile as predicted by MALAMUTE. We conclude by highlighting projects where the MALAMUTE EFAS modeling and simulation capabilities will be used to assist experimental design.

36 - MATERIALS SCIENCE↗

Air-Cooled RCCS CFD Modeling Validation 2025

Slide deck for the Advanced Reactor Technologies Gas Cooled Reactor (ART-GCR) program review. The slides show the progress on the air-cooled reactor cavity cooling system (RCCS) CFD validation work. The validation of the air-cooled RCCS is performed using the experimental facility at the University of Wisconsin-Madison. The slide deck provides a progress update on this year's achievements. The natural convection tests under uniform power are modeled and compared with the experimental results. The results show good agreement with the experimental results. A sensitivity study on the RANS turbulence models is performed. Additionally, the contribution of radiative and convective heat transfer within the heated cavity is calculated and compared to forced convection setups.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

SEM Milestone Report for MARMOT Validation Project

MARMOT is a meso-scale fuel code under development by NEAMS designed to predict the microstructure evolution of fuel materials to determine updated thermal and mechanical property models. These updated models can be used by engineering scale codes such as BISON. To support its development and validation the MARMOT Validation Project (MVP) was initiated and consists of extensive microstructure and thermal characterization of U-10Zr fuel material before and at discreet levels of irradiation. This report summarizes the SEM and EDS characterization of the lowest burnup samples (1.5% FIMA) and how they compare to pre-irradiation SEM and EDS.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Post-Event Fault Identification with Machine Learning for Protection System Validation

Power system protection devices have transitioned over the past few decades from mechanical to analog devices, then to solid state and finally digital. Relays and their associated critical network of equipment have significantly increased in complexity. Even internally, relays have gained significant intricacy, with relatively simple overcurrent or differential functions now being assisted by a myriad of other functions. This is necessary as the grid becomes more complex, but it brings increased difficulty in monitoring and upkeep. Misoperation caused by accidental improper relay settings or deliberate malicious actions is a constant challenge faced by all utilities. These improper settings can be difficult to identify and may require exhaustive post-mortem analysis, typically after a major outage event has already occurred. A mechanism is needed for monitoring the behavior of protection systems to validate that their performance falls within expectations. Relays that fail to isolate a fault or trip when there is no system disturbance can be flagged for settings review in situations where this behavior may not have been noticed due to manual restoration or backup protection operations. This work presents a concept for a machine learning (ML) system capable of validating the performance of protection systems by identifying fault events and characterizing protection system responses based solely on available current and voltage measurements. As a first step in its development, an experimental dataset is generated, and a random forest model is implemented with high accuracy in distinguishing four power system scenarios.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

Protection System Validation Using Post-Event Anomaly Classification with Machine Learning

Power system protection devices have transitioned over the past few decades from mechanical to analog devices, then to solid state and finally digital. Relays and their associated critical network of equipment have significantly increased in complexity. Even internally, relays have gained significant intricacy, with relatively simple overcurrent or differential functions now being assisted by a myriad of other functions. This is necessary as the grid becomes more complex, but it brings increased difficulty in monitoring and upkeep. Misoperation caused by improper relay settings or malicious actions is a constant challenge faced by all utilities. These improper settings can be difficult to identify and may require exhaustive post-mortem analysis, typically after a major outage event has already occurred. A mechanism is needed for monitoring the behavior of protection systems to validate that they act and perform as expected. This work presents a concept for a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. As a first step in its development, an experimental dataset is generated, and a random forest model is implemented with high accuracy in distinguishing four power system scenarios.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

Validation and Verification of Python based Neutron Spectrum Unfolding Software

To validate and verify the python-based code (PySL), designed to replicate the programs used by STAYSL for Beam Correction Factor (BCF) and Self-Shielding Factor (SHIELD), a series of tests were performed. To test BCF a python script was written to generate a random flux history file and both versions of the code processed the data. The test verified matching values up to at least one decimal place, approximately 10,000 tests where run and each one passed. Isotopes began to fail the tests once neutron saturation was reached. To verify this the total time of exposure was varied the isotopes that failed were compared to a list of their half-lives. The test process for SHIELD was very similar but, in this case, the code began by producing an input file with varying thickness and device type/environment for the SHIELD input. The failure condition for this test was if any of the data points for an isotope had a difference above 3%. Approximately 40 of these tests were run and there were only 3 isotopes that had reoccurring failures but only 2% of their points were above the 3% difference. A visual comparison was conducted by plotting the results from both programs. Although the test failed, the differences between their values were minuscule, and the self-shielding factor’s shape was preserved when plotted. Next steps for this project will be validating and verifying the python-based SigPhi code and then reproducing and testing the least squares unfolding performed by STAYSL.

73 - NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Protection System Validation with Machine Learning Anomaly Classification

A poster for the Early Career Poster Session. Power system protection devices have transitioned over the past few decades from mechanical to analog devices, then to solid state and finally digital. Relays and their associated critical network of equipment have significantly increased in complexity. Even internally, relays have gained significant intricacy, with relatively simple overcurrent or differential functions now being assisted by a myriad of other functions. This is necessary as the grid becomes more complex, but it brings increased difficulty in monitoring and upkeep. Misoperation caused by improper relay settings or malicious actions is a constant challenge faced by all utilities. These improper settings can be difficult to identify and may require exhaustive post-mortem analysis, typically after a major outage event has already occurred. A mechanism is needed for monitoring the behavior of protection systems to validate that they act and perform as expected. This work presents a concept for a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. As a first step in its development, an experimental dataset is generated, and a random forest model is implemented with high accuracy in distinguishing four power system scenarios.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

ECAR-7300 Rev 1 Verification and Validation of MCNP6.2 for MARVEL Neutronic Analysis

This report documents the verification and validation (V&V) efforts of the Monte Carlo N-Particle transport code (MCNP) version 6.2 on the Sawtooth supercomputer for the Microreactor Applications Research Validation and Evaluation (MARVEL) microreactor required for the preliminary documented safety analysis. This document records V&V for a safety, hazards, analysis, and design software used for design and analysis of safety class structures, system and components (SSC)s.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Validating Protection System Behavior with Machine Learning in a Master State Overseer

As power system protection devices continue the widespread transition from analog to digital, they become increasingly intricate. The internal functions and communication between critical grid components must now be significantly more complex to keep up with the demands of the modern smart grid. This brings increased difficulty in maintenance and monitoring, making it harder to identify potential misoperation, power anomalies, and cyber threats. Such issues are often only pinpointed after an exhaustive and costly post-mortem analysis, when a major outage or damage has already occurred. A solution is needed for validating protection systems as they operate, independently evaluating grid state and confirming whether the protection system is behaving accordingly. As opposed to incident response, this acts as a constant verification mechanism that raises a flag when subtler issues are noticed, catching them earlier and preventing larger incidents. This work presents the implementation of such a system, expanding on the prototype developed by the authors in a previous paper. This is accomplished with a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. Additionally, this system is contextualized within a larger, modular Master State awareness Overseer (MSO) framework, responsible for monitoring, analyzing, and managing an electric grid.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

CoLoRe-2LPT: Lyman-$α$ mock catalogues for the validation of DESI cosmological analyses

The Lyman-$α$ (Ly$α$) forest has become a crucial probe for studying the large-scale structure of the universe at high redshift ($z > 2$), providing powerful constraints on Baryon Acoustic Oscillations (BAO) and the full-shape (FS) clustering of matter. As a key ingredient for upcoming BAO and FS analyses, we present a new generation of fast cosmological Ly$α$ mocks based on second-order Lagrangian perturbation theory (2LPT). These new mocks significantly improve upon previous log-normal approaches, both at accurately capturing small scale clustering and at recovering the non-linear broadening of the BAO peak. They are able to reproduce Ly$α$ statistics within $10\%$ of the latest DESI measurement; including the Ly$α$ bias and the redshift-space distortion $β$ parameter, mean transmitted flux, and 1D power spectrum. The corresponding quasar (QSO) clustering is also improved with respect to previous approaches, calibrated against high-resolution Abacus simulations, recovering the observational QSO linear bias to less than $5\%$ and improving redshift-space distortions via 2LPT velocities and the addition of Fingers-of-God effects. Furthermore, these mocks incorporate high column density systems and metal lines, allowing us to explore the effects and systematics induced by these astrophysical contaminants. This new set of mocks has been key for enhancing the modeling and validation of the DESI DR2 Ly$α$ full shape cosmological analysis. This work provides a physically motivated and computationally efficient tool for simulating current and next-generation Ly$α$ surveys and validating FS and BAO analysis.

Bernal, M.F. Ruiz-Herrera [Madrid, CIEMAT] (ORCID:↗

Validating a Dynamic PWR Safety and Security Model?

Nuclear power plants (NPPs) are assessed for safety and security using separate models that cannot capture how an attacker's decisions and a plant's response unfold together in real time, leaving regulators and operators without a complete picture of true plant vulnerability. Traditional probabilistic risk assessment (PRA) methods treat adversarial events as fixed initiators with predetermined outcomes, and are structurally incapable of representing the time-dependent interplay between physical security events, safety system response, and operator mitigative actions. At Idaho National Laboratory (INL), I contributed to the development and validation of Modeling and Analysis for Safety and Security using the Dynamic EMRALD Framework (MASS-DEF). Where static PRA relies on event-tree logic that cannot evolve mid-scenario, MASS-DEF couples a time-dependent dynamic PRA tool EMRALD (Event Modeling Risk Assessment using Linked Diagrams) with attack simulation software, allowing attacker behavior, plant system states, and operator actions to interact across time. My work focused on validating a general Pressurized Water Reactor (PWR) model. I traced model logic against PWR plant to identified errors in logic and confirm accuracy. I then built and tested attack scenarios against a general PWR model to verify that the model produced expected outcomes across all logical pathways. I also contributed a section to a related technical paper applying the same EMRALD platform to radiation dose modeling. Results show that MASS-DEF can quantitatively demonstrate that many plants exceed their regulatory security thresholds. This demonstrated margin provides a technically defensible basis for reducing the number of guards without compromising regulatory compliance. Physical security costs represent roughly 10% of annual operating budgets, making such reductions directly meaningful to INL's mission of sustaining existing commercial NPPs. This internship strengthened my understanding of nuclear systems, probabilistic modeling, and technical writing, and has solidified my pursuit of a career at a national laboratory.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗

Leveraging a Southern California Energy Innovation Cluster to Pilot and Validate Emerging Energy Technologies

The EPIC Pilot Program, led by the Los Angeles Cleantech Incubator (LACI), was designed to help early-stage clean technology startups accelerate technical validation, investment readiness, and market entry. The project focused on supporting startups in designing and deploying small-scale pilots with the guidance of EPIC Partners, a network of regional stakeholders in the Southern California energy ecosystem, including but not limited to: the Los Angeles Department of Water and Power (LADWP), the California Energy Commission (CEC), Los Angeles County Metropolitan Transportation Authority (LA Metro), and Edison International, among others. Through mentorship, funding, and site access for technology deployments, the program provided a structured pathway for startups to test and refine their technologies in real-world settings.

14 SOLAR ENERGY↗

Validation of NSFsim as a Grad-Shafranov equilibrium solver at DIII-D

Plasma shape is a significant factor that must be considered for any Fusion Pilot Plant (FPP) as it has significant consequences for plasma stability and core confinement. A new simulator, NSFsim, has been developed based on a historically successful code, DINA [1], offering tools to simulate both transport and plasma shape. Specifically, NSFsim is a free boundary equilibrium and transport solver and has been configured to match the properties of the DIII-D tokamak. This paper is focused on validating the Grad-Shafranov (GS) solver of NSFsim by analyzing its ability to recreate the plasma shape, the poloidal flux distribution, and the measurements of the simulated diagnostic signals originating from flux loops and magnetic probes in DIII-D. Five different plasma shapes are simulated to show the robustness of NSFsim to different plasma conditions; these shapes are Lower Single Null (LSN), Upper Single Null (USN), Double Null (DN), Inner Wall Limited (IWL), and Negative Triangularity (NT). The NSFsim results are compared against real measured signals, magnetic profile fits from EFIT [2], and another plasma equilibrium simulator, GSevolve [3]. EFIT reconstructions of shots are readily available at DIII-D, but GSevolve was manually ran by us to provide simulation data to compare against.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A method for bounding high-order finite element functions: Applications to mesh validity and bounds-preserving limiters

We introduce a novel method for bounding high-order multi-dimensional polynomials in finite element approximations. The method involves precomputing optimal piecewise-linear bounding boxes for polynomial basis functions, which can then be used to locally bound any combination of these basis functions. This approach can be applied to any element/basis type at any approximation order, can provide local (i.e., subcell) extremum bounds to a desired level of accuracy, and can be evaluated efficiently on-the-fly in simulations. Furthermore, we show that this approach generally yields more accurate bounds in comparison to traditional methods based on convex hull properties (e.g., Bernstein polynomials). Furthermore, the efficacy of this technique is shown in applications such as mesh validity checks and optimization for high-order curved meshes, where positivity of the element Jacobian determinant can be ensured throughout the entire element, and continuously bounds-preserving limiters for hyperbolic systems, which can enforce maximum principle bounds across the entire solution polynomial.

Bounding box↗

Scalable phononic metamaterials: Tunable bandgap design and multi-scale experimental validation

Phononic metamaterials offer unprecedented control over wave propagation, making them essential for applications such as vibration isolation, waveguiding, and acoustic filtering. However, achieving scalable and precisely tunable bandgap properties across different length scales remains challenging. This study presents a user-friendly design framework for phononic metamaterials, enabling ultra-wide bandgap tunability (B/ω c ratios up to 172 %) across multiple frequency ranges and scales. Using finite element simulations of a Yablonovite-inspired unit cell, we establish a comprehensive parametric design space that illustrates how geometric parameters, such as sphere size and beam diameter, controls bandgap width and frequency. The scalability and robustness of the framework are validated through experimental testing on additively manufactured structures at both macro (10 mm) and micro (80 µm) scales, fabricated using Stereolithography and Two-Photon Polymerization. Transmission loss measurements, conducted with piezoelectric transducers and laser vibrometry, closely match simulations in the kHz and MHz frequency ranges, confirming the reliability and consistency of the bandgap behavior across scales. This work bridges theory and experiments at multiple scales, offering a practical methodology for the rapid design of phononic metamaterials and expanding their potential for diverse applications across a broad range of frequencies.

36 MATERIALS SCIENCE↗