Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Air-Cooled RCCS CFD Modeling Validation 2025

Slide deck for the Advanced Reactor Technologies Gas Cooled Reactor (ART-GCR) program review. The slides show the progress on the air-cooled reactor cavity cooling system (RCCS) CFD validation work. The validation of the air-cooled RCCS is performed using the experimental facility at the University of Wisconsin-Madison. The slide deck provides a progress update on this year's achievements. The natural convection tests under uniform power are modeled and compared with the experimental results. The results show good agreement with the experimental results. A sensitivity study on the RANS turbulence models is performed. Additionally, the contribution of radiative and convective heat transfer within the heated cavity is calculated and compared to forced convection setups.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

SEM Milestone Report for MARMOT Validation Project

MARMOT is a meso-scale fuel code under development by NEAMS designed to predict the microstructure evolution of fuel materials to determine updated thermal and mechanical property models. These updated models can be used by engineering scale codes such as BISON. To support its development and validation the MARMOT Validation Project (MVP) was initiated and consists of extensive microstructure and thermal characterization of U-10Zr fuel material before and at discreet levels of irradiation. This report summarizes the SEM and EDS characterization of the lowest burnup samples (1.5% FIMA) and how they compare to pre-irradiation SEM and EDS.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Post-Event Fault Identification with Machine Learning for Protection System Validation

Power system protection devices have transitioned over the past few decades from mechanical to analog devices, then to solid state and finally digital. Relays and their associated critical network of equipment have significantly increased in complexity. Even internally, relays have gained significant intricacy, with relatively simple overcurrent or differential functions now being assisted by a myriad of other functions. This is necessary as the grid becomes more complex, but it brings increased difficulty in monitoring and upkeep. Misoperation caused by accidental improper relay settings or deliberate malicious actions is a constant challenge faced by all utilities. These improper settings can be difficult to identify and may require exhaustive post-mortem analysis, typically after a major outage event has already occurred. A mechanism is needed for monitoring the behavior of protection systems to validate that their performance falls within expectations. Relays that fail to isolate a fault or trip when there is no system disturbance can be flagged for settings review in situations where this behavior may not have been noticed due to manual restoration or backup protection operations. This work presents a concept for a machine learning (ML) system capable of validating the performance of protection systems by identifying fault events and characterizing protection system responses based solely on available current and voltage measurements. As a first step in its development, an experimental dataset is generated, and a random forest model is implemented with high accuracy in distinguishing four power system scenarios.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

Protection System Validation Using Post-Event Anomaly Classification with Machine Learning

Power system protection devices have transitioned over the past few decades from mechanical to analog devices, then to solid state and finally digital. Relays and their associated critical network of equipment have significantly increased in complexity. Even internally, relays have gained significant intricacy, with relatively simple overcurrent or differential functions now being assisted by a myriad of other functions. This is necessary as the grid becomes more complex, but it brings increased difficulty in monitoring and upkeep. Misoperation caused by improper relay settings or malicious actions is a constant challenge faced by all utilities. These improper settings can be difficult to identify and may require exhaustive post-mortem analysis, typically after a major outage event has already occurred. A mechanism is needed for monitoring the behavior of protection systems to validate that they act and perform as expected. This work presents a concept for a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. As a first step in its development, an experimental dataset is generated, and a random forest model is implemented with high accuracy in distinguishing four power system scenarios.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

Validation and Verification of Python based Neutron Spectrum Unfolding Software

To validate and verify the python-based code (PySL), designed to replicate the programs used by STAYSL for Beam Correction Factor (BCF) and Self-Shielding Factor (SHIELD), a series of tests were performed. To test BCF a python script was written to generate a random flux history file and both versions of the code processed the data. The test verified matching values up to at least one decimal place, approximately 10,000 tests where run and each one passed. Isotopes began to fail the tests once neutron saturation was reached. To verify this the total time of exposure was varied the isotopes that failed were compared to a list of their half-lives. The test process for SHIELD was very similar but, in this case, the code began by producing an input file with varying thickness and device type/environment for the SHIELD input. The failure condition for this test was if any of the data points for an isotope had a difference above 3%. Approximately 40 of these tests were run and there were only 3 isotopes that had reoccurring failures but only 2% of their points were above the 3% difference. A visual comparison was conducted by plotting the results from both programs. Although the test failed, the differences between their values were minuscule, and the self-shielding factor’s shape was preserved when plotted. Next steps for this project will be validating and verifying the python-based SigPhi code and then reproducing and testing the least squares unfolding performed by STAYSL.

73 - NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Protection System Validation with Machine Learning Anomaly Classification

A poster for the Early Career Poster Session. Power system protection devices have transitioned over the past few decades from mechanical to analog devices, then to solid state and finally digital. Relays and their associated critical network of equipment have significantly increased in complexity. Even internally, relays have gained significant intricacy, with relatively simple overcurrent or differential functions now being assisted by a myriad of other functions. This is necessary as the grid becomes more complex, but it brings increased difficulty in monitoring and upkeep. Misoperation caused by improper relay settings or malicious actions is a constant challenge faced by all utilities. These improper settings can be difficult to identify and may require exhaustive post-mortem analysis, typically after a major outage event has already occurred. A mechanism is needed for monitoring the behavior of protection systems to validate that they act and perform as expected. This work presents a concept for a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. As a first step in its development, an experimental dataset is generated, and a random forest model is implemented with high accuracy in distinguishing four power system scenarios.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

ECAR-7300 Rev 1 Verification and Validation of MCNP6.2 for MARVEL Neutronic Analysis

This report documents the verification and validation (V&V) efforts of the Monte Carlo N-Particle transport code (MCNP) version 6.2 on the Sawtooth supercomputer for the Microreactor Applications Research Validation and Evaluation (MARVEL) microreactor required for the preliminary documented safety analysis. This document records V&V for a safety, hazards, analysis, and design software used for design and analysis of safety class structures, system and components (SSC)s.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Validating Protection System Behavior with Machine Learning in a Master State Overseer

As power system protection devices continue the widespread transition from analog to digital, they become increasingly intricate. The internal functions and communication between critical grid components must now be significantly more complex to keep up with the demands of the modern smart grid. This brings increased difficulty in maintenance and monitoring, making it harder to identify potential misoperation, power anomalies, and cyber threats. Such issues are often only pinpointed after an exhaustive and costly post-mortem analysis, when a major outage or damage has already occurred. A solution is needed for validating protection systems as they operate, independently evaluating grid state and confirming whether the protection system is behaving accordingly. As opposed to incident response, this acts as a constant verification mechanism that raises a flag when subtler issues are noticed, catching them earlier and preventing larger incidents. This work presents the implementation of such a system, expanding on the prototype developed by the authors in a previous paper. This is accomplished with a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. Additionally, this system is contextualized within a larger, modular Master State awareness Overseer (MSO) framework, responsible for monitoring, analyzing, and managing an electric grid.

24 - POWER TRANSMISSION AND DISTRIBUTION↗

CoLoRe-2LPT: Lyman-$α$ mock catalogues for the validation of DESI cosmological analyses

The Lyman-$α$ (Ly$α$) forest has become a crucial probe for studying the large-scale structure of the universe at high redshift ($z > 2$), providing powerful constraints on Baryon Acoustic Oscillations (BAO) and the full-shape (FS) clustering of matter. As a key ingredient for upcoming BAO and FS analyses, we present a new generation of fast cosmological Ly$α$ mocks based on second-order Lagrangian perturbation theory (2LPT). These new mocks significantly improve upon previous log-normal approaches, both at accurately capturing small scale clustering and at recovering the non-linear broadening of the BAO peak. They are able to reproduce Ly$α$ statistics within $10\%$ of the latest DESI measurement; including the Ly$α$ bias and the redshift-space distortion $β$ parameter, mean transmitted flux, and 1D power spectrum. The corresponding quasar (QSO) clustering is also improved with respect to previous approaches, calibrated against high-resolution Abacus simulations, recovering the observational QSO linear bias to less than $5\%$ and improving redshift-space distortions via 2LPT velocities and the addition of Fingers-of-God effects. Furthermore, these mocks incorporate high column density systems and metal lines, allowing us to explore the effects and systematics induced by these astrophysical contaminants. This new set of mocks has been key for enhancing the modeling and validation of the DESI DR2 Ly$α$ full shape cosmological analysis. This work provides a physically motivated and computationally efficient tool for simulating current and next-generation Ly$α$ surveys and validating FS and BAO analysis.

Bernal, M.F. Ruiz-Herrera [Madrid, CIEMAT] (ORCID:↗

Validating a Dynamic PWR Safety and Security Model?

Nuclear power plants (NPPs) are assessed for safety and security using separate models that cannot capture how an attacker's decisions and a plant's response unfold together in real time, leaving regulators and operators without a complete picture of true plant vulnerability. Traditional probabilistic risk assessment (PRA) methods treat adversarial events as fixed initiators with predetermined outcomes, and are structurally incapable of representing the time-dependent interplay between physical security events, safety system response, and operator mitigative actions. At Idaho National Laboratory (INL), I contributed to the development and validation of Modeling and Analysis for Safety and Security using the Dynamic EMRALD Framework (MASS-DEF). Where static PRA relies on event-tree logic that cannot evolve mid-scenario, MASS-DEF couples a time-dependent dynamic PRA tool EMRALD (Event Modeling Risk Assessment using Linked Diagrams) with attack simulation software, allowing attacker behavior, plant system states, and operator actions to interact across time. My work focused on validating a general Pressurized Water Reactor (PWR) model. I traced model logic against PWR plant to identified errors in logic and confirm accuracy. I then built and tested attack scenarios against a general PWR model to verify that the model produced expected outcomes across all logical pathways. I also contributed a section to a related technical paper applying the same EMRALD platform to radiation dose modeling. Results show that MASS-DEF can quantitatively demonstrate that many plants exceed their regulatory security thresholds. This demonstrated margin provides a technically defensible basis for reducing the number of guards without compromising regulatory compliance. Physical security costs represent roughly 10% of annual operating budgets, making such reductions directly meaningful to INL's mission of sustaining existing commercial NPPs. This internship strengthened my understanding of nuclear systems, probabilistic modeling, and technical writing, and has solidified my pursuit of a career at a national laboratory.

98 - NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL↗

Leveraging a Southern California Energy Innovation Cluster to Pilot and Validate Emerging Energy Technologies

The EPIC Pilot Program, led by the Los Angeles Cleantech Incubator (LACI), was designed to help early-stage clean technology startups accelerate technical validation, investment readiness, and market entry. The project focused on supporting startups in designing and deploying small-scale pilots with the guidance of EPIC Partners, a network of regional stakeholders in the Southern California energy ecosystem, including but not limited to: the Los Angeles Department of Water and Power (LADWP), the California Energy Commission (CEC), Los Angeles County Metropolitan Transportation Authority (LA Metro), and Edison International, among others. Through mentorship, funding, and site access for technology deployments, the program provided a structured pathway for startups to test and refine their technologies in real-world settings.

14 SOLAR ENERGY↗

Validation of NSFsim as a Grad-Shafranov equilibrium solver at DIII-D

Plasma shape is a significant factor that must be considered for any Fusion Pilot Plant (FPP) as it has significant consequences for plasma stability and core confinement. A new simulator, NSFsim, has been developed based on a historically successful code, DINA [1], offering tools to simulate both transport and plasma shape. Specifically, NSFsim is a free boundary equilibrium and transport solver and has been configured to match the properties of the DIII-D tokamak. This paper is focused on validating the Grad-Shafranov (GS) solver of NSFsim by analyzing its ability to recreate the plasma shape, the poloidal flux distribution, and the measurements of the simulated diagnostic signals originating from flux loops and magnetic probes in DIII-D. Five different plasma shapes are simulated to show the robustness of NSFsim to different plasma conditions; these shapes are Lower Single Null (LSN), Upper Single Null (USN), Double Null (DN), Inner Wall Limited (IWL), and Negative Triangularity (NT). The NSFsim results are compared against real measured signals, magnetic profile fits from EFIT [2], and another plasma equilibrium simulator, GSevolve [3]. EFIT reconstructions of shots are readily available at DIII-D, but GSevolve was manually ran by us to provide simulation data to compare against.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A method for bounding high-order finite element functions: Applications to mesh validity and bounds-preserving limiters

We introduce a novel method for bounding high-order multi-dimensional polynomials in finite element approximations. The method involves precomputing optimal piecewise-linear bounding boxes for polynomial basis functions, which can then be used to locally bound any combination of these basis functions. This approach can be applied to any element/basis type at any approximation order, can provide local (i.e., subcell) extremum bounds to a desired level of accuracy, and can be evaluated efficiently on-the-fly in simulations. Furthermore, we show that this approach generally yields more accurate bounds in comparison to traditional methods based on convex hull properties (e.g., Bernstein polynomials). Furthermore, the efficacy of this technique is shown in applications such as mesh validity checks and optimization for high-order curved meshes, where positivity of the element Jacobian determinant can be ensured throughout the entire element, and continuously bounds-preserving limiters for hyperbolic systems, which can enforce maximum principle bounds across the entire solution polynomial.

Bounding box↗

Scalable phononic metamaterials: Tunable bandgap design and multi-scale experimental validation

Phononic metamaterials offer unprecedented control over wave propagation, making them essential for applications such as vibration isolation, waveguiding, and acoustic filtering. However, achieving scalable and precisely tunable bandgap properties across different length scales remains challenging. This study presents a user-friendly design framework for phononic metamaterials, enabling ultra-wide bandgap tunability (B/ω c ratios up to 172 %) across multiple frequency ranges and scales. Using finite element simulations of a Yablonovite-inspired unit cell, we establish a comprehensive parametric design space that illustrates how geometric parameters, such as sphere size and beam diameter, controls bandgap width and frequency. The scalability and robustness of the framework are validated through experimental testing on additively manufactured structures at both macro (10 mm) and micro (80 µm) scales, fabricated using Stereolithography and Two-Photon Polymerization. Transmission loss measurements, conducted with piezoelectric transducers and laser vibrometry, closely match simulations in the kHz and MHz frequency ranges, confirming the reliability and consistency of the bandgap behavior across scales. This work bridges theory and experiments at multiple scales, offering a practical methodology for the rapid design of phononic metamaterials and expanding their potential for diverse applications across a broad range of frequencies.

36 MATERIALS SCIENCE↗

A CHIL Validation of Machine Learning-Assisted Methods for Real-Time Controls of Solar PV for Grid Services

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been proposed; however, these technologies lack comprehensive validation under real-world application scenarios. This paper addresses this gap by designing and developing a controller-hardware-in-the-loop framework to evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. Simulation results indicate the superior performance of an ML-based approach compared to the conventional reference-control grouping-based approach, showcasing its potential to support grid stability and operational efficiency.

closed-loop validation↗

Verified, Archived, Library of Inputs and Data (VALID) Supporting Files

This dataset contains input, output, and sensitivity data files for computational simulations with the SCALE code system as part of the Verified, Archived Library of Inputs and Data (VALID). The simulations cover critical benchmark experiments from the International Criticality Safety Benchmark Evaluation Project. The files are to be housed in a public directory for distribution. The information contained in the files have been approved for release by the Organisation for Economic Co-operation and Development Nuclear Energy Agency (NEA). Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases.

keff↗

Floating PV Potential and Technology Validation [Slides]

This presentation covers, at a high-level, the potential for floating solar PV (FPV) in the United States as well as technology validation approaches and research capabilities at the U.S. Department of Energy's National Renewable Energy Laboratory (NREL).

14 SOLAR ENERGY↗

Chicago Energy Efficiency Planning and Analysis and Integrated Retrofit Strategy Validation in Single-Family Homes

In June 2020, the project team comprised of Elevate and the National Renewable Energy Laboratory (NREL), with advisory roles from the City of Chicago and Commonwealth Edison, initiated a three-year project with the U.S. Department of Energy to inform communitywide energy planning at a local scale and validate advanced retrofit packages that achieve at least 50% energy savings in existing homes. The project team has characterized Chicago’s single-family and 2-4 unit housing stock and energy use using the ResStock™ modeling tool, and with that information developed advanced whole home energy retrofit packages for single family and 2-4 unit homes that can reduce energy use by at least 50% and support climate, air quality, and other goals. This report presents an analysis of the technical potential of applying these retrofit packages at a City-wide scale, and a roadmap for rapidly scaling up retrofit programs to improve Chicago’s housing stock and target investments in the neighborhoods that need it most. The main goals of the analysis are to: 1) develop a Chicago-specific single-family and 2-4 unit building retrofit prioritization strategy; 2) identify opportunities for beneficial electrification in communities and home types that stand to benefit most; and 3) assess costs and savings potential for retrofit investments at a household and city scale, in terms of energy use, bill impacts, carbon emissions, and other outcomes.

14 SOLAR ENERGY↗