Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

A CHIL Validation of Machine Learning-Assisted Methods for Real-Time Controls of Solar PV for Grid Services

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been proposed; however, these technologies lack comprehensive validation under real-world application scenarios. This paper addresses this gap by designing and developing a controller-hardware-in-the-loop framework to evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. Simulation results indicate the superior performance of an ML-based approach compared to the conventional reference-control grouping-based approach, showcasing its potential to support grid stability and operational efficiency.

14 SOLAR ENERGY↗

A CHIL Validation of Machine Learning-Assisted Methods for Real-Time Controls of Solar PV for Grid Services: Preprint

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been proposed; however, these technologies lack comprehensive validation under real-world application scenarios. This paper addresses this gap by designing and developing a controller-hardware-in-the-loop framework to evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. Simulation results indicate the superior performance of an ML-based approach compared to the conventional reference-control grouping-based approach, showcasing its potential to support grid stability and operational efficiency.

closed-loop validation↗

Interpretation of energy deposition data from historical operation of the transient test facility (TREAT)

The Transient Test Reactor (TREAT) at Idaho National Laboratory will resume operations in late 2017 after a 23 year hiatus while maintained in a cold standby state. Over that time period, computational power and simulation capabilities have increased substantially and now allow for new multiphysics modeling possibilities that were not practical or feasible for most of TREAT's operational history. Hence the return of TREAT to operational service provides a unique opportunity to apply state-of-the-art software and associated methods in the modeling and simulation of general three-dimensional steady state and kinetic behavior for reactor operation, and for coupling of the core power transient model to experiment simulations. However, measurements taken in previous operations were intended to predict power deposition in experimental samples, with little consideration of three-dimensional core power distributions. Hence, interpretation of data for the purpose of validation of modern methods can be challenging. For the research discussed herein, efforts are described for the process of proper interpretation of data from the most recent calibration experiments performed in the core, the M8 calibration series (M8-CAL). These measurements were taken between 1990 and 1993 using a set of fission wires and test fuel pins to estimate the power deposition that would be produced in fast reactor test fuel pins during the M8 experiment series. Because of the decision to place TREAT into a standby state in 1994, the M8 series of transients were never performed. However, potentially valuable information relevant for validation is available in the M8-CAL measurement data, if properly interpreted. This article describes the current state of the process of recovery of useful data from M8-CAL measurements and quantification of biases and uncertainties to potentially apply to the validation of multiphysics methods.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Reducing uncertainties in nucleation rates: A comparison of measurements and simulations

Recently, large uncertainties in amine nucleation thermodynamics associated with the description of interactions of H{sub 2}SO{sub 4}, the key atmospheric nucleation precursor, with pre-nucleation clusters have been revealed. Here we investigate the formation of (H{sub 2}SO{sub 4}){sub 2}(H{sub 2}O){sub n} (n=0-5) clusters via H{sub 2}O–induced dimerization using conventional RI-MP2 and PW91PW91 methods and recently developed multistep BRIMP2 and B3RICC2 methods widely used in nucleation studies and compare the obtained results with measurements for equilibrium constants of H{sub 2}O–induced dimerization. Variations in K{sub p} and Gibbs free energies predicted by different methods were found to be unexpectedly large, several times of those in hydration free energies commonly used to benchmark computational quantum methods. This means that the common hydration benchmarks are not fully representative of nucleation and that the validation of quantum methods to be recommended for use in nucleation studies is impossible without a thorough assessment of H{sub 2}SO{sub 4}-H{sub 2}SO{sub 4} interactions. We show clearly that only conventional RI-MP2 and PW91PW91 methods are consistent with experiments and that a thorough validation of theoretical predictions against experimental data on H{sub 2}SO{sub 4} clustering is needed prior to recommending a quantum–chemical method for use in nucleation research. We also shows that conclusions about the role of Amine-Enhanced Ternary Homogeneous Nucleation (ATHN) in atmospheric nucleation may be affected by the large uncertainties in nucleation thermodynamics associated with the application of B3RICC2 and BRIMP2 methods and may need a thorough revision.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Validating Mixtures of 233 U, 235 U, and 239 Pu for the Sum-of-Fractions Method [Slides]

A joint effort by PNNL and ORNL examined mixtures of 233 U, 235 U, and 239 Pu to determine subcritical mass limits based on similarities to critical benchmark experiments through the Sum-of-Fractions method. Results of the validation efforts by ORNL were used to determine areas of applicability based on EALF and moderator/reflector type. TSUNAMI-1D, TSUNAMI-IP, and VADER sequences used for generating sensitivities, similarity assessments, and statistical testing. Validation efforts provided here using the Sum-of-Fractions method results in k eff values below established calculational margins and provides additional flexibility to limits provided in ANSI/ANS-8.15.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Electronic structure of aqueous solutions: Bridging the gap between theory and experiments

Predicting the electronic properties of aqueous liquids has been a long-standing challenge for quantum mechanical methods. However, it is a crucial step in understanding and predicting the key role played by aqueous solutions and electrolytes in a wide variety of emerging energy and environmental technologies, including battery and photoelectrochemical cell design. Here, we propose an efficient and accurate approach to predict the electronic properties of aqueous solutions, on the basis of the combination of first-principles methods and experimental validation using state-of-the-art spectroscopic measurements. We present results of the photoelectron spectra of a broad range of solvated ions, showing that first-principles molecular dynamics simulations and electronic structure calculations using dielectric hybrid functionals provide a quantitative description of the electronic properties of the solvent and solutes, including excitation energies. The proposed computational framework is general and applicable to other liquids, thereby offering great promise in understanding and engineering solutions and liquid electrolytes for a variety of important energy technologies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Validation of the Computational Fluid Dynamics Method using the Aboveground Configuration of the Dry Cask Simulator

Dry cask applicants submit their spent nuclear fuel dry storage and transportation cask designs to the U.S. Nuclear Regulatory Commission (NRC) for certification under Title 10 of the Code of Federal Regulations (10 CFR) Part 72, 'Licensing Requirements for the Independent Storage of Spent Nuclear Fuel, High-Level Radioactive Waste, and Reactor-Related Greater Than Class C Waste'. The NRC staff performs its technical review of these designs in accordance with 10 CFR Part 72 and NUREG-1536, 'Standard Review Plan for Spent Fuel Dry Storage Systems at a General License Facility,' Revision 1, issued July 2010. To ensure that the cask and fuel material temperatures of the dry cask storage system remain within the allowable limits or criteria for normal, off-normal, and accident conditions, the NRC staff performs a thermal review as part of the technical review. Recent applications increasingly have used thermalhydraulic analyses using computational fluid dynamics (CFD) codes (e.g., ANSYS FLUENT) to demonstrate the adequacy of the thermal design. The NRC performs validation studies of the FLUENT CFD code to assist it in making regulatory decisions to ensure adequate protection for storage and transportation casks. Recent advances in dry storage cask designs have significantly increased the maximum thermal load allowed in a cask in part by increasing the efficiency of internal conduction pathways and by increasing the internal convection through greater canister helium pressure. In efforts to further validate these designs, the NRC in conjunction with the Department of Energy and Sandia National Laboratories (SNL) are conducting an experiment to capture the effects of elevated helium pressures and accurately portray the external convection of aboveground and belowground canister dry cask systems.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Sensitivity-Uncertainty Based Nuclear Criticality Safety Validation

These are slides from a seminar given to the University of Mexico Nuclear Engineering Department. Whisper is a statistical analysis package developed to support nuclear criticality safety validation. It uses the sensitivity profile data for an application as computed by MCNP6 along with covariance files for the nuclear data to determine a baseline upper-subcritical-limit for the application. Whisper and its associated benchmark files are developed and maintained as part of MCNP6, and will be distributed with all future releases of MCNP6. Although sensitivity-uncertainty methods for NCS validation have been under development for 20 years, continuous-energy Monte Carlo codes such as MCNP could not determine the required adjoint-weighted tallies for sensitivity profiles. The recent introduction of the iterated fission probability method into MCNP led to the rapid development of sensitivity analysis capabilities for MCNP6 and the development of Whisper. Sensitivity-uncertainty based methods represent the future for NCS validation – making full use of today’s computer power to codify past approaches based largely on expert judgment. Validation results are defensible, auditable, and repeatable as needed with different assumptions and process models. The new methods can supplement, support, and extend traditional validation approaches.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

An integrated approach to examine fuel-cladding chemical interaction in HT9/U-10Zr metallic fast reactor fuels: Coupling machine learning with electron microscopy and local mechanical properties analysis

The metallic U-Zr nuclear fuel alloy has garnered renewed interest as a promising candidate for next-generation sodium-cooled fast reactors. Recent studies and technology assessments have identified several areas requiring improvements, enhanced knowledge, and reliable data to strengthen the U-Zr fuel design basis for qualification and commercial applications. One of the most challenging phenomena impacting this fuel system’s performance is fuel-cladding chemical interaction (FCCI). This work aimed to harvest FCCI data by examining selected HT9/U-10Zr (wt. %) fuel samples of prototypic full-length fuel pins through an integrated approach. This approach integrated scanning electron microscopy (SEM) microstructure characterization with localized mechanical properties examination to deepen understanding of FCCI phenomenon in HT9/U-10Zr fuel system. Particularly, this study focused on MFF fuel pins irradiated at Fast Flux Test Facility (FFTF), which aimed to qualify metallic fuel as a driver fuel for FFTF and to assess its viability for larger-scale fast reactors. Electron microscopy provided high confidence in detecting and distinguishing the different FCCI layers, while small-scale mechanical testing (SSMT) probed the mechanical properties of these layers. SEM examination of a MFF-2 pin 192167, with a time averaged inner cladding temperature (TICT) slightly over 500°C, revealed minimal cladding-side FCCI (cladding wastage). In contrast, significantly thicker cladding wastage comprising two distinct sublayers was observed in samples from the thermally hot MFF-3 pin 193045 and MFF-5 pin 195011 where the TICT ranged from 610-635°C. SSMT indicated complete embrittlement in the sublayer adjacent to the fuel and a tendency toward embrittlement in the other sublayer. Additionally, a new machine learning method was developed, validated, and used to quantify cladding wastage thickness. The machine learning method reliably predicted the wastage thickness across various fuel pins and sample cross-sections. Furthermore, the available cladding wastage data from HT9/U-10Zr fuel system demonstrated a strong temperature dependency. However, the dataset remains small, and ongoing research activities are essential to further understand the FCCI phenomenon and develop a reliable FCCI model for enhanced fuel performance simulation under various conditions.

36 - MATERIALS SCIENCE↗

Passive Islanding Detection of Inverter-Based Resources in a Noisy Environment

Islanding occurs when a load is energized solely by local generators and can result in frequency and voltage instability, changes in current, and poor power quality. Poor power quality can interrupt industrial operations, damage sensitive electrical equipment, and induce outages upon the resynchronization of the island with the grid. This study proposes an islanding detection method employing a Duffing oscillator to analyze voltage fluctuations at the point of common coupling (PCC) under a high-noise environment. Unlike existing methods, which overlook the noise effect, this paper mitigates noise impact on islanding detection. Power system noise in PCC measurements arises from switching transients, harmonics, grounding issues, voltage sags and swells, electromagnetic interference, and power quality issues that affect islanding detection. Transient events like lightning-induced traveling waves to the PCC can also introduce noise levels exceeding the voltage amplitude by more than seven times, thus disturbing conventional detection techniques. The noise interferes with measurements and increases the nondetection zone (NDZ), causing failed or delayed islanding detection. The Duffing oscillator nonlinear dynamics enable detection capabilities at a high noise level. The proposed method is designed to detect the PCC voltage fluctuations based on the IEEE standard 1547 through the Duffing oscillator. For the voltages beyond the threshold, the Duffing oscillator phase trajectory changes from periodic to chaotic mode and sends an islanded operation command to the inverter. The proposed islanding detection method distinguishes switching transients and faults from an islanded operation. Experimental validation of the method is conducted using a 3.6 kW PV setup.

Energy & Fuels↗

Instrumental Response Model and Detrending for the Dark Energy Camera

We describe the model for mapping from sky brightness to the digital output of the Dark Energy Camera (DECam) and the algorithms adopted by the Dark Energy Survey (DES) for inverting this model to obtain photometric measures of celestial objects from the raw camera output. This calibration aims for fluxes that are uniform across the camera field of view and across the full angular and temporal span of the DES observations, approaching the accuracy limits set by shot noise for the full dynamic range of DES observations. The DES pipeline incorporates several substantive advances over standard detrending techniques, including principal-components-based sky and fringe subtraction; correction of the "brighter-fatter" nonlinearity; use of internal consistency in on-sky observations to disentangle the influences of quantum efficiency, pixel-size variations, and scattered light in the dome flats; and pixel-by-pixel characterization of instrument spectral response, through combination of internal-consistency constraints with auxiliary calibration data. This article provides conceptual derivations of the detrending/calibration steps, and the procedures for obtaining the necessary calibration data. Other publications will describe the implementation of these concepts for the DES operational pipeline, the detailed methods, and the validation that the techniques can bring DECam photometry and astrometry within $\approx 2$ mmag and $\approx 3$ mas, respectively, of fundamental atmospheric and statistical limits. In conclusion, the DES techniques should be broadly applicable to wide-field imagers.

79 ASTRONOMY AND ASTROPHYSICS↗

SU-C-201-06: Small Field Correction Factors for the MicroDiamond Detector in the Gamma Knife-Model C Derived Using Monte Carlo Methods

Purpose: To determine small field correction factors for PTW’s microDiamond detector in Elekta’s Gamma Knife Model-C unit. These factors allow the microDiamond to be used in QA measurements of output factors in the Gamma Knife Model-C; additionally, the results also contribute to the discussion on the water equivalence of the relatively-new microDiamond detector and its overall effectiveness in small field applications. Methods: The small field correction factors were calculated as k correction factors according to the Alfonso formalism. An MC model of the Gamma Knife and microDiamond was built with the EGSnrc code system, using BEAMnrc and DOSRZnrc user codes. Validation of the model was accomplished by simulating field output factors and measurement ratios for an available ABS plastic phantom and then comparing simulated results to film measurements, detector measurements, and treatment planning system (TPS) data. Once validated, the final k factors were determined by applying the model to a more waterlike solid water phantom. Results: During validation, all MC methods agreed with experiment within the stated uncertainties: MC determined field output factors agreed within 0.6% of the TPS and 1.4% of film; and MC simulated measurement ratios matched physically measured ratios within 1%. The final k correction factors for the PTW microDiamond in the solid water phantom approached unity to within 0.4%±1.7% for all the helmet sizes except the 4 mm; the 4 mm helmet size over-responded by 3.2%±1.7%, resulting in a k factor of 0.969. Conclusion: Similar to what has been found in the Gamma Knife Perfexion, the PTW microDiamond requires little to no corrections except for the smallest 4 mm field. The over-response can be corrected via the Alfonso formalism using the correction factors determined in this work. Using the MC calculated correction factors, the PTW microDiamond detector is an effective dosimeter in all available helmet sizes. The authors would like to thank PTW (Friedberg, Germany) for providing the PTW microDiamond detector for this research.

07 ISOTOPE AND RADIATION SOURCES↗

Performing k eff Validation of As-Loaded Criticality Safety Calculations Using UNF-ST&DARDS: Sensitivity Calculations

The general method for performing validation of as loaded criticality safety calculations using UNF ST&DARDS is presented in a paper by Clarity, which includes a description of the UNF-ST&DARDS system. Proof-of-principle analyses were performed in the summer of 2019 for MPC-32 dual purpose canisters (DPCs) containing pressurized water reactor (PWR) fuel assemblies. Summaries of these results are presented in this and a companion paper for this conference. The current paper describes the TSUNAMI-3D calculations performed to generate sensitivity data, and the companion paper discusses the selection of critical experiments applicable for validation of the 11 MPC-32 DPCs considered. The generation of sensitivity data for as-loaded spent nuclear fuel (SNF) DPCs is a challenge given the detailed model of the fuel compositions generated by UNF ST&DARDS. Each fuel assembly is modeled with its own irradiation history in 18 axial nodes, unless the fuel assembly is damaged and thus considered as fresh by design basis. This results in a set of 576 fuel compositions, each of which must be processed separately in a multigroup (MG) calculation. Therefore, a continuous-energy (CE) TSUNAMI-3D method was chosen to alleviate this challenge. Two CE TSUNAMI-3D methods are available in SCALE 6.2.3: the iterated fission probability (IFP) and contribution-linked eigenvalue sensitivity/uncertainty estimation via track-length importance characterization (CLUTCH). Since the IFP method is not feasible because of memory requirements associated with its implementation in SCALE, the CLUTCH method was selected for these calculations. CLUTCH has been implemented in SCALE in parallel, allowing long calculations to be performed in reasonable timeframes. The two primary user inputs necessary for CLUTCH calculations are the F*(r) mesh and the number of latent generations used in determining the F*(r) function. This F*(r) function is used as the importance function for fission chains originating in a given volume element (voxel), and it is calculated using the IFP method in the skipped generations. A large number of skipped generations is thus required to ensure accurate calculation of this importance function. In these calculations, 500 generations were used to calculate the F*(r) function. For more information regarding the calculation of F*(r), see Jones [4]. The remainder of this paper is focused on the selection of the F*(r) mesh and the number of latent generations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Determining the tilt of the Raman laser beam using an optical method for atom gravimeters

The tilt of a Raman laser beam is a major systematic error in precision gravity measurement using atom interferometry. The conventional approach to evaluating this tilt error involves modulating the direction of the Raman laser beam and conducting time-consuming gravity measurements to identify the error minimum. In this work, we demonstrate a method to expediently determine the tilt of the Raman laser beam by transforming the tilt angle measurement into characterization of parallelism, which integrates the optical method of aligning the laser direction, commonly used in freely falling corner-cube gravimeters, into an atom gravimeter. A position-sensing detector (PSD) is utilized to quantitatively characterize the parallelism between the test beam and the reference beam, thus measuring the tilt precisely and rapidly. After carefully positioning the PSD and calibrating the relationship between the distance measured by the PSD and the tilt angle measured by the tiltmeter, we achieved a statistical uncertainty of less than 30 µrad in the tilt measurement. Furthermore, we compared the results obtained through this optical method with those from the conventional tilt modulation method for gravity measurement. The comparison validates that our optical method can achieve tilt determination with an accuracy level of better than 200 µrad, corresponding to a systematic error of 20 µGal in g measurement. This work has practical implications for real-world applications of atom gravimeters.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Systems and methods for enhanced power system model validation

A system for enhanced power system model validation is provided. The system includes a computing device including at least one processor in communication with at least one memory device. The at least one processor is programmed to store a plurality of models for a plurality of devices and a plurality of input files associated with the plurality of models, receive, from a user, a selection of model of the plurality of models to simulate, retrieve one or more input files of the plurality of input files, perform a model validity check on the selected model, if the selected model passed the model validity check, perform a model calibration on the selected model, and if the selected model passed the model calibration, perform a post evaluation on the selected model.

Wang, Honggang↗