Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validate”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

WE-Validate: An Open-Source Framework For Wind Power Validation

Grid operators rely on historical weather time series at existing and planned wind power plants to make informed decisions when planning for a future power grid with very high penetration of renewable power. While synthetic wind power time series have been developed based on historical weather models, their validation with actual power production data remains complex due to variations in modeling practices and methodologies. This paper introduces the WE-Validate framework, originally designed for wind speed validation and now enhanced for wind power validation with a graphical user interface to support users with minimal programming experience. Validation of wind power with WE-Validate is based on robust metrics consisting of RMSE, centered RMSE, average bias, average percent bias, mean absolute error, mean absolute percent error, cross correlation, and calculation of ramping magnitude, rate, and duration. This paper showcases WE-Validate with validation of synthetically derived power for a wind plant in Washington state for one month in 2018. Validation of the synthetic power from two comparison data sets compared with observations shows both comparison series have strong correlation with observed across weekly and monthly aggregations while suffering from persistent negative bias. The suite of metrics within WE-Validate facilitates immediate insight into the utility of the comparison data sets through compression across multiple axes. This user-friendly, open-source tool can be extended beyond wind power, making it a valuable resource for system planners and operators in different domains.

Moncheur de Rieudotte, Malcolm P.↗
DOE OSTI2024

Validation Assessment of Turbulent Reacting Flow Model Using The Area-Validation Metric on Medium-Scale Methanol Pool Fire Results

Accident analysis and ensuring power plant safety are pivotal in the nuclear energy sector. Significant strides have been achieved over the past few decades regarding fire protection and safety, primarily centered on design and regulatory compliance. Yet, after the Fukushima accident a decade ago, the imperative to enhance measures against fire, internal flooding, and power loss has intensified. Hence, a comprehensive, multilayered protection strategy against severe accidents is needed. Consequently, gaining a deeper insight into pool fires and their behavior through extensive validated data can greatly aid in improving these measures using advanced validation techniques. A model validation study was performed at Sandia National Laboratories in which a 30-cm diameter methanol pool fire was modeled using the SIERRA/Fuego turbulent reacting flow code. This validation study used a standard validation experiment to compare model results against, and conclusions have been published. The fire was modeled with a Large Eddy Simulation (LES) turbulence model with subgrid turbulent kinetic energy closure. Combustion was modeled using a strained laminar flamelet library approach. Radiative heat transfer was accounted for with a model utilizing the gray-gas approximation. In the present study, additional validation analysis is performed using the area validation metric (AVM). These activities are done on multiple datasets involving different variables and temporal/spatial ranges and intervals. In conclusion, the results provide insight into the use of the area validation metric on such temporally varying datasets and the importance of physics-aware use of the metric for proper analysis.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2021

Scalable Programming Workflows for Validation of Quantum Computers

Hybrid quantum-classical workflows have become standard methods for executing variational algorithms and other quantum simulation techniques, which are key applications for noisy intermediate scale quantum (NISQ) computers. Validating these simulations is an important task which helps gauge the progress of quantum computer development, and classical simulation can serve as a tool to this end. Both exact and more scalable approximate methods with quantifiable error bounds can be used in validation tasks where the applicable metrics include the distance from a calculable ground truth, the quality of an error model fit to data, etc. Here we present a library extension that includes methods for validation of quantum simulations based on scalable hybrid workflows executable on high performance computers. We provide examples that use approximate methods based on tensor networks and stabilizer simulators to bound the error of quantum simulations on NISQ hardware.

Nguyen, Thien↗
DOE OSTI2020

Lab-Scale, Closed-Loop Experimental Characterization, Model Refinement, and Validation of a Hydrokinetic Energy-Harvesting Ocean Kite

This paper presents a study wherein we experimentally characterize the dynamics and control system of a lab-scale ocean kite, and then refine, validate, and extrapolate this model for use in a full-scale system. Ocean kite systems, which harvest tidal and ocean current resources through high-efficiency cross-current motion, enable energy extraction with an order of magnitude less material (and cost) than stationary systems with the same rated power output. However, an ocean kite represents a nascent technology that is characterized by relatively complex dynamics and requires sophisticated control algorithms. In order to characterize the dynamics and control of ocean kite systems rapidly, at a relatively low cost, the authors have developed a lab-scale, closed-loop prototyping environment for characterizing tethered systems, whereby 3D printed systems are tethered and flown in a water channel environment. While this system has been shown to be capable of yielding similar dynamic characteristics to some full-scale systems, there are also fundamental limitations to the geometric scales and flow speeds within the water channel environment, making many other real-world scenarios impossible to replicate from the standpoint of dynamic similarity. Here, to address these scenarios, we show how the lab-scale framework is used to refine and validate a scalable dynamic model of a tethered system, which can then be extrapolated to full-scale operation. In this work, we present an extensive case study of this model refinement, validation, and extrapolation on an ocean kite system intended for operation in the Gulf Stream or similar current environments.

42 ENGINEERING↗
DOE OSTI2021

Validation of the Community Land Model Version 5 over the Contiguous United States (CONUS) using in situ and remote sensing data sets

The Community Land Model (CLM) is an effective tool to simulate the biophysical and biogeochemical processes and their interactions with the atmosphere. Although CLM Version 5 (CLM5) constitutes various updates in these processes, its performance in simulating energy, water and carbon cycles over the Contiguous United States (CONUS) at scales which land surface changes and hydrometeorological and hydroclimatological applications are more locally relevant is yet to be assessed. In this study, we conducted three simulations at 0.125? during 1979-2018 over the CONUS using different configurations of CLM, namely CLM5-biogeochemistry (CLM5BGC), CLM4.5BGC, and CLM5-satellite phenology (CLM5SP). We validated and compared their simulations against multiple remote-sensed and in-situ datasets. Overall, the parametric and structural updates (e.g., carbon cost for nitrogen uptake, variable soil thickness, dry surface layer) in CLM5 improve its ability in capturing terrestrial biogeochemical dynamics. The low evapotranspiration in CLM5BGC is associated with biases in simulating vegetation phenological characteristics rather than soil water limitations. The mismatch between CLM5BGC-simulated peak leaf area index and reference data can be attributed to CLM5BGC's inability in simulating phenology of trees and grasses. The differences between CLM-simulated irrigation and reference estimates can be attributed to differences between processes represented in models and in reality, and uncertainties in input and validation datasets. Evaluation against observations at small catchments suggest that hydrologic parameters needed to be calibrated to improve simulations of runoff, especially subsurface runoff. Additional efforts are needed to incorporate spatially-distributed plant phenology and physiology parameters and regional-specific agricultural management practices (e.g., planting, harvest).

Cheng, Yanyan↗
DOE OSTI2022

Dark Energy Survey Year 3 results: Cosmology from combined galaxy clustering and lensing validation on cosmological simulations

In this work, we present a validation of the Dark Energy Survey Year 3 (DES Y3) 3×2-point analysis choices by testing them on Buzzard2.0, a new suite of cosmological simulations that is tailored for the testing and validation of combined galaxy clustering and weak-lensing analyses. We show that the buzzard2.0 simulations accurately reproduce many important aspects of the DES Y3 data, including photometric redshift and magnitude distributions, and the relevant set of two-point clustering and weak-lensing statistics. We then show that our model for the 3×2-point data vector is accurate enough to recover the true cosmology in simulated surveys assuming the true redshift distributions for our source and lens samples, demonstrating robustness to uncertainties in the modeling of the nonlinear matter power spectrum, nonlinear galaxy bias, and higher-order lensing corrections. Additionally, we demonstrate for the first time that our photometric redshift calibration methodology, including information from photometry, spectroscopy, clustering cross-correlations, and galaxy–galaxy lensing ratios, is accurate enough to recover the true cosmology in simulated surveys in the presence of realistic photometric redshift uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Dark Energy Survey Year 3 results: Simulation-based cosmological inference with wavelet harmonics, scattering transforms, and moments of weak lensing mass maps. Validation on simulations

Beyond-two-point statistics contain additional information on cosmological as well as astrophysical and observational (systematics) parameters. In this methodology paper we provide an end-to-end simulationbased analysis of a set of Gaussian and non-Gaussian weak lensing statistics using detailed mock catalogs of the Dark Energy Survey (DES). Here, we implement: 1) second and third moments; 2) wavelet phase harmonics (WPH); 3) the scattering transform (ST). Our analysis is fully based on simulations, it spans a space of seven $νw$CDM cosmological parameters, and it forward models the most relevant sources of systematics of the data (masks, noise variations, clustering of the sources, intrinsic alignments, and shear and redshift calibration). We implement a neural network compression of the summary statistics, and we estimate the parameter posteriors using a likelihood-free-inference approach. We validate the pipeline extensively, and we find that WPH exhibits the strongest performance when combined with second moments, followed by ST, and then by third moments. The combination of all the different statistics further enhances constraints with respect to second moments, up to 25 percent, 15 percent, and 90 percent for S 8 , Ω m , and the figure-of-merit FoM S8;Ωm , respectively. We further find that non-Gaussian statistics improve constraints on w and on the amplitude of intrinsic alignment with respect to second moments constraints. The methodological advances presented here are suitable for application to Stage IV surveys from Euclid, Rubin-LSST, and Roman with additional validation on mock catalogs for each survey. In a companion paper we present an application to DES Year 3 data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Verification and Validation Tests of Gamma Library of MC2-3 for Coupled Neutron and Gamma Heating Calculation

For the accurate assessment of the heat generation rate in fast reactors, the gamma library of MC2 -3 and the MC2 -3 + GAMSOR procedure employing the coupled neutron and gamma heating calculation has been thoroughly verified against Monte Carlo results and validated using the ZPPR-15D gamma dose measurement data. NJOY outputs are post-processed in a consistent way with the NJOY procedure to avoid any missing data or double counting of data. Prompt heating for 379 out of 391 isotopes in the gamma library was verified against MCNP6.2 to within 1% relative error in total heating for most isotopes. For both a simple one-dimensional slab problem representing a sodium cooled fast reactor and the Experimental Breeder Reactor II (EBR-II) benchmark problem, the root-mean-square values of assembly power error were less than 0.5% for fuel assemblies, ~1% in blankets and ~1 to ~3% in reflectors compared to MCNP6.2 results. The most plausible cause for the 3% error in a reflector assembly is believed to be the error in the multigroup neutron cross sections for the reflector assembly. For validation, gamma doses measured with thermoluminiscent dosimeters (TLDs) in the ZPPR-15D experiment were calculated using GAMSOR. Due to the uncertainty in the TLD measurement with regards to the energy deposition of photons and neutrons, the validation data leads to a 12.7% uncertainty on the experimental measurement. With this uncertainty bound, the calculated doses all fell within one standard deviation of the measured value. Combined with the accurate calculation of reaction rate distributions and neutron spectrum measurements, these results indicate good agreement for the neutron and gamma heating calculations that were performed.

coupled neutron and gamma heating↗
DOE OSTI2022

Validation of MPACT BWR capabilities against critical experiments

Over the years, significant validation work for the neutronics code MPACT has been performed against zero-power critical benchmarks and measured data from operating nuclear power plants. As a part of the Modeling and Analysis of Exelon BWRs for Eigenvalue and Thermal Limits Predictability project, new validation efforts relevant to boiling water reactor (BWR) core applications have been performed. This paper presents the results of the critical experiment portion of the BWR validation efforts for MPACT. The Kritz-4 experiments and IPEN/MB-01 BWR-relevant configurations are modeled with MPACT. The Kritz-4 BWR critical experiments were performed at both cold and hot conditions, which is a unique feature among other critical experiment facilities. The MPACT results with linear source (LS) Method of Characteristics (MOC) have very good agreement with the measured criticality. When using the 60-group BWR library with LS and P2 scattering, the maximum k{sub eff} error is 109 pcm, and the average cold-hot bias is only -0.11 pcm/K. The fission rate distributions of MPACT are also verified with Serpent calculations. For the IPEN facility, two configurations are considered: one with a large central void, and one with a cruciform control rod. The MPACT k{sub eff} errors are less than 50 pcm for all IPEN problems. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

FAST.Farm Development and Validation of Structural Load Prediction Against Large Eddy Simulations

FAST.Farm is a mid-fidelity engineering tool developed by the National Renewable Energy Laboratory targeted at accurately and efficiently predicting wind turbine power production and structural loading in wind farm settings, including wake interactions between turbines. FAST.Farm is based on several principles of the dynamic wake meandering (DWM) model, but also addresses limitations of previous DWM implementations. Previous FAST.Farm studies have shown the similarities and differences between FAST.Farm and large eddy simulations for rigid turbine cases. The objective of this work is to quantify the ability of FAST.Farm to accurately predict turbine structural response in a small wind farm. This is done by comparing FAST.Farm structural response to SOWFA-OpenFAST results for three laterally-aligned turbines. The purpose of this study is to characterize the similarities and differences between FAST.Farm and a higher fidelity model for predicting turbine structural response in a wind farm for differing atmospheric inflows. Strong statistical agreement was found between FAST.Farm and SOWFA-OpenFAST structural response for the non-waked upstream turbine, and good agreement was found for the downstream turbines for most structural quantities. Higher differences were seen for downstream turbines with low ambient turbulence intensity or yawed turbines, suggesting areas for FAST.Farm wake dynamics modeling improvements. For all cases and turbines, small statistical differences were seen between blade deflections and bending moments, with larger differences for tower-top and tower-base bending moments. Overall, the results establish confidence for applying FAST.Farm to wind farm power and loads analyses and identify areas where further model validations and model improvements should be targeted.

49 EE - Wind and Water Power Program - Wind (EE-4W↗
DOE OSTI2021

Modeling heat transport processes in enhanced geothermal systems: Validation study from EGS Collab Experiment 1

Heat recovery from enhanced geothermal systems (EGS) is a complex process involving heat transport in both fracture networks and rock formations. A comprehensive understanding of and the ability to model the underlying heat transport mechanisms is important for the success of EGS but remains challenging in practice due to the generally insufficient characterization of EGS reservoirs. In the present study, we analyze an extensively monitored intermediate-scale EGS field experiment performed in a well-characterized testbed. The high-resolution, high-quality measurements from the field experiment enable the development of a high-fidelity model incorporating a well-constrained fracture network. Based on the field experiment, we investigate the complex heat transport processes in an EGS-relevant environment and validate the capability of a numerical approach in simulating these inherently coupled heat transport processes. A series of numerical simulations were performed to study the effects of different heat transport mechanisms, including thermal convection with fracture flow, thermal conduction in rock formations, and the Joule-Thomson effect. The agreement of thermal responses between field measurements and simulation results indicates that our numerical approach can appropriately model the heat transport processes pertaining to heat recovery from EGS reservoirs.

Wu, Hui↗
DOE OSTI2023

Validation study of sodium pool fire modeling efforts in $\mathrm{MELCOR}$ and $\mathrm{SPHINCS}$ codes

Discharge of sodium coolant into containment from a sodium-cooled fast reactor vessel can occur in the event of a pipe leak or break. In this situation, some of the liquid sodium droplets discharged from the coolant system will react with oxygen in the air before reaching the containment. This phase of the event is normally termed the sodium spray fire phase. Unreacted sodium droplets pool on the containment floor where continued reaction with containment atmospheric oxygen occurs. This phase of the event is normally termed the sodium pool fire phase. Both phases of these sodium-oxygen reactions (or fires) are important to model because of the heat addition and aerosol generation that occur. Any fission products trapped in the sodium coolant may also be released during this progression of events, which if released from containment could pose a health risk to workers and the public. The paper describes progress of an international collaborative research in the area of the sodium fire modeling in the sodium-cooled fast reactors between the United States and Japan under the framework of the Civil Nuclear Energy Research and Development Working Group. In this collaboration between Sandia National Laboratories and Japan Atomic Energy Agency, the validation basis for and modeling capabilities of sodium spray and pool fires in MELCOR of Sandia National Laboratories and SPHINCS of Japan Atomic Energy Agency are being enhanced. Here this study documents MELCOR and SPHINCS sodium pool fire model validation exercises against the JAEA’s sodium pool fire experiments, F7-1 and F7-2. The proposed enhancement of the sodium pool fire models in MELCOR through addition of thermal hydraulic and sodium spreading models that enable a better representation of experimental results is also described.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Design and Validation of a High-Throughput Reductive Catalytic Fractionation Method

Reductive catalytic fractionation (RCF) is a promising method to extract and depolymerize lignin from biomass, and bench-scale studies have enabled considerable progress in the past decade. RCF experiments are typically conducted in pressurized batch reactors with volumes ranging between 50 and 1000 mL, limiting the throughput of these experiments to one to six reactions per day for an individual researcher. Here, we report a high-throughput RCF (HTP-RCF) method in which batch RCF reactions are conducted in 1 mL wells machined directly into Hastelloy reactor plates. The plate reactors can seal high pressures produced by organic solvents by vertically stacking multiple reactor plates, leading to a compact and modular system capable of performing 240 reactions per experiment. Using this setup, we screened solvent mixtures and catalyst loadings for hydrogen-free RCF using 50 mg poplar and 0.5 mL reaction solvent. The system of 1:1 isopropanol/methanol showed optimal monomer yields and selectivity to 4-propyl substituted monomers, and validation reactions using 75 mL batch reactors produced identical monomer yields. To accommodate the low material loadings, we then developed a workup procedure for parallel filtration, washing, and drying of samples and a 1H nuclear magnetic resonance spectroscopy method to measure the RCF oil yield without performing liquid-liquid extraction. As a demonstration of this experimental pipeline, 50 unique switchgrass samples were screened in RCF reactions in the HTP-RCF system, revealing a wide range of monomer yields (21-36%), S/G ratios (0.41-0.93), and oil yields (40-75%). These results were successfully validated by repeating RCF reactions in 75 mL batch reactors for a subset of samples. We anticipate that this approach can be used to rapidly screen substrates, catalysts, and reaction conditions in high-pressure batch reactions with higher throughput than standard batch reactors.

BIOMASS FUELS,INORGANIC, ORGANIC, PHYSICAL, AND AN↗
DOE OSTI2025

Large-scale experimental validation of thermochemical water-splitting oxides discovered by defect graph neural networks

Thermochemical water-splitting (TCH) based on 2-step thermal redox cycles in metal oxides is a promising approach to generating H 2 , but state-of-the-art (SOTA) CeO 2 has several practical limitations, which has motivated continued materials discovery efforts in this field. Here, in this study, we improve upon a SOTA defect graph neural network (dGNN) surrogate model's oxygen vacancy predictions and combine them with materials project phase diagrams to down-select and discover structurally diverse, experimentally known metal oxides whose TCH performance was previously unknown. Amongst twelve candidates selected based on our high-throughput screening and down-selection criteria, we achieved ∼80% accuracy in identifying materials with stable redox cycling and hydrogen production in stagnation flow reactor water-splitting experiments. Closer to 100% accuracy can be achieved if higher-accuracy, hybrid DFT-predicted vacancy formation energies were computed and used in lieu of the most uncertain dGNN-based screening predictions, as they correct false positives to true negatives. Notably, two discovered candidates, Sr 3 PrMn 2 O 8 and Ba 2 Fe 2 O 5 , display hydrogen yields greater than CeO 2 under specific redox conditions. In conclusion, these results demonstrate our ability to computationally predict and experimentally validate promising candidate TCH materials that have the potential to compete with CeO 2 .

08 HYDROGEN↗
DOE OSTI2020

Perturbation theory for modeling galaxy bias: validation with simulations of the Dark Energy Survey

We describe perturbation theory (PT) models of galaxy bias for applications to photometric galaxy surveys. We model the galaxy-galaxy and galaxy-matter correlation functions in configuration space and validate against measurements from mock catalogs designed for the Dark Energy Survey (DES). We find that an effective PT model with five galaxy bias parameters provides a good description of the 3D correlation functions above scales of 4 Mpc/$h$ and $z < 1$. Our tests show that at the projected precision of the DES-Year 3 analysis, two of the non-linear bias parameters can be fixed to their co-evolution values, and a third (the $k^2$ term for higher derivative bias) set to zero. The agreement is typically at the 2 percent level over scales of interest, which is the statistical uncertainty of our simulation measurements. To achieve this level of agreement, our {\it fiducial} model requires using the full non-linear matter power spectrum (rather than the 1-loop PT one). We also measure the relationship between the non-linear and linear bias parameters and compare them to their expected co-evolution values. We use these tests to motivate the galaxy bias model and scale cuts for the cosmological analysis of the Dark Energy Survey; our conclusions are generally applicable to all photometric surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Searching For Transiting Planets Around Halo Stars. I. Sample Selection and Validation

By measuring the elemental abundances of a star, we can gain insight into the composition of its initial gas cloud—the formation site of the star and its planets. Planet formation requires metals, the availability of which is determined by the elemental abundance. In the case where metals are extremely deficient, planet formation can be stifled. To investigate such a scenario requires a large sample of metal-poor stars and a search for planets therein. This paper focuses on the selection and validation of a halo star sample. We select ~17,000 metal-poor halo stars based on their Galactic kinematics, and confirm their low metallicities ([Fe/H] < -0.5), using spectroscopy from the literature. Furthermore, we perform high-resolution spectroscopic observations using LBT/PEPSI and conduct detailed metallicity ([Fe/H]) analyses on a sample of 13 previously-known halo stars that also have hot kinematics. We can use the halo star sample presented here to measure the frequency of planets and to test planet formation in extremely metal-poor environments. The result of the planet search and its implications will be presented and discussed in a companion paper by Boley et al.

47 OTHER INSTRUMENTATION↗