Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Bichromatic Wave Selection for Validation of the Difference-Frequency Transfer Function for the OC6 Validation Campaign: Preprint

The focus of the Offshore Code Comparison Collaboration, Continuation, with Correlation and unCertainity (OC6) project, which operates under the International Energy Agency (IEA) Wind Task 30, is to refine the accuracy of engineering tools used to design offshore wind turbines. In support of this work, a new validation campaign is being developed that seeks to better understand the nonlinear wave loading that excites floating wind systems at their low-frequency, rigid-body modes in surge and pitch. The validation data will be used in a three-way validation between simplified engineering tools and higher-fidelity tools, such as computational fluid dynamics (CFD). Irregular wave spectrums, which are traditionally used to examine the nonlinear wave interaction with offshore structures, are too computationally expensive to be simulated in CFD tools, and so bichromatic wave cases will be used instead. This paper reviews the process used to choose the bichromatic wave pairs to be used in the campaign to validate the second-order difference-frequency quadratic and potential loads at the surge and pitch natural frequencies of a floating semisubmersible.

17 WIND ENERGY↗
DOE OSTI2024

WE-Validate: An Open-Source Framework For Wind Power Validation

Grid operators rely on historical weather time series at existing and planned wind power plants to make informed decisions when planning for a future power grid with very high penetration of renewable power. While synthetic wind power time series have been developed based on historical weather models, their validation with actual power production data remains complex due to variations in modeling practices and methodologies. This paper introduces the WE-Validate framework, originally designed for wind speed validation and now enhanced for wind power validation with a graphical user interface to support users with minimal programming experience. Validation of wind power with WE-Validate is based on robust metrics consisting of RMSE, centered RMSE, average bias, average percent bias, mean absolute error, mean absolute percent error, cross correlation, and calculation of ramping magnitude, rate, and duration. This paper showcases WE-Validate with validation of synthetically derived power for a wind plant in Washington state for one month in 2018. Validation of the synthetic power from two comparison data sets compared with observations shows both comparison series have strong correlation with observed across weekly and monthly aggregations while suffering from persistent negative bias. The suite of metrics within WE-Validate facilitates immediate insight into the utility of the comparison data sets through compression across multiple axes. This user-friendly, open-source tool can be extended beyond wind power, making it a valuable resource for system planners and operators in different domains.

Moncheur de Rieudotte, Malcolm P.↗
DOE OSTI2024

Validation Assessment of Turbulent Reacting Flow Model Using The Area-Validation Metric on Medium-Scale Methanol Pool Fire Results

Accident analysis and ensuring power plant safety are pivotal in the nuclear energy sector. Significant strides have been achieved over the past few decades regarding fire protection and safety, primarily centered on design and regulatory compliance. Yet, after the Fukushima accident a decade ago, the imperative to enhance measures against fire, internal flooding, and power loss has intensified. Hence, a comprehensive, multilayered protection strategy against severe accidents is needed. Consequently, gaining a deeper insight into pool fires and their behavior through extensive validated data can greatly aid in improving these measures using advanced validation techniques. A model validation study was performed at Sandia National Laboratories in which a 30-cm diameter methanol pool fire was modeled using the SIERRA/Fuego turbulent reacting flow code. This validation study used a standard validation experiment to compare model results against, and conclusions have been published. The fire was modeled with a Large Eddy Simulation (LES) turbulence model with subgrid turbulent kinetic energy closure. Combustion was modeled using a strained laminar flamelet library approach. Radiative heat transfer was accounted for with a model utilizing the gray-gas approximation. In the present study, additional validation analysis is performed using the area validation metric (AVM). These activities are done on multiple datasets involving different variables and temporal/spatial ranges and intervals. In conclusion, the results provide insight into the use of the area validation metric on such temporally varying datasets and the importance of physics-aware use of the metric for proper analysis.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2021

Scalable Programming Workflows for Validation of Quantum Computers

Hybrid quantum-classical workflows have become standard methods for executing variational algorithms and other quantum simulation techniques, which are key applications for noisy intermediate scale quantum (NISQ) computers. Validating these simulations is an important task which helps gauge the progress of quantum computer development, and classical simulation can serve as a tool to this end. Both exact and more scalable approximate methods with quantifiable error bounds can be used in validation tasks where the applicable metrics include the distance from a calculable ground truth, the quality of an error model fit to data, etc. Here we present a library extension that includes methods for validation of quantum simulations based on scalable hybrid workflows executable on high performance computers. We provide examples that use approximate methods based on tensor networks and stabilizer simulators to bound the error of quantum simulations on NISQ hardware.

Nguyen, Thien↗
DOE OSTI2020

Lab-Scale, Closed-Loop Experimental Characterization, Model Refinement, and Validation of a Hydrokinetic Energy-Harvesting Ocean Kite

This paper presents a study wherein we experimentally characterize the dynamics and control system of a lab-scale ocean kite, and then refine, validate, and extrapolate this model for use in a full-scale system. Ocean kite systems, which harvest tidal and ocean current resources through high-efficiency cross-current motion, enable energy extraction with an order of magnitude less material (and cost) than stationary systems with the same rated power output. However, an ocean kite represents a nascent technology that is characterized by relatively complex dynamics and requires sophisticated control algorithms. In order to characterize the dynamics and control of ocean kite systems rapidly, at a relatively low cost, the authors have developed a lab-scale, closed-loop prototyping environment for characterizing tethered systems, whereby 3D printed systems are tethered and flown in a water channel environment. While this system has been shown to be capable of yielding similar dynamic characteristics to some full-scale systems, there are also fundamental limitations to the geometric scales and flow speeds within the water channel environment, making many other real-world scenarios impossible to replicate from the standpoint of dynamic similarity. Here, to address these scenarios, we show how the lab-scale framework is used to refine and validate a scalable dynamic model of a tethered system, which can then be extrapolated to full-scale operation. In this work, we present an extensive case study of this model refinement, validation, and extrapolation on an ocean kite system intended for operation in the Gulf Stream or similar current environments.

42 ENGINEERING↗
DOE OSTI2019

Validation of the first LiDAR wind resource assessment buoy system offshore the Northeast United States

The US offshore wind industry is maturing with several projects in various stages of development. These projects require site wind and environmental data before and during operation. Conventional techniques such as fixed-bottom meteorological towers present economical and permitting challenges for the US. Floating Light Detection and Ranging (LiDAR) buoys offer significant advantages including reduced costs, less permitting, and reusability. This paper presents the validation of the first floating LiDAR buoy in Northeast US waters. The buoy, named DeepCLiDAR, includes a LiDAR, ecological monitoring sensors, and metocean sensors. A three-phase LiDAR validation plan was executed, and its results are presented. The objective of the validation plan was to verify the accuracy of measurements made by the LiDAR buoy in wave environments against an unmoving reference wind measurement. Due to a lack of reference met masts, the use of a LiDAR on land as a baseline reference was implemented for validation. Comparison to a reference LiDAR instead of a traditional meteorological tower was a unique approach required in the Northeast US waters due to the absence of a reference fixed-bottom meteorological tower in the region at the time of this study. The testing included a comparison of wind speed measurements made by the buoy deployed 15 km offshore from the mainland and a land-based reference LiDAR located on a nearby island. This paper presents the methodology and results of this program, which indicate favorable agreement. This was the first such validation program in the Northeast USA which is now seeing rapid development of offshore wind.

17 WIND ENERGY↗
DOE OSTI2020

Investigating Core Gaps and the Development of Subcomponent Validation Methods for Wind Turbine Blades: Preprint

Core gaps are a common manufacturing defect observed in wind blade composite sandwich constructions, which occur when sheets of core material are not properly butted up against each other in the mold. The aim of this study was to characterize core gaps in composite sandwich constructions at the coupon scale. This was to gain an initial understanding of the defect before developing appropriate methodologies for more complex subcomponents as part of a much broader wind blade structural validation and damage tolerance program. Long beam flexure in 4-point-bending was chosen as the most appropriate loading scenario. Beam specimens were characterized with and without 10 mm core gaps in fiberglass/balsa sandwich beams. The core gaps were characterized with two separate resin systems; a Hexion epoxy and Arkema's Elium resins system (a novel, infusible thermoplastic). Results showed that the Elium beams without the core gaps were had a 15% lower static strength than their epoxy counterparts. The introduction of the core gap to the epoxy beams reduced their static strength by 35%. The Elium beams, however, exhibited negligible strength reductions with the inclusion of the core gap. Overall, this characterization study provided pertinent information with regards to core gaps as a manufacturing defect to allow for continued development of damage tolerance and subcomponent validation methodologies with the inclusion of manufacturing defects.

17 WIND ENERGY↗
DOE OSTI2021

Validation of the Community Land Model Version 5 over the Contiguous United States (CONUS) using in situ and remote sensing data sets

The Community Land Model (CLM) is an effective tool to simulate the biophysical and biogeochemical processes and their interactions with the atmosphere. Although CLM Version 5 (CLM5) constitutes various updates in these processes, its performance in simulating energy, water and carbon cycles over the Contiguous United States (CONUS) at scales which land surface changes and hydrometeorological and hydroclimatological applications are more locally relevant is yet to be assessed. In this study, we conducted three simulations at 0.125? during 1979-2018 over the CONUS using different configurations of CLM, namely CLM5-biogeochemistry (CLM5BGC), CLM4.5BGC, and CLM5-satellite phenology (CLM5SP). We validated and compared their simulations against multiple remote-sensed and in-situ datasets. Overall, the parametric and structural updates (e.g., carbon cost for nitrogen uptake, variable soil thickness, dry surface layer) in CLM5 improve its ability in capturing terrestrial biogeochemical dynamics. The low evapotranspiration in CLM5BGC is associated with biases in simulating vegetation phenological characteristics rather than soil water limitations. The mismatch between CLM5BGC-simulated peak leaf area index and reference data can be attributed to CLM5BGC's inability in simulating phenology of trees and grasses. The differences between CLM-simulated irrigation and reference estimates can be attributed to differences between processes represented in models and in reality, and uncertainties in input and validation datasets. Evaluation against observations at small catchments suggest that hydrologic parameters needed to be calibrated to improve simulations of runoff, especially subsurface runoff. Additional efforts are needed to incorporate spatially-distributed plant phenology and physiology parameters and regional-specific agricultural management practices (e.g., planting, harvest).

Cheng, Yanyan↗
DOE OSTI2021

Combination of cluster number counts and two-point correlations: validation on mock Dark Energy Survey

ABSTRACT We present a method of combining cluster abundances and large-scale two-point correlations, namely galaxy clustering, galaxy–cluster cross-correlations, cluster autocorrelations, and cluster lensing. This data vector yields comparable cosmological constraints to traditional analyses that rely on small-scale cluster lensing for mass calibration. We use cosmological survey simulations designed to resemble the Dark Energy Survey Year 1 (DES-Y1) data to validate the analytical covariance matrix and the parameter inferences. The posterior distribution from the analysis of simulations is statistically consistent with the absence of systematic biases detectable at the precision of the DES-Y1 experiment. We compare the χ2 values in simulations to their expectation and find no significant difference. The robustness of our results against a variety of systematic effects is verified using a simulated likelihood analysis of DES-Y1-like data vectors. This work presents the first-ever end-to-end validation of a cluster abundance cosmological analysis on galaxy catalogue level simulations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Dark Energy Survey Year 3 results: Cosmology from combined galaxy clustering and lensing validation on cosmological simulations

In this work, we present a validation of the Dark Energy Survey Year 3 (DES Y3) 3×2-point analysis choices by testing them on Buzzard2.0, a new suite of cosmological simulations that is tailored for the testing and validation of combined galaxy clustering and weak-lensing analyses. We show that the buzzard2.0 simulations accurately reproduce many important aspects of the DES Y3 data, including photometric redshift and magnitude distributions, and the relevant set of two-point clustering and weak-lensing statistics. We then show that our model for the 3×2-point data vector is accurate enough to recover the true cosmology in simulated surveys assuming the true redshift distributions for our source and lens samples, demonstrating robustness to uncertainties in the modeling of the nonlinear matter power spectrum, nonlinear galaxy bias, and higher-order lensing corrections. Additionally, we demonstrate for the first time that our photometric redshift calibration methodology, including information from photometry, spectroscopy, clustering cross-correlations, and galaxy–galaxy lensing ratios, is accurate enough to recover the true cosmology in simulated surveys in the presence of realistic photometric redshift uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Dark Energy Survey Year 3 results: Simulation-based cosmological inference with wavelet harmonics, scattering transforms, and moments of weak lensing mass maps. Validation on simulations

Beyond-two-point statistics contain additional information on cosmological as well as astrophysical and observational (systematics) parameters. In this methodology paper we provide an end-to-end simulationbased analysis of a set of Gaussian and non-Gaussian weak lensing statistics using detailed mock catalogs of the Dark Energy Survey (DES). Here, we implement: 1) second and third moments; 2) wavelet phase harmonics (WPH); 3) the scattering transform (ST). Our analysis is fully based on simulations, it spans a space of seven $νw$CDM cosmological parameters, and it forward models the most relevant sources of systematics of the data (masks, noise variations, clustering of the sources, intrinsic alignments, and shear and redshift calibration). We implement a neural network compression of the summary statistics, and we estimate the parameter posteriors using a likelihood-free-inference approach. We validate the pipeline extensively, and we find that WPH exhibits the strongest performance when combined with second moments, followed by ST, and then by third moments. The combination of all the different statistics further enhances constraints with respect to second moments, up to 25 percent, 15 percent, and 90 percent for S 8 , Ω m , and the figure-of-merit FoM S8;Ωm , respectively. We further find that non-Gaussian statistics improve constraints on w and on the amplitude of intrinsic alignment with respect to second moments constraints. The methodological advances presented here are suitable for application to Stage IV surveys from Euclid, Rubin-LSST, and Roman with additional validation on mock catalogs for each survey. In a companion paper we present an application to DES Year 3 data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Verification and Validation Tests of Gamma Library of MC2-3 for Coupled Neutron and Gamma Heating Calculation

For the accurate assessment of the heat generation rate in fast reactors, the gamma library of MC2 -3 and the MC2 -3 + GAMSOR procedure employing the coupled neutron and gamma heating calculation has been thoroughly verified against Monte Carlo results and validated using the ZPPR-15D gamma dose measurement data. NJOY outputs are post-processed in a consistent way with the NJOY procedure to avoid any missing data or double counting of data. Prompt heating for 379 out of 391 isotopes in the gamma library was verified against MCNP6.2 to within 1% relative error in total heating for most isotopes. For both a simple one-dimensional slab problem representing a sodium cooled fast reactor and the Experimental Breeder Reactor II (EBR-II) benchmark problem, the root-mean-square values of assembly power error were less than 0.5% for fuel assemblies, ~1% in blankets and ~1 to ~3% in reflectors compared to MCNP6.2 results. The most plausible cause for the 3% error in a reflector assembly is believed to be the error in the multigroup neutron cross sections for the reflector assembly. For validation, gamma doses measured with thermoluminiscent dosimeters (TLDs) in the ZPPR-15D experiment were calculated using GAMSOR. Due to the uncertainty in the TLD measurement with regards to the energy deposition of photons and neutrons, the validation data leads to a 12.7% uncertainty on the experimental measurement. With this uncertainty bound, the calculated doses all fell within one standard deviation of the measured value. Combined with the accurate calculation of reaction rate distributions and neutron spectrum measurements, these results indicate good agreement for the neutron and gamma heating calculations that were performed.

coupled neutron and gamma heating↗
DOE OSTI2022

Validation of MPACT BWR capabilities against critical experiments

Over the years, significant validation work for the neutronics code MPACT has been performed against zero-power critical benchmarks and measured data from operating nuclear power plants. As a part of the Modeling and Analysis of Exelon BWRs for Eigenvalue and Thermal Limits Predictability project, new validation efforts relevant to boiling water reactor (BWR) core applications have been performed. This paper presents the results of the critical experiment portion of the BWR validation efforts for MPACT. The Kritz-4 experiments and IPEN/MB-01 BWR-relevant configurations are modeled with MPACT. The Kritz-4 BWR critical experiments were performed at both cold and hot conditions, which is a unique feature among other critical experiment facilities. The MPACT results with linear source (LS) Method of Characteristics (MOC) have very good agreement with the measured criticality. When using the 60-group BWR library with LS and P2 scattering, the maximum k{sub eff} error is 109 pcm, and the average cold-hot bias is only -0.11 pcm/K. The fission rate distributions of MPACT are also verified with Serpent calculations. For the IPEN facility, two configurations are considered: one with a large central void, and one with a cruciform control rod. The MPACT k{sub eff} errors are less than 50 pcm for all IPEN problems. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Validation and Recalibration of the Solubility Models in Support of the Heater Test in Salt Formations

The US Department of Energy Office of Nuclear Energy is conducting a brine availability heater test to characterize the thermal, mechanical, hydrological and chemical response of salt at elevated temperatures. In the heater test, brines will be collected and analyzed for chemical compositions. In order to support the geochemical modeling of chemical evolutions of the brines during the heater test, we are recalibrating and validating the solubility models for the mineral constituents in salt formations up to 100°C, based on the solubility data in multiple component systems as well as simple systems from literature. In this work, we systematically compare the model-predicted values based on the various solubility models related to the constituents of salt formations, with the experimental data. As halite is the dominant constituent in salt formations, we first test the halite solubility model in the Na-Mg-Cl dominated brines. We find the existing halite solubility model systematically over-predict the solubility of halite. We recalibrate the halite model, which can reproduce halite solubilities in Na-Mg-Cl dominated brines well. As gypsum/anhydrite in salt formations controls the sulfate concentrations in associated brines, we test the gypsum solubility model in NaCl solutions up to 5.87 mol•kg –1 from 25 ° C to 50 ° C. The testing shows that the current gypsum solubility model reproduces the experimental data well when NaCl concentrations are less than 1 mol•kg –1 . However, at NaCl concentrations higher than 1, the model systematically overpredicts the solubility of gypsum. In the Na + —Cl – —SO 4 2– —CO 3 2– system, the validation tests up to 100 ° C demonstrate that the model excellently reproduces the experimental data for the solution compositions equilibrated with one single phase such as halite (NaCl) or thenardite (Na 2 SO 4 ), with deviations equal to, or less than, 1.5 %. The model is much less ideal in reproducing the compositions in equilibrium with the assemblages of halite + thenardite, and of halite + thermonatrite (Na 2 CO 3 •H 2 O), with deviations up to 31 %. The high deviations from the experimental data for the multiple assemblages in this system at elevated temperatures may be attributed to the facts that the database has the Pitzer interaction parameters for Cl – —CO 3 2– and SO 4 2– —CO 3 2– only at 25 ° C. Finally, in the Na + —Ca 2+ —SO 4 2– —HCO 3 – system, the validation tests also demonstrate that the model reproduces the equilibrium compositions for one single phase such as gypsum better than the assemblages of more than one phase.

36 MATERIALS SCIENCE↗
DOE OSTI2020

FAST.Farm Development and Validation of Structural Load Prediction Against Large Eddy Simulations

FAST.Farm is a mid-fidelity engineering tool developed by the National Renewable Energy Laboratory targeted at accurately and efficiently predicting wind turbine power production and structural loading in wind farm settings, including wake interactions between turbines. FAST.Farm is based on several principles of the dynamic wake meandering (DWM) model, but also addresses limitations of previous DWM implementations. Previous FAST.Farm studies have shown the similarities and differences between FAST.Farm and large eddy simulations for rigid turbine cases. The objective of this work is to quantify the ability of FAST.Farm to accurately predict turbine structural response in a small wind farm. This is done by comparing FAST.Farm structural response to SOWFA-OpenFAST results for three laterally-aligned turbines. The purpose of this study is to characterize the similarities and differences between FAST.Farm and a higher fidelity model for predicting turbine structural response in a wind farm for differing atmospheric inflows. Strong statistical agreement was found between FAST.Farm and SOWFA-OpenFAST structural response for the non-waked upstream turbine, and good agreement was found for the downstream turbines for most structural quantities. Higher differences were seen for downstream turbines with low ambient turbulence intensity or yawed turbines, suggesting areas for FAST.Farm wake dynamics modeling improvements. For all cases and turbines, small statistical differences were seen between blade deflections and bending moments, with larger differences for tower-top and tower-base bending moments. Overall, the results establish confidence for applying FAST.Farm to wind farm power and loads analyses and identify areas where further model validations and model improvements should be targeted.

49 EE - Wind and Water Power Program - Wind (EE-4W↗
DOE OSTI2019

Validation on Aggregate Flexibility from Residential Air Conditioning Systems for Building-to-Grid Integration

To facilitate the integration of buildings to the power grid, battery-equivalent models have been proposed to characterize and quantify aggregate flexibility from building loads. An analytical method has been proposed to construct such a flexibility model for thermostatically controlled loads. Since this analytical method is derived from a simplified representation of building thermal dynamics, it is necessary to evaluate the resulting flexibility model in a more realistic context. This paper focuses on the validation of this analytical method for estimating aggregate flexibility from residential air conditioning (ACs) systems. A high-fidelity model is first developed to mimic thermal behaviors of a residential AC system through a co-simulation between Modelica and EnergyPlus. A population of virtual residential AC systems is then generated by randomizing parameters of the high-fidelity model. Finally, an aggregate flexibility model is constructed for the residential AC population using the analytical method and validated using results from simulation of the high-fidelity model. It is found that the flexibility estimated using the analytical method is with reasonable accuracy, but can be improved by explicitly incorporating heat gains into the method.

Huang, Sen↗