Search NASA⌕ Search

SEARCH · Search NASA

Results for “MODEL VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Understanding Dynamic Model Validation of a Wind Turbine Generator and a Wind Power Plant

Regional reliability organizations require power plants to validate the dynamic models that represent them to ensure that power systems studies are performed to the best representation of the components installed. In the process of validating a wind power plant (WPP), one must be cognizant of the parameter settings of the wind turbine generators (WTGs) and the operational settings of the WPP. Validating the dynamic model of a WPP is required to be performed periodically. This is because the control parameters of the WTGs and the other supporting components within a WPP may be modified to comply with new grid codes or upgrades to the WTG controller with new capabilities developed by the turbine manufacturers or requested by the plant owners or operators. The diversity within a WPP affects the way we represent it in a model. Diversity within a WPP may be found in the way the WTGs are controlled, the wind resource, the layout of the WPP (electrical diversity), and the type of WTGs used. Each group of WTGs constitutes a significant portion of the output power of the WPP, and their unique and salient behaviors should be represented individually. The objective of this paper is to illustrate the process of dynamic model validations of WTGs and WPPs, the available data recorded that must be screened before it is used for the dynamic validations, and the assumptions made in the dynamic models of the WTG and WPP that must be understood. Without understanding the correct process, the validations may lead to the wrong representations of the WTG and WPP modeled.

17 WIND ENERGY↗
DOE OSTI2017

An ice sheet model validation framework for the Greenland ice sheet

We propose a new ice sheet model validation framework the Cryospheric Model Comparison Tool (CMCT) that takes advantage of ice sheet altimetry and gravimetry observations collected over the past several decades and is applied here to modeling of the Greenland ice sheet. We use realistic simulations performed with the Community Ice Sheet Model (CISM) along with two idealized, non-dynamic models to demonstrate the framework and its use. Dynamic simulations with CISM are forced from 1991 to 2013 using combinations of reanalysis-based surface mass balance and observations of outlet glacier flux change. We propose and demonstrate qualitative and quanti- tative metrics for use in evaluating the different model simulations against the observations. We find 10 that the altimetry observations used here are largely ambiguous in terms of their ability to distinguish one simulation from another. Based on basin- and whole-ice-sheet scale metrics, the model initial condition as well as output from idealized and dynamic models all provide an equally reasonable representation of the ice sheet surface (mean elevation differences of <1 m). This is likely due to their short period of record, biases inherent to digital elevation models used for model initial conditions, and biases resulting from firn dynamics, which are not explicitly accounted for in the models or observations. On the other hand, we find that the gravimetry observations used here are able to unambiguously distinguish between simulations of varying complexity, and along with the CMCT, can provide a quantitative score for assessing a particular model and/or simulation. The new framework demonstrates that our proposed metrics can distinguish relatively better from relatively worse simulations and that dynamic ice sheet models, when appropriately initialized and forced with the right boundary conditions, demonstrate predictive skill with respect to observed dynamic changes occurring on Greenland over the past few decades. An extensible design will allow for continued use of the CMCT as future altimetry, gravimetry, and other remotely sensed data become available for use in ice sheet model validation.

58 GEOSCIENCES↗
DOE OSTI2022

1D Heat Loss Models Validation Experiment

Contains data from the model validation in the 1D Heat Loss Models to Predict the Aquifer Temperature Profile during Hot/Cold Water Injection Project. The data include two COMSOL models (2D axisymmetric benchmark model and 2D Vinsome model), one python code (1D Vinsome based FEM numerical simulation), one matlab main code (1D Newton analytical solution and all results comparison visualization), and output files generated from the above models.

1D↗
DOE OSTI2023

Milestone 1.2.13: Preliminary Measurements of Radiolytic Nitric Acid Formation to Support Predictive Model Validation

Predictive computational models have been developed to support the technical basis for extended dry storage of aluminum-clad spent nuclear fuel (ASNF) in helium-backfilled cannisters. To date, these models have been optimized on a variety of irradiation experiments designed to elucidate the radiation-induced formation of molecular hydrogen gas, a radiolysis product that is potentially problematic for the safe storage of ASNF. However, the yield of nitric acid (HNO3) has not been determined, despite conservative predictions of its formation (300–4000 ppm) in 1% residual air environments irradiated in contact with ASNF. HNO3, another problematic radiolysis product, can lead to enhanced corrosion and potentially compromise storage canister integrity. Thus, to support the validation of predictive computer models, we report the measurement and quantification of HNO3 from the gamma irradiation of aluminum alloy coupons in humid air.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2019

Distribution-Level Phasor Measurement Units Application to Composite Load Model Validation

The paper presents the results of composite load model validation based on the distribution level micro- phasor measurement units (PMU) measurements. The actual micro-PMU measurements from the distribution feeders are collected by Lawrence Berkley National Laboratory (LBNL). The composite load model parameters are initially generated using the load model data tool developed by Pacific Northwest National Laboratory (PNNL). The generated load models are calibrated to match the performances with the micro-PMU measurements using disturbance records “play-in” capabilities available in a GE PSLF simulation package. A trial-and-error approach based on engineering judgement is proposed in this paper to benchmark the generated load model parameters and is implemented in the prototype of load model validation tool, which would be a supplement to the load model data tool.

Liu, Yuan↗
DOE OSTI2016

Feature Extraction for Structural Dynamics Model Validation

As structural dynamics becomes increasingly non-modal, stochastic and nonlinear, finite element model-updating technology must adopt the broader notions of model validation and uncertainty quantification. For example, particular re-sampling procedures must be implemented to propagate uncertainty through a forward calculation, and non-modal features must be defined to analyze nonlinear data sets. The latter topic is the focus of this report, but first, some more general comments regarding the concept of model validation will be discussed.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Validated model of a thermoelectric heat pump clothes dryer using secondary pumped loops

The energy associated with clothes drying makes up 4% of the total residential electrical energy consumption in the US. The cost is high since most clothes dryers use electric resistance heating which is inexpensive but also energy inefficient. State-of-the-art vapor-compression heat pump clothes dryers offer significant energy savings but have limited market penetration in the US. Here, a new configuration of clothes dryer was studied that utilizes a solid-state thermoelectric heat pump with pumped secondary water loops and conventional fin-and-tube water-to-air heat exchangers. Experimental results are presented for the thermoelectric dryer prototype with a combined energy factor of 6.89 lb BDW /kWh (specific moisture extraction rate of 1.71 kg w /kWh) and a dry time of 84 min for a standard load size of 8.45 lb (3.83 kg) with 57.5% starting moisture content. This is a 85% energy efficiency improvement over baseline electric resistance dryers. The efficiency and drying time results achieved are similar to vapor compression heat pump dryers. Compared to previous air-based thermoelectric clothes dryers, the energy efficiency has been increased by 6%, but drying time has been reduced by as much as 47% using secondary pumped loops and separate heat exchangers, which represents a significant advancement in the technology. In addition to the experimental prototype, a model was also developed to study the performance. The model was validated against experimental prototype data and used to identify the range of performance (dry time and efficiency) that could be expected of the design.

42 ENGINEERING↗
DOE OSTI2025

Radiation-induced bowing of SiC/SiC composites under neutron flux gradients—integral experimental data for model validation

Here, the radiation-induced swelling of SiC and its composites, including strong dependencies on temperature and dose, can drive significant lateral bowing in the presence of temperature and/or dose gradients. In recent years, simulations have been performed to assess the extent of bowing in SiC composite light-water reactor (LWR) fuel cladding and boiling water reactor (BWR) channel boxes. However, to date, no integral experimental data exist to validate these models. This work provides the first experimental bowing evaluation of three ∼380 mm long SiC composite specimens irradiated under varying neutron dose gradients (∼50°C–60°C, 0.03–0.06 dpa): two tubes (∼9.8 mm diameter) and a miniature BWR channel box (∼30 mm square). The measured radiation-induced length swelling (∼0.3%–0.7% linear) was consistently 10%–21% higher than values obtained from 3D finite element structural analyses with inputs from 3D radiation transport calculations. This discrepancy could be at least partially explained by differences in dose rate (∼10 -8 dpa/s) compared to the literature data (∼10-6 dpa/s) used to establish the dose-to-swelling correlations in the model. Nevertheless, the modeled bowing magnitudes (<2 mm) obtained from finite element analyses and simple analytical equations were within the bounds of the experimental measurements for all specimens. With improved confidence in the ability to predict the structural response and measure the macroscopic deformations, future experiments will target transient bowing under neutron flux gradients at representative LWR temperatures and assess whether grid spacers can mitigate the tens of millimeters of bowing that would otherwise be expected in ∼4 m long LWR components.

bowing↗
DOE OSTI2019

A FREQUENCY RESPONSE APPROACH TO MODEL VALIDATION FOR THE COMPACT INTEGRAL EFFECTS TEST FACILITY IN TRANSFORM

One of the key challenges to licensing new reactor designs is validating the integral transient response models of a novel system. This work used a frequency response approach for model validation of the Compact Integral Effects Test (CIET) facility at the University of California, Berkeley. This facility was built as a scaled integral effects test for verifying transient modeling tools for fluoride-salt-cooled hightemperature reactors using Dowtherm A as a simulant fluid for molten salt. The dynamic system model of CIET was created using the Modelica-based TRANSFORM tool developed by Oak Ridge National Laboratory (ORNL). Analysis of the model’s performance as compared with experimental results indicates good agreement under both steady-state and transient conditions. This paper describes the Modelica model creation process using TRANSFORM and the modeling assumptions and methods for matching dynamic behavior with frequency response data. Results, analysis, and a discussion of future work are also presented.

De wet, Dane↗
DOE OSTI2024

Inverter Model Validation and Calibration Using Phasor Measurement Unit Data

As the penetration of inverter-based renewable energy resources increases in the power grid, especially at the distribution and microgrid levels, the need to accurately represent them in planning studies increases as well. However, due to the lack of well-established standard procedures, and vendor reluctance towards the detailed sharing of proprietary models, automated dynamic model validation and parameter calibration tools for inverter based resources (IBRs) remain scarce. This work presents a model validation and parameter calibration platform for representing IBRs with generic phasor-domain models. Phasor measurements of power system events are used for continuous validation using the data playback method, and model parameters are re-calibrated if a significant mismatch between measurements and model response is observed. Unique features of the proposed platform include- (a) an iterative Bayesian optimization approach towards parameter calibration to address a possible mismatch between the structures of generic models implemented in simulation softwares and actual commercial inverters, (b) error metrics designed to account for a possible mismatch between the time resolution of simulation and measurements, and (c) analysis of the measurement-simulation mismatch to provide guidance to engineering personnel regarding model shortcomings. The performance of the platform has been illustrated using both simulated data and field measurements to validate/calibrate inverter models in GridLAB-D.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. Finally, the methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

HYBRID Modeling Validation and Verification Status Matrix

The HYBRID modeling repository is a premier resource for integrated energy systems modeling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Due to the increased size of the repository, a concise summary matrix of available models is desired. This matrix will consolidate not only the list of available models but also indicate original information sources, publications that have model examples, and level of validation and verification that exists for the models. Validation and verification (V&V) levels begin from simplified algebraic relationship and advance to dynamic data validation. Moving forward, as new models are contributed to HYBRID, their V&V level will be included, updating this matrix.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

Blind Modeling Validation Exercises Using the Horizontal Dry Cask Simulator

The U.S. Department of Energy (DOE) established a need to understand the thermal-hydraulic properties of dry storage systems for commercial spent nuclear fuel (SNF) in response to a shift towards the storage of high-burnup (HBU) fuel (> 45 gigawatt days per metric ton of uranium, or GWd/MTU). This shift raises concerns regarding cladding integrity, which faces increased risk at the higher temperatures within spent fuel assemblies present within HBU fuel compared to low-burnup fuel (≤ 45 GWd/MTU). A dry cask simulator (DCS) was built at Sandia National Laboratories (SNL) in Albuquerque, New Mexico to produce validation-quality data that can be used to test the accuracy of the modeling used to predict cladding temperatures. These temperatures are critical to evaluating cladding integrity throughout the storage cycle of commercial spent nuclear fuel. A model validation exercise was previously carried out for the DCS in a vertical configuration. Lessons learned during the previous validation exercise have been applied to a new, blind study using a horizontal dry cask simulator (HDCS). Three modeling institutions – the Nuclear Regulatory Commission (NRC), Pacific Northwest National Laboratory (PNNL), and Empresa Nacional del Uranio, S.A., S.M.E. (ENUSA) – were granted access to the input parameters from the DCS Handbook, SAND2017-13058R, and results from a limited data set from the horizontal BWR dry cask simulator tests reported in the HDCS update report, SAND2019-11688R. With this information, each institution was tasked to calculate peak cladding temperatures and air mass flow rates for ten HDCS test cases. Axial as well as vertical and horizontal transverse temperature profiles were also calculated. These calculations were done using modeling codes (ANSYS/Fluent, STAR-CCM+, or COBRA-SFS), each with their own unique combination of modeling assumptions and boundary conditions. For this validation study, the ten test cases of the horizontal dry cask simulator were defined by three independent variables – fuel assembly decay heat (0.5 kW, 1 kW, 2.5 W, and 5 kW), internal backfill pressure (100 kPa and 800 kPa), and backfill gas (helium and air). The plots provided in Chapter 3 of this report show the axial, vertical, and horizontal temperature profiles obtained from the dry cask simulator experiments in the horizontal configuration and the corresponding models used to describe the thermal-hydraulic behavior of this system. The tables provided in Chapter 3 illustrate the closeness of fit of the model data to the experiment data through root mean square (RMS) calculations of the error in peak cladding temperatures (PCTs), PCT axial locations, axial temperature profiles, vertical and horizontal temperature profiles at two different axial locations, and air mass flow rates for the ten test cases, normalized by the experimental results. The model results are assigned arbitrary model numbers to retain anonymity. Due to the relatively flat axial temperature profiles, small temperature gradients resulted in large deviations of all models’ PCT axial location from the experimental PCT axial location. When the PCT axial location error is excluded in the calculation of the combined RMS of the normalized errors that considers PCT, the temperature profiles, and the air mass flow rates, the model data fits the experimental data to within 5%. When the vault information is excluded, the model data fits the experimental data to within 2.5%. An error analysis was developed further for one model, using the model and experimental uncertainties in each validation parameter to calculate validation uncertainties. The uncertainties for each parameter were used to define quantifiable validation criteria. For this analysis, the model was considered validated for a given comparison metric if the normalized error in that metric divided by the validation uncertainty was less than or equal to 1. When considering the combined RMS of the normalized errors of all metrics divided by their validation uncertainties, the model was found to have satisfied the criterion for model validation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Model validation and selection in metabolic flux analysis and flux balance analysis

13C-Metabolic Flux Analysis (13C-MFA) and Flux Balance Analysis (FBA) are widely used to investigate the operation of biochemical networks in both biological and biotechnological research. Both methods use metabolic reaction network models of metabolism operating at steady state so that reaction rates (fluxes) and the levels of metabolic intermediates are constrained to be invariant. They provide estimated (MFA) or predicted (FBA) values of the fluxes through the network in vivo, which cannot be measured directly. These fluxes can shed light on basic biology and have been successfully used to inform metabolic engineering strategies. Several approaches have been taken to test the reliability of estimates and predictions from constraint-based methods and to compare alternative model architectures. Despite advances in other areas of the statistical evaluation of metabolic models, such as the quantification of flux estimate uncertainty, validation and model selection methods have been underappreciated and underexplored. We review the history and state-of-the-art in constraint-based metabolic model validation and model selection. Applications and limitations of the χ 2 -test of goodness-of-fit, the most widely used quantitative validation and selection approach in 13C-MFA, are discussed, and complementary and alternative forms of validation and selection are proposed. A combined model validation and selection framework for 13C-MFA incorporating metabolite pool size information that leverages new developments in the field is presented and advocated for. Finally, we discuss how adopting robust validation and selection procedures can enhance confidence in constraint-based modeling as a whole and ultimately facilitate more widespread use of FBA in biotechnology.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

Representing Small Commercial Building Faults in EnergyPlus, Part II: Model Validation

Automated fault detection and diagnosis (AFDD) tools based on machine-learning algorithms hold promise for lowering cost barriers for AFDD in small commercial buildings; however, access to high-quality training data for such algorithms is often difficult to obtain. To fill the gap in this research area, this study covers the development (Part I) and validation (Part II) of fault models that can be used with the building energy modeling software EnergyPlus® and OpenStudio® to generate a cost-effective training data set for developing AFDD algorithms. Part II (this paper) first presents a methodology of validating fault models with OpenStudio and then presents validation results, which are compared against measurements from a reference building. We discuss the results of our experiments with eight different faults in the reference building (a total of 39 different baseline and faulted scenarios), including our methodology for using fault models along with the reference building model to simulate the same faulted scenarios. Then, we present validation of the fault models by comparing results of simulations and experiments either quantitatively or qualitatively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Medium-Scale Methanol Pool Fire Model Validation

In this work, medium scale (30 cm diameter) methanol pool fires were simulated using the latest fire modeling suite implemented in Sierra/Fuego, a low Mach number multiphysics reacting flow code. The sensitivity of model outputs to various model parameters was studied with the objective of providing model validation. This work also assesses model performance relative to other recently published large eddy simulations (LES) of the same validation case. Two pool surface boundary conditions were simulated. The first was a prescribed fuel mass flux and the second used an algorithm to predict mass flux based on a mass and energy balance at the fuel surface. Gray gas radiation model parameters (absorption coefficients and gas radiation sources) were varied to assess radiant heat losses to the surroundings and pool surface. The radiation model was calibrated by comparing the simulated radiant fraction of the plume to experimental data. The effects of mesh resolution were also quantified starting with a grid resolution representative of engineering type fire calculations and then uniformly refining that mesh in the plume region. Simulation data were compared to experimental data collected at the University of Waterloo and the National Institute of Standards and Technology (NIST). Validation data included plume temperature, radial and axial velocities, velocity temperature turbulent correlations, velocity velocity turbulent correlations, radiant and convective heat fluxes to the pool surface, and plume radiant fraction. Additional analyses were performed in the pool boundary layer to assess simulated flame anchoring and the effect on convective heat fluxes. This work assesses the capability of the latest Fuego physics and chemistry model suite and provides additional insight into pool fire modeling for nonluminous, non-sooting flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗