Search NASA⌕ Search

SEARCH · Search NASA

Results for “MODEL VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Blind Modeling Validation Exercises Using the Horizontal Dry Cask Simulator

The U.S. Department of Energy (DOE) established a need to understand the thermal-hydraulic properties of dry storage systems for commercial spent nuclear fuel (SNF) in response to a shift towards the storage of high-burnup (HBU) fuel (> 45 gigawatt days per metric ton of uranium, or GWd/MTU). This shift raises concerns regarding cladding integrity, which faces increased risk at the higher temperatures within spent fuel assemblies present within HBU fuel compared to low-burnup fuel (≤ 45 GWd/MTU). A dry cask simulator (DCS) was built at Sandia National Laboratories (SNL) in Albuquerque, New Mexico to produce validation-quality data that can be used to test the accuracy of the modeling used to predict cladding temperatures. These temperatures are critical to evaluating cladding integrity throughout the storage cycle of commercial spent nuclear fuel. A model validation exercise was previously carried out for the DCS in a vertical configuration. Lessons learned during the previous validation exercise have been applied to a new, blind study using a horizontal dry cask simulator (HDCS). Three modeling institutions – the Nuclear Regulatory Commission (NRC), Pacific Northwest National Laboratory (PNNL), and Empresa Nacional del Uranio, S.A., S.M.E. (ENUSA) – were granted access to the input parameters from the DCS Handbook, SAND2017-13058R, and results from a limited data set from the horizontal BWR dry cask simulator tests reported in the HDCS update report, SAND2019-11688R. With this information, each institution was tasked to calculate peak cladding temperatures and air mass flow rates for ten HDCS test cases. Axial as well as vertical and horizontal transverse temperature profiles were also calculated. These calculations were done using modeling codes (ANSYS/Fluent, STAR-CCM+, or COBRA-SFS), each with their own unique combination of modeling assumptions and boundary conditions. For this validation study, the ten test cases of the horizontal dry cask simulator were defined by three independent variables – fuel assembly decay heat (0.5 kW, 1 kW, 2.5 W, and 5 kW), internal backfill pressure (100 kPa and 800 kPa), and backfill gas (helium and air). The plots provided in Chapter 3 of this report show the axial, vertical, and horizontal temperature profiles obtained from the dry cask simulator experiments in the horizontal configuration and the corresponding models used to describe the thermal-hydraulic behavior of this system. The tables provided in Chapter 3 illustrate the closeness of fit of the model data to the experiment data through root mean square (RMS) calculations of the error in peak cladding temperatures (PCTs), PCT axial locations, axial temperature profiles, vertical and horizontal temperature profiles at two different axial locations, and air mass flow rates for the ten test cases, normalized by the experimental results. The model results are assigned arbitrary model numbers to retain anonymity. Due to the relatively flat axial temperature profiles, small temperature gradients resulted in large deviations of all models’ PCT axial location from the experimental PCT axial location. When the PCT axial location error is excluded in the calculation of the combined RMS of the normalized errors that considers PCT, the temperature profiles, and the air mass flow rates, the model data fits the experimental data to within 5%. When the vault information is excluded, the model data fits the experimental data to within 2.5%. An error analysis was developed further for one model, using the model and experimental uncertainties in each validation parameter to calculate validation uncertainties. The uncertainties for each parameter were used to define quantifiable validation criteria. For this analysis, the model was considered validated for a given comparison metric if the normalized error in that metric divided by the validation uncertainty was less than or equal to 1. When considering the combined RMS of the normalized errors of all metrics divided by their validation uncertainties, the model was found to have satisfied the criterion for model validation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Techniques and Issues in Agent-Based Modeling Validation

Validation of simulation models is extremely important. It ensures that the right model has been built and lends confidence to the use of that model to inform critical decisions. Agent-based models (ABM) have been widely deployed in different fields for studying the collective behavior of large numbers of interacting agents. However, researchers have only recently started to consider the issues of validation. Compared to other simulation models, ABM has many differences in model development, usage and validation. An ABM is inherently easier to build than a classical simulation, but more difficult to describe formally since they are closer to human cognition. Using multi-agent models to study complex systems has attracted criticisms because of the challenges involved in their validation [1]. In this report, we describe the challenge of ABM validation and present a novel approach we recently developed for an ABM system.

99 GENERAL AND MISCELLANEOUS↗

Low frequency eddy current finite element model validation and benchmark studies

A finite element method (FEM) model was created to calculate the change in impedance of a coil due to the presence of a notch in a plate. The rectangular notches were created via electrical discharge machining (EDM) in a thick aluminum plate and were positioned at normal and oblique angles (10, 20, and 30 degrees) with respect to the vertical axis of the coil. The FEM method was chosen for this model due to its ability to solve problems in complicated geometries with the use of irregular mesh elements to discretize the solution domain. The change in impedance was calculated from the field variables in the simulation for each probe position along the parallel axis of the plate. The error between the model and the experimental data was approximately 5% for the majority of cases. The validated model was used to investigate more complex problems.

42 ENGINEERING↗

Model validation and selection in metabolic flux analysis and flux balance analysis

13C-Metabolic Flux Analysis (13C-MFA) and Flux Balance Analysis (FBA) are widely used to investigate the operation of biochemical networks in both biological and biotechnological research. Both methods use metabolic reaction network models of metabolism operating at steady state so that reaction rates (fluxes) and the levels of metabolic intermediates are constrained to be invariant. They provide estimated (MFA) or predicted (FBA) values of the fluxes through the network in vivo, which cannot be measured directly. These fluxes can shed light on basic biology and have been successfully used to inform metabolic engineering strategies. Several approaches have been taken to test the reliability of estimates and predictions from constraint-based methods and to compare alternative model architectures. Despite advances in other areas of the statistical evaluation of metabolic models, such as the quantification of flux estimate uncertainty, validation and model selection methods have been underappreciated and underexplored. We review the history and state-of-the-art in constraint-based metabolic model validation and model selection. Applications and limitations of the χ 2 -test of goodness-of-fit, the most widely used quantitative validation and selection approach in 13C-MFA, are discussed, and complementary and alternative forms of validation and selection are proposed. A combined model validation and selection framework for 13C-MFA incorporating metabolite pool size information that leverages new developments in the field is presented and advocated for. Finally, we discuss how adopting robust validation and selection procedures can enhance confidence in constraint-based modeling as a whole and ultimately facilitate more widespread use of FBA in biotechnology.

59 BASIC BIOLOGICAL SCIENCES↗

Low frequency eddy current benchmark study for model validation

This paper presents results of an eddy current model validation study. Precise measurements were made using an impedance analyzer to investigate changes in impedance due to Electrical Discharge Machining (EDM) notches in aluminum plates. Each plate contained one EDM notch at an angle of 0, 10, 20, or 30 degrees from the normal of the plate surface. Measurements were made with the eddy current probe both scanning parallel and perpendicular to the notch length. The experimental response from the vertical and oblique notches will be reported and compared to results from different numerical simulation codes.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Representing Small Commercial Building Faults in EnergyPlus, Part II: Model Validation

Automated fault detection and diagnosis (AFDD) tools based on machine-learning algorithms hold promise for lowering cost barriers for AFDD in small commercial buildings; however, access to high-quality training data for such algorithms is often difficult to obtain. To fill the gap in this research area, this study covers the development (Part I) and validation (Part II) of fault models that can be used with the building energy modeling software EnergyPlus® and OpenStudio® to generate a cost-effective training data set for developing AFDD algorithms. Part II (this paper) first presents a methodology of validating fault models with OpenStudio and then presents validation results, which are compared against measurements from a reference building. We discuss the results of our experiments with eight different faults in the reference building (a total of 39 different baseline and faulted scenarios), including our methodology for using fault models along with the reference building model to simulate the same faulted scenarios. Then, we present validation of the fault models by comparing results of simulations and experiments either quantitatively or qualitatively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Medium-Scale Methanol Pool Fire Model Validation

In this work, medium scale (30 cm diameter) methanol pool fires were simulated using the latest fire modeling suite implemented in Sierra/Fuego, a low Mach number multiphysics reacting flow code. The sensitivity of model outputs to various model parameters was studied with the objective of providing model validation. This work also assesses model performance relative to other recently published large eddy simulations (LES) of the same validation case. Two pool surface boundary conditions were simulated. The first was a prescribed fuel mass flux and the second used an algorithm to predict mass flux based on a mass and energy balance at the fuel surface. Gray gas radiation model parameters (absorption coefficients and gas radiation sources) were varied to assess radiant heat losses to the surroundings and pool surface. The radiation model was calibrated by comparing the simulated radiant fraction of the plume to experimental data. The effects of mesh resolution were also quantified starting with a grid resolution representative of engineering type fire calculations and then uniformly refining that mesh in the plume region. Simulation data were compared to experimental data collected at the University of Waterloo and the National Institute of Standards and Technology (NIST). Validation data included plume temperature, radial and axial velocities, velocity temperature turbulent correlations, velocity velocity turbulent correlations, radiant and convective heat fluxes to the pool surface, and plume radiant fraction. Additional analyses were performed in the pool boundary layer to assess simulated flame anchoring and the effect on convective heat fluxes. This work assesses the capability of the latest Fuego physics and chemistry model suite and provides additional insight into pool fire modeling for nonluminous, non-sooting flames.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Highly Accurate Experimental Heave Decay Tests with a Floating Sphere: A Public Benchmark Dataset for Model Validation of Fluid–Structure Interaction

Highly accurate and precise heave decay tests on a sphere with a diameter of 300 mm were completed in a meticulously designed test setup in the wave basin in the Ocean and Coastal Engineering Laboratory at Aalborg University, Denmark. The tests were dedicated to providing a rigorous benchmark dataset for numerical model validation. The sphere was ballasted to half submergence, thereby floating with the waterline at the equator when at rest in calm water. Heave decay tests were conducted, wherein the sphere was held stationary and dropped from three drop heights: a small drop height, which can be considered a linear case, a moderately nonlinear case, and a highly nonlinear case with a drop height from a position where the whole sphere was initially above the water. The precision of the heave decay time series was calculated from random and systematic standard uncertainties. At a 95% confidence level, uncertainties were found to be very low—on average only about 0.3% of the respective drop heights. Physical parameters of the test setup and associated uncertainties were quantified. A test case was formulated that closely represents the physical tests, enabling the reader to do his/her own numerical tests. The paper includes a comparison of the physical test results to the results from several independent numerical models based on linear potential flow, fully nonlinear potential flow, and the Reynolds-averaged Navier–Stokes (RANS) equations. A high correlation between physical and numerical test results is shown. The physical test results are very suitable for numerical model validation and are public as a benchmark dataset.

42 ENGINEERING↗

A Framework for Model Validation and Calibration of Microgrid Components Using PMU Data

This paper presents a framework for phasor measurement-based component model validation and calibration islanded microgrids, with emphasis on grid-forming inverters. Real measurements from the Plum Island microgrid facility are used to calibrate the model of a commercial inverter in the open-source phasor-based distribution system simulator GridLAB-D.Limitations of current distribution system simulators in replicating the behavior of commercial inverters are also identified.

microgrid, Synchrophasor data, model validation↗

Multi-component testing using HZ-PAN and AgZ-PAN Sorbents for OSPREY Model validation

In efforts to further develop the capability of the Off-gas SeParation and RecoverY (OSPREY) model, multi-component tests were completed using both HZ-PAN and AgZ-PAN sorbents. The primary purpose of this effort was to obtain multi-component xenon and krypton capacities for comparison to future OSPREY predicted multi-component capacities using previously acquired Langmuir equilibrium parameters determined from single component isotherms. Experimental capacities were determined for each sorbent using two feed gas compositions of 1000 ppmv xenon and 150 ppmv krypton in either a helium or air balance. Test temperatures were consistently held at 220 K and the gas flowrate was 50 sccm. Capacities were calculated from breakthrough curves using TableCurve® 2D software by Jandel Scientific. The HZ-PAN sorbent was tested in the custom designed cryostat while the AgZ-PAN was tested in a newly installed cooling apparatus. Previous modeling validation efforts indicated the OSPREY model can be used to effectively predict single component xenon and krypton capacities for both engineered form sorbents. Results indicated good agreement with the experimental and predicted capacity values for both krypton and xenon on the sorbents. Overall, the model predicted slightly elevated capacities for both gases which can be partially attributed to the estimation of the parameters and the uncertainty associated with the experimental measurements. Currently, OSPREY is configured such that one species adsorbs and one does not (i.e. krypton in helium). Modification of OSPREY code is currently being performed to incorporate multiple adsorbing species and non-ideal interactions of gas phase species with the sorbent and adsorbed phases. Once these modifications are complete, the sorbent capacities determined in the present work will be used to validate OSPREY multicomponent adsorption predictions.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Modeling, Validation, and Control of the IEA‐15 MW Reference Wind Turbine and VolturnUS‐S Platform

This paper presents the acausal modeling, validation, and control of floating offshore wind turbines (FOWTs). The model simulates the IEA‐15 MW reference turbine and the semi‐submersible VolturnUS‐S platform utilizing a Control‐oriented, Reconfigurable, and Acausal Floating Turbine Simulator (CRAFTS), which integrates the key coupled aero‐hydro‐elasto‐servo dynamics and is being developed by authors at the University of Central Florida. Verification and validation are conducted using numerical data from the industry‐standard simulation platform OpenFAST and experimental data from the Floating Offshore‐wind and Controls Advanced Laboratory (FOCAL) project, in which the authors were involved. Numerical results demonstrate the model's ability to qualitatively capture loads and responses across various load cases, highlighting the impact of the control system under different wind and wave conditions and opening new opportunities for optimizing FOWT designs. This paper provides wind turbine researchers with valuable insights into system characteristics, system frequencies, damping effects, and internal reaction forces, serving as a reference for future studies in FOWT modeling and control.

17 WIND ENERGY↗

Recent DIII-D advances in runaway electron measurement and model validation

Novel measurements and modeling of runaway electron (RE) dynamics in DIII-D have resolved experimental discrepancies and validated predictions for ITER, improving confidence that RE avoidance and mitigation can be predictably achieved. Considering RE formation, first experimental assessments of the RE seed current demonstrates that present hot-tail theories are not yet accurate and require improved treatment of the pellet dynamics. Novel measurements of kinetic instabilities in the MHz-range have been made in the RE formation phase, with the intensity of these modes correlated with previously unexplained empirical thresholds for RE generation. Controlled RE dissipation experiments in quiescent regimes have validated RE distribution function dependencies on collisional and synchrotron damping, both in terms of distribution function shape and dissipation rates. Measurements of RE bremsstrahlung and synchrotron emission are now used in tandem to resolve energy and pitch-angle effects. A resolution to long-standing dissipation anomalies in the quiescent regime is offered by taking into account kinetic instability effects on RE phase-space dynamics. Kinetic instabilities in the 100–200 MHz range are directly observed, though modeling finds the largest dissipation arises from GHz range instabilities that are beyond the reach of existing diagnostics. Kinetic instabilities are also observed in the mature post-disruption RE plateau phase, so long as the collisional damping rate is reduced with low-Z injection. Experiments with high-Z injection find that the dissipation rate saturates with injection quantity, likely due to neutral diffusion rates being slower than vertical instability rates in DIII-D. Considering the final loss, a 0D model for first-wall Joule heating is found to be in agreement with experiment, and controlled access to RE equilibria with edge safety factor of two identifies novel dynamics brought about by large-scale kink instabilities. These dynamics are typified by fast (tens of microseconds) RE loss rates without RE beam regeneration. The above measurements and comparison with theory represent significant advances in the understanding of RE dynamics and indicate possible new opportunities for RE avoidance or mitigation via kinetic instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Dynamic Model Validation with Governor Deadband on the Eastern Interconnection

This report documents the efforts to perform dynamic model validation on the Eastern Interconnection (EI) by modeling governor deadband. An on-peak EI dynamic model is modified to represent governor deadband characteristics. Simulation results are compared with synchrophasor measurements collected by the Frequency Monitoring Network (FNET/GridEye). The comparison shows that by modeling governor deadband the simulated frequency response can closely align with the actual system response.

dynamic↗

Crystal Plasticity Model Validation Using Combined High-Energy Diffraction Microscopy Data for a Ti-7Al Specimen

High-Energy Diffraction Microscopy (HEDM) is a 3-d x-ray characterization method that is uniquely suited to measuring the evolving micromechanical state and microstructure of polycrystalline materials during in situ processing. The near-field and far-field configurations provide complementary information; orientation maps computed from the near-field measurements provide grain morphologies, while the high angular resolution of the far-field measurements provide intergranular strain tensors. The ability to measure these data during deformation in situ makes HEDM an ideal tool for validating micro-mechanical deformation models that make their predictions at the scale of individual grains. Crystal Plasticity Finite Element Models (CPFEM) are one such class of micro-mechanical models. While there have been extensive studies validating homogenized CPFEM response at a macroscopic level, a lack of detailed data measured at the level of the microstructure has hindered more stringent model validation efforts. Here, we utilize an HEDM dataset from an alphatitanium alloy (Ti-7Al), collected at the Advanced Photon Source, Argonne National Laboratory, under in situ tensile deformation. The initial microstructure of the central slab of the gage section, measured via near-field HEDM, is used to inform a CPFEM model. The predicted intergranular stresses for 39 internal grains are then directly compared to data from 4 far-field measurements taken between ~4% and ~80% of the macroscopic yield strength. In conclusion, the intergranular stresses from the CPFEM model and far-field HEDM measurements up to incipient yield are shown to be in good agreement, and implications for application of such an integrated computational/experimental approach to phenomena such as fatigue and crack propagation is discussed.

36 MATERIALS SCIENCE↗

System Advisor Model: Flat Plate Photovoltaic Performance Modeling Validation Report

The System Advisor Model (SAM) is a free software tool that performs detailed analysis of both system performance and system financing for a variety of renewable energy technologies. This report provides detailed validation of the SAM flat plate photovoltaic performance model by comparing SAM-modeled PV system generation data to actual measured production data for nine PV systems ranging from 75 kW to greater than 25 MW in size. The results show strong agreement between SAM predictions and field data, with annualized prediction error below 3% for all fixed tilt cases and below 8% for all one axis tracked cases. The analysis concludes that snow cover and system outages are the primary sources of disagreement, and other deviations resulting from seasonal biases in the irradiation models and one axis tracking issues are discussed in detail.

14 SOLAR ENERGY↗

Customized open source renewable energy models validated through PHIL lab experiments

Energy models for power systems require ongoing updates to reflect advancements in equipment technology and the increasing complexity of power electronic devices. This study utilizes a Power Hardware-in-the-Loop (PHIL) experimental setup to validate custom photovoltaic (PV) inverter models, aiming to enhance and expedite the development of advanced renewable energy models. The research compares the performance of a physical inverter with generic Renewable Energy Source (RES) models recommended by the Western Electricity Coordinating Council (WECC). As inverter-based renewable energy sources become more prevalent in modern electrical grids, it is crucial that dynamic models accurately represent their real-world behavior. Accurate models improve our understanding of these energy resources and their interactions with the grid. The proposed model enhancements are designed to better reflect real inverter performance, based on insights from PHIL experiments. These models are developed using the open source Modelica language and the OpenIPSL Modelica Library, allowing integration across various simulation tools without re-implementation. The paper concludes with a thorough assessment, comparing the enhanced models with PHIL experiments on a real PV inverter in a controlled laboratory setting. As a result, the study provides the enhanced WECC RES models and validation data as open source resources, facilitating further research and development.

Modelica↗