Search NASA⌕ Search

SEARCH · Search NASA

Results for “model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Coarse Woody Debris Decomposition Assessment Tool: Model validation and application

Coarse woody debris (CWD) is a significant component of the forest biomass pool; hence a model is warranted to predict CWD decomposition and its role in forest carbon (C) and nutrient cycling under varying management and climatic conditions. A process-based model, CWDDAT (Coarse Woody Debris Decomposition Assessment Tool) was calibrated and validated using data from the FACE (Free Air Carbon Dioxide Enrichment) Wood Decomposition Experiment utilizing pine ( Pinus taeda ), aspen ( Populous tremuloides ) and birch ( Betula papyrifera ) on nine Experimental Forests (EF) covering a range of climate, hydrology, and soil conditions across the continental USA. The model predictions were evaluated against measured FACE log mass loss over 6 years. Four widely applied metrics of model performance demonstrated that the CWDDAT model can accurately predict CWD decomposition. The R 2 (squared Pearson’s correlation coefficient) between the simulation and measurement was 0.80 for the model calibration and 0.82 for the model validation ( P <0.01). The predicted mean mass loss from all logs was 5.4% lower than the measured mass loss and 1.4% lower than the calculated loss. The model was also used to assess the decomposition of mixed pine-hardwood CWD produced by Hurricane Hugo in 1989 on the Santee Experimental Forest in South Carolina, USA. The simulation reflected rapid CWD decomposition of the forest in this subtropical setting. The predicted dissolved organic carbon (DOC) derived from the CWD decomposition and incorporated into the mineral soil averaged 1.01 g C m -2 y -1 over the 30 years. The main agents for CWD mass loss were fungi (72.0%) and termites (24.5%), the remainder was attributed to a mix of other wood decomposers. These findings demonstrate the applicability of CWDDAT for large-scale assessments of CWD dynamics, and fine-scale considerations regarding the fate of CWD carbon.

54 ENVIRONMENTAL SCIENCES↗

TEAMER - AquaHarmonics High Fidelity WEC Sim PTO and Control Model Validation, Test Logs and Results

Collaborative effort between AquaHarmonics, Sandia National Laboratories (SNL), and the National Renewable Energy Laboratory (NREL) to revise and validate Aquaharmonics' full wave to wire model, allowing for reduced uncertainty and increased understanding of design requirements of a utility scale wave energy converter (WEC). SNL and NREL in collaboration with AquaHarmonics, will set up and run WEC Simulator (WEC-Sim) models of the AquaHarmonics WEC, building off past model developments for inclusion of custom PTO (power take-off) dynamics. The intent is to review, update, and verify or validate a new WEC-Sim model against wave tank experimental data. Furthermore, the WEC-Sim model will be coupled to an energy storage system model to better understand the wave-to-wire functionality. This data set is described in the "Test Log" excel file. Please refer to that document for details on each specific test date/time, constraint parameters and model hardware setup details. Sim model can be found in the associated MHKDR link below.

16 TIDAL AND WAVE POWER↗

A Numerical Study of Hypoxia in Chesapeake Bay Using an Unstructured Grid Model: Validation and Sensitivity to Bathymetry Representation

A three-dimensional unstructured-grid hydrodynamic and water quality model (Semi-implicit Cross-scale Hydroscience Intergrated System Model-Integrated Compartment Model) is applied successfully for Chesapeake Bay. The model is validated with observations of salinity, chlorophyll-a, dissolved oxygen, nutrients, and phytoplankton productions from the year 1991 to 1995 for the mainstem and some major tributaries, based on multiple model skill scores. Model experiments are conducted to test the importance of having (1) an accurate representation of bathymetry to correctly predict hypoxia and other processes and (2) a high-resolution model grid for tributaries to correctly simulate water quality variables. Further, comparison with the model experiment results with bathymetry smoothing indicates that bathymetry smoothing, as commonly used for many systems, changes the stratification and lateral circulation pattern, resulting in more salt intrusion into shallow water regions, and an increase in the freshwater age. Consequently, a model with bathymetry smoothing can lead to an unrealistic prediction of the distribution of hypoxia and phytoplankton production. Local grid refinement shows significant improvement of model simulations on local stratification and water quality variables. Overall, the use of high-resolution unstructured grid model leads to a faithful representation of the complex geometry, and thus a seamless cross-scale capability for simulating water quality processes in the Bay including tributaries and tidal creeks.

54 ENVIRONMENTAL SCIENCES↗

Selection and Ranking of Experiments from the Halden Database in support of Multiscale Model Validation

Validating fuel performance codes, such as BISON, requires an extensive amount of experiments covering a wide range of operating conditions and fuel types. Within the light-water reactor (LWR) space, there have been several international experimental programs that have contributed to the wealth of available experimental data available for use. One of those international programs, the Halden Reactor Project (HRP), began in 1958 and utilized the Halden Boiling Water Reactor to conduct many highly instrumented experiments until the reactor closed in 2018. Idaho National Laboratory, through the U.S. Department of Energy, has utilized several Halden experiments to perform the initial validation of the BISON code based upon their inclusion in international modeling and simulation benchmarks. Recently, the HRP has provided member organizations a complete copy of all available data, reports, and presentations since the HRP began. This report provides an initial exploration of the data available in the database for use in validating the multiscale models under development in the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program for LWR applications. Ranking tables that identify potential validation cases are provided for the high priority models of interest. It was found that some of the recommended high priority experiments correspond to additional rods in existing assemblies already available in the BISON validation suite. It is expected that several of these cases will be incorporated into future NEAMS milestones in the fuels technical area for increased validation of BISON.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

The executive disruption model of tinnitus distress: Model validation in two independent datasets using factor score regression

This study presents the executive disruption model (EDM) of tinnitus distress and subsequently validates it statistically using two independent datasets (the Construction Dataset: n = 96 and the Validation Dataset: n = 200). The conceptual EDM was first operationalised as a structural causal model (construction phase). Then multiple regression was used to examine the effect of executive functioning on tinnitus-related distress (validation phase), adjusting for the additional contributions of hearing threshold and psychological distress. For both datasets, executive functioning negatively predicted tinnitus distress score by a similar amount (the Construction Dataset: β = −3.50, p = 0.13 and the Validation Dataset: β = −3.71, p = 0.02). Theoretical implications and applications of the EDM are subsequently discussed; these include the predictive nature of executive functioning in the development of distressing tinnitus, and the clinical utility of the EDM.

Clarke, Nathan A.↗

Model Validation and Demonstration of a Hydrogen Fuel Cell Parcel Delivery Truck

With an emphasis on reducing fossil fuel consumption and emissions, major delivery service corporations have begun deploying and operating Class 6 battery electric delivery vans. Fuel cell hybrid delivery vans offer a zero emissions solution with extended range and route planning flexibility. This paper follows a prior publication [1] on the vehicle modeling and design and presents demonstration data and a validation of the prior modeling and design effort. Here, the validation exercise shows that the modeling tools predict performance and energy efficiency within 5% for most of the routes, while the demonstration data shows that in service operation fuel economy was over 14 km/kg of hydrogen gas. In addition, results from a range test showed the vehicle design and onboard hydrogen storage was able to surpass the design target range of 200 km.

08 HYDROGEN↗

X-ray Inspection Model Validation with Physical Dosimetry

A non-functional printed circuit board assembly was developed using ULTIboard and a simple computational transport model was created for use with the Monte Carlo software MCNP. EBT 3 film radiography was used to compare with Monte Carlo simulation to validate the board representation. The computational transport model was then revised to include connection pins, solder balls, highly attenuating internal structures, and copper trace distribution. Results from the revised model were compared to the EBT 3 films to observe improvements to dose profiles. It was found that this method was useful in verifying the placement of components, as the dose profiles were observed to follow the same trends. The experiment was then repeated using XRQA 2 films to achieve the same level of contrast with 1% the dose of EBT 3 films. It was found that high contrast may be achieved using these films to identify major issues with the model geometry, at a cost of dose profile accuracy. A second validation method was applied to the model using 37 CaF 2 thermoluminescent dosimeters (TLDs). TLD measurements were compared with the simplified and complex transport models to identify the features that have the greatest impact on simulation accuracy. The TLD calibration to CaF 2 was found to be accurate within 5.6%, while calibration to dose in Si was found to be accurate within 4.7%. Finally, it was observed that the accurate representation of solder balls and proper modeling of highly attenuating internal structures had the greatest impact on simulation accuracy.

61 RADIATION PROTECTION AND DOSIMETRY↗

Model Validation and Uncertainty Quantification on the KRUSTY Microreactor Design Using GRIFFIN Neutron Transport Code [Poster]

Argonne National Laboratory (ANL) and INL have developed a GRIFFIN steady state neutronics model for the multiphysics simulations of the Kilopower Reactor Using Sterling TechnologY (KRUSTY) microreactor in the Multiphysics Object Oriented Simulation Environment (MOOSE). The reliability of such deterministic neutronics models can be validated by comparing with computations from Monte Carlo codes (e.g. MCNP, SERPENT, OpenMC, Shift, etc). Furthermore, potential modeling/design improvements can be identified by incorporating uncertainty quantification (UQ), which can be performed by MOOSE’s Stochastic Tools Module (STM). KRUSTY is a prototype for a 5-kW thermal nuclear-powered space reactor. Its primary components consist of nuclear fuel, heat pipes, a control rod, a reflector, and the shielding. The fuel consists of 3 stacked U-7.65Mo cylinders with a hole in the center for the control rod. 8 liquid sodium heat pipes transfer fission energy from the solid fuel block to the Sterling power conversion system where the energy is extracted, and the cooled sodium flows back to the core via capillary action . The movable Boron Carbide control rod regulates the neutron population during startup or when a reactor temperature boost is needed . The beryllium oxide reflector is in 3 places in the reactor; it surrounds the core axially, it lies beneath the core on a platen, and it is present in the shim. The axial and lower reflectors rest on an adjustable stainless-steel platen that moves upward to cover the fuel and help the reactor reach criticality. Lastly, radial stainless steel surrounds the core offering protection from radiation exposure .

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

RM3 Wave Tank Validation Model

An approximately 1/75th scale point absorber wave energy absorber was built to validate the testing systems of a 16k gallon single paddle wave tank. The model was build based on the RM3 design and incorporated a linear position sensor, a force transducer, and wetness detection sensors. The data set also includes motion tracking data of the device's two bodies acquired from 4x Qualisys cameras. The tank wave spectrum is measured by 4 ultrasonic water height sensors.

16 TIDAL AND WAVE POWER↗

Scenario optimization for the tokamak ramp-down phase in RAPTOR: Part A. Analysis and model validation on ASDEX Upgrade

We discuss how the combination of experimental observations and rapid modeling has enabled to improve understanding of the tokamak ramp-down phase in ASDEX Upgrade. A series of dedicated experiments has been performed, to disentangle the effect of individual actuators like plasma current, auxiliary heating and plasma shaping. Optimized discharge termination strategies with increased margin with respect to radiative and vertical stability limits are proposed and tested in experiment. Radiative collapse of the edge $T$ $e$ profile after the HL back-transition is avoided by initially maintaining auxiliary heating during L-mode, showing beneficial effects even after the auxiliary heating is turned off. The capability of the RAPTOR code to model the time evolution of the internal inductance $\ell$ $i3$ has been validated, including the effect of a change in the $I$ $p$ ramp-down rate and the HL transition timing. The reduction of $\ell$ $i3$ caused by rapid compression of the plasma cross-section has been quantitatively recovered in simulations. Successful modeling of the $\ell$ $i3$ time evolution is essential to optimize ramp-down scenarios for future fusion reactors, for which vertical stability and power balance control will be more challenging.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Pronghorn Porous Media Model Validation with Pressure Drop Measurements

The verification and validation (V&V) of Pronghorn is imperative to assert its accuracy when predicting the fluid velocity, temperature, and pressure in high temperature gas-cooled reactors. Pronghorn is a coarse-mesh, intermediate-fidelity, and multidimensional thermal-hydraulics (TH) code developed by the Idaho National Laboratory (INL). New pebble bed experiments are used to observe the details of the fluid motion and pressure drop in the porous bed under the reactor normal operation. This paper focuses on the validation of the Pronghorn compressible and incompressible Navier-Stokes equations using the pressure drop measurements performed at the engineering-scale pebble bed facility at the Texas A&M university (TAMU). Various pressure drop correlations and porosity functions are implemented in both Pronghorn and STAR-CCM+ to compare the pressure drop due to the combined viscous and inertial resistances in the porous bed. The correlations accounting for the near-wall effect are also utilized to observe if the pressure drop estimates can be improved. Pronghorn porous media models predict the pressure drop well relative to the STAR-CCM+ simulation results and 1D correlations, and both the finite element method (FEM) and finite volume method (FVM) perform accurately. Pronghorn models are also validated with the experimental measurements given the different Reynolds number ranges and specific aspect ratios. The likelihood of the statistical significance between the pressure drop measurements and specific correlations or simulations is low provided that the overlap of their confidence intervals is more than the half of a single arm. Several validation metrics are reasonable in regard to the similar studies from other literature. The precise average pebble bed porosity estimation has much impact on the pressure drop, and the Foumeny and Montillet (dense packing) models carry out the accurate pressure drop prediction by considering the near-wall effect.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Eddy current flow meter model validation with a moving solid rod*

We report that the eddy current flow meter (ECFM) has been used to measure velocities and temperatures of conductive flows, such as liquid metal flows in a nuclear fission reactor. The goal of this paper is to develop a finite element electromagnetic model that can characterize the ECFM sensor performance and validate this finite element model with detailed velocity measurements of a controlled, well-characterized moving conductive solid rod. Both measurements and modeling were performed for various parameters that are important for ECFM performance such as rod velocity, rod material, ECFM sensor coil length, number of sensor coils, applied alternating current (AC) current amplitude, and applied ECFM AC frequency. For all parametric scans, the measurement and modeling agree well in both magnitude and trend. The normalized root-mean-square error between measurement and modeling is less than 10% for all cases. These results suggest that electromagnetic modeling could eventually be used to cost-effectively design future ECFM sensors in arbitrary geometry for more challenging applications such as liquid metal nuclear fission reactors.

47 OTHER INSTRUMENTATION↗

Model Validation for the FY2021 SRS Composite Analysis Monitoring Plan

Using a projected end-state date of 2065 (SRNS 2015b), the Savannah River Site (SRS) Composite Analysis (CA) modeling for each facility and waste site began on the inventory year assigned to it so that source depletion and radionuclide transport out of the system could be appropriately captured. Some SRS waste sites that have already achieved their end states (i.e., end-state inventories and end-state configuration) are currently contributing to the potential off-site public dose through source release, groundwater transport, discharge to on-site surface streams, and stream transport to the CA point of assessments (POAs). The inventory year assigned to these waste sites is 2002 or before. This means that SRS CA results from 2002 and beyond are a reasonable representation for these waste sites that have already achieved their end states and are currently contributing to the potential off-site public dose. The SRS Annual Environmental Report (AER) monitoring can differentiate and separate liquid pathway data allowing the data representing only waste sites at their end state to be produced. Because the SRS CA has projected reasonable end-state impacts from 2002 and beyond, and the AER monitoring can differentiate and separate operating and end-state contributions to annual liquid pathway release, an opportunity exists to use the AER monitoring data to validate the SRS CA model.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A methodology to develop multi-physics dynamic fuel cell system models validated with vehicle realistic drive cycle data

Fuel cell (FC) technology has been identified as a technically attractive solution to decarbonize the transportation sector, especially for heavy-duty vehicles. In this context, the industry and the scientific community are in need of advanced fuel cell systems (FCS) models that are able to replicate real -world operating conditions. Due to the scarcity of said models in the open literature, this study aimed to develop a comprehensive methodology to calibrate and validate multi -physics dynamic FCS models. Therefore, the key contribution of this paper is the detailed description of the calibration process for each component and the calibration order. The specific focus here was to accurately describe the behavior of the FC stack as well as the cathode, anode, and cooling circuits of the balance of plant. The model was calibrated with the aid of experimental data from a Toyota Mirai FC electric vehicle, which was predominantly retrieved from the vehicle's Controller Area Network (CAN) bus system thereby negating the need for major intrusion into the powertrain system. The validation process was deemed successful with the model being able to truthfully replicate the characteristics of the FC vehicle operated on the World-wide harmonized Light duty Test Cycle (WLTC) 3b and US06 driving cycle. The time -resolved physical parameters such as the cathode pressure, mass flow, or the FC stack temperature were captured with high fidelity, while the overall performance parameters such as the H2 consumption in the stack and the system, and the compressor energy consumption were predicted accurately with a deviation lower than 0.47%, 1.75% and 1.89% with respect to the experimental data, respectively.

Lopez-Juarez, Marcos↗