Search NASA⌕ Search

SEARCH · Search NASA

Results for “database for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model's suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS↗

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities (Version 2)

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model’s suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS↗

Power Plant Model Validation Tool

The PPMV is used to validate generator model using disturbance recordings. The PPMV tool contains a collection of power plant models and model validation studies, as well as disturbance recordings from a number of historic grid events. The user can import data from a new disturbance into the database, which converts PMU and SCADA data into GE PSLF format, and then run the tool to validate (or invalidate) the model for a specific power plant against its actual performance. The PNNL PPMV tool enables the automation of the process of power plant model validation using disturbance recordings. The tool uses PMU and SCADA measurements as input information. The tool automatically adjusts all required EPCL scripts and interacts with GE PSLF in the batch mode. The main tool features includes: The tool interacts with GE PSLF; The tool uses GE PSLF Play-In Function for generator model validation; Database of projects (model validation studies); Database of the historic events; Database of the power plant; The tool has advanced visualization capabilities; and the tool automatically generates reports.

Source record↗

Selection and Ranking of Experiments from the Halden Database in support of Multiscale Model Validation

Validating fuel performance codes, such as BISON, requires an extensive amount of experiments covering a wide range of operating conditions and fuel types. Within the light-water reactor (LWR) space, there have been several international experimental programs that have contributed to the wealth of available experimental data available for use. One of those international programs, the Halden Reactor Project (HRP), began in 1958 and utilized the Halden Boiling Water Reactor to conduct many highly instrumented experiments until the reactor closed in 2018. Idaho National Laboratory, through the U.S. Department of Energy, has utilized several Halden experiments to perform the initial validation of the BISON code based upon their inclusion in international modeling and simulation benchmarks. Recently, the HRP has provided member organizations a complete copy of all available data, reports, and presentations since the HRP began. This report provides an initial exploration of the data available in the database for use in validating the multiscale models under development in the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program for LWR applications. Ranking tables that identify potential validation cases are provided for the high priority models of interest. It was found that some of the recommended high priority experiments correspond to additional rods in existing assemblies already available in the BISON validation suite. It is expected that several of these cases will be incorporated into future NEAMS milestones in the fuels technical area for increased validation of BISON.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Circulation Control Model Experimental Database for CFD Validation

A 2D circulation control wing was tested in the Basic Aerodynamic Research Tunnel at the NASA Langley Research Center. A traditional circulation control wing employs tangential blowing along the span over a trailing-edge Coanda surface for the purpose of lift augmentation. This model has been tested extensively at the Georgia Tech Research Institute for the purpose of performance documentation at various blowing rates. The current study seeks to expand on the previous work by documenting additional flow-field data needed for validation of computational fluid dynamics. Two jet momentum coefficients were tested during this entry: 0.047 and 0.114. Boundary-layer transition was investigated and turbulent boundary layers were established on both the upper and lower surfaces of the model. Chordwise and spanwise pressure measurements were made, and tunnel sidewall pressure footprints were documented. Laser Doppler Velocimetry measurements were made on both the upper and lower surface of the model at two chordwise locations (x/c = 0.8 and 0.9) to document the state of the boundary layers near the spanwise blowing slot.

Paschal, Keith B.↗

Three-Dimensional Navier-Stokes Simulations with Two-Equation Turbulence Models of Intersecting Shock-Waves/Turbulent Boundary Layer at Mach 8.3

An investigation of the numerical simulation with two-equation turbulence models of a three-dimensional hypersonic intersecting (SWTBL) shock-wave/turbulent boundary layer interaction flow is presented. The flows are solved with an efficient implicit upwind flux-difference split Reynolds-averaged Navier-Stokes code. Numerical results are compared with experimental data for a flow at Mach 8.28 and Reynolds number 5.3x10(exp 6) with crossing shock-waves and expansion fans generated by two lateral 15 fins located on top of a cold-wall plate. This experiment belongs to the hypersonic database for modeling validation. Simulations show the development of two primary counter-rotating cross-flow vortices and secondary turbulent structures under the main vortices and in each corner singularity inside the turbulent boundary layer. A significant loss of total pressure is produced by the complex interaction between the main vortices and the uplifted jet stream of the boundary layer. The overall agreement between computational and experimental data is generally good. The turbulence modeling corrections show improvements in the predictions of surface heat transfer distribution and an increase in the strength of the cross-flow vortices. Accurate predictions of the outflow flowfield is found to require accurate modeling of the laminar/turbulent boundary layers on the fin walls.

Bardina, J. E.↗

Activities of the NASA Urban Air Mobility Noise Working Group (UNWG)

The NASA-led Urban Air Mobility Noise Working Group was established in 2018 following an exploratory meeting of stakeholders from traditional and emerging aviation sectors across industry, government agencies, academia, and community groups. Its mission is to create and support a diverse community of acoustics experts to identify, discuss, and address noise issues associated with UAM vehicles and their operations. The UNWG is comprised of four subgroups including Tools and Technologies, Ground and Flight Testing, Human Response and Metrics, and Regulation and Policy. In 2020, NASA published the white paper entitled “Urban Air Mobility Noise: Current Practice, Gaps, and Recommendations,” that presents a set of high-level goals and makes recommendations to address gaps in the current practice. This presentation is about recent activities of each of the subgroups to address those recommendations, including work towards establishment of an aeroacoustic test database for model validation, development of a set of measurement guidelines to quantify vehicle acoustic emission, a remotely administered human response study for quantifying annoyance to UAM operations, and status on noise standard, regulation, policy, and community engagement developments.

Urban air mobility↗

Large-database cross-verification and validation of tokamak transport models using baselines for comparison

State-of-the-art 1D transport solvers ASTRA and TRANSP are verified, then validated across a large database of semi-randomly selected, time-dependent DIII-D discharges. Various empirical models are provided as baselines to contextualize the validation figures of merit using statistical hypothesis tests. For predicting plasma temperature profiles, no statistically significant advantage is found for the ASTRA and TRANSP simulators over a baseline empirical (two-parameter) model. For predicting stored energy, a significant advantage is found for the simulators over a baseline empirical model based on confinement time scaling. Uncertainty in the results due to diagnostic and profile fitting uncertainties is approximated and determined to be insignificant due in part to the large quantity of discharges employed in the study. Advantages are discussed for validation methodologies like this one that employ (1) large databases and (2) baselines for comparison that are specific to the intended use-case of the model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Model validation using CFD-grade experimental database for NGNP Reactor Cavity Cooling Systems with water and air

This project has been focused on the experimental and numerical investigations of the water-cooled and air-cooled Reactor Cavity Cooling System (RCCS) designs. At this aim, we have leveraged an existing experimental facility at the University of Wisconsin-Madison (UW), and we have designed and built a separate effect test facility at the University of Michigan. The experimental facility at UW has underwent several upgrades, including the installation of advanced instrumentation (i.e. wire-mesh sensors) built at the University of Michigan. These provides highresolution time-resolved measurements of the void-fraction distribution in the risers of the water-cooled RCCS facility. A phenomenological model has been developed to assess the water cooled RCCS system stability and determine the root cause behind the oscillatory behavior that occurs under normal two-phase operation. Testing under various perturbations to the water-cooled RCCS facility have resulted in changes in the stability of the integral system. In particular, the effects on stability of inlet orifices, water tank volume have and system pressure been investigated. MELCOR was used as a predictive tool when performing inlet orificing tests and was able to capture the Density Wave Oscillations (DWOs) that occurred upon reaching saturation in the risers. The experimental and numerical results have then been used to provide RCCS design recommendations. The experimental facility built at the University of Michigan was aimed at the investigation of mixing in the upper plenum of the air-cooled RCCS design. The facility has been equipped with state-of-theart high-resolution instrumentation to achieve so-called CFD grade experiments, that can be used for the validation of Computational Fluid Dynanmics (CFD) models, both RANS (Reynold-Averaged) and LES (Large Eddy Simulations). The effect of risers penetration in the upper plenum has been investigated as well.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Geographical Database Integrity Validation

Airport Safety Modeling Data (ASMD) was developed at the request of a 1997 White House Conference on Aviation Safety and Security. Politicians, military personnel, commercial aircraft manufacturers and the airline industry attended the conference. The objective of the conference was to study the airline industry and make recommendations to improve safety and security. One of the topics discussed at the conference was the loss of situational awareness by aircraft pilots. Loss of situational awareness occurs when a pilot loses his geographic position during flight and can result in crashes into terrain and obstacles. It was recognized at the conference that aviation safety could be improved by reducing the loss of situational awareness. The conference advised that a system be placed in the airplane cockpit that would provide pilots with a visual representation of the terrain around airports. The system would prevent airline crashes during times of inclement weather and loss of situational awareness. The system must be based on accurate data that represents terrain around airports. The Department of Defense and the National Imagery and Mapping Agency (NIMA) released ASMD to be used for the development of a visual system for aircraft pilots. ASMD was constructed from NIMA digital terrain elevation data (DTED).

Jacobs, Derya↗

Aerosol Models from the AERONET Database: Application to Surface Reflectance Validation Satellite Data

Aerosols play a critical role in radiative transfer within the atmosphere, and they have a significant impact on climate change. In this paper, we propose and implement a framework for developing an aerosol model using their microphysical properties. Such microphysical properties as the size distribution, the complex refractive index, and the percentage of sphericity are derived from the global AERosol RObotic NETwork (AERONET). These measurements, however, are typically retrieved when almucantar measurement procedures are performed (i.e., early mornings and late afternoons with clear sky) and might not have a temporal correspondence to a satellite overpass time, so a valid validation of satellite-derived products cannot be carried out. To address this problem of temporal inconsistency of satellite and ground-based measurements, we developed an approach to retrieve these microphysical properties (and the corresponding aerosol model) using the optical thickness at 440 nm, τ440, and the Ångström coefficient between 440 and 870 nm, α440–870. Such aerosol models were developed for 851 AERONET sites within the last 28 years. Obtained results suggest that empirically microphysical properties can be retrieved with uncertainties of up to 23 %. An exception is the imaginary part of the refractive index ni, for which the derived uncertainties reach up to 38 %. These specific parametric models of aerosol can be used for the studies when retrieval of microphysical properties is required as well as validation of satellite-derived products over land. Specifically, we demonstrate the usefulness of the aerosol models to validate surface reflectance records over land derived from optical remote sensing sensors. We then quantify the propagation of uncertainties in the surface reflectance due to uncertainties with the aerosol model retrieval that is used as a reference from radiative transfer simulations. Results indicate that individual aerosol microphysical properties can impact uncertainties in surface reflectance retrievals between 3.5 × 10(exp -5) to 1 × 10(exp -3) (in reflectance units). The overall impact of microphysical properties combined yields an overall uncertainty in surface reflectance <0.004 (in reflectance units). That corresponds, for example, to 1 to 3 % of the retrieved surface reflectance in the red spectral band (620–670 nm) by the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument. These uncertainty values are well below the specification (0.005 + 0.05ρ; ρ is the retrieved surface reflectance) used for the MODIS atmospheric correction.

Jean-Claude Roger↗

NASA 5.2%-Scale High Lift Common Research Model (CRM-HL) Test in the National Transonic Facility (NTF)

Problem: Predicting CL,max and assessing transition, turbulence models, and Reynolds number effect predictions in CFD requires wind tunnel data for comparison. Objective: Expand the CFD validation database by running multiple models designed using the same reference geometry in various wind tunnels around the world. The wind tunnel data and model geometry will be open source to allow for CFD validation use. Approach: Run the NASA 5.2%-scale High Lift Common Research Model (CRM-HL) semi-span model at the National Transonic Facility (NTF). Test the model at chord Reynolds numbers (Rec) between 1.6 million and 30 million and at varying Q/Es to assess Reynolds number effects and aeroelasticity affects on the model, while collecting force and moment, pressure and wing deformation data. Test the model with ice shapes installed on the leading edges. Results: Ran eight model configurations, including four landing, two landing with ice shapes installed, and two takeoff configurations. Ran in air (120°F) and nitrogen operations (-50°F, -180°F and -250°F) at 7 different chord Reynolds numbers. The data compare well with previous tests of the same model at DLR (The Germany Aerospace Center) and the 14- by 22-Foot Subsonic Tunnel (14x22). Significance: Provided valuable high Reynolds number data on a high lift configuration to the worldwide research community. Provide icing data at flight Reynolds number to the research community.

CRM-HL↗

AI Data Quality Monitoring with Hydra

Hydra is an extensible framework for training and managing AI for near real time monitoring that aims to replace the tedious and repetitive data quality monitoring activities the shift crew and online monitoring coordinator typically perform. It continuously scans incoming data in the form of monitoring plots for signs of problems, flagging them for human review. A web app was developed such that experts can efficiently label images for training. Labels are stored in a database for use in training and model validation. Backed up by a comprehensive database, it utilizes an additional web based front-end for viewing the current monitoring status from anywhere in the world. The system has been in production use for the GlueX experiment at Jefferson Lab for more than 2 years with new features still under active development.

Britton, Thomas↗

Analysis of the Value Added When Deploying a Model-Based Approach for the Validation and Verification of the Medical Database Software

The Medical Database (MD) is a virtual repository consisting of two software components: Medical Item Database (MedID) and the Evidence Library (EL). MedID consists of engineering data and associated information for specific medical resource items (e.g., pharmaceutical, medical devices, and supporting components), while the EL is a tool which provides all of the medical evidence necessary. The MD will 1) serve as the single “source of truth” for the Informing Mission Planning via Analysis of Complex Tradespaces (IMPACT) tool suite for both medical evidence and medical resource engineering data and 2) will be used in conjunction with the IMPACT tool suite to inform research prioritizations and perform systematic trade study evaluations to aid stakeholders in making informed decisions regarding simulated human spaceflight missions. The MD project used a Model-Based Systems Engineering (MBSE) approach to support all life cycles of the software development, while in parallel the human factors engineering team used modeling to support Human Centered Design (HCD) strategies in an effort to improve software usability. HCD is a frequently used approach in design frameworks that develops resolutions to complexities and challenges by involving the human perspective in all steps of the problem-solving process. By integrating the model-based approaches used for systems engineering and human factors activities, the project is able to leverage the model-based artifacts originally created for HCD activities for system level and human factors validation. In this presentation, our team highlights the value added when leveraging these model-based artifacts to support the on-going verification and validation activities.

C. Laing↗

Predictive turbulence-driven flux model of scrape-off layer widths across confinement regimes in tokamaks

Reliable scrape-off layer (SOL) profile decay lengths predictions are needed to design and operate future tokamaks. The present manuscript describes a new model based on turbulent transport that is able to predict SOL widths for both L-mode and H-mode plasmas. The model is based upon the sheared-spectral filament paradigm (Peret et al (WEST Team) 2022 Phys. Plasmas 29 072306), however, incorporating the effects of thermal transport in order to calculate the parallel heat fluxes. The effects of magnetic shear and ExB shear on the cross-field transport are crucial to explain the shorter SOL decay lengths found in H-mode. The model is validated against a database of thousands of DIII-D L-mode and H-mode SOL profiles. We also calculate SOL decay length predictions in terms of plasma and engineer control parameters, which are in agreement with the multi-machine empirical H-mode scaling (Eich et al (ASDEX Upgrade Team and JET EFDA Contributors) 2013 Nucl. Fusion 53 093031), however, with an additional device geometry dependence. ITER SOL width predictions by the model are 3 times higher than the empirical scaling.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Calibration and Validation of NRC Fuel Performance Models

Pacific Northwest National Laboratory maintains steady-state and transient fuel performance codes for the U.S Nuclear Regulatory Commission (NRC). The NRC uses these codes in performing confirmatory calculations of licensee fuel performance codes and safety analysis methods during the review and approval of these codes and methods. The NRC also uses these codes to perform calculations to direct regulatory research and to assist in the development of new regulations and regulatory guides. Because of the safety-related uses for these codes, it is critically important that the codes are capable of accurately modeling modern fuel and operations and that the models and code predictions are well validated using data collected from conditions relevant to in-reactor conditions. FRAPCON and FRAPTRAN have an extensive database of separate effects data used to validate individual material property and fuel performance models and an integral effects database used to assess the overall code prediction within the full range of fuel operations. The key code predictions that are of regulatory interest as they relate to various specified acceptable design limits are; fuel and cladding temperature, rod internal pressure, cladding hoop strain, cladding corrosion and hydriding, and fission gas release. To assess the ability of the code to accurately predict these values, the integral assessment database consists of measurements of fuel centerline temperature, fission gas release, void volume, cladding corrosion, and cladding hoop strain. This paper will discuss the activities that are performed to ensure that FRAPCON and FRAPTRAN represent the state of the industry and will describe the separate effect and integral effect databases that are used to validate the models and are continually being expanded to ensure validation over the full range of fuel operations.

Geelhood, Kenneth J.↗

Battery inverter experimental data

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 30 kW off-the-shelf grid following battery inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. Inverter is tested under 100%, 75%, 50%, 25% load conditions. In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.9 to 1.1 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (100%, 75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59 Hz to 61 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗

PV inverter experimental data

The increase in power electronic based generation sources require accurate modeling of inverters. Accurate modeling requires experimental data over wider operation range. We used 20 kW off-the-shelf grid following PV inverter in the experiments. We used controllable AC supply and controllable DC supply to emulate AC and DC side characteristics. The experiments were performed at NREL's Energy Systems Integration Facility. Due to the limitations of the DC supply used, inverter is tested under 75%, 50%, 25% load conditions (This dataset does not contain 100% load condition). In the first dataset, for each operating condition, controllable AC source voltage is varied from 0.88 to 1.09 per unit (p.u) with a step value of 0.025 p.u while keeping the frequency at 60 Hz. In the second dataset, under similar load conditions (75%, 50%, 25% ), the frequency of the controllable AC source voltage was varied from 59.4 Hz to 60.45 Hz with a step value of 0.2 Hz. Voltage and frequency range is chosen based on inverter protection. Voltages and currents on DC and AC side are included in the dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗