Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Updated Gadolinium Validation in SCALE 6.3.0 using ENDF/B-VIII.0 Data [Slides]

This presentation provides a brief recap of the ANS Summer meeting in 2018 with a discussion of the results. The presentation also provides an overview of new models and states that all new models have been checked but have not yet been added to the VALID library. It also states that the models were originally created as part of a master's thesis or summer internships. Additionally, all models have been rerun in SCALE 6.3.0 using CE ENDF/B-VIII.0 library. In conclusion, this project has facilitated a significant expansion of validation set containing gadolinium, including 13 cases previously in VALID plus 99 new cases. The completion of IPPE HST experiments confirm no clear trend as a function of concentration or spectrum. Solid absorber cases also show no clear trends and LANL HMT experiments have significant discrepancies in Gd alloy cases. While almost half of the total gadolinium-bearing cases from the ICSBEP Handbook are considered here, the presentation recognizes that there is more work to be done.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Expansion of the Verified, Archived, Library of Inputs and Data (VALID) [Slides]

This project dialogue provides an update on the Expansion of Verified, Archived, Library of Inputs and Data or VALID. VALID is a QA-Like (Quality Assurance) process to generate high quality models from reliable reference descriptions and make those models available to users. This presentation provides a brief project overview, a reminder of cases added in FY2021, cases currently in progress, and future plans for VALID.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Applying Methodology for Evaluating and Validating TSLs to Materials of Interest to NCSP [Slides]

This presentation covers the topic of applying methodology for evaluation validation of TSLs to material of interest to the Nuclear Criticality Safety Program (NCSP). The talk covers recent efforts in validating thermal neutron scattering cross sections. The presentation also proposes a methodology for not only validating thermal scattering files that utilizes all available experimental data, but also for evaluating new libraries as demonstrated on Polystyrene and Lucite

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Validation and Verification of TEDS Facility HYBRID Modeling

The HYBRID modeling repository is an in-house developed library of models for selected integrated energy systems (IES) modelling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Here, validation and verification (V&V) capabilities are demonstrated using the Thermal Energy Distribution System (TEDS) at INL. Building upon prior work, the TEDS model has been updated and verified so that it better represents the installed system configuration and the operating control system. The model control system was changed to allow replication of actual experimental procedures. Experimental operations focusing primarily on thermocline tank performance were devised and performed. Several anomalies were found in the operation data of the experiment facility. V&V activities calibrating a selected input parameter are demonstrated on a single component as well as with a single parameter within the thermocline. Calibrating is then demonstrated on multiple components and a multi-parameter metric for the entire system. The validation methodology is successfully applied to validate the model with experimental data. It is also used to confirm a hypothesis behind one of the anomalies in experimental performance.

25 ENERGY STORAGE↗

HYBRID Modeling Validation and Verification Status Matrix

The HYBRID modeling repository is a premier resource for integrated energy systems modeling. HYBRID models have been developed since 2015 to describe the physical operation of tightly coupled thermal systems including power generators, thermal transport systems, thermal storage, thermal-to-electric conversion systems, and other thermal applications. Due to the increased size of the repository, a concise summary matrix of available models is desired. This matrix will consolidate not only the list of available models but also indicate original information sources, publications that have model examples, and level of validation and verification that exists for the models. Validation and verification (V&V) levels begin from simplified algebraic relationship and advance to dynamic data validation. Moving forward, as new models are contributed to HYBRID, their V&V level will be included, updating this matrix.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Performance Test and Validation Evaluation for the Neutron Slab Counter

This Performance Testing and Validation Evaluation (PTVE) reviews and analyzes the data collected with the Neutron Slab Counter (NSC) according to the Performance Test and Validation Plan (PTVP, UCOR-4443) and reported in the NSC Performance Test and Validation Report (PTVR, NDA-13-0622). The NSC was designed for quantitative Nondestructive Assay (NDA) measurements of compressor volutes from the K25/K27 Buildings. The NSC PTVP (UCOR-4443) prescribed a methodology and set of field measurements to determine the NSC system efficiency, calibrate the system, perform verification measurements, define the components of the system's total measurement uncertainty, and perform a calibration confirmation measurement. All of the required measurements of the NSC PTVP (UCOR-4443) were completed according to the Calibration of NDA Equipment Procedure (PROC-DE-0714) and the Quantitative Measurements Using the Neutron Slab Counter Procedure (PROC-DE-0723). Following the completion of this PTVE, if the data quality objectives (DQO) of the NSC PTVP (UCOR-4443) are met, a commissioning report will be prepared which specifies the limits of use of the NSC.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Radiography Facility - Building 239 Independent Validation Review

The purpose of this task was to perform an Independent Validation Review to evaluate the successful implementation and effectiveness of Safety Basis controls, including new and revised controls, to support the implementation of a new DSA/TSR for B239. This task addresses Milestone 2 of FY10 PEP 7.6.6. As the first IVR ever conducted on a LLNL nuclear facility, it was designated a pilot project. The review follows the outline developed for Milestone 1 of the PEP, which is based on the DOE Draft Guide for Performance of Independent Verification Review of Safety Basis Controls. A formal Safety Basis procedure will be developed later, based on the lessons learned with this pilot project. Note, this review is termed a ''Validation'' in order to be consistent with the PEP definition and address issues historically raised about verification mechanisms at LLNL. Validation is intended to confirm that implementing mechanisms realistically establish the ability of TSR LCO, administrative control or safety management program to accomplish its intended safety function and that the controls are being implemented. This effort should not, however, be confused with a compliance assessment against all relevant DOE requirements and national standards. Nor is it used as a vehicle to question the derivation of controls already approved by LSO unless a given TSR statement simply cannot be implemented as stated.

99 GENERAL AND MISCELLANEOUS↗

Standard Problems for CFD Validation for NGNP - Status Report

The U.S. Department of Energy (DOE) is conducting research and development to support the resurgence of nuclear power in the United States for both electrical power generation and production of process heat required for industrial processes such as the manufacture of hydrogen for use as a fuel in automobiles. The project is called the Next Generation Nuclear Plant (NGNP) Project, which is based on a Generation IV reactor concept called the very high temperature reactor (VHTR). The VHTR will be of the prismatic or pebble bed type; the former is considered herein. The VHTR will use helium as the coolant at temperatures ranging from 250°C to perhaps 1000°C. While computational fluid dynamics (CFD) has not previously been used for the safety analysis of nuclear reactors in the United States, it is being considered for existing and future reactors. It is fully recognized that CFD simulation codes will have to be validated for flow physics reasonably close to actual fluid dynamic conditions expected in normal operational and accident situations. The “Standard Problem” is an experimental data set that represents an important physical phenomenon or phenomena, whose selection is based on a phenomena identification and ranking table (PIRT) for the reactor in question. It will be necessary to build a database that contains a number of standard problems for use to validate CFD and systems analysis codes for the many physical problems that will need to be analyzed. The first two standard problems that have been developed for CFD validation consider flow in the lower plenum of the VHTR and bypass flow in the prismatic core. Both involve scaled models built from quartz and designed to be installed in the INL’s matched index of refraction (MIR) test facility. The MIR facility employs mineral oil as the working fluid at a constant temperature. At this temperature, the index of refraction of the mineral oil is the same as that of the quartz. This provides an advantage to the optics used for data gathering. Particle image velocimetry (PIV) is used to take the data. The first standard problem represents several flow physics expected to be present in the lower plenum of the prismatic VHTR. In the lower plenum, heated helium coolant in the form of jets issues downward into the plenum and is then forced to turn ninety degrees and flow toward the exit duct. The lower plenum is filled with cylindrical graphite posts that hold up the core. Figure S-1 provides a plan view of the lower plenum. The red circles represent support posts holding up columns of heated blocks. Grey circles represent support posts under columns of reflector blocks. Helium enters the lower plenum at the junctions of the hexagonal blocks.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

ISOTHERMAL AIR INGRESS VALIDATION EXPERIMENTS AT IDAHO NATIONAL LABORATORY: DESCRIPTION AND SUMMARY OF DATA

Idaho National Laboratory performed air ingress experiments as part of validating computational fluid dynamics code (CFD). An isothermal stratified flow experiment was designed and set to understand stratified flow phenomena in the very high temperature gas cooled reactor (VHTR) and to provide experimental data for validating computer codes. The isothermal experiment focused on three flow characteristics unique in the VHTR air-ingress accident: stratified flow in the horizontal pipe, stratified flow expansion at the pipe and vessel junction, and stratified flow around supporting structures. Brine and sucrose were used as heavy fluids and water was used as light fluids. The density ratios were changed between 0.87 and 0.98. This experiment clearly showed that a stratified flow between heavy and light fluids is generated even for very small density differences. The code was validated by conducting blind CFD simulations and comparing the results to the experimental data. A grid sensitivity study was also performed based on the Richardson extrapolation and the grid convergence index method for modeling confidence. As a result, the calculated current speed showed very good agreement with the experimental data, indicating that the current CFD methods are suitable for predicting density gradient stratified flow phenomena in the air-ingress accident.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Improving Residential Building Simulations Through Large-Scale Empirical Validation

Residential building energy simulations are increasingly used for energy-efficient building design, codes and standards analysis, home certifications and ratings, utility programs, and technology assessments. Various software tools exist to perform residential building simulations, and these tools often use different models, inputs, and assumptions. This leads to inconsistencies that can undermine confidence in the predicted results. Validation of these tools can increase confidence by ensuring their accuracy and consistency. One way to validate simulation tools is through empirical testing, which compares predicted energy usage to measured utility billing data. This paper describes the process of data collection, data standardization, and empirical validation, and illustrates its use with our residential EnergyPlus (R)-based software. The data and process can be extended to other simulation tools and contribute to improving residential building simulations more broadly.

empirical validation↗

ACCRUE—An Integral Index for Measuring Experimental Relevance in Support of Neutronic Model Validation

A key challenge for the introduction of any design changes, e.g., advanced fuel concepts, first-of-a-kind nuclear reactor designs, etc., is the cost of the associated experiments, which are required by law to validate the use of computer models for the various stages, starting from conceptual design, to deployment, licensing, operation, and safety. To achieve that, a criterion is needed to decide on whether a given experiment, past or planned, is relevant to the application of interest. This allows the analyst to select the best experiments for the given application leading to the highest measures of confidence for the computer model predictions. The state-of-the-art methods rely on the concept of similarity or representativity, which is a linear Gaussian-based inner-product metric measuring the angle—as weighted by a prior model parameters covariance matrix—between two gradients, one representing the application and the other a single validation experiment. This manuscript emphasizes the concept of experimental relevance which extends the basic similarity index to account for the value accrued from past experiments and the associated experimental uncertainties, both currently missing from the extant similarity methods. Accounting for multiple experiments is key to the overall experimental cost reduction by prescreening for redundant information from multiple equally-relevant experiments as measured by the basic similarity index. Accounting for experimental uncertainties is also important as it allows one to select between two different experimental setups, thus providing for a quantitative basis for sensor selection and optimization. The proposed metric is denoted by ACCRUE, short for Accumulative Correlation Coefficient for Relevance of Uncertainties in Experimental validation. Using a number of criticality experiments for highly enriched fast metal systems and low enriched thermal compound systems with accident tolerant fuel concept, the manuscript will compare the performance of the ACCRUE and basic similarity indices for prioritizing the relevance of a group of experiments to the given application.

97 MATHEMATICS AND COMPUTING↗

Anion exchange membrane test protocol validation

This study presents the validation of protocols for measuring ion exchange capacity (IEC) and alkaline stability of anion exchange membranes (AEMs) for low-temperature water electrolysis. While protocols are often tested within individual laboratories, their results across multiple laboratories with varying equipment, environmental conditions, and personnel qualification remain unverified. The validation involved Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), and University of Oregon (UO) using the same commercially available AEM to assess reproducibility and reliability of the protocols under diverse conditions. For the IEC protocol, results across laboratories were consistent within ±10% of the NMR-determined reference value. The alkaline stability protocol could pose greater challenges due to factors such as variations in sample collection timing, preservation methods, and analytical techniques, but consistent test results for percentage IEC loss were demonstrated across institutions. These results highlight the reliability and applicability of the protocols, emphasizing the importance of validation to ensure consistency in diverse research environments.

08 HYDROGEN↗

Development of Training Materials for Pathologists to Provide Machine Learning Validation Data of Tumor-Infiltrating Lymphocytes in Breast Cancer

The High Throughput Truthing project aims to develop a dataset for validating artificial intelligence and machine learning models (AI/ML) fit for regulatory purposes. The context of this AI/ML validation dataset is the reporting of stromal tumor-infiltrating lymphocytes (sTILs) density evaluations in hematoxylin and eosin-stained invasive breast cancer biopsy specimens. After completing the pilot study, we found notable variability in the sTILs estimates as well as inconsistencies and gaps in the provided training to pathologists. Using the pilot study data and an expert panel, we created custom training materials to improve pathologist annotation quality for the pivotal study. We categorized regions of interest (ROIs) based on their mean sTILs density and selected ROIs with the highest and lowest sTILs variability. In a series of eight one-hour sessions, the expert panel reviewed each ROI and provided verbal density estimates and comments on features that confounded the sTILs evaluation. We aggregated and shaped the comments to identify pitfalls and instructions to improve our training materials. From these selected ROIs, we created a training set and proficiency test set to improve pathologist training with the goal to improve data collection for the pivotal study. We are not exploring AI/ML performance in this paper. Instead, we are creating materials that will train crowd-sourced pathologists to be the reference standard in a pivotal study to create an AI/ML model validation dataset. The issues discussed here are also important for clinicians to understand about the evaluation of sTILs in clinical practice and can provide insight to developers of AI/ML models.

60 APPLIED LIFE SCIENCES↗

A Metric-Based Validation Process to Assess the Realism of Synthetic Power Grids

Public power system test cases that are of high quality benefit the power systems research community with expanded resources for testing, demonstrating, and cross-validating new innovations. Building synthetic grid models for this purpose is a relatively new problem, for which a challenge is to show that created cases are sufficiently realistic. This paper puts forth a validation process based on a set of metrics observed from actual power system cases. These metrics follow the structure, proportions, and parameters of key power system elements, which can be used in assessing and validating the quality of synthetic power grids. Though wide diversity exists in the characteristics of power systems, the paper focuses on an initial set of common quantitative metrics to capture the distribution of typical values from real power systems. The process is applied to two new public test cases, which are shown to meet the criteria specified in the metrics of this paper.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Ten Years of VIIRS Land Surface Temperature Product Validation

The Visible Infrared Imaging Radiometer Suite (VIIRS) Land Surface Temperature (LST) has been operationally produced for a decade since the Suomi National Polar-orbiting Partnership (SNPP) launched in October 2011. A comprehensive evaluation of its accuracy and precision will be helpful for product users in climate studies and atmospheric models. In this study, the VIIRS LST is validated with ground observations from multiple high-quality radiation networks, including six stations from the Surface Radiation budget (SURFRAD) network, two stations from the Baseline Surface Radiation Network (BSRN), and 13 stations from the Atmospheric Radiation Measurement (ARM) network, to evaluate its performance over various land-cover types. The VNP21A1 LST was validated against the same ground observations as a reference. The results yield a close agreement between the SNPP VIIRS LST and ground LSTs with a bias of -0.4 K and a RMSE of 1.96 K over six SURFRAD sites; a bias of -0.2 K and a RMSE of 1.93 K over two BSRN sites; and a bias of -0.1 K and a RMSE of 1.7 K over the 13 ARM sites. The time series of the LST errors over individual sites indicate seasonal cycles. The data anomaly over the BSRN site in Cabauw and the SURFRAD site in Desert Rock is revealed and discussed in this study. In addition, a method using Landsat-8 data is applied to quantify the heterogeneity level of each ground station and the results provide promising insights. The validation results demonstrate the maturity of the JPSS VIIRS LST products and their readiness for various application studies.

54 ENVIRONMENTAL SCIENCES↗

Assessing Technology Maturity for ST-9 Technology Validation Experiments

This viewgraph presentation reviews the process of assessing the maturity of a technology for use in NASA missions. The NASA New Millennium Program (NMP) identifies and flight validates breakthrough technologi es that will significantly benefit future operational Space and Earth Science missions NMP conducts two types of flight validation projec ts for the Space Science Enterprise: (1) Integrated System Validatio n Projects, and (2) Stand-Alone Subsystem Validation Projects.

Space Technology (ST) 9↗

Thermal Design Validation of the Mars Scout Phoenix Payload

This slide presentation reviews the validation of the thermal design for the Mars Scout Phoenix Payload. It includes a description of the Phoenix Mission, the science objectives, the timeline, and the flight system and payloads that were on the lander. The initial responsibility for the development and validation the thermal design was with the developers. This process lacked overall system engineering, there was a difference of thermal expertise, and the number of institutions involved complicated the interactions. The revised approach for payload thermal design validation is described.

thermal design validation↗

Retrieval, Inter-Comparison, and Validation of Above-Cloud Aerosol Optical Depth from A-train Sensors

Absorbing aerosols produced from biomass burning and dust outbreaks are often found to overlay lower level cloud decks and pose greater potentials of exerting positive radiative effects (warming) whose magnitude directly depends on the aerosol loading above cloud, optical properties of clouds and aerosols, and cloud fraction. Recent development of a 'color ratio' (CR) algorithm applied to observations made by the Aura/OMI and Aqua/MODIS constitutes a major breakthrough and has provided unprecedented maps of above-cloud aerosol optical depth (ACAOD). The CR technique employs reflectance measurements at TOA in two channels (354 and 388 nm for OMI; 470 and 860 nm for MODIS) to retrieve ACAOD in near-UV and visible regions and aerosol-corrected cloud optical depth, simultaneously. An inter-satellite comparison of ACAOD retrieved from NASA's A-train sensors reveals a good level of agreement between the passive sensors over the homogeneous cloud fields. Direct measurements of ACA such as carried out by the NASA Ames Airborne Tracking Sunphotometer (AATS) and Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) can be of immense help in validating ACA retrievals. We validate the ACA optical depth retrieved using the CR method applied to the MODIS cloudy-sky reflectance against the airborne AATS and 4STAR measurements. A thorough search of the historic AATS-4STAR database collected during different field campaigns revealed five events where biomass burning, dust, and wildfire-emitted aerosols were found to overlay lower level cloud decks observed during SAFARI-2000, ACE-ASIA 2001, and SEAC4RS- 2013, respectively. The co-located satellite-airborne measurements revealed a good agreement (RMSE less than 0.1 for AOD at 500 nm) with most matchups falling within the estimated uncertainties in the MODIS retrievals. An extensive validation of satellite-based ACA retrievals requires equivalent field measurements particularly over the regions where ACA are often observed from satellites, i.e., south-eastern Atlantic Ocean, tropical Atlantic Ocean, northern Arabian Sea, South-East and North-East Asia.

validation↗