Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

A Multi-Year Effort to Forward the Validation of Solar Energetic Particle Prediction Models

To enable a consistent and quantitative understanding of solar energetic particle (SEP) model performance, a generalized, automated validation infrastructure, called SPHINX, is being developed by the NASA Space Radiation Analysis Group (SRAG) in close collaboration with the NASA Community Coordinated Modeling Center (CCMC), NASA Moon to Mars Space Weather Analysis Office (M2M), NOAA Space Weather Prediction Center (SWPC), and the Royal Belgian Institute for Space Aeronomy (BIRA-IASB). SPHINX is being developed to evaluate the SEP Scoreboards (https://ccmc.gsfc.nasa.gov/scoreboards/sep/), which are being used by SRAG to support space radiation operations for Mission Control. SPHINX is also being developed through a series of community challenges, which have defined a list of challenge events and a prescribed set of rules of participation. The participation of the research community has enabled the generalization of the infrastructure to validate all the types of outputs being produced by SEP models and fully exercised the framework. The most recent challenge includes 30 SEP events and 33 non-event (quiet) periods and was supported by two dedicated SEPVAL working meetings, one in the US and one in Europe (https://ccmc.gsfc.nasa.gov/community-workshops/ccmc-sepval-2023/). Here, we describe SPHINX and its interactive user interface, SPHINX-VIVID, which will eventually be made available for public use. We present selected results, outcomes, and lessons learned from the SEPVAL working meetings and validation results of the SEP Scoreboards from 2019 to present. These efforts aim to define a set of community standards for SEP model validation and describe the current state-of-the-art of SEP model performance.

Kathryn Whitman↗
NASA NTRSDate not supplied

A CFD Validation Study using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD↗
NASA NTRSDate not supplied

A CFD Validation Study Using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD↗
DOE OSTI2024

Results of an In-Field Validation Exercise in Support of Wide-Area Environmental Sampling

The National Nuclear Security Administration’s (NNSA) Office of Nonproliferation and Arms Control (NA-24) is evaluating Wide-Area Environmental Sampling (WAES) as an additional safeguards verification tool for the International Atomic Energy Agency to detect undeclared nuclear activities. The NNSA is evaluating strategies for conducting a generic WAES campaign, the cost of a WAES campaign, and the effect of technological advancements that have occurred since the last major WAES review in 1999. Until now, the NNSA effort has focused on tabletop exercises (TTXs) in which high-performance computing allows for advanced modeling and simulation efforts to be applied to the WAES question. Although the modeling and simulations used in the TTXs are extremely valuable, field campaigns are still needed to validate the assumptions that underpin the models and the modeling process itself. During a 7 week period beginning in May 2023 and ending in June 2023, which included 4 weeks of active field collections, a multilaboratory team conducted its first in-field validation exercise. Prior to the in-field exercise, abbreviated TTXs were conducted to estimate the performance of all collection systems to be used during the field test. These TTXs guided the selection of materials to be released and the placement of the collection system. Based on these determinations, materials were procured to use in the field test, and an injection/release system was designed, built, and installed at the test facility. Background samples were collected during weeks one and four, and environmental collections against active releases were conducted during weeks two and three. The goals of this validation exercise included a demonstration of (1) the ability to provide controlled releases of particulates of surrogate materials, (2) the fielding and operation of collection systems (including deposition and active air collectors), and (3) the flexibility to revise equipment and campaign plans in the field. This paper presents the results and preliminary conclusions for this initial validation test. Based on these results, subsequent field campaigns are anticipated and will include the addition of other released materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Validation of the DESI DR2 Ly$α$ forest full-shape analysis

We present the validation of the Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) Lyman-$α$ (Ly$α$) forest full-shape analysis. This analysis combines three-dimensional Ly$α$ forest auto-correlations and cross-correlations with quasars to extract information from both the baryon acoustic oscillation (BAO) feature and the broadband clustering signal, with primary emphasis on the Alcock-Paczynski (AP) measurement. Compared to the DESI DR1 analysis, the DR2 validation uses substantially larger and more realistic mock datasets, including CoLoRe 2LPT and AbacusSummit Ly$α$ forest simulations. The modeling framework is also improved through analytic marginalization over small scales ($<10$$h^{-1}$Mpc) and the impact of ultraviolet background fluctuations. The validation program was completed prior to unblinding and defines quantitative requirements for the cosmological parameters of interest, which are evaluated using hundreds of mock realizations. We further test the analysis through independent fits to the auto- and cross-correlations, multiple catalog splits, and a broad suite of analysis and modeling variations applied to both mocks and blinded observational data. We find that the BAO and AP parameters satisfy all validation requirements and remain stable across all tests. In contrast, mock studies reveal a significant bias in the inferred growth-rate parameter $fσ_8$, leading us to exclude this measurement from the final analysis. The consistency across mocks, data splits, and robustness tests demonstrates that the DR2 Ly$α$ full-shape analysis provides a reliable and substantially improved broadband AP measurement over previous Ly$α$ forest studies.

Herbold, M. [Chicago U., KICP; Ohio State U.] (ORC↗
DOE OSTI2024

OC6 Phase IV: Validation of CFD Models for Stiesdal TetraSpar Floating Offshore Wind Platform

ABSTRACT With only a few floating offshore wind turbine (FOWT) farms deployed anywhere in the world, FOWT technology is still in its infancy, building on a modicum of real‐world experience to advance the nascent industry. To support further development, engineers rely heavily on modeling tools to accurately portray the behavior of these complex systems under realistic environmental conditions. This reliance creates a need for verification and validation of such tools to improve reliability of load and dynamic response prediction and analysis capabilities of FOWT systems. The Offshore Code Comparison Collaboration, Continued with Correlation and unCertainty (OC6) project was created under the framework of the International Energy Agency to address this need and considers a three‐sided verification and validation between engineering level models, computational fluid dynamics (CFD), and experimental results. In this paper, a novel floating offshore wind platform, the Stiesdal TetraSpar, is simulated using CFD under the load conditions defined by Phase IV of the OC6 project. The comparison of these CFD results against the experimental results demonstrated the ability to predict the platform response to waves when imposing the measured wave signals as input. Although validation versus experiment was largely successful, the damping behavior was impacted by uncertainties likely originating from the mooring system and sensor umbilical cable. This extensive comparison effort with multiple CFD practitioners offers insight into best practices to achieve reliable results.

17 WIND ENERGY↗
DOE OSTI2024

Validation of Phasor-Domain Transmission and Distribution Co-simulation Against Electromagnetic Transient Simulation

The rapid deployment of renewable energy resources has led to the widespread use of power electronics in modern power systems. As these systems transition from being dominated by large synchronous machines to increasingly incorporating inverter-based resources (IBRs), traditional methods are becoming inadequate. Addressing this challenge, this paper introduces a scalable phasor-domain T\&D co-simulation framework based on open-source software. It focuses on the framework's validation against the PSCAD Electromagnetic Transient (EMT) analysis tool. The validation results demonstrate the framework's high-fidelity and a computational time speed-up of 60 to 100 times, marking a pioneering validation effort in T\&D co-simulation research.

Inverter-based resources, co-simulation, Electroma↗
DOE OSTI2026

Validation of electron backscattering in the MCNP6.3 code

A new electron backscattering validation suite has been developed for the MCNP® code. The calculations in this suite cover both condensed history and single-event transport methods, seven different elemental materials ranging from beryllium to uranium, and incident electron energies from 200 eV to 14.1 MeV. In general, the accuracy of the MCNP code for electron backscattering calculations is energy-dependent. For incident electron energies below 2 keV, the condensed history method is not applied while the single-event method shows poor agreement with experimental measurements due to poor accuracy of the underlying atomic data. For incident energies between 2 keV and 256 keV, the single-event method typically shows better agreement with experiments, while for incident energies above 256 keV the condensed history method gives better accuracy. Additionally, agreement with experimental data is generally worse for low- Z materials such as beryllium and carbon, which may reflect deficiencies in the data or physics underlying electron transport through light elements in the MCNP code. The new electron backscattering validation suite, along with the previously introduced electron stopping power and Lockwood energy deposition validation suites, provide MCNP users with a quantified understanding of the uncertainties in electron transport calculations. Future improvements to electron transport in the MCNP code are necessary for low energies (≤ 2 keV) and for low- Z materials.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Benchmark of the Chlorine Worth Study Experiments in Support of Chlorine Nuclear Data Validation for Nuclear Criticality Safety

The Chlorine Worth Study (CWS) was a critical experiment to address an urgent need for thermal chlorine nuclear data validation in plutonium systems. This urgent need is tied directly to plutonium recycle and recovery operations in the plutonium facility at Los Alamos National Laboratory, where exceptionally conservative criticality safety limits are used because no credit is taken for the neutron capture by chlorine. The experiment used weapons-grade plutonium metal plates clad in stainless steel, known as the PANN (plutonium aluminum no nickel) ZPPR (zero power physics reactor) plates. The plutonium was reflected and moderated by high-density polyethylene and included combinations of polyvinyl chloride (PVC) and chlorinated polyvinyl chloride (CPVC) as absorbers. The experiment and benchmark included three configurations mimicking 30 g 239 Pu/L plutonium, 300 g 239 Pu/L plutonium, and 600 g 239 Pu/L plutonium in an aqueous chloride solution. Uncertainties in the benchmark included five broad categories: (1) criticality measurement, (2) mass and density, (3) dimensions, (4) material compositions, and (5) positioning. The largest contribution to the overall uncertainties for all three cases came from the material compositions, in particular the PVC and CPVC absorber compositions. A detailed model was created to be a near match (that is within expectations of transport code users) and a simplified model was created to minimize offset dimensions and expedite modeling for code validation. Sample calculations were completed in MCNP6.3 with ENDF/B-VIII.0 and ENDF/B-VII.1 nuclear data. For the detailed and simplified models, the average difference between the computed and experimental k eff was 951 pcm. CWS will serve as the key validation experiment for nuclear criticality safety in support of aqueous chloride operations. The sensitivity to the chlorine capture cross section is orders of magnitude greater than other existing benchmarks. The current limits, as defined by nuclear criticality safety, are 520 g Pu per batch, i.e. the minimum critical mass of the Pu solution infinitely reflected by water [Criticality Handbook: Volume II, (1969)]. This extremely conservative critical mass limit does not credit any neutron capture by chlorine (in particular neutron capture by 35 Cl) and greatly impedes the throughput required for current and future operations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Offshore Wind Energy Validation Experiment Hierarchy

This paper provides a summary of planning work for experiments that will be necessary to address the long-term model validation needs required to meet offshore wind energy deployment goals. Conceptual experiments are identified and laid out in a validation hierarchy for both wind turbine and wind plant applications. Instrumentation needs that will be required for the offshore validation experiments to be impactful are then listed. The document concludes with a nominal vision for how these experiments can be accomplished.

17 WIND ENERGY↗
DOE OSTI2024

Inverter Model Validation and Calibration Using Phasor Measurement Unit Data

As the penetration of inverter-based renewable energy resources increases in the power grid, especially at the distribution and microgrid levels, the need to accurately represent them in planning studies increases as well. However, due to the lack of well-established standard procedures, and vendor reluctance towards the detailed sharing of proprietary models, automated dynamic model validation and parameter calibration tools for inverter based resources (IBRs) remain scarce. This work presents a model validation and parameter calibration platform for representing IBRs with generic phasor-domain models. Phasor measurements of power system events are used for continuous validation using the data playback method, and model parameters are re-calibrated if a significant mismatch between measurements and model response is observed. Unique features of the proposed platform include- (a) an iterative Bayesian optimization approach towards parameter calibration to address a possible mismatch between the structures of generic models implemented in simulation softwares and actual commercial inverters, (b) error metrics designed to account for a possible mismatch between the time resolution of simulation and measurements, and (c) analysis of the measurement-simulation mismatch to provide guidance to engineering personnel regarding model shortcomings. The performance of the platform has been illustrated using both simulated data and field measurements to validate/calibrate inverter models in GridLAB-D.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Anion exchange membrane test protocol validation

This study presents the validation of protocols for measuring ion exchange capacity (IEC) and alkaline stability of anion exchange membranes (AEMs) for low-temperature water electrolysis. While protocols are often tested within individual laboratories, their results across multiple laboratories with varying equipment, environmental conditions, and personnel qualification remain unverified. The validation involved Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), and University of Oregon (UO) using the same commercially available AEM to assess reproducibility and reliability of the protocols under diverse conditions. For the IEC protocol, results across laboratories were consistent within ±10% of the NMR-determined reference value. The alkaline stability protocol could pose greater challenges due to factors such as variations in sample collection timing, preservation methods, and analytical techniques, but consistent test results for percentage IEC loss were demonstrated across institutions. These results highlight the reliability and applicability of the protocols, emphasizing the importance of validation to ensure consistency in diverse research environments.

08 HYDROGEN↗
NASA NTRS2005

Assessing Technology Maturity for ST-9 Technology Validation Experiments

This viewgraph presentation reviews the process of assessing the maturity of a technology for use in NASA missions. The NASA New Millennium Program (NMP) identifies and flight validates breakthrough technologi es that will significantly benefit future operational Space and Earth Science missions NMP conducts two types of flight validation projec ts for the Space Science Enterprise: (1) Integrated System Validatio n Projects, and (2) Stand-Alone Subsystem Validation Projects.

Space Technology (ST) 9↗
NASA NTRS2007

Thermal Design Validation of the Mars Scout Phoenix Payload

This slide presentation reviews the validation of the thermal design for the Mars Scout Phoenix Payload. It includes a description of the Phoenix Mission, the science objectives, the timeline, and the flight system and payloads that were on the lander. The initial responsibility for the development and validation the thermal design was with the developers. This process lacked overall system engineering, there was a difference of thermal expertise, and the number of institutions involved complicated the interactions. The revised approach for payload thermal design validation is described.

thermal design validation↗
NASA NTRS2014

Retrieval, Inter-Comparison, and Validation of Above-Cloud Aerosol Optical Depth from A-train Sensors

Absorbing aerosols produced from biomass burning and dust outbreaks are often found to overlay lower level cloud decks and pose greater potentials of exerting positive radiative effects (warming) whose magnitude directly depends on the aerosol loading above cloud, optical properties of clouds and aerosols, and cloud fraction. Recent development of a 'color ratio' (CR) algorithm applied to observations made by the Aura/OMI and Aqua/MODIS constitutes a major breakthrough and has provided unprecedented maps of above-cloud aerosol optical depth (ACAOD). The CR technique employs reflectance measurements at TOA in two channels (354 and 388 nm for OMI; 470 and 860 nm for MODIS) to retrieve ACAOD in near-UV and visible regions and aerosol-corrected cloud optical depth, simultaneously. An inter-satellite comparison of ACAOD retrieved from NASA's A-train sensors reveals a good level of agreement between the passive sensors over the homogeneous cloud fields. Direct measurements of ACA such as carried out by the NASA Ames Airborne Tracking Sunphotometer (AATS) and Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) can be of immense help in validating ACA retrievals. We validate the ACA optical depth retrieved using the CR method applied to the MODIS cloudy-sky reflectance against the airborne AATS and 4STAR measurements. A thorough search of the historic AATS-4STAR database collected during different field campaigns revealed five events where biomass burning, dust, and wildfire-emitted aerosols were found to overlay lower level cloud decks observed during SAFARI-2000, ACE-ASIA 2001, and SEAC4RS- 2013, respectively. The co-located satellite-airborne measurements revealed a good agreement (RMSE less than 0.1 for AOD at 500 nm) with most matchups falling within the estimated uncertainties in the MODIS retrievals. An extensive validation of satellite-based ACA retrievals requires equivalent field measurements particularly over the regions where ACA are often observed from satellites, i.e., south-eastern Atlantic Ocean, tropical Atlantic Ocean, northern Arabian Sea, South-East and North-East Asia.

validation↗
NASA NTRS2014

Integrated Medical Model Verification, Validation, and Credibility

The Integrated Medical Model (IMM) was designed to forecast relative changes for a specified set of crew health and mission success risk metrics by using a probabilistic (stochastic process) model based on historical data, cohort data, and subject matter expert opinion. A probabilistic approach is taken since exact (deterministic) results would not appropriately reflect the uncertainty in the IMM inputs. Once the IMM was conceptualized, a plan was needed to rigorously assess input information, framework and code, and output results of the IMM, and ensure that end user requests and requirements were considered during all stages of model development and implementation. METHODS: In 2008, the IMM team developed a comprehensive verification and validation (VV) plan, which specified internal and external review criteria encompassing 1) verification of data and IMM structure to ensure proper implementation of the IMM, 2) several validation techniques to confirm that the simulation capability of the IMM appropriately represents occurrences and consequences of medical conditions during space missions, and 3) credibility processes to develop user confidence in the information derived from the IMM. When the NASA-STD-7009 (7009) was published, the IMM team updated their verification, validation, and credibility (VVC) project plan to meet 7009 requirements and include 7009 tools in reporting VVC status of the IMM. RESULTS: IMM VVC updates are compiled recurrently and include 7009 Compliance and Credibility matrices, IMM VV Plan status, and a synopsis of any changes or updates to the IMM during the reporting period. Reporting tools have evolved over the lifetime of the IMM project to better communicate VVC status. This has included refining original 7009 methodology with augmentation from the NASA-STD-7009 Guidance Document. End user requests and requirements are being satisfied as evidenced by ISS Program acceptance of IMM risk forecasts, transition to an operational model and simulation tool, and completion of service requests from a broad end user consortium including Operations, Science and Technology Planning, and Exploration Planning. CONCLUSIONS: The VVC approach established by the IMM project of combining the IMM VV Plan with 7009 requirements is comprehensive and includes the involvement of end users at every stage in IMM evolution. Methods and techniques used to quantify the VVC status of the IMM have not only received approval from the local NASA community but have also garnered recognition by other federal agencies seeking to develop similar guidelines in the medical modeling community.

Validation↗
NASA NTRS2016

Qualitative Validation of the IMM Model for ISS and STS Programs

To validate and further improve the Integrated Medical Model (IMM), medical event data were obtained from 32 ISS and 122 STS person-missions. Using the crew characteristics from these observed missions, IMM v4.0 was used to forecast medical events and medical resource utilization. The IMM medical condition incidence values were compared to the actual observed medical event incidence values, and the IMM forecasted medical resource utilization was compared to actual observed medical resource utilization. Qualitative comparisons of these parameters were conducted for both the ISS and STS programs. The results of these analyses will provide validation of IMM v4.0 and reveal areas of the model requiring adjustments to improve the overall accuracy of IMM outputs. This validation effort should result in enhanced credibility of the IMM and improved confidence in the use of IMM as a decision support tool for human space flight.

risk assessment↗
NASA NTRS2017

Recalibration and Validation of the SMAP L-Band Radiometer

SMAP mission was launched on 31st January 2015 in a 6 AM 6 PM sun-synchronous orbit at 685 km altitude to measure soil moisture and freethaw globally. The passive instrument of SMAP is a fully polarimetric L-band radiometer (1.4GHz) operating with a bandwidth of 24MHz. The radiometer L1B data product version 3 has been released for public science activities. Post-launch calibration and validation activities are described in [4,5]. Validation results show that SMAP antenna temperature (TA) is 2.6 K warmer over galactic Cold Sky (CS), and land TB is 2.6 K colder comparing to SMOS land TB (compared at the top of the atmosphere) after the update of the reflectors thermal model. Due to the biases, the SMAP radiometer is under re-calibration for next data release in 2018.We present the updated calibration approaches for the SMAP radiometer product. We will discuss the various radiometer calibration parameters and part of the validation process and result.

SMAP↗