Search NASA⌕ Search

SEARCH · Search NASA

Results for “EXPERIMENTAL VERIFICATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

VALIDATION, VERIFICATION, AND CALIBRATION THROUGH A CAUSAL LENS

This paper presents an alternative method based on causal inference to perform validation, verification, and calibration of simulation models. While classical validation and verification approaches focus on the identification of the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on the identification of causal relationships between data elements. Statistical and machine learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between datasets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, then the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles it is known as a directed acyclic graph (DAG). A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and from experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts have a means to identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

Development of MELCOR 2.1 Guidance Report for LPF Applications

A complex nuclear facility includes several pathways that can transport accidentally released materials throughout the facility and potentially to the exterior environment. To model and estimate material transport and possible release as a source term from a U.S. Department of Energy (DOE) nuclear facility requires proficiency in applying simulation tools, such as the MELCOR code. DOE has designated MELCOR version 1.8.5, an obsolete version, as a DOE Tool Box code in its Central Registry. A leak path factor (LPF) guidance report written in 2004 did not include experimental validation data. Using an obsolete version of MELCOR requires additional verification and validations, which may be cost prohibitive. Without any developer support and lack of experimental data validation, it is difficult to justify to regulators that the calculated source term with the obsolete version of MELCOR from the facility is accurate and defensible. The goal of this work is to replace the obsolete guidance report with MELCOR 2.1 with experimental validations. In this paper, we will present our approach to develop a MELCOR 2.1 guidance report for LPF applications. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Accuracy requirements and benchmark experiments for CFD validation

The role of experiment in the development of Computation Fluid Dynamics (CFD) for aerodynamic flow prediction is discussed. The CFD verification is a concept that depends on closely coordinated planning between computational and experimental disciplines. Because code applications are becoming more complex and their potential for design more feasible, it no longer suffices to use experimental data from surface or integral measurements alone to provide the required verification. Flow physics and modeling, flow field, and boundary condition measurements are emerging as critical data. Four types of experiments are introduced and examples given that meet the challenge of validation: flow physics experiments; flow modeling experiments; calibration experiments; and verification experiments. Measurement and accuracy requirements for each of these differ and are discussed. A comprehensive program of validation is described, some examples given, and it is concluded that the future prospects are encouraging.

Marvin, Joseph G.↗

Accuracy requirements and benchmark experiments for CFD validation

The role of experiment in the development of Computational Fluid Dynamics (CFD) for aerodynamic flow prediction is discussed. The CFD verification is a concept that depends on closely coordinated planning between computational and experimental disciplines. Because code applications are becoming more complex and their potential for design more feasible, it no longer suffices to use experimental data from surface or integral measurements alone to provide the required verification. Flow physics and modeling, flow field, and boundary condition measurements are emerging as critical data. Four types of experiments are introduced and examples are given that meet the challenge of validation: flow physics experiments; flow modeling experiments; calibration experiments; and verification experiments. Measurement and accuracy requirements for each of these differ and are discussed. A comprehensive program of validation is described, some examples given, and it is concluded that the future prospects are encouraging.

Marvin, Joseph G.↗

Computational Fluid Dynamics Uncertainty Analysis Applied to Heat Transfer over a Flat Plate

There have been few discussions on using Computational Fluid Dynamics (CFD) without experimental validation. Pairing experimental data, uncertainty analysis, and analytical predictions provides a comprehensive approach to verification and is the current state of the art. With pressed budgets, collecting experimental data is rare or non-existent. This paper investigates and proposes a method to perform CFD uncertainty analysis only from computational data. The method uses current CFD uncertainty techniques coupled with the Student-T distribution to predict the heat transfer coefficient over a at plate. The inputs to the CFD model are varied from a specified tolerance or bias error and the difference in the results are used to estimate the uncertainty. The variation in each input is ranked from least to greatest to determine the order of importance. The results are compared to heat transfer correlations and conclusions drawn about the feasibility of using CFD without experimental data. The results provide a tactic to analytically estimate the uncertainty in a CFD model when experimental data is unavailable

Computational↗

FY2021 Improvements to the New CTH Code Verification & Validation Test Suite

Over the past few years, the CTH multiphysics hydrocode has overhauled its software quality and testing processes, implementing current best practices in software quality and building a robust V&V test suite comprised of traditional hydrocode verification problems, including ASC Tri-Lab Test Suite and Enhanced Tri-Lab Test Suite problems, as well as validation problems for some of CTH’s most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards building this new test suite was made in FY19 and FY20. In FY21, the test suite has been expanded to include verification and validation tests of the Steinberg-Guinan-Lund (ST) viscoplastic model and the Johnson Cook (JFRAC) fracture model. Additionally, two new verification tests were added, covering hydrodynamics and high explosive (HE) modeling capabilities: the Kidder Gaussian density problem and the Escape of HE Products (EHEP) problem from the Tri-Lab Test Suite. This report discusses each of these test problems in detail. Verification test results are compared to analytic solutions. Validation test results are compared to experimental data. Wherever possible, convergence or mesh refinement studies are included. Additionally, while implementing the Kidder verification problem, a bug was identified that affects the use of tables to initialize pressure or density in 1D or 2D calculations. A brief discussion of the bug and its fix is included. CTH demonstrates good performance overall on the new test suite problems. Simulation results showed good agreement with analytic solutions for the Kidder problem, with convergence rates ranging between 1.8 and sub-linear, and relatively good agreement for the EHEP problem, though convergence rates for pressure and density were nearly 0. The ST and JFRAC strain rate loading verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data, including Taylor rod impact testing, for the materials tested. Future V&V work will focus on adding 2D and 3D versions of existing verification tests as well as adding validation tests of other frequently used capabilities such as other fracture models.

42 ENGINEERING↗

Entanglement Verification of Hyperentangled Photon Pairs

In this work, we experimentally investigate the properties of hyperentangled states displaying simultaneous entanglement in multiple degrees of freedom and find that Bell tests beyond the standard Clauser-Horne-Shimony-Holt inequality can reveal a higher-dimensional nature in a device-independent way. Specifically, we show that hyperentangled states possess more than just simultaneous entanglement in separate degrees of freedom but also entanglement in a higher-dimensional Hilbert space. We also verify the steerability of hyperentangled quantum states by steering different photonic degrees of freedom.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A method for calculating strut and splitter plate noise in exit ducts: Theory and verification

Portions of a four-year analytical and experimental investigation relative to noise radiation from engine internal components in turbulent flow are summarized. Spectra measured for such airfoils over a range of chord, thickness ratio, flow velocity, and turbulence level were compared with predictions made by an available rigorous thin-airfoil analytical method. This analysis included the effects of flow compressibility and source noncompactness. Generally good agreement was obtained. This noise calculation method for isolated airfoils in turbulent flow was combined with a method for calculating transmission of sound through a subsonic exit duct and with an empirical far-field directivity shape. These three elements were checked separately and were individually shown to give close agreement with data. This combination provides a method for predicting engine internally generated aft-radiated noise from radial struts and stators, and annular splitter rings. Calculated sound power spectra, directivity, and acoustic pressure spectra were compared with the best available data. These data were for noise caused by a fan exit duct annular splitter ring, larger-chord stator blades, and turbine exit struts.

Fink, M. R.↗

Structural behavior of scientific balloons - Finite element simulation and verification

An off-the-shelf nonlinear finite element code was used to analyze fully inflated scientific balloons. The thin balloon film was modeled by shell bending elements. Numerical difficulties caused by insignificant bending stiffness terms were overcome by introducing some artificial bending stiffness. This approximation is justified by the fact that in thin shells with nonzero Gaussian curvature the membrane solution component is essentially independent of the bending solution component. Perturbation of the coveraged solution by increasing the bending stiffness by a full decade verified this assertion. This analytical approach was experimentally verified. As a result of this verification process it was discovered that the generally accepted linearly visco-elastic model for polyethylene film is inappropriate for a significant planar (as opposed to uniaxial) stress state. A linear elastic model presents a good approximation for planar stress states.

Schur, Willi W.↗

Verification and validation of the Alternative Nonlinear Two-phase Subchannel (ANTS) code

The Alternative Nonlinear Two-phase Subchannel solver (ANTS) code was written to provide a fast-running, steady-state, pin-resolved modeling and simulation tool for analysis of common boiling water reactor (BWR) geometry and common operating conditions. ANTS has been integrated into the Virtual Environment for Reactor Application (VERA) core simulator software, where it can be used to provide a thermal/hydraulic (T/H) subchannel solution that is then used to provide neutronic feedback as well as perform the fuel depletion and temperature solution. Herein, this paper presents the rigorous analysis performed on the ANTS code, which includes both code and solution verification testing, benchmarking with the existing two-phase subchannel capability in VERA, CTF, and validation testing using popular two-phase experiments such as PWR Sub-channel and Bundle Tests (PSBT), BWR Full-size Fine-mesh Bundle Tests (BFBT), Risø, and FRIGG. This assessment was used to qualify ANTS for its intended applications before its use for core-scale, multiphysics BWR simulations. In general, it was found that agreement with experimental data was good; errors were within the range of experimental data uncertainty. Furthermore, code and solution verification confirmed that the governing equations and the most important closure terms were correctly implemented and behaving as expected.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Formation and Combustion of Unconfined Drop Clusters in Microgravity

Single-drop and droplet array studies have become common methods to isolate and investigate the effects of any of the complexities that enter into the drop combustion process. Microgravity environments are required to allow larger drops to be studied while minimizing or eliminating the confounding effects of buoyancy. Based on the results from current isolated drop, drop array, and spray studies funded through the Microgravity Science and Applications Division, it has become clear that even with the effects of buoyancy removed, the extrapolation of results from droplet array studies to spray flames is difficult. The problem occurs because even the simplest spray systems introduce complexities of multi-disperse drop sizes and drop-drop interactions, coupled with more complicated fluid dynamics. Not only do these features make the interpretation of experimental data difficult, they also make the problem very difficult to analyze computationally. Group combustion models, in which the interaction between droplets is treated on a statistical manner, have become a popular method to investigate the behavior of large numbers of interacting droplets, particularly through the work of Ryan et al. and Bellan and co-workers. While these models idealize the actual spray systems to a point where they can be treated computationally, the experimental analogy to these models is difficult to achieve because it requires the formation and Combustion of drop clusters without the effects of buoyancy. Therefore, even though these models have provided useful and insightful information, the verification of the results by direct comparison with experimental data is still lacking.

Liu, S.↗

Observations on CFD Verification and Validation from the AIAA Drag Prediction Workshops

The authors provide observations from the AIAA Drag Prediction Workshops that have spanned over a decade and from a recent validation experiment at NASA Langley. These workshops provide an assessment of the predictive capability of forces and moments, focused on drag, for transonic transports. It is very difficult to manage the consistency of results in a workshop setting to perform verification and validation at the scientific level, but it may be sufficient to assess it at the level of practice. Observations thus far: 1) due to simplifications in the workshop test cases, wind tunnel data are not necessarily the “correct” results that CFD should match, 2) an average of core CFD data are not necessarily a better estimate of the true solution as it is merely an average of other solutions and has many coupled sources of variation, 3) outlier solutions should be investigated and understood, and 4) the DPW series does not have the systematic build up and definition on both the computational and experimental side that is required for detailed verification and validation. Several observations regarding the importance of the grid, effects of physical modeling, benefits of open forums, and guidance for validation experiments are discussed. The increased variation in results when predicting regions of flow separation and increased variation due to interaction effects, e.g., fuselage and horizontal tail, point out the need for validation data sets for these important flow phenomena. Experiences with a recent validation experiment at NASA Langley are included to provide guidance on validation experiments.

Computational Fluid Dynamics↗

Report on Field Test at INL Cask Farm of Single Detector Fast Neutron Spent Fuel Cask Verification System

Detecting diversion of spent fuel elements in dry storage casks is challenging due to the thick shielding used in cask construction. Measurements on top of the cask to map the underlying arrangement of the fuel elements and looking for anomalous changes over time has proven difficult to achieve using gamma rays due to the high scattering and attenuation from the thick steel structure, weakening information on the present or absence of fuel bundles. Simulations and laboratory experiments suggest that the high-energy neutron flux (>200 keV) measured directly above each fuel bundle is sufficient to produce a position map that enables detection of the present or absence of fuel bundles, and therefore diversion of a spent fuel bundle. A single-detector spent-fuel monitoring technique based on this principle was development at the Lawrence Livermore National Laboratory (LLNL). The INL Cask Farm in the INTEC technical area at Idaho National Laboratory (INL) offers the capability to test this technique on an MC-10 storage cask which has a distribution of full and empty fuel positions. An experimental test plan for the single-detector verification system was developed in consultation with INL personnel to be completed in FY2021. Due to travel advisories related to COVID-19, the experimental test plan was adapted to enable INL personnel to carry out the measurements in consultation with LLNL personnel following shipment of the LLNL system to INL. Field test measurements of the single detector verification system were successfully carried out at the INL cask farm on September 7-9, 2021. This document summarizes results of the field test.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Verification and Validation in NASA-CUIP LOX/methane Injector Research Efforts

The NASA-CUIP program is supporting experimental and modeling/computational research efforts investigating wall heat flux characteristics of LOX/methane single-element injectors. A Verification and Validation (V&V) task has begun with the objective of quantifying the degree of accuracy of the models for wall heat flux distributions at specific sets of conditions. The V&V approach used is that being drafted as a standard by the ASME Performance Test Codes Committee, PTC 61: Verification and Validation in Computational Fluid Dynamics and Heat Transfer. The approach is based on well-established concepts from experimental uncertainty analysis. Initially the V&V and uncertainty estimation efforts will use data obtained previously in the same facility using oxygen/hydrogen in single-element injector testing. In this paper the V&V process, experimental facility, and computer code are described, and approaches to estimating the associated uncertainties are discussed.

Coleman, Hugh W.↗

Advancing understanding and predictive capability for fast-ion driven instabilities and associated anomalous transport in NSTX-U

This project advanced predictive capability for the spherical tokamak (ST) by (a) experimental validation of physics models in GTC for simulating fast-ion driven instabilities and their fast-ion and energy transport in the ST, and (b) verification of GTC with linear theory and validation using experimental measurements in the high frequency regime in the ST.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Computational Methods to Characterize Panel Loading Conditions for Accelerated Testing

Panel cracking and degradation due to wind loading are known to have a detrimental effect on power output. Recreating these damaging conditions in a controlled experimental setting requires an understanding of the loads being generated at the panel surface as a function of both wind speed, wind direction, and panel orientation. To better understand these relationships, a computational fluid dynamics (CFD) simulation package was constructed using an open-source Python library for solving partial differential equations with the finite element method. This CFD package allows the simulated wind speed and panel orientation of a multi-panel array to be easily changed and provides the capability to measure the traction forces at discrete points along the sun-facing and ground-facing surface of an interior panel residing in the wake of one or more upstream panels. A parameter exploration was performed in which the panel angle was varied in even increments from -70 deg to 70 deg and the wind speed was varied from 2 to 30 m/s. During post processing, the measured traction along the panel surface was averaged spatially and interpreted as a time-varying signal, where further processing of this signal yielded the root mean square amplitude and a characteristic frequency associated with the loading. This study found that higher wind speeds are generally associated with increased amplitude of loading and that the panel orientation angle can significantly exacerbate or mitigate this loading. These outcomes are presented along with current work on higher-fidelity verification simulations and recommendations for performing accelerated experimental testing.

loading↗

Hoop/Column Antenna: RF Verification Model. Volume 1: Test Results

As part of the Large Space System Technology Program, this report, in two volumes, presents the theoretical and experimental results of the RF characteristic of a hoop/column, quad aperture antenna using an RF verification model. To satisfy the primary purposes of the model it provides experimental pattern data for the quad aperture configuration at different reflector edge illumination levels, from which the geometry and edge effects can be assessed, and provides experimental data which can be compared with calculations using various theoretical reflector scattering formulae. It also experimentally determines the effects upon secondary patterns of scale model quartz cables, as used in the hoop/column design, upon secondary patterns in order to assess the importance of developing a scattering theory to predict such effects. In addition, this report contains a comprehensive theoretical study and the experimental pattern results of quad aperture antenna feeds, a discussion of the fundamental affect of parasitic side lobes, their amplitude, and location in space.

Croswell, W. F.↗

Verification of component mode techniques for flexible multibody systems

Investigations were conducted in the modeling aspects of flexible multibodies undergoing large angular displacements. Models were to be generated and analyzed through application of computer simulation packages employing the 'component mode synthesis' techniques. Multibody Modeling, Verification and Control Laboratory (MMVC) plan was implemented, which includes running experimental tests on flexible multibody test articles. From these tests, data was to be collected for later correlation and verification of the theoretical results predicted by the modeling and simulation process.

Wiens, Gloria J.↗