Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation studies”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Validation Studies using ELK and the Open-Source MOOSE Framework Application Zapdos for Electromagnetic Coupled Plasma Simulation

An open source simulation platform that captures electromagnetics, plasma chemistry, and fluid treatment of the plasma domain would be a powerful tool for studying low temperature plasma (LTP) phenomena. Within the Multiphysics Object-Oriented Simulation Environment (MOOSE) open source framework, ELK, CRANE, and Zapdos are combined to provide open source simulation capability for the LTP community. This talk presents continued validation of the general electromagnetic (EM) simulation tool ELK (Electromagnetic Library for Kinetics & fluids). Previous validation efforts focused on simulating standard waveguide and antenna benchmarks in vacuum and linear dielectrics, but ELK has since been coupled with the MOOSE-based plasma fluid application Zapdos [Lindsay et al 2016 J. Phys. D: Appl. Phys. 49 235204] to perform radio-frequency (rf) capacitively coupled plasma (CCP) system simulation. Plasma validation efforts initially focused on electrostatic benchmarks to demonstrate ELK-Zapdos code coupling and then moved to electromagnetic benchmarks based on interesting geometries and conditions (VHF effects in a CCP reactor, microwave heating, etc.). Results and progress in these efforts will be summarized and discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Validation Study for Crediting Chlorine in Criticality Analyses for Spent Nuclear Fuel Disposition

Spent nuclear fuel (SNF) management practices in the United States rely on dry storage systems that include both canister- and cask-based systems. The United States Department of Energy Used Fuel Disposition Campaign is examining the feasibility of direct disposal of dual-purpose (storage and transportation) canisters (DPCs) in a geological repository. One of the major technical challenges for direct disposal is the ability to demonstrate the subcriticality of the DPCs loaded with SNF for the repository performance period (e.g., 10,000 years or more) as the DPCs may undergo degradation over time. Specifically, groundwater ingress into the DPC (i.e., flooding) could allow the system to achieve criticality in scenarios where the neutron absorber plates in the DPC basket have degraded. However, as was shown by Banerjee et al., some aqueous species in the groundwater provide noticeable reactivity reduction for these systems. For certain amounts of particular aqueous species (e.g., chlorine, lithium) in the groundwater, subcriticality can be demonstrated even for DPCs with complete degradation of the neutron absorber plates or a degraded fuel basket configuration. It has been demonstrated that chlorine is the leading impurity, as indicated by significant neutron absorption in the water that is available in reasonable quantities for the deep geological repository media under consideration. This paper presents the results of an investigation of the available integral experiments worldwide that could be used to validate DPC disposal criticality evaluations, including credit for chlorine. Due to the small number of applicable critical configurations, validation through traditional trending analysis was not possible. The bias in the eigenvalue of the application systems due only to the chlorine was calculated using TSURFER analysis and found to be on the order of 100 percent mille (1 pcm = 10 -5 k eff ). This study investigated the design of a series of critical configurations with varying amounts of chlorine to address validation gaps. Such integral experiments would support the crediting of the chlorine neutron-absorption properties in groundwater and the demonstration of subcriticality for DPCs in deep geologic repositories with sufficient chlorine availability.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Validation study for crediting chlorine in critically analyses for spent nuclear fuel disposition - 14428

Spent nuclear fuel (SNF) management practices in the United States rely on dry storage systems that include both canister- and cask-based systems. The United States Department of Energy Used Fuel Disposition Campaign is examining the feasibility of direct disposal of dual-purpose (storage and transportation) canisters (DPCs) in a geological repository. One of the major technical challenges for direct disposal is the ability to demonstrate the subcriticality of the DPCs loaded with SNF for the repository performance period (e.g., 10,000 years or more) as the DPCs may undergo degradation over time. Specifically, groundwater ingress into the DPC (i.e., flooding) could allow the system to achieve criticality in scenarios where the neutron absorber plates in the DPC basket have degraded. However, as was shown by Banerjee et al., some aqueous species in the groundwater provide noticeable reactivity reduction for these systems. For certain amounts of particular aqueous species (e.g., chlorine, lithium) in the groundwater, subcriticality can be demonstrated even for DPCs with complete degradation of the neutron absorber plates or a degraded fuel basket configuration. It has been demonstrated that chlorine is the leading impurity, as indicated by significant neutron absorption in the water that is available in reasonable quantities for the deep geological repository media under consideration. This paper presents the results of an investigation of the available integral experiments worldwide that could be used to validate DPC disposal criticality evaluations, including credit for chlorine. Due to the small number of applicable critical configurations, validation through traditional trending analysis was not possible. The bias in the eigenvalue of the application systems due only to the chlorine was calculated using TSURFER analysis and found to be on the order of 100 percent mille (1 pcm = 10-5 k{sub eff}). This study investigated the design of a series of critical configurations with varying amounts of chlorine to address validation gaps. Such integral experiments would support the crediting of the chlorine neutron-absorption properties in groundwater and the demonstration of subcriticality for DPCs in deep geologic repositories with sufficient chlorine availability. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Validation Study of the Compressible Rayleigh–Taylor Instability Comparing the Ares and Miranda Codes

In this paper, the compressible Rayleigh–Taylor (RT) instability is studied by performing a suite of large eddy simulations (LES) using the Miranda and Ares codes. A grid convergence study is carried out for each of these computational methods, and the convergence properties of integral mixing diagnostics and late-time spectra are established. A comparison between the methods is made using the data from the highest resolution simulations in order to validate the Ares hydro scheme. We find that the integral mixing measures, which capture the global properties of the RT instability, show good agreement between the two codes at this resolution. The late-time turbulent kinetic energy and mass fraction spectra roughly follow a Kolmogorov spectrum, and drop off as k approaches the Nyquist wave number of each simulation. The spectra from the highest resolution Miranda simulation follow a Kolmogorov spectrum for longer than the corresponding spectra from the Ares simulation, and have a more abrupt drop off at high wave numbers. The growth rate is determined to be between around 0.03 and 0.05 at late times; however, it has not fully converged by the end of the simulation. Finally, we study the transition from direct numerical simulation (DNS) to LES. The highest resolution simulations become LES at around t/τ ≃ 1.5. Finally, to have a fully resolved DNS through the end of our simulations, the grid spacing must be 3.6 (3.1) times finer than our highest resolution mesh when using Miranda (Ares).

42 ENGINEERING↗

An Overview of Mesoscale Aerosol Processes, Comparisons, and Validation Studies from DRAGON Networks

Over the past 24 years, the AErosol RObotic NETwork (AERONET) program has provided highly accurate remote-sensing characterization of aerosol optical and physical properties for an increasingly extensive geographic distribution including all continents and many oceanic island and coastal sites. The measurements and retrievals from the AERONET global network have addressed satellite and model validation needs very well, but there have been challenges in making comparisons to similar parameters from in situ surface and airborne measurements. Additionally, with improved spatial and temporal satellite remote sensing of aerosols, there is a need for higher spatial-resolution ground-based remote-sensing networks. An effort to address these needs resulted in a number of field campaign networks called Distributed Regional Aerosol Gridded Observation Networks (DRAGONs) that were designed to provide a database for in situ and remote-sensing comparison and analysis of local to mesoscale variability in aerosol properties. This paper describes the DRAGON deployments that will continue to contribute to the growing body of research related to meso- and microscale aerosol features and processes. The research presented in this special issue illustrates the diversity of topics that has resulted from the application of data from these networks.

Holben, Brent N.↗

Overview of the Exploration Exercise Device Validation Study Plans

The NASA has determined that a multi-functional exercise device will be developed for use as an exercise device during exploration missions. The device will allow for full body resistance and metabolic exercise necessary to minimize physiological losses during space flight and to maintain fitness necessary to perform critical mission tasks. Prior to implementation as an exercise device on an Exploration vehicle, there will be verification and validation testing completed to determine device efficacy at providing the necessary training stimuli to achieve desired goals. Because the exploration device will be new device that has yet be specified, specific Verification and Validation (V&V) protocols have yet to be developed. Upon delivery of an exploration exercise device training unit, stakeholders throughout NASA will develop V&V plans that include ground-based testing and testing on the International Space Station (ISS). Stakeholders will develop test protocols that include success criterion for the device. Ground tests will occur at NASA Johnson Space Station prior to flight testing. The intents of the ground tests are to allow crew, spaceflight medicine, science, engineering, Astronaut Strength, Conditioning, and Reconditioning staff, and others to gain experience in the best utilization of the device. The goal is to obtain an evidence base for recommending use of the device on the ISS. The developed protocol will be created to achieve multiple objectives, including determining if the device provides an adequate training stimulus for 5th - 95th percentile males and females, allows for exercise modalities that protect functional capability, and is robust and can withstand extensive human use. Although protocols are yet to be determined, current expectations include use of the device by test subjects and current crew in order to obtain quantitative and qualitative feedback. Information obtained during the ground tests may be used to influence device modifications during design iterations. Assuming successful ground tests, the device will be installed on the ISS for testing during space flight. Spaceflight testing is envisioned to include an activation and checkout (ACO) phase and a V&V phase. During the ACO phase, 1-2 crewmembers will exercise with the device to ensure proper function. ACO is expected to last multiple months because of the many modes and methods of exercise that need to be assessed. However, the goal is to complete the ACO as quickly as possible. Once successful ACO occurs, the crew will be free to use the device for normal exercise pending concurrence from stakeholders. V&V tests on the ISS will ideally consist of crew using the device for all of their exercise for an entire mission. Exercise prescriptions will be supplied that replicate expected prescriptions during exploration missions. Crew that are not enrolled in the V&V studies would be also free to use the device as their schedule permits. As experience is gained by users, exercise protocols could change. The intent of all V&V testing is to ensure that all have thorough understanding of experience at optimizing device capability

DeWitt, J. K.↗

A CFD Validation Study using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD↗

A CFD Validation Study Using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD↗

Cable SGEMP Code Validation Study

This report compared data taken on the Modular Bremsstrahlung Simulator using copper jacketed (cujac) cables with calculations using the RHSD-RA Cable SGEMP analysis tool. The tool relies on CEPXS/ONBFP to perform radiation transport in a series of 1D slices through the cable, and then uses a Green function technique to evaluate the expected current drive on the center conductor. The data were obtained in 2003 as part of a Cabana verification and validation experiment using 1-D geometries, but were not evaluated until now. The agreement between data and model is not adequate unless gaps between the dielectric and outer conductor (ground) are assumed, and these gaps are large compared with what is believed to be in the actual cable.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Small Bowel Dose Parameters Predicting Grade ≥3 Acute Toxicity in Rectal Cancer Patients Treated With Neoadjuvant Chemoradiation: An Independent Validation Study Comparing Peritoneal Space Versus Small Bowel Loop Contouring Techniques

Purpose: To determine whether volumes based on contours of the peritoneal space can be used instead of individual small bowel loops to predict for grade ≥3 acute small bowel toxicity in patients with rectal cancer treated with neoadjuvant chemoradiation therapy. Methods and Materials: A standardized contouring method was developed for the peritoneal space and retrospectively applied to the radiation treatment plans of 67 patients treated with neoadjuvant chemoradiation therapy for rectal cancer. Dose-volume histogram (DVH) data were extracted and analyzed against patient toxicity. Receiver operating characteristic analysis and logistic regression were carried out for both contouring methods. Results: Grade ≥3 small bowel toxicity occurred in 16% (11/67) of patients in the study. A highly significant dose-volume relationship between small bowel irradiation and acute small bowel toxicity was supported by the use of both small bowel loop and peritoneal space contouring techniques. Receiver operating characteristic analysis demonstrated that, for both contouring methods, the greatest sensitivity for predicting toxicity was associated with the volume receiving between 15 and 25 Gy. Conclusion: DVH analysis of peritoneal space volumes accurately predicts grade ≥3 small bowel toxicity in patients with rectal cancer receiving neoadjuvant chemoradiation therapy, suggesting that the contours of the peritoneal space provide a reasonable surrogate for the contours of individual small bowel loops. The study finds that a small bowel V15 less than 275 cc and a peritoneal space V15 less than 830 cc are associated with a less than 10% risk of grade ≥3 acute toxicity.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Continued Validation Studies using the MOOSE Framework for Plasma Simulation with Electromagnetics

Resources and tools for the modeling and simulation of low-temperature plasma (LTP) discharges are increasingly vital to progress in the field in order to properly characterize and study complex source designs and plasma chemistries beyond the scope of traditional diagnostics. Open-source software provides powerful platforms for this work and can enable community-driven LTP R&D. Within the Multiphysics Object-Oriented Simulation Environment (MOOSE) open-source framework [1], capabilities have been demonstrated in the areas of plasma fluids (Zapdos [2]), plasma chemistry (CRANE [3]), and general electromagnetic wave theory (Electromagnetic Library for Kinetics & fluids [ELK] [4]). ELK has since been coupled to Zapdos/CRANE to enable fully coupled electromagnetic plasma simulations. This talk will detail the continued validation efforts and discuss Zapdos-ELK-CRANE code coupling with various-low temperature plasma sources. The impact of fully coupled electromagnetics on process parameters (e.g., temperature and electron/ion energy) versus an electrostatic description will also be discussed. [1] Permann et al., SoftwareX, 11 (2020) 100430. [2] Lindsay et al., J. Phys. D: Appl. Phys. 49 (2016) 235204. [3] Keniley et al., Talk, GEC Session DT3.00002 (2019). [4] Icenhour et al., Talk, GEC Session RR1.00006 (2019). Acknowledgements: INL Graduate Fellowship Program, NSF SI2 Grant 1740300, U.S. Dept. of Energy Office of Science Graduate Student Research Program

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Validation Study of the Performance Prediction Methodology of the Early Warning Metrics

Complex projects frequently experience delays and develop backlogs of their project control milestones during the acquisition and development lifecycles. In response, the National Aeronautics and Space Administration (NASA) Goddard Space Flight Center (GSFC) formed an independent group of Subject Matter Experts (SMEs) to monitor the execution performance of GSFC Flight projects and instruments that are under development. The SME team’s objective is to generate data driven performance-based indicators that quantify the degree to which projects are meeting their respective schedule and budget commitments. One of these performance-based indicators, the Early Warning Metrics, provides performance forecasts and insight to project performance relative to historical successful projects. Herein this paper describes the purpose and utility of the Early Warning Metrics. Additionally, the initial prediction method used in the creation of the metrics is described along with its validity and the validity of comparable prediction methods.

Holloman, Sherrica↗

Development of a Common Research Model for Applied CFD Validation Studies

The development of a wing/body/nacelle/pylon/horizontal-tail configuration for a common research model is presented, with focus on the aerodynamic design of the wing. Here, a contemporary transonic supercritical wing design is developed with aerodynamic characteristics that are well behaved and of high performance for configurations with and without the nacelle/pylon group. The horizontal tail is robustly designed for dive Mach number conditions and is suitably sized for typical stability and control requirements. The fuselage is representative of a wide/body commercial transport aircraft; it includes a wing-body fairing, as well as a scrubbing seal for the horizontal tail. The nacelle is a single-cowl, high by-pass-ratio, flow-through design with an exit area sized to achieve a natural unforced mass-flow-ratio typical of commercial aircraft engines at cruise. The simplicity of this un-bifurcated nacelle geometry will facilitate grid generation efforts of subsequent CFD validation exercises. Detailed aerodynamic performance data has been generated for this model; however, this information is presented in such a manner as to not bias CFD predictions planned for the fourth AIAA CFD Drag Prediction Workshop, which incorporates this common research model into its blind test cases. The CFD results presented include wing pressure distributions with and without the nacelle/pylon, ML/D trend lines, and drag-divergence curves; the design point for the wing/body configuration is within 1% of its max-ML/D. Plans to test the common research model in the National Transonic Facility and the Ames 11-ft wind tunnels are also discussed.

Vassberg, John C.↗

Characterization of Highly Nonlinear and Anisotropic Vascular Tissues from Experimental Inflation Data: a Validation Study Towards the Use of Clinical Data for In-vivo Modeling and Analysis

A new ¯nite element (FE) modeling approach is proposed to model blood vessel by using data from blood vessel during in°ation instead of using data from biaxial test to estimate the tissue property. A particular constitutive equation is used to model the tissue property as a dispersed transverse isotropic hyperelastic material under both single-layer and multi-layer assumption for comparison. In order to compensate the drawback of using this type of data that does not provide su±cient information to estimate the tissue property in axial direction, the axial/circumferential elastic moduli ratio is being constrained in a typical range. The semi-global inverse method is applied with the pressure-diameter test data from porcine thoracic aorta to esti- mate the optimal tissue property. The simulated data of all cases is then compared with the biaxial test data. It is found that the single-layer model without the con- straint ¯ts well with the pressure-diameter test data but not with the biaxial test data at the axial direction, so it is suitable only for pressure-diameter analysis. The multi-layer model with the constraint ¯ts well with the pressure-diameter data and also the biaxial test data, so it is suitable to estimate the tissue property and for stress-strain analysis. The constitutive equation and the semi-global inverse method are found e±cient in this study. We believe that this new approach that uses this type of data, such as magnetic resonance imaging (MRI) data that could be ob- tained non-invasive in vivo, is time-e±cient and would be bene¯cial for pre-surgical analysis.

59 BASIC BIOLOGICAL SCIENCES↗

A Validation Study of Pin Heat Transfer for MOX Fuel Based on the IFA-597 Experiments

Abstract The IFA-597 (Integrated Fuel Assessment) experiments from the International Fuel Performance Experiments (IFPE) database were designed to study the thermal behavior of mixed oxide (MOX) fuel and the effects of an annulus on fission gas release in light-water-reactor fuel. An evaluation of nuclear fuel pin heat transfer in the FRAPCON-3.4 and Exnihilo codes for MOX fuel systems was performed, with a focus on the first 20 time steps ( 6 GWd/MT(iHM)) for explicit comparison between the codes. In addition, sensitivity studies were performed to evaluate the effect of the radial power shape and approximations to the geometry to account for the thermocouple hole, dish, and chamfer. The analysis demonstrated relative agreement for both solid (rod 1) and annular (rod 2) fuel in the experiment, demonstrating the accuracy of the codes and their underlying material models for MOX fuel, while also revealing a small energy loss artifact in how gap conductance is currently handled in Exnihilo for chamfered fuel pellets. The within-pellet power shape was shown to significantly impact the predicted centerline temperatures. This has provided an initial benchmarking of the pin heat transfer capability of Exnihilo for MOX fuel with respect to a well-validated nuclear fuel performance code.

Phillippe, Aaron M↗

SU-F-J-201: Validation Study of Proton Radiography Against CT Data for Quantitative Imaging of Anatomical Changes in Head and Neck Patients

Purpose: In clinical pencil-beam-scanned (PBS) proton therapy, the advantage of the characteristic sharp dose fall-off after the Bragg Peak (BP) becomes a disadvantage if the BP positions of a plan’s constituent pencil beams are shifted, eg.due to anatomical changes. Thus, for fractionated PBS proton therapy, accurate knowledge of the water equivalent path length (WEPL) of the traversed anatomy is critical. In this work we investigate the feasibility of using 2D proton range maps (proton radiography, PR) with the active-scanning gantry at PSI. Methods: We simulated our approach using Monte Carlo methods (MC) to simulate proton beam interactions in patients using clinical imaging data. We selected six head and neck cases having significant anatomical changes detected in per-treatment CTs.PRs (two at 0°/90°) were generated from MC simulations of low-dose pencil beams at 230MeV. Each beam’s residual depth-dose was propagated through the patient geometry (from CT) and detected on exiting the patient anatomy in an ideal depth-resolved detector (eg. range telescope). Firstly, to validate the technique, proton radiographs were compared to the ground truth, which was the WEPL from ray-tracing in the patient CT at the pencil beam location. Secondly, WEPL difference maps (per-treatment – planning imaging timepoints) were then generated to locate the anatomical changes, both in the CT (ground truth) and in the PRs. Binomial classification was performed to evaluate the efficacy of the technique relative to CT. Results: Over the projections simulated over all six patients, 70%, 79% and 95% of the grid points agreed with the ground truth proton range to within ±0.5%, ±1%, and ±3% respectively. The sensitivity, specificity, precision and accuracy were high (mean±1σ, 83±8%, 87±13%, 95±10%, 83±7% respectively). Conclusion: We show that proton-based radiographic images can accurately monitor patient positioning and in vivo range verification, while providing equivalent WEPL information to a CT scan, with the advantage of a much lower imaging dose.

60 APPLIED LIFE SCIENCES↗

A Validation Study of Pin Heat Transfer for UO2 Fuel Based on the IFA-432 Experiments

The IFA-432 (Integrated Fuel Assessment) experiments from the International Fuel Performance Experiments (IFPE) database were designed to study the effects of gap size, fuel density, and fuel densification on fuel centerline temperature in light-water-reactor fuel. An evaluation of nuclear fuel pin heat transfer in the FRAPCON-3.4 and Exnihilo codes for uranium dioxide (UO$_2$) fuel systems was performed, with a focus on the densification stage (2.2 \unitfrac{GWd}{MT(UO$_{2}$)}). In addition, sensitivity studies were performed to evaluate the effect of the radial power shape and approximations to the geometry to account for the thermocouple hole. The analysis demonstrated excellent agreement for rods 1, 2, 3, and 5 (varying gap thicknesses and density with traditional fuel), demonstrating the accuracy of the codes and their underlying material models for traditional fuel. For rod 6, which contained unstable fuel that densified an order of magnitude more than traditional, stable fuel, the magnitude of densification was over-predicted and the temperatures were outside of the experimental uncertainty. The radial power shape within the fuel was shown to significantly impact the predicted centerline temperatures, whereas modeling the fuel at the thermocouple location as either annular or solid was relatively negligible. This has provided an initial benchmarking of the pin heat transfer capability of Exnihilo for UO$_2$ fuel with respect to a well-validated nuclear fuel performance code.

Phillippe, Aaron M↗