SEARCH · Search NASA

Results for “Qualitative and Quantitative verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

29 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Southwest Regional Partnership on Carbon Sequestration: Phase III (Final Scientific/Technical Report)

The Southwest Regional Partnership on Carbon Sequestration (SWP) is one of 7 regional partnerships formed in 2003 under the U.S. Department of Energy’s (DOE) Regional Carbon Sequestration Partnerships (RCSPs) initiative. The overall purpose of the initiative was to help determine and implement the technology, infrastructure, and regulations most appropriate to promote carbon storage in different regions of the country. Covering Arizona, Colorado, New Mexico, Oklahoma, Utah, and parts of Texas, Wyoming, and Kansas, the SWP evaluated regional carbon storage and utilization potential and focused on technologies and sites that could complement the region’s strong position in energy production. The project progressed through three phases: • Phase I (2003–2005): Characterized regional geologic formations and CO 2 sources, assessed sequestration potential, and identified pilot test sites. • Phase II (2005–2013): Conducted small-scale field tests to validate sequestration methods, including geologic and terrestrial projects. • Phase III (2008–2022): Demonstrated large-scale CO 2 injection at a commercial oil field to test monitoring, verification, and long-term storage strategies. This report covers Phase III. The final project site, the Farnsworth Unit (FWU) in Texas, provided real-world testing of reservoir characterization, monitoring, and risk evaluation tools and processes that could be used in any commercial scale carbon capture, utilization, and storage (CCUS) project. Extensive data collection and analysis helped refine best practices for reservoir characterization, injection monitoring, and storage verification. The SWP contributed to national databases, DOE best practice manuals, and regional geological assessments to support future sequestration efforts. Key lessons learned include the importance of robust data management, strategic site selection, regulatory navigation, and effective industry collaboration. The project’s findings will inform ongoing and future carbon storage initiatives. Task 1 (Regional Characterization) • The SWP continued to participate in national outreach efforts and NATCARB. • The SWP evaluated multiple potential sites before selecting the FWU as the primary field test location. Task 2 (Public Outreach and Education) • The SWP contributed to national databases, DOE best practice manuals, and regional geological assessments to support future sequestration efforts. Task 3 (Permitting and Regulatory Compliance) • The SWP ensured compliance with federal and state regulations, including National Environmental Policy Act (NEPA) requirements. • The SWP obtained all necessary permits for drilling, injection, and monitoring activities. Task 4 (Site Characterization and Planning) • The SWP developed work plans for four key activities: characterization, simulation, monitoring and verification, and risk evaluation. • The SWP collected and synthesized legacy data from multiple sources to build initial static geological models and dynamic reservoir models demonstrating project feasibility. • The SWP conducted an initial risk evaluation and developed mitigation plans. Task 5 (Field Operations and Data Collection) • The SWP drilled, logged, and cored three characterization wells to gather critical subsurface data. • The SWP conducted multiple geophysical surveys, including 3D seismic, crosswell seismic, and vertical seismic profiling, to improve reservoir characterization. Task 6 (Monitoring and Verification) • The SWP performed extensive geological characterization using data from characterization wells and seismic surveys. • The SWP established a surface monitoring network to track CO 2 flux in soil gas, groundwater chemistry, and near-surface atmospheric CO 2 levels. • The SWP built and refined reservoir models to study the effects of relative permeability on simulation behavior and improve calibration with experimental data. Task 7 (Risk Assessment and Model Refinement) • The SWP conducted multiple studies to evaluate reservoir integrity, predict CO 2 plume behavior and improve predictive modeling capabilities. • The SWP refined geological models and used them to enhance the accuracy of simulation models. • The SWP continued quantitative risk assessment of top-ranked risks and strengthened the link between qualitative and quantitative risk methodologies.

02 PETROLEUM↗

DOE OSTI2023

Investigation of thermal hydraulic behavior of the High Temperature Test Facility's lower plenum via large eddy simulation

A high-fidelity computational fluid dynamics (CFD) analysis was performed using the Large Eddy Simulation (LES) model for the lower plenum of the High–Temperature Test Facility (HTTF), a ¼ scale test facility of the modular high temperature gas-cooled reactor (MHTGR) managed by Oregon State University. In most next–generation nuclear reactors, thermal stress due to thermal striping is one of the risks to be curiously considered. This is also true for HTGRs, especially since the exhaust helium gas temperature is high. In order to evaluate these risks and performance, organizations in the United States led by the OECD NEA are conducting a thermal hydraulic code benchmark for HTGR, and the test facility used for this benchmark is HTTF. HTTF can perform experiments in both normal and accident situations and provide high-quality experimental data. However, it is difficult to provide sufficient data for benchmarking through experiments, and there is a problem with the reliability of CFD analysis results based on Reynolds–averaged Navier–Stokes to analyze thermal hydraulic behavior without verification. To solve this problem, high-fidelity 3-D CFD analysis was performed using the LES model for HTTF. It was also verified that the LES model can properly simulate this jet mixing phenomenon via a unit cell test that provides experimental information. As a result of CFD analysis, the lower the dependency of the sub-grid scale model, the closer to the actual analysis result. In the case of unit cell test CFD analysis and HTTF CFD analysis, the volume-averaged sub-grid scale model dependency was calculated to be 13.0% and 9.16%, respectively. As a result of HTTF analysis, quantitative data of the fluid inside the HTTF lower plenum was provided in this paper. As a result of qualitative analysis, the temperature was highest at the center of the lower plenum, while the temperature fluctuation was highest near the edge of the lower plenum wall. The power spectral density of temperature was analyzed via fast Fourier transform (FFT) for specific points on the center and side of the lower plenum. FFT results did not reveal specific frequency-dominant temperature fluctuations in the center part. It was confirmed that the temperature power spectral density (PSD) at the top increased from the center to the wake. The vortex was visualized using the well-known scalar Q-criterion, and as a result, the closer to the outlet duct, the greater the influence of the mainstream, so that the inflow jet vortex was dissipated and mixed at the top of the lower plenum. Additionally, FFT analysis was performed on the support structure near the corner of the lower plenum with large temperature fluctuations, and as a result, it was confirmed that the temperature fluctuation of the flow did not have a significant effect near the corner wall. In addition, the vortices generated from the lower plenum to the outlet duct were identified in this paper. It is considered that the quantitative and qualitative results presented in this paper will serve as reference data for the benchmark.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2016

Functional Fault Model Development Process to Support Design Analysis and Operational Assessment

A functional fault model (FFM) is an abstract representation of the failure space of a given system. As such, it simulates the propagation of failure effects along paths between the origin of the system failure modes and points within the system capable of observing the failure effects. As a result, FFMs may be used to diagnose the presence of failures in the modeled system. FFMs necessarily contain a significant amount of information about the design, operations, and failure modes and effects. One of the important benefits of FFMs is that they may be qualitative, rather than quantitative and, as a result, may be implemented early in the design process when there is more potential to positively impact the system design. FFMs may therefore be developed and matured throughout the monitored system's design process and may subsequently be used to provide real-time diagnostic assessments that support system operations. This paper provides an overview of a generalized NASA process that is being used to develop and apply FFMs. FFM technology has been evolving for more than 25 years. The FFM development process presented in this paper was refined during NASA's Ares I, Space Launch System, and Ground Systems Development and Operations programs (i.e., from about 2007 to the present). Process refinement took place as new modeling, analysis, and verification tools were created to enhance FFM capabilities. In this paper, standard elements of a model development process (i.e., knowledge acquisition, conceptual design, implementation & verification, and application) are described within the context of FFMs. Further, newer tools and analytical capabilities that may benefit the broader systems engineering process are identified and briefly described. The discussion is intended as a high-level guide for future FFM modelers.

Verification↗

NASA NTRS1996

Fluid Dynamic Verification Experiments on STS-70

Fluid dynamic experiments were flown on STS-70 as phase two of the engineering evaluation of the first bioreactor Engineering Development Unit (EDU#1). The phase one experiments were comparative cell cultures in identical units on earth and onboard STS-70. In phase two, two types of fluid dynamic experiments were performed. Qualitative comparisons of the basic flow patterns were evaluated with the use of 'dye' streaklines formed from alternate injections of either a mild acid or base solution into the external flow loop that was then perfused into the vessel. The presence of Bromothymol Blue in the fluid then caused color changes from yellow to blue or vice versa, indicating the basic fluid motions. This reversible change could be repeated as desired. In the absence of significant density differences in the fluid, the flow patterns in space should be the same as on earth. Video tape records of the flow patterns for a wide range of operating conditions were obtained. The second type of fluid dynamic experiment was the quantitative evaluation of the trajectories of solid beads of various densities and sizes. The beads were introduced into the vessel and the paths recorded on video tape, with the vessel operated at various rotation rates and flow perfusion rates. Because of space limitations, the video camera was placed as close as possible to the vessel, resulting in significant optical distortion. This report describes the analysis methods to obtain comparisons between the in-flight fluid dynamics and numerical models of the flow field. The methods include optical corrections to the video images and calculation of the bead trajectories for given operating conditions and initial bead locations.

Kleis, Stanley J.↗

DOE OSTI2023

Magnification Determination for AGHCF Metallographic Images

Metallographic images generated in the Alpha Gamma Hot Cell Facility (AGHCF) have been used for quantitative and qualitative characterization of irradiated metallic fuel pins. Individual high-magnification images (micrographs) contained in AGHCF file folders and experimental notebooks are in the form of polaroid photographs labeled with AGHCF identification number, magnification, and surface condition (as-polished or etched). Low magnification composite images (photomosaics) are also available for fuel cross sections, for radial strips from the fuel center to the cladding outer diameter, and for circumferential strips of the cladding and outer fuel region. The individual images do not have scale bars. Only a few of the composite images contain scale bars. The purpose of this work is to describe and apply methods for checking the magnification (50X to 500X) of individual images and for determining the magnification (~25X to ~100X) of composite images. The metallographic images used to verify and/or determine magnification were generated during the 1989 to 1993 timeframe for cross sections of U-10Zr/HT9 fuel rods irradiated in EBR-II and for cross sections of irradiated U-10Zr/HT9 fuel-rod samples following elevated-temperature tests conducted in the out-of-pile AGHCF Fuel Behavior Test Apparatus (FBTA). Procedures are documented in the AGHCF Operations Manual for preparation of metallographic samples, for calibration verification, and for constructing composites from individual images. Calibration verification of magnification was performed at least semiannually. One standard used for calibration verification was a glass slide with vertical lines indicating distances of 1 mm, 0.1 mm and 0.01mm. Guidance is provided in the current work for determining magnification from images of the standard. In addition to the periodic calibration verification, consistency checks are recommended to verify the magnification of images taken between the routine calibration verifications. For cladding samples with or without significant fuel-cladding chemical interaction (FCCI), images taken at different magnifications (e.g., 150X and 200X) of the unaffected cladding thickness can be compared. This process is independent of changes in cladding thickness due to swelling and creep. For images taken at only one magnification of cladding regions with no FCCI, the cladding thickness determined from the images may be compared to the nominal as-built cladding thickness (15.0 ± 0.5 mils for examples used in current work)). This procedure works best for cladding that has not experienced significant swelling and/or creep (e.g., ≤2% circumferential strain at the cladding outer surface). Composite images were constructed by pasting together higher magnification images and photographing the composite to generate a negative from which the hard-copy photograph was developed. The primary purpose of the composite images was to identify interesting areas of the fuel and cladding for imaging at higher magnification. However, procedures are recommended in the current work for determining composite magnifications to allow quantitative characterization of the fuel. Composites are not recommended for determining cladding thickness or FCCI depth because magnifications are too low (generally ≤110X) and image contrast is low. Fuel cross-section composites were created by pasting together 50X or 75X images. The nominal magnification for the photographed fuel cross-section composites is 25.4X. A more precise magnification can be determined by comparing the average cladding outer diameter measured from the composite to the average cladding outer diameter measured by profilometry. Radial-strip composites were constructed by pasting together high-magnification (150X or 250X) images. The nominal magnification of radial-strip composites photographs is about 100X. A more precise method for determining the magnification of radial strips is to compare the cladding thick

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2022

CTF Validation and Verification: Version 4.3

Coolant-Boiling in Rod Arrays- Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for light water reactor (LWR) analysis. It uses a two-fluid, three-field (i.e., fluid film, fluid drops, and vapor) modeling approach. Both subchannel and 3D Cartesian forms of nine conservation equations are available for LWR modeling. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last several decades. COBRA-TF is also used at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently became the CTF. One part of the improvement process includes validating the methods in CTF. This document seeks to provide a certain level of certainty and confidence in the predictive capabilities of the code for the scenarios it was designed to model—rod bundle geometries with operating conditions that are representative of prototypical pressurized water reactor (PWR)s and boiling water reactor (BWR)s in both normal and accident conditions. This is done by modeling a variety of experiments that simulate these scenarios and then presenting a qualitative and quantitative analysis of the results that demonstrates the accuracy to which CTF is capable of capturing specific quantities of interest.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

CTF Validation and Verification: Version 4.4

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2020

CTF Validation and Verification (V.4.2)

Coolant-Boiling in Rod Arrays- Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for Light Water Reactor (LWR) analysis. It uses a two-fluid, three-field (i.e. fluid film, fluid drops, and vapor) modeling approach. Both sub-channel and 3D Cartesian forms of nine conservation equations are available for LWR modeling. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last several decades. COBRA-TF is also used at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently became the PSU RDFMG version of COBRA-TF (CTF). One part of the improvement process includes validating the methods in CTF. This document seeks to provide a certain level of certainty and confidence in the predictive capabilities of the code for the scenarios it was designed to model-rod bundle geometries with operating conditions that are representative of prototypical Pressurized Water Reactor (PWR)s and Boiling Water Reactor (BWR)s in both normal and accident conditions. This is done by modeling a variety of experiments that simulate these scenarios and then presenting a qualitative and quantitative analysis of the results that demonstrates the accuracy to which CTF is capable of capturing specific quantities of interest.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

NASA NTRS2018

Overview of the Exploration Exercise Device Validation Study Plans

The NASA has determined that a multi-functional exercise device will be developed for use as an exercise device during exploration missions. The device will allow for full body resistance and metabolic exercise necessary to minimize physiological losses during space flight and to maintain fitness necessary to perform critical mission tasks. Prior to implementation as an exercise device on an Exploration vehicle, there will be verification and validation testing completed to determine device efficacy at providing the necessary training stimuli to achieve desired goals. Because the exploration device will be new device that has yet be specified, specific Verification and Validation (V&V) protocols have yet to be developed. Upon delivery of an exploration exercise device training unit, stakeholders throughout NASA will develop V&V plans that include ground-based testing and testing on the International Space Station (ISS). Stakeholders will develop test protocols that include success criterion for the device. Ground tests will occur at NASA Johnson Space Station prior to flight testing. The intents of the ground tests are to allow crew, spaceflight medicine, science, engineering, Astronaut Strength, Conditioning, and Reconditioning staff, and others to gain experience in the best utilization of the device. The goal is to obtain an evidence base for recommending use of the device on the ISS. The developed protocol will be created to achieve multiple objectives, including determining if the device provides an adequate training stimulus for 5th - 95th percentile males and females, allows for exercise modalities that protect functional capability, and is robust and can withstand extensive human use. Although protocols are yet to be determined, current expectations include use of the device by test subjects and current crew in order to obtain quantitative and qualitative feedback. Information obtained during the ground tests may be used to influence device modifications during design iterations. Assuming successful ground tests, the device will be installed on the ISS for testing during space flight. Spaceflight testing is envisioned to include an activation and checkout (ACO) phase and a V&V phase. During the ACO phase, 1-2 crewmembers will exercise with the device to ensure proper function. ACO is expected to last multiple months because of the many modes and methods of exercise that need to be assessed. However, the goal is to complete the ACO as quickly as possible. Once successful ACO occurs, the crew will be free to use the device for normal exercise pending concurrence from stakeholders. V&V tests on the ISS will ideally consist of crew using the device for all of their exercise for an entire mission. Exercise prescriptions will be supplied that replicate expected prescriptions during exploration missions. Crew that are not enrolled in the V&V studies would be also free to use the device as their schedule permits. As experience is gained by users, exercise protocols could change. The intent of all V&V testing is to ensure that all have thorough understanding of experience at optimizing device capability

DeWitt, J. K.↗

DOE OSTI2025

Simulation Center for Runaway Electron Avoidance and Mitigation (SCREAM SciDAC) (Technical Final Report)

Runaway electrons can severely damage the plasma facing components on ITER during a major disruption and pose a major risk for tokamak fusion. It has been recognized that an adequate disruption mitigation system (DMS) is essential for the safe operation of ITER. The United States is responsible for the design and implementation of the disruption mitigation system on ITER, and in July 2016 the Simulation Center for Runaway Electron Avoidance and Mitigation (SCREAM) was launched by DOE, in a joint Fusion Energy Sciences (FES) and Advanced Scientific Computing Research (ASCR) collaboration. SCREAM was a comprehensive theory and simulation SciDAC center that provided physics guidance in the avoidance and mitigation of runaway electrons, and in tandem with domestic and international experiments, helped establish the qualitative and quantitative bases for safe operational scenarios and viable mitigation techniques. The SCREAM center assembled a national team of experts in runaway electron physics, tokamak disruptions, magnetohydrodynamic (MHD) simulation, and advanced algorithms and computing. The team combined advanced simulation and analysis capability facilitated by direct participation of ASCR SciDAC institutes with theoretical models and code development by FES scientists to focus on the runaway risk for ITER and tokamaks in general. The research scope was focussed on integrated simulations of kinetic runaway electrons, including MHD and fluid models of impurity transport, within a research plan guided by theory. The specific research tasks were (1) establish the fundamental physics of runaway generation, saturation, and dynamical evolution in a tokamak; (2) examine the critical path toward runaway avoidance; and (3) investigate the viability and effectiveness of the leading candidate schemes for runaway mitigation. In all three areas, members of the team carried out scoping studies that established the readiness for rapid and critical advances, especially in the deployment and further development of large-to extreme-scale simulation tools. Our multi-pronged computational approach included (1) relativistic Fokker-Planck solvers with discretization in phase space, (2) self-consistent particle-in-cell techniques, (3) particle-based Monte-Carlo, and (4) MHD-particle hybrid simulations. Cross-check between these different methods provided an additional means for verification and further bolstered the fidelity of our physics prediction. Validation against experimental results brings confidence to the predictive capability for ITER and frequently leads to new ideas for understanding and mitigating the thermal quench driven runaway electron phenomenon.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2003

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

To achieve its science objectives in deep space exploration, NASA has a need for science platform vehicles to autonomously make control decisions in a time frame that excludes intervention from Earth-based controllers. Round-trip light-time is one significant factor motivating autonomy capability, another factor is the need to reduce ground support operations cost. An unsolved problem potentially impeding the adoption of autonomy capability is the verification and validation of such software systems, which exhibit far more behaviors (and hence distinct execution paths in the software) than is typical in current deepspace platforms. Hence the need for a study to benchmark advanced Verification and Validation (V&V) tools on representative autonomy software. The objective of the study was to access the maturity of different technologies, to provide data indicative of potential synergies between them, and to identify gaps in the technologies with respect to the challenge of autonomy V&V. The study consisted of two parts: first, a set of relatively independent case studies of different tools on the same autonomy code, second a carefully controlled experiment with human participants on a subset of these technologies. This paper describes the second part of the study. Overall, nearly four hundred hours of data on human use of three different advanced V&V tools were accumulated, with a control group that used conventional testing methods. The experiment simulated four independent V&V teams debugging three successive versions of an executive controller for a Martian Rover. Defects were carefully seeded into the three versions based on a profile of defects from CVS logs that occurred in the actual development of the executive controller. The rest of the document is structured a s follows. In section 2 and 3, we respectively describe the tools used in the study and the rover software that was analyzed. In section 4 the methodology for the experiment is described; this includes the code preparation, seeding of defects, participant training and experimental setup. Next we give a qualitative overview of how the experiment went from the point of view of each technology; model checking (section 5), static analysis (section 6), runtime analysis (section 7) and testing (section 8). The find section gives some preliminary quantitative results on how the tools compared.

Brat, Guillaume↗