Results for “EXPERIMENTAL VERIFICATION” — Page 27

NASA NTRS2003

Experimental Evaluation of Verification and Validation Tools on Martian Rover Software

To achieve its science objectives in deep space exploration, NASA has a need for science platform vehicles to autonomously make control decisions in a time frame that excludes intervention from Earth-based controllers. Round-trip light-time is one significant factor motivating autonomy capability, another factor is the need to reduce ground support operations cost. An unsolved problem potentially impeding the adoption of autonomy capability is the verification and validation of such software systems, which exhibit far more behaviors (and hence distinct execution paths in the software) than is typical in current deepspace platforms. Hence the need for a study to benchmark advanced Verification and Validation (V&V) tools on representative autonomy software. The objective of the study was to access the maturity of different technologies, to provide data indicative of potential synergies between them, and to identify gaps in the technologies with respect to the challenge of autonomy V&V. The study consisted of two parts: first, a set of relatively independent case studies of different tools on the same autonomy code, second a carefully controlled experiment with human participants on a subset of these technologies. This paper describes the second part of the study. Overall, nearly four hundred hours of data on human use of three different advanced V&V tools were accumulated, with a control group that used conventional testing methods. The experiment simulated four independent V&V teams debugging three successive versions of an executive controller for a Martian Rover. Defects were carefully seeded into the three versions based on a profile of defects from CVS logs that occurred in the actual development of the executive controller. The rest of the document is structured a s follows. In section 2 and 3, we respectively describe the tools used in the study and the rover software that was analyzed. In section 4 the methodology for the experiment is described; this includes the code preparation, seeding of defects, participant training and experimental setup. Next we give a qualitative overview of how the experiment went from the point of view of each technology; model checking (section 5), static analysis (section 6), runtime analysis (section 7) and testing (section 8). The find section gives some preliminary quantitative results on how the tools compared.

Brat, Guillaume↗

DOE OSTI2024

EXPERIMENTAL AND ANALYTICAL VERIFICATION OF ASME SECTION III, DIVISION 5 CREEP-FATIGUE DESIGN RULES

Explore the source record for details and available documents.

Wang, Yanli↗

DOE OSTI2024

Experimental and Analytical Verification of ASME Section IiII Division 5 Creep-Fatigue Design Rules

The continuous advancement of structural materials and the growing demands for more reliable and economical structural components in high-temperature reactor applications have necessitated the development of comprehensive design methodologies and design rules. Mechanical degradation of structural components at elevated temperatures subjected to cyclic deformation is controlled by the creep-fatigue damage. Over the past few decades, diligent research efforts have been dedicated to refining the development of elevated temperature design rules in the American Society of Mechanical Engineers (ASME) Boiler and Pressure Vessel Code (BPVC), Section III, Division 5 and to develop conservative design rules that can effectively guard against the risk of creep-fatigue failure. In ASME Section III, Division 5, for a design to pass the creep-fatigue acceptance criteria, creep damage and fatigue damage are evaluated separately, and these damages must not violate the bi-linear creep-fatigue interaction diagram, i.e., the so-called D-diagram. The creep-fatigue damage evaluation procedure assumes that the effects of the actual cyclic loading sequence can be bounded by assuming that the individual loading cycles are uniformly distributed throughout the component design life. In this study, creep-fatigue experiments with variable amplitudes and loading sequencies were designed and performed on Alloy 617 at high temperatures. The results were analyzed to evaluate the loading history effect on creep-fatigue damage accumulation and to verify the assumptions for the creep-fatigue evaluation design rules.

36 - MATERIALS SCIENCE↗

DOE OSTI2024

L4-3 Developing DOE M441.1-1 Compliant Container Components: Filter Cup Experimental Fixture Test Data Verification

This document serves to provide technical documentation and justification for using the Filter Cup Experimental Fixture (FCEP) for filter efficiency and pressure drop testing in the Enhanced Filter Test System (EFTS). This document assumes that the reader has prior knowledge related to both of these systems, as well as the SAVY-4000® nuclear material container series filter technology.

42 ENGINEERING↗

DOE OSTI2022

Divertorlets concept for low-recycling fusion reactor divertor: experimental, analytical and numerical verification

The 'divertorlets' concept is a potential non-evaporative liquid metal solution for heat removal at low recycling regime. A toroidal divertorlets prototype was built and tested in LMX-U at Princeton Plasma Physics Laboratory to evaluate the performance of this configuration. Here, details of the design, experimental results, comparison with analytical theory and MHD numerical simulations of toroidal divertorlets are covered. Experiments, analytical model and simulations showed agreement and allowed the projection of operation properties at higher magnetic flux densities (reactor-like operation), proving the concept to be a compelling solution for divertor applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2016

Experimenting Galileo on Board the International Space Station

The SCaN Testbed is an advanced integrated communications system and laboratory facility installed on the International Space Station (ISS) in 2012. The testbed incorporates a set of new generation of Software Defined Radio (SDR) technologies intended to allow researchers to develop, test, and demonstrate new communications, networking, and navigation capabilities in the actual environment of space. Qascom, in cooperation with ESA and NASA, is designing a Software Defined Radio GalileoGPS Receiver capable to provide accurate positioning and timing to be installed on the ISS SCaN Testbed. The GalileoGPS waveform will be operated in the JPL SDR that is constituted by several hardware components that can be used for experimentations in L-Band and S-Band. The JPL SDR includes an L-Band Dorne Margolin antenna mounted onto a choke ring. The antenna is connected to a radio front end capable to provide one bit samples for the three GNSS frequencies (L1, L2 and L5) at 38 MHz, exploiting the subharmonic sampling. The baseband processing is then performed by an ATMEL AT697 processor (100 MIPS) and two Virtex 2 FPGAs. The JPL SDR supports the STRS (Space Telecommunications Radio System) that provides common waveform software interfaces, methods of instantiation, operation, and testing among different compliant hardware and software products. The standard foresees the development of applications that are modular, portable, reconfigurable, and reusable. The developed waveform uses the STRS infrastructure-provided application program interfaces (APIs) and services to load, verify, execute, change parameters, terminate, or unload an application. The project is divided in three main phases. 1)Design and Development of the GalileoGPS waveform for the SCaN Testbed starting from Qascom existing GNSS SDR receiver. The baseline design is limited to the implementation of the single frequency Galileo and GPS L1E1 receiver even if as part of the activity it will be to assess the feasibility of a dual frequency implementation (L1E1+L5E5a) in the same SDR platform.2)Qualification and test the GalileoGPS waveform using ground systems available at the NASA Glenn Research Center. Experimenters can have access to two SCaN Testbed ground based systems for development and verification: the Experimenter Development System (EDS) that is intended to provide initial opportunity for software testing and basic functional validation and the Ground Integration Unit (GIU) that is a high fidelity version of the SCaN Testbed flight system and is therefore used for more controlled final development testing and verification testing.3)Perform in-orbit validation and experimentation: The experimentation phase will consists on the collection of raw measurements (pseudorange, Carrier phase, CN0) in space, assessment on the quality of the measurements and the receiver performances in terms of signal acquisition, tracking, etc. Finally computation of positioning in space (Position, Velocity and time) and assessment of its performance.(Complete abstract in attached document).

GPS↗

NASA NTRS2016

Experimenting Galileo on Board the International Space Station

The SCaN Testbed is an advanced integrated communications system and laboratory facility installed on the International Space Station (ISS) in 2012. The testbed incorporates a set of new generation of Software Defined Radio (SDR) technologies intended to allow researchers to develop, test, and demonstrate new communications, networking, and navigation capabilities in the actual environment of space. Qascom, in cooperation with ESA and NASA, is designing a Software Defined Radio GalileoGPS Receiver capable to provide accurate positioning and timing to be installed on the ISS SCaN Testbed. The GalileoGPS waveform will be operated in the JPL SDR that is constituted by several hardware components that can be used for experimentations in L-Band and S-Band. The JPL SDR includes an L-Band Dorne Margolin antenna mounted onto a choke ring. The antenna is connected to a radio front end capable to provide one bit samples for the three GNSS frequencies (L1, L2 and L5) at 38 MHz, exploiting the subharmonic sampling. The baseband processing is then performed by an ATMEL AT697 processor (100 MIPS) and two Virtex 2 FPGAs. The JPL SDR supports the STRS (Space Telecommunications Radio System) that provides common waveform software interfaces, methods of instantiation, operation, and testing among different compliant hardware and software products. The standard foresees the development of applications that are modular, portable, reconfigurable, and reusable. The developed waveform uses the STRS infrastructure-provided application program interfaces (APIs) and services to load, verify, execute, change parameters, terminate, or unload an application. The project is divided in three main phases. 1)Design and Development of the GalileoGPS waveform for the SCaN Testbed starting from Qascom existing GNSS SDR receiver. The baseline design is limited to the implementation of the single frequency Galileo and GPS L1E1 receiver even if as part of the activity it will be to assess the feasibility of a dual frequency implementation (L1E1+L5E5a) in the same SDR platform.2)Qualification and test the GalileoGPS waveform using ground systems available at the NASA Glenn Research Center. Experimenters can have access to two SCaN Testbed ground based systems for development and verification: the Experimenter Development System (EDS) that is intended to provide initial opportunity for software testing and basic functional validation and the Ground Integration Unit (GIU) that is a high fidelity version of the SCaN Testbed flight system and is therefore used for more controlled final development testing and verification testing.3)Perform in-orbit validation and experimentation: The experimentation phase will consists on the collection of raw measurements (pseudorange, Carrier phase, CN0) in space, assessment on the quality of the measurements and the receiver performances in terms of signal acquisition, tracking, etc. Finally computation of positioning in space (Position, Velocity and time) and assessment of its performance.(Complete abstract in attached document).

Galileo↗

DOE OSTI2021

Practical verification protocols for analog quantum simulators

Abstract Analog quantum simulation is expected to be a significant application of near-term quantum devices. Verification of these devices without comparison to known simulation results will be an important task as the system size grows beyond the regime that can be simulated classically. We introduce a set of experimentally-motivated verification protocols for analog quantum simulators, discussing their sensitivity to a variety of error sources and their scalability to larger system sizes. We demonstrate these protocols experimentally using a two-qubit trapped-ion analog quantum simulator and numerically using models of up to five qubits.

Physics↗

DOE OSTI2022

Development, verification, and validation of comprehensive acoustic fluid-structure interaction capabilities in an open-source computational platform

The acoustic fluid-structure interaction (FSI) formulation is a practical numerical approach for the seismic analysis of fluid-filled tanks. However, there are no verification and validation studies reported in the literature that demonstrate the ability of an acoustic FSI numerical model to predict responses important to structural and mechanical design for intense translational and rotational earthquake inputs. Herein, an acoustic FSI formulation is implemented in the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE), and is formally verified and validated using analytical solutions and code-to-code verification, and experimental data, respectively. The analytical solutions are for small amplitude, unidirectional seismic inputs. The code-to-code verification utilizes a previously verified and validated Arbitrary Lagrangian-Eulerian (ALE) numerical model in the commercial finite element code LS-DYNA. The validation studies utilize a comprehensive data set assembled from results of 3D earthquake-simulator tests of a fluid-filled vessel. The acoustic numerical model in MOOSE is verified and validated for hydrodynamic pressures and support reactions except for cases that involve significant convective response. For small amplitude inputs, numerically predicted wave heights match those of the analytical solutions. The numerical model is not verified and validated for wave height calculations under intense 3D seismic inputs. The run times for the acoustic FSI simulations in MOOSE are an order of magnitude, or more, shorter than for the corresponding ALE simulations in LS-DYNA. The utility of the MOOSE acoustic FSI implementation is demonstrated by seismic analysis of a building equipped with a fluid-filled, advanced nuclear reactor.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS2018

Methodologies for Verification and Validation of Space Launch System (SLS) Structural Dynamic Models

Responses to challenges associated with verification and validation (V&V) of Space Launch System (SLS) structural dynamics models are presented in this paper. Four methodologies addressing specific requirements for V&V are discussed. (1) Residual Mode Augmentation (RMA), which has gained acceptance by various principals in the NASA community, defines efficient and accurate FEM modal sensitivity models that are useful in test-analysis correlation and reconciliation and parametric uncertainty studies. (2) Modified Guyan Reduction (MGR) and Harmonic Reduction (HR, introduced in 1976), developed to remedy difficulties encountered with the widely used Classical Guyan Reduction (CGR) method, are presented. MGR and HR are particularly relevant for estimation of "body dominant" target modes of shell-type SLS assemblies that have numerous "body", "breathing" and local component constituents. Realities associated with configuration features and "imperfections" cause "body" and "breathing" mode characteristics to mix resulting in a lack of clarity in the understanding and correlation of FEM- and test-derived modal data. (3) Mode Consolidation (MC) is a newly introduced procedure designed to effectively "de-feature" FEM and experimental modes of detailed structural shell assemblies for unambiguous estimation of "body" dominant target modes. Finally, (4) Experimental Mode Verification (EMV) is a procedure that addresses ambiguities associated with experimental modal analysis of complex structural systems. Specifically, EMV directly separates well-defined modal data from spurious and poorly excited modal data employing newly introduced graphical and coherence metrics.

Coppolino, Robert N.↗

DOE OSTI2025

Validation and demonstration of the AEFC as a practical safeguards tool for inventory verification

The Advanced Experimental Fuel Counter (AEFC) is a nondestructive assay (NDA) instrument designed to determine the residual fissile mass in irradiated fuel assemblies for safeguards verification purposes. This is done by actively interrogating an assembly with a neutron source and measuring the total (Singles) and correlated (Doubles) neutron count rates resulting from induced fissions in the irradiated nuclear fuel and relating those rates to the residual fissile mass using calibration curves. Comprehensive NDA measurements of the irradiated fuel inventory at Israeli Research Reactor 1 (IRR-1) were taken with the AEFC to validate a set of previously developed calibration curves. During the campaign, measurements were acquired of 32 standard fuel assemblies and three control assemblies in just nine days. This is a significant majority of the research reactor's irradiated fuel inventory and the largest data set gathered by the AEFC to date. Many of the fuel assemblies measured during the campaign had much shorter cooling times than those assemblies previously measured with the instrument. Calibration curves developed from previous AEFC deployments were used to determine the residual 235 U mass in the measured standard fuel assemblies. The results of the campaign demonstrated that the AEFC can be used to estimate the 235 U mass remaining in a large number of irradiated fuel assemblies with 1%–5% uncertainty in a reasonable amount of time despite operating in a high dose environment.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

NASA NTRS2026

Development and Experimental Validation of a Path-Dependent Spin Forming Finite Element Model

Spin forming is an advanced manufacturing process widely used in the aerospace and defense sectors to produce lightweight, high-strength cylindrical components with tight dimensional tolerances. This study explores the applicability of the path-dependent Mechanical Threshold Stress (MTS) constitutive model by simulating the evolution of geometry, machining forces, and plastic deformation during the spin forming of a 10-mm thick 6061-O aluminum cylinder. While numerical modeling of spin forming has advanced substantially over the past decade, systematic verification and experimental validation of material models remain limited, particularly in predicting through-thickness process evolution. The MTS model, incorporating a Voce hardening rule, is employed for its ability to represent cyclic loading, rapidly varying temperature fields, and strain rates characteristic of spin forming. Numerical convergence analysis indicates discretization uncertainties between 0.3% and 9.2% for key quantities of interest. Experimental validation demonstrates that the MTS model, when implemented with a verified mesh, accurately reproduces both elastic and plastic behavior of 6061-O aluminum, predicting peak roller loads within 11–18% of measurements, geometric tolerances within 3%, and plastic strain distributions within 10% of experimental values. Collectively, these results establish a validated computational framework for predictive spin-forming simulations with quantified confidence, providing a foundation for extension to other alloys, geometries, and forming conditions.

Spin forming↗

NASA NTRS2018

Methodologies for Verification and Validation of Space Launch System (SLS) Structural Dynamic Models: Appendices

Verification and validation (V&V) is a highly challenging undertaking for SLS structural dynamics models due to the magnitude and complexity of SLS subassemblies and subassemblies. Responses to challenges associated with V&V of Space Launch System (SLS) structural dynamics models are presented in Volume I of this paper. Four methodologies addressing specific requirements for V&V are discussed. (1) Residual Mode Augmentation (RMA). (2) Modified Guyan Reduction (MGR) and Harmonic Reduction (HR, introduced in 1976). (3) Mode Consolidation (MC). Finally, (4) Experimental Mode Verification (EMV). This document contains the appendices to Volume I.

Coppolino, Robert N.↗

DOE OSTI2024

Transport coefficient approach for characterizing nonequilibrium dynamics in soft matter

Nonequilibrium states in soft condensed matter require a systematic approach to characterize and model materials, enhancing predictability and applications. Among the tools, X-ray photon correlation spectroscopy (XPCS) provides exceptional temporal and spatial resolution to extract dynamic insight into the properties of the material. However, existing models might overlook intricate details. We introduce an approach for extracting the transport coefficient, denoted as $J(t)$, from the XPCS studies. This coefficient is a fundamental parameter in nonequilibrium statistical mechanics and is crucial for characterizing transport processes within a system. Our method unifies the Green–Kubo formulas associated with various transport coefficients, including gradient flows, particle–particle interactions, friction matrices, and continuous noise. We achieve this by integrating the collective influence of random and systematic forces acting on the particles within the framework of a Markov chain. We initially validated this method using molecular dynamics simulations of a system subjected to changes in temperatures over time. Subsequently, we conducted further verification using experimental systems reported in the literature and known for their complex nonequilibrium characteristics. The results, including the derived $J(t)$ and other relevant physical parameters, align with the previous observations and reveal detailed dynamical information in nonequilibrium states. This approach represents an advancement in XPCS analysis, addressing the growing demand to extract intricate nonequilibrium dynamics. Further, the methods presented are agnostic to the nature of the material system and can be potentially expanded to hard condensed matter systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2023

Performance assessment of a real water source heat pump within a hardware-in-the-loop (HIL) testing environment

Over the last decade, the global fight against climate change through electrification has led to an increase in research on building heating, ventilation, and air conditioning (HVAC) systems that utilize intelligent control algorithms to provide demand-side grid service while also maintaining the thermal comfort of building occupants. As the pivotal point between building electricity consumption and indoor thermal comfort, high-efficiency electrical vapor-compression heat pumps are at the center of these emerging studies, and various grid-interactive and occupant-comfort control algorithms have been developed for them. The impact of these algorithms on heat pump operation and performance when subjected to different weather conditions, building loads, and grid requests calls for investigation and verification via experimental testing with actual heat pumps integrated with real-time building and grid responses. This study introduces a Water-Source Heat Pump (WSHP) Hardware-in-The-Loop (HIL) Test Facility that is the first of its kind. This testbed utilizes a 2-ton variable speed water-to-air heat pump that is capable of interacting with a virtual environment currently comprised of an EnergyPlus (E+) building simulation, an agent-based occupant behavioral model, and a single U-tube ground-loop heat exchanger (GLHE) model. Detailed descriptions of the testbed’s physical design and operation, virtual environment, as well as their mutual communication is provided. An uncertainty analysis is also performed under manufacturer specified heating and cooling design conditions. This analysis shows that the total load across the WSHP’s demand side heat exchanger, i.e., the sum of its latent and sensible components, can be measured with a relative uncertainty of ± 10.4% and ± 3.6% in cooling and heating mode respectively. The WSHP’s coefficient of performance (COP) can be measured with relative uncertainties of ± 10.4% in cooling mode, and ± 3.7% in heating mode. A preliminary 24-h experimental demonstration is then performed utilizing the DOE prototype small commercial office building model in E+. The simulation takes place in Atlanta, GA on the date of 08/26/15 from 12:00 AM to 11:59 PM using TMY3 weather data. Here, the results from this demonstration show that over the course of this experiment the simulated outputs of zone dry-bulb temperature, zone humidity ratio, and WSHP inlet water temperature can be tracked by testbed emulators up to a root mean squared error (RMSE) of ± 0.27 °C, ± 0.376 g/kg, and ± 0.85 °C respectively. The WSHP’s dynamic behavioral characteristics and performance are also captured, and correspond well with the authors’ previous understanding of heat pump efficiency as a function of evaporator and condenser fluid inlet conditions respectively.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

Nimble Feedthrough Qualification - 125% High Explosive Overpressure Test Plan RevA

The primary purpose of this High Explosive (HE) Over-Pressure Test (OPT) is to qualify top cover diagnostic feedthroughs that will be used on LLNL Nimble Subcritical Experiment (SCE) Series designs per experimental design verification requirements specified in ASME Boiler and Pressure Vessel Code Case 2564, Impulsively-Loaded Pressure Vessels, Section VIII, Division 3; and to satisfy the over-test requirement of DOE-STD-1212. The diagnostic feedthroughs are part of the Vessel Confinement System (VCS), which is credited as a Safety Significant Design Feature per the U1a Facility Documented Safety Analysis (DSA). The OPT will be conducted at the LANL Area 1, R306 Firing Site (TA-15-R306) in a 3-foot diameter VCS depicted in Figure 1.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

NASA NTRS1968

Improved fluid dynamics similarity, analysis and verification. Part 5: Analytical and experimental studies of thermal stratification phenomena

The stratification behavior of a contained fluid subjected to transient free convection heat transfer was studied. A rectangular vessel was employed with heat transfer from two opposite walls of the vessel to the fluid. The wall temperature was increased suddenly to initiate the process and was then maintained constant throughout the transient stratification period. Thermocouples were positioned on a post at the center of the vessel. They were adjusted so that temperatures could be measured at the fluid surface and at specific depths beneath the surface. The predicted values of the surface temperature and the stratified layer thickness were found to agree reasonably well with the experimental measurements. The experiments also provided information on the transient centerline temperature distribution and the transient flow distribution.

Winter, E. R. F.↗

NASA NTRS1973

The theory, design, and operation of the suppressed carrier data-aided tracking receiver

A viable, efficient, and easily mechanized carrier regenerating receiver for use in suppressed carrier-tracking system is described. The receiver referred to as a data-aided receiver (DAR) incorporates a data-aided loop (DAL) which provides the required carrier reference signal. The DAL employs the principle of decision feedback and as such is more efficient than other forms of suppressed carrier-tracking loops. The analysis, design, and implementation of the DAR are covered in detail. Performance comparisons and mechanization tradeoffs are made, wherever possible, with discrete carrier systems and other suppressed carrier systems presently in use. Experimental performance verification is given throughout in support of the theory presented.

Simon, M. K.↗