Search NASA⌕ Search

SEARCH · Search NASA

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Introduction: The 2014 Sandia Verification and Validation Challenge Workshop [The 2014 Sandia Verification and Validation Challenge Workshop]

The 2014 Sandia Verification & Validation Challenge Workshop was held at the 3rd ASME Verification & Validation Symposium in Las Vegas, on May 5-8, 2014. The workshop was built around a challenge problem, formulated as an engineering investigation that required integration of experimental data, modeling and simulation, and verification and validation. The challenge problem served as a common basis for the ASME Journal of Verification, Validation, and Uncertainty Quantification participants to both demonstrate methodology and explore a critical aspect of the field: the role of verification and validation in establishing credibility and supporting decision making. Ten groups presented responses to the challenge problem at the workshop, and the follow-on efforts are documented in this special edition of the ASME Journal of Verification, Validation, and Uncertainty Quantification.

97 MATHEMATICS AND COMPUTING↗

Stennis Space Center Verification and Validation Capabilities

Verification and validation capabilities are discussed for: spatial response,reflectance radiometry, positional accuracy,in-flight instruments, lab calibration, thermal radiometry,hyperspectral radiometry, and portable atmospheric monitoring.

Daehler, Erik↗

Ares I-X Range Safety Simulation Verification and Analysis Independent Validation and Verification

NASA s Ares I-X vehicle launched on a suborbital test flight from the Eastern Range in Florida on October 28, 2009. To obtain approval for launch, a range safety final flight data package was generated to meet the data requirements defined in the Air Force Space Command Manual 91-710 Volume 2. The delivery included products such as a nominal trajectory, trajectory envelopes, stage disposal data and footprints, and a malfunction turn analysis. The Air Force s 45th Space Wing uses these products to ensure public and launch area safety. Due to the criticality of these data, an independent validation and verification effort was undertaken to ensure data quality and adherence to requirements. As a result, the product package was delivered with the confidence that independent organizations using separate simulation software generated data to meet the range requirements and yielded consistent results. This document captures Ares I-X final flight data package verification and validation analysis, including the methodology used to validate and verify simulation inputs, execution, and results and presents lessons learned during the process

Merry, Carl M.↗

ON THE VERIFICATION AND VALIDATION OF GEOSPATIAL IMAGE ANALYSIS ALGORITHMS

Verification and validation (V&V) of geospatial image analysis algorithms is a difficult task and is becoming increasingly important. While there are many types of image analysis algorithms, we focus on developing V&V methodologies for algorithms designed to provide textual descriptions of geospatial imagery. In this paper, we present a novel methodological basis for V&V that employs a domain-specific ontology, which provides a naming convention for a domain-bounded set of objects and a set of named relationship between these objects. We describe a validation process that proceeds through objectively comparing benchmark imagery, produced using the ontology, with algorithm results. As an example, we describe how the proposed V&V methodology would be applied to algorithms designed to provide textual descriptions of facilities

99 GENERAL AND MISCELLANEOUS↗

Verification and validation of linear gyrokinetic simulation of Alfven eigenmodes in the DIII-D tokamak

A verification and validation study is carried out for a sequence of reversed shear Alfven instability time slices. The mode frequency increases in time as the minimum (q{sub min}) in the safety factor profile decreases. Profiles and equilibria are based upon reconstructions of DIII-D discharge (no. 142111) in which many such frequency up-sweeping modes were observed. Calculations of the frequency and mode structure evolution from two gyrokinetic codes, GTC and GYRO, and a gyro-Landau fluid code TAEFL are compared. The experimental mode structure of the instability was measured using time-resolved two-dimensional electron cyclotron emission imaging. The three models reproduce the frequency upsweep event within {+-}10% of each other, and the average of the code predictions is within {+-}8% of the measurements; growth rates are predicted that are consistent with the observed spectral line widths. The mode structures qualitatively agree with respect to radial location and width, dominant poloidal mode number, ballooning structure, and the up-down asymmetry, with some remaining differences in the details. Such similarities and differences between the predictions of the different models and the experimental results are a valuable part of the verification/validation process and help to guide future development of the modeling efforts.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA Operational Simulator for Small Satellites: Tools for Software Based Validation and Verification of Small Satellites

The NASA Operational Simulator for Small Satellites (NOS3) is a suite of tools to aid in areas such as software development, integration test (IT), mission operations training, verification and validation (VV), and software systems check-out. NOS3 provides a software development environment, a multi-target build system, an operator interface-ground station, dynamics and environment simulations, and software-based hardware models. NOS3 enables the development of flight software (FSW) early in the project life cycle, when access to hardware is typically not available. For small satellites there are extensive lead times on many of the commercial-off-the-shelf (COTS) components as well as limited funding for engineering test units (ETU). Considering the difficulty of providing a hardware test-bed to each developer tester, hardware models are modeled based upon characteristic data or manufacturers data sheets for each individual component. The fidelity of each hardware models is such that FSW executes unaware that physical hardware is not present. This allows binaries to be compiled for both the simulation environment, and the flight computer, without changing the FSW source code. For hardware models that provide data dependent on the environment, such as a GPS receiver or magnetometer, an open-source tool from NASA GSFC (42 Spacecraft Simulation) is used to provide the necessary data. The underlying infrastructure used to transfer messages between FSW and the hardware models can also be used to monitor, intercept, and inject messages, which has proven to be beneficial for VV of larger missions such as James Webb Space Telescope (JWST). As hardware is procured, drivers can be added to the environment to enable hardware-in-the-loop (HWIL) testing. When strict time synchronization is not vital, any number of combinations of hardware components and software-based models can be tested. The open-source operator interface used in NOS3 is COSMOS from Ball Aerospace. For testing, plug-ins are implemented in COSMOS to control the NOS3 simulations, while the command and telemetry tools available in COSMOS are used to communicate with FSW. NOS3 is actively being used for FSW development and component testing of the Simulation-to-Flight 1 (STF-1) CubeSat. As NOS3 matures, hardware models have been added for common CubeSat components such as Novatel GPS receivers, ClydeSpace electrical power systems and batteries, ISISpace antenna systems, etc. In the future, NASA IVV plans to distribute NOS3 to other CubeSat developers and release the suite to the open-source community.

Verification↗

Verification and Validation Tests of Gamma Library of MC2-3 for Coupled Neutron and Gamma Heating Calculation

For the accurate assessment of the heat generation rate in fast reactors, the gamma library of MC2 -3 and the MC2 -3 + GAMSOR procedure employing the coupled neutron and gamma heating calculation has been thoroughly verified against Monte Carlo results and validated using the ZPPR-15D gamma dose measurement data. NJOY outputs are post-processed in a consistent way with the NJOY procedure to avoid any missing data or double counting of data. Prompt heating for 379 out of 391 isotopes in the gamma library was verified against MCNP6.2 to within 1% relative error in total heating for most isotopes. For both a simple one-dimensional slab problem representing a sodium cooled fast reactor and the Experimental Breeder Reactor II (EBR-II) benchmark problem, the root-mean-square values of assembly power error were less than 0.5% for fuel assemblies, ~1% in blankets and ~1 to ~3% in reflectors compared to MCNP6.2 results. The most plausible cause for the 3% error in a reflector assembly is believed to be the error in the multigroup neutron cross sections for the reflector assembly. For validation, gamma doses measured with thermoluminiscent dosimeters (TLDs) in the ZPPR-15D experiment were calculated using GAMSOR. Due to the uncertainty in the TLD measurement with regards to the energy deposition of photons and neutrons, the validation data leads to a 12.7% uncertainty on the experimental measurement. With this uncertainty bound, the calculated doses all fell within one standard deviation of the measured value. Combined with the accurate calculation of reaction rate distributions and neutron spectrum measurements, these results indicate good agreement for the neutron and gamma heating calculations that were performed.

coupled neutron and gamma heating↗

A Systematic Method for Verification and Validation of Gyrokinetic Microstability Codes

My original proposal for the period Feb. 15, 2014 through Feb. 14, 2017 called for an integrated validation and verification effort carried out by myself with collaborators. The validation component would require experimental profile and power-balance analysis. In addition, it would require running the gyrokinetic codes varying the input profiles within experimental uncertainties to seek agreement with experiment before discounting a code as invalidated. Therefore, validation would require a major increase of effort over my previous grant periods which covered only code verification (code benchmarking). Consequently, I had requested full-time funding. Instead, I am being funded at somewhat less than half time (5 calendar months per year). As a consequence, I decided to forego the validation component and to only continue the verification efforts.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Shift Verification and Validation

This documentation outlines the verification and validation of Shift for the Consortium for Advanced Simulation of Light Water Reactors (CASL). Five main types of problems were used for validation: small criticality benchmark problems; full-core reactor benchmarks for light water reactors; fixed-source coupled neutron-photon dosimetry benchmarks; depletion/burnup benchmarks; and full-core reactor performance benchmarks. We compared Shift results to measured data and other simulated Monte Carlo radiation transport code results, and found very good agreement in a variety of comparison measures. These include prediction of critical eigenvalue, radial and axial pin power distributions, rod worth, leakage spectra, and nuclide inventories over a burn cycle. Based on this validation of Shift, we are confident in Shift to provide reference results for CASL benchmarking.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and validation of detonation-shock-dynamics relations for explosives described by general equation of state and chemical reaction models

Detonation shock dynamics is a powerful method to model the behaviour of High Explosives (HE). However in order to use this method, the underlying relationship between the local radius of curvature and the detonation speed must be known. Previous work has developed methods to calculate this effect using simple, single-step Arrhenius and polytropic gas, models for the chemical reaction and the equation of state, respectively. In recent years, more complex models for both reaction rates and equations of state have been developed which show better agreement with experimental data than these simple models, especially when considering condensed phase explosives.. This work presents the governing equations for solving these problems in a way that is generalised to use arbitrary equations of state as well as reaction models which may have more than a single step and multiple product species. This implementation is verified against exact solutions, demonstrating that the equations were implemented properly. The verified algorithm is then validated against experimental data and high fidelity simulations, showing that it is able to make accurate predictions in a regime where the underlying assumptions of the governing equations are valid. Importantly, this approach has many applications: from creating equivalent detonation shock dynamics models for existing reactive burn calibrations for HE; to developing new functional forms and calibrations of reactive burn models for condensed phase high explosives.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Verification and Validation of EnergyPlus Conduction Finite Difference and Phase Change Material Models for Opaque Wall Assemblies

Phase change materials (PCMs) represent a potential technology to reduce peak loads and HVAC energy consumption in buildings. There are few building energy simulation programs that have the capability to simulate PCM but their accuracy has not been completely tested. This report summarizes NREL efforts to develop diagnostic tests cases to obtain accurate energy simulations when PCMs are modeled in residential buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Verification and Validation Propensity Improvements via Solution Verification Automation: Presentation Package (Part 1 of 2) (FY15 ASC L2 milestone #5320)

A new tool, called Mesh Scaling, for producing series of hexahedral meshes suitable for solution verification was enhanced and hardened by this milestone. In addition, solution verification using the meshes produced from Mesh Scaling was performed and documented. We conclude that Mesh Scaling now produces meshes suitable for solution verification, while offering a substantial decrease in the computational cost of solution verification.

97 MATHEMATICS AND COMPUTING↗