Search NASA⌕ Search

SEARCH · Search NASA

Results for “V&V process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

TEAMS Model Analyzer

The TEAMS model analyzer is a supporting tool developed to work with models created with TEAMS (Testability, Engineering, and Maintenance System), which was developed by QSI. In an effort to reduce the time spent in the manual process that each TEAMS modeler must perform in the preparation of reporting for model reviews, a new tool has been developed as an aid to models developed in TEAMS. The software allows for the viewing, reporting, and checking of TEAMS models that are checked into the TEAMS model database. The software allows the user to selectively model in a hierarchical tree outline view that displays the components, failure modes, and ports. The reporting features allow the user to quickly gather statistics about the model, and generate an input/output report pertaining to all of the components. Rules can be automatically validated against the model, with a report generated containing resulting inconsistencies. In addition to reducing manual effort, this software also provides an automated process framework for the Verification and Validation (V&V) effort that will follow development of these models. The aid of such an automated tool would have a significant impact on the V&V process.

Tijidjian, Raffi P.↗

IV&V Project Assessment Process Validation

The Space Launch System (SLS) will launch NASA's Multi-Purpose Crew Vehicle (MPCV). This launch vehicle will provide American launch capability for human exploration and travelling beyond Earth orbit. SLS is designed to be flexible for crew or cargo missions. The first test flight is scheduled for December 2017. The SLS SRR/SDR provided insight into the project development life cycle. NASA IV&V ran the standard Risk Based Assessment and Portfolio Based Risk Assessment to identify analysis tasking for the SLS program. This presentation examines the SLS System Requirements Review/System Definition Review (SRR/SDR), IV&V findings for IV&V process validation correlation to/from the selected IV&V tasking and capabilities. It also provides a reusable IEEE 1012 scorecard for programmatic completeness across the software development life cycle.

Driskell, Stephen↗

NEAMS Experimental Support for Code Validation, INL FY2009

The goal is for all modeling and simulation tools to be demonstrated accurate and reliable through a formal Verification and Validation (V&V) process, especially where such tools are to be used to establish safety margins and support regulatory compliance, or to design a system in a manner that reduces the role of expensive mockups and prototypes. Whereas the Verification part of the process does not rely on experiment, the Validation part, on the contrary, necessitates as many relevant and precise experimental data as possible to make sure the models reproduce reality as closely as possible. Hence, this report presents a limited selection of experimental data that could be used to validate the codes devoted mainly to Fast Neutron Reactor calculations in the US. Emphasis has been put on existing data for thermal-hydraulics, fuel and reactor physics. The principles of a new “smart” experiment that could be used to improve our knowledge of neutron cross-sections are presented as well. In short, it consists in irradiating a few milligrams of actinides and analyzing the results with Accelerator Mass Spectroscopy to infer the neutron cross-sections. Finally, the wealth of experimental data relevant to Fast Neutron Reactors in the US should not be taken for granted and efforts should be put on saving these 30-40 years old data and on making sure they are validation-worthy, i.e. that the experimental conditions and uncertainties are well documented.

97 MATHEMATICS AND COMPUTING↗

V&V on a NASA Technology Demonstration Project: Low Density Supersonic Decelerator

Given their smaller budgets, but higher allowed risk posture, technology demonstration missions face different Verification and Validation (V&V) challenges than typical NASA missions. Despite these challenges, the Low Density Supersonic Decelerator (LDSD) project, managed by NASA’s Jet Propulsion Laboratory (JPL), has been extremely successful in testing new supersonic atmospheric decelerator technologies. A contribution to the project’s success is the unique V&V program that emphasized efficiency and flexibility. This paper will provide an overview of LDSD test objectives, Supersonic Flight Dynamics Tests (SFDT) performed so far, unique requirements structure and V&V processes implemented. The paper will focus on the V&V of the SFDT test architecture. Furthermore, lessons learned will also be presented at the end of the paper to aid future technology demonstration projects.

Murry, Michael L.↗

Quantitative Analysis Guidance in Safety Software Validation

Quantitative analysis in software development has been a challenging topic over the years in safety software. While qualitative processes for vigorous safety software verification and validation (V and V) have been provided through standard such as IEEE 1012, quantitative analysis for V and V tasks such as correctness, completeness or accuracy evaluation have not been formally defined. In practice, there are quantitative analyses in terms of using software metrics. Many of these software metrics are useful in analyzing the test results. Some of them are used for providing guidance in code evaluation activities e.g. numbers of line of codes not exceeding certain limits, recursive calls are not allowed, etc. However, few can be used for providing quantitative analysis guidance for the V and V tasks such as completeness evaluation. AREVA Federal Services (AFS) has provided services for many nuclear projects in US. Through compliance with IEEE 1012, AFS V and V processes have provided vigorous qualitative processes ensuring quality level of the software products used in the project meeting the required nuclear software level. In addition, quantitative analysis is developed to provide structured validation framework ensuring 'zero defect' in the software products. This paper describes some aspects of the quantitative approaches using a sample safety application. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

New ramsdellites LiTi{sub 2-y}V{sub y}O{sub 4} (0<=y<=1): Synthesis, structure, magnetic properties and electrochemical performances as electrode materials for lithium batteries

The new ramsdellite series LiTi{sub 2-y}V{sub y}O{sub 4} (0<=y<=1) has been prepared by conventional solid state chemistry techniques and was characterized by X-ray powder diffraction and electron diffraction. To our knowledge, this is the first report on ramsdellites containing vanadium. The magnetic behaviour of these ramsdellites is strongly influenced by its vanadium content. In this sense, LiTi{sub 2}O{sub 4} (y=0) exhibits metallic-like temperature independent paramagnetism, but d electrons tend to localize with increasing V content. LiTiVO{sub 4}, though also paramagnetic, follows then the Curie-Weiss law. The crossover from delocalized to localized electrons is observed between compositions y=0.6 and 0.8. For y>=0.8 the magnetic results evidence an isovalent substitution mechanism of trivalent Ti by V. The electrochemical lithium intercalation and deintercalation chemistry of LiTi{sub 2-y}V{sub y}O{sub 4} is grouped into two different operating voltage regions. Reversible lithium deintercalation of vanadium-substituted ramsdellite titanates LiTi{sub 2-y}V{sub y}O{sub 4} in the high voltage range 2-3 V vs. Li occurs in two main steps, one at about 2 V and the other at about 3 V. The 3 V process capacity increases with the vanadium content, while the 2 V capacity decreases at the same time. The vanadium to titanium substitution rate in LiTi{sub 2}O{sub 4} was found to be beneficial to the specific energy in as much as a 50% increase (1 V) of the working voltage is observed. On the other hand, reversible lithium intercalation in vanadium-substituted ramsdellite titanates LiTi{sub 2-y}V{sub y}O{sub 4} in the low voltage range 1-2 V vs. Li occurs in one main single step, in which the capacity is not affected by the vanadium content, although vanadium-doping produces an improved capacity retention with an excellent cycling behaviour observed for y<=0.6. - Graphical abstract: Ti-based ramsdellite compounds can make up cathode and anode materials for lithium batteries by introducing vanadium. Lithium deinsertion experiments on LiTi{sub 2-y}V{sub y}O{sub 4} materials develop a high operating voltage (3 V) useful as the cathode, while lithium insertion experiments yield a low operating voltage, 1.5 V, useful as the anode. Vanadium-rich compounds show specific theoretical capacity values in the high voltage range that are even comparable to those reported for LiFePO{sub 4} which is presently one of the preferred cathode materials for lithium batteries.

36 MATERIALS SCIENCE↗

Independent verification and validation for Space Shuttle flight software

The Committee for Review of Oversight Mechanisms for Space Shuttle Software was asked by the National Aeronautics and Space Administration's (NASA) Office of Space Flight to determine the need to continue independent verification and validation (IV&V) for Space Shuttle flight software. The Committee found that the current IV&V process is necessary to maintain NASA's stringent safety and quality requirements for man-rated vehicles. Therefore, the Committee does not support NASA's plan to eliminate funding for the IV&V effort in fiscal year 1993. The Committee believes that the Space Shuttle software development process is not adequate without IV&V and that elimination of IV&V as currently practiced will adversely affect the overall quality and safety of the software, both now and in the future. Furthermore, the Committee was told that no organization within NASA has the expertise or the manpower to replace the current IV&V function in a timely fashion, nor will building this expertise elsewhere necessarily reduce cost. Thus, the Committee does not recommend moving IV&V functions to other organizations within NASA unless the current IV&V is maintained for as long as it takes to build comparable expertise in the replacing organization.

Source record↗

Application of automated measurement and verification to utility energy efficiency program data

Trustworthy savings calculations are critical to convincing regulators of both the cost-effectiveness of energy efficiency program investments and their ability to defer supply-side capital investments. Today’s methods for measurement and verification (M&V) of energy savings constitute a significant portion of the total costs of energy efficiency programs. They also require time-consuming data acquisition. A spectrum of savings calculation approaches is used, with some relying more heavily on measured data and others relying more heavily on estimated, modeled, or stipulated data. The increasing availability of “smart” meters and devices that report near-real time data, combined with new analytical approaches to quantify savings, offers the potential to conduct M&V more quickly and at lower cost, with comparable or improved accuracy. Commercial energy management and information systems (EMIS) technologies are beginning to offer these ‘M&V 2.0’ capabilities, and program administrators want to understand how they might assist programs in quickly and accurately measuring energy savings. This paper presents the results of recent testing of the ability to use automation to streamline the M&V process. In this paper, we apply an automated whole-building M&V tool to historic data sets from energy efficiency programs to begin to explore the accuracy, cost, and time trade-offs between more traditional M&V, and these emerging streamlined methods that use high-resolution energy data and automated computational intelligence. For the data sets studied we evaluate the fraction of buildings that are well suited to automated baseline characterization, the uncertainty in gross savings that is due to M&V 2.0 tools’ model error, and indications of labor time savings, and how the automated savings results compare to prior, traditionally determined savings results. The results show that 70% of the buildings were well suited to the automated approach. In a majority of the cases (80%) savings and uncertainties for each individual building were quantified to levels above the criteria in ASHRAE Guideline 14. In addition the findings suggest that M&V 2.0 methods may also offer time-savings relative to traditional approaches. Lastly, we discuss the implications of these findings relative to the potential evolution of M&V, and pilots currently being launched to test how M&V automation can be integrated into ratepayer-funded programs and professional implementation and evaluation practice.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Single photon simultaneous K-shell ionization and K-shell excitation. II. Specificities of hollow nitrogen molecular ions

The formalism developed in the companion Paper I is used here for the interpretation of spectra obtained recently on the nitrogen molecule. Double core-hole ionization K{sup −2} and core ionization-core excitation K{sup −2}V processes have been observed by coincidence electron spectroscopy after ionization by synchrotron radiation at different photon energies. Theoretical and experimental cross sections reported on an absolute scale are in satisfactory agreement. The evolution with photon energy of the relative contribution of shake-up and conjugate shake-up processes is discussed. The first main resonance in the K{sup −2}V spectrum is assigned to a K{sup −2}π{sup ∗} state mainly populated by the 1s→ lowest unoccupied molecular orbital dipolar excitation, as it is in the K{sup −1}V NEXAFS (Near-Edge X-ray Absorption Fine Structure) signals. Closer to the K{sup −2} threshold Rydberg resonances have been also identified, and among them a K{sup −2}σ{sup ∗} resonance characterized by a large amount of 2s/2p hybridization, and double K{sup −2}(2σ{sup ∗}/1π/3σ){sup −1}1π{sup ∗2} shake-up states. These resonances correspond in NEXAFS spectra to, respectively, the well-known σ{sup ∗} shape resonance and double excitation K{sup −1}(2σ{sup ∗}/1π/3σ){sup −1}1π{sup ∗2} resonances, all being positioned above the threshold.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Performing Verification and Validation in Reuse-Based Software Engineering

The implementation of reuse-based software engineering not only introduces new activities to the software development process, such as domain analysis and domain modeling, it also impacts other aspects of software engineering. Other areas of software engineering that are affected include Configuration Management, Testing, Quality Control, and Verification and Validation (V&V). Activities in each of these areas must be adapted to address the entire domain or product line rather than a specific application system. This paper discusses changes and enhancements to the V&V process, in order to adapt V&V to reuse-based software engineering.

Addy, Edward A.↗

Statistical change detection of building energy consumption: Applications to savings estimation

The surge in interval meter data availability and associated activity in energy data analytics has inspired new interest in advanced methods for building efficiency savings estimation. Statistical and machine learning approaches are being explored to improve the energy baseline models used to measure and verify savings. One outstanding challenge is the ability to identify and account for operational changes that may confound savings estimates. In the measurement and verification (M&V) context, ‘non-routine events’ (NREs) cause changes in building energy use that are not attributable to installed efficiency measures, and not accounted for in the baseline model’s independent variables. In the M&V process NREs must be accounted for as ‘adjustments’ to appropriately attribute the estimated energy savings to the specific efficiency interventions that were implemented. Currently this is a manual and custom process, conducted using professional judgment and engineering expertise. As such it remains a barrier in scaling and standardizing meter-based savings estimation. Here in this work, a data driven methodology was developed to (partially) automate, and therefore streamline the process of detecting NREs in the post-retrofit period and making associated savings adjustments. The proposed NRE detection algorithm is based on a statistical change point detection method and a dissimilarity metric. The dissimilarity metric measures the proximity between the actual time series of the post-retrofit energy consumption and the projected baseline, which is generated using a statistical baseline model. The suggested approach for NRE adjustment involves the NRE detection algorithm, the M&V practitioner, and a regression modeling algorithm. The performance of the detection and adjustment algorithm was evaluated using a simulation-generated test data set, and two benchmark algorithms. Results show a high true positive detection rate (75%-100% across the test cases), higher than ideal false positive detection rates (20%-70%), and low errors in energy adjustment (<0.7%). These results indicate that the algorithm holds for helping M&V practitioners to streamline the process of handling NREs. Moreover, the change point algorithm and underlying statistical principles could prove valuable for other building analytics applications such as anomaly detection and fault diagnostics.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

MPACT Verification and Validation Manual (V.4.3)

As the VERA SQA plan requires, it is the responsibility of the University of Michigan (UM) and Oak Ridge National Laboratory (ORNL), as co-owners of MPACT, to ensure that verification and validation activities are performed and documented in a V&V manual with supporting publications and CASL technical reports which can be provided for reference and distribution within VERA. This document provides the current revision of the MPACT verification and validation (V&V) manual and describes the current state of MPACT V&V and updates the plans for future MPACT V&V activities. The following sections provide an overview of the V&V process used in MPACT, as well as a summary of the status of each component of V&V in the code.

97 MATHEMATICS AND COMPUTING↗

MPACT Verification and Validation Manual Version 4.4

As the VERA SQA plan requires, it is the responsibility of the University of Michigan (UM) and Oak Ridge National Laboratory (ORNL), as co-owners of MPACT, to ensure that verification and validation activities are performed and documented in a V&V manual with supporting publications and CASL technical reports which can be provided for reference and distribution within VERA. This document provides the current revision of the MPACT verification and validation (V&V) manual and describes the current state of MPACT V&V and updates the plans for future MPACT V&V activities. The following sections provide an overview of the V&V process used in MPACT, as well as a summary of the status of each component of V&V in the code.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Model-Based Verification and Validation of the SMAP Uplink Processes

This case study stands as an example of how a project can validate a system-level design earlier in the project life cycle than traditional V&V processes by using simulation on a system model. Specifically, this paper describes how simulation was added to a system model of the Soil Moisture Active-Passive (SMAP) mission's uplink process.Also discussed are the advantages and disadvantages of the methods employed and the lessons learned; which are intended to benefit future model-based and simulation-based V&V development efforts.

verification and validation (V&V)↗

Verification and validation of developed short-term forecasting models

Recent advancements in machine learning (ML) and artificial intelligence (AI) technologies provide an opportunity for leveraging data-driven algorithms to predict future nuclear power plant (NPP) operating conditions by using recorded plant process data. Successfully implementing these models can lead to cost-reducing, conditioned-based predictive maintenance through optimized maintenance schedules and a reduction of unnecessary maintenance activities. This report discusses the verification and validation of short-term forecasting processes (i.e., data cleaning, feature selection, model optimization, and forecasting) developed in previous reports. The verification and validation (V&V) process demonstrates the expected precision and accuracy when the ML model encounters new datasets from different systems. Shapley additive explanations were used as the primary means of feature selection across these different data set. Individual models were trained for each data set, then validated through a cross-validation procedure. In this report, two different ML models were tasked to predict variables from three different plant process data sets with varying prediction horizons. The results indicate that support vector regression (SVR) outperformed long short-term memory (LSTM) neural networks in regard to each data set and each prediction horizon in this study, but further tuning and optimization could improve long short-term memory results. However, each forecasting model showed reduced performance as the prediction horizon was extended from 1 hour to 1 day ahead. Research is ongoing to evaluate the optimal input variable space, which is based on a given set of process parameters, to further improve forecasting accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

The Application of V&V within Reuse-Based Software Engineering

Verification and Validation (V&V) is performed during application development for many systems, especially safety-critical and mission-critical systems. The V&V process is intended to discover errors as early as possible during the development process. Early discovery is important in order to minimize the cost and other impacts of correcting these errors. In reuse-based software engineering, decisions on the requirements, design and even implementation of domain assets can can be made prior to beginning development of a specific system. in order to bring the effectiveness of V&V to bear within reuse-based software engineering. V&V must be incorporated within the domain engineering process.

Addy, Edward↗

A Framework for Performing Verification and Validation in Reuse Based Software Engineering

Verification and Validation (V&V) is currently performed during application development for many systems, especially safety-critical and mission- critical systems. The V&V process is intended to discover errors, especially errors related to critical processing, as early as possible during the development process. The system application provides the context under which the software artifacts are validated. This paper describes a framework that extends V&V from an individual application system to a product line of systems that are developed within an architecture-based software engineering environment. This framework includes the activities of traditional application-level V&V, and extends these activities into domain engineering and into the transition between domain engineering and application engineering. The framework includes descriptions of the types of activities to be performed during each of the life-cycle phases, and provides motivation for the activities.

Addy, Edward A.↗

The Need for V&V in Reuse-Based Software Engineering

V&V is currently performed during application development for many systems, especially safety-critical and mission-critical systems. The V&V process is intended to discover errors, especially errors related to entire' domain or product line rather than a critical processing, as early as possible during the development process. The system application provides the context under which the software artifacts are validated. engineering. This paper describes a framework that extends V&V from an individual application system to a product line of systems that are developed within an architecture-based software engineering environment. This framework includes the activities of traditional application-level V&V, and extends these activities into the transition between domain engineering and application engineering. The framework includes descriptions of the types of activities to be performed during each of the life-cycle phases, and provides motivation for activities.

Addy, Edward A.↗