SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
The purpose of this presentation is to outline how the NASA Independent Verification and Validation (IVV) Program helps to build reliability into the Space Mission Software Systems (SMSSs) that its customers develop.
NASA s Ares I-X vehicle launched on a suborbital test flight from the Eastern Range in Florida on October 28, 2009. To obtain approval for launch, a range safety final flight data package was generated to meet the data requirements defined in the Air Force Space Command Manual 91-710 Volume 2. The delivery included products such as a nominal trajectory, trajectory envelopes, stage disposal data and footprints, and a malfunction turn analysis. The Air Force s 45th Space Wing uses these products to ensure public and launch area safety. Due to the criticality of these data, an independent validation and verification effort was undertaken to ensure data quality and adherence to requirements. As a result, the product package was delivered with the confidence that independent organizations using separate simulation software generated data to meet the range requirements and yielded consistent results. This document captures Ares I-X final flight data package verification and validation analysis, including the methodology used to validate and verify simulation inputs, execution, and results and presents lessons learned during the process
This paper provides an overview of Optical Payload for Lasercomm Science (OPALS) activities and lessons learned during mission operations. Activities described cover the periods of commissioning, prime, and extended mission operations, during which primary and secondary mission objectives were achieved for demonstrating space-to-ground optical communications. Lessons learned cover Mission Operations System topics in areas of: architecture verification and validation, staffing, mission support area, workstations, workstation tools, interfaces with support services, supporting ground stations, team training, procedures, flight software upgrades, post-processing tools, and public outreach.
Throughout this work, a database for the Cr-Ni-V system was constructed by modeling the binary Cr-V and ternary Cr-Ni-V systems using the CALPHAD approach aided by density functional theory (DFT)-based first-principles calculations and ab initio molecular dynamics (AIMD) simulations. To validate this new database, a functionally graded material (FGM) using Ni-20Cr and elemental V was fabricated using directed energy deposition additive manufacturing (DED AM) and experimentally characterized. The deposited Ni-20Cr was pure fcc phase, while increasing the amount of V across the gradient resulted in the formation of sigma phase, followed by the bcc phase. The experimentally measured phase data was compared with computational predictions made using a Cr-Ni-V thermodynamic database from the literature as well as the database developed in the present work. The newly developed database was shown to better predict the experimentally observed phases due to its accurate modeling of binary systems within the database and the ternary liquid phase, which is critical for accurate Scheil calculations.
Qualification considerations for assuring the safety of a life-critical digital flight control system include four major areas: systems interactions, verification, validation, and configuration control. The AFTI/F-16 design, development, and qualification illustrate these considerations. In this paper, qualification concepts, procedures, and methodologies are discussed and illustrated through specific examples.
TARGET (Task Analysis/Rule Generation Tool) represents a new breed of tool that blends graphical process flow modeling capabilities with the function of a top-down reporting facility. Since NASA personnel frequently perform tasks that are primarily procedural in nature, TARGET models mission or task procedures and generates hierarchical reports as part of the process capture and analysis effort. Historically, capturing knowledge has proven to be one of the greatest barriers to the development of intelligent systems. Current practice generally requires lengthy interactions between the expert whose knowledge is to be captured and the knowledge engineer whose responsibility is to acquire and represent the expert's knowledge in a useful form. Although much research has been devoted to the development of methodologies and computer software to aid in the capture and representation of some types of knowledge, procedural knowledge has received relatively little attention. In essence, TARGET is one of the first tools of its kind, commercial or institutional, that is designed to support this type of knowledge capture undertaking. This paper will describe the design and development of TARGET for the acquisition and representation of procedural knowledge. The strategies employed by TARGET to support use by knowledge engineers, subject matter experts, programmers and managers will be discussed. This discussion includes the method by which the tool employs its graphical user interface to generate a task hierarchy report. Next, the approach to generate production rules for incorporation in and development of a CLIPS based expert system will be elaborated. TARGET also permits experts to visually describe procedural tasks as a common medium for knowledge refinement by the expert community and knowledge engineer making knowledge consensus possible. The paper briefly touches on the verification and validation issues facing the CLIPS rule generation aspects of TARGET. A description of efforts to support TARGET's interoperability issues on PCs, Macintoshes and UNIX workstations concludes the paper.
The verification and validation of autonomy software is widely believed to be a challenging unsolved problem. To a certain extent this is true, but in this paper I argue that the problem is not nearly as severe as seems to be widely perceived. many of the perceived hard problems in autonomy software V&V also exist for traditional software, and can be solved using many of the same methods and techniques used for traditional spacecraft software. In particular, the problem of intractably large state spaces exists for any non-trivial software system.
No abstract available
Quantifying the annual energy impacts of efficient technologies in commercial buildings has been well established by the building science field. As we move toward enabling grid-interactive efficient buildings (GEB) targeting flexible building operation and carbon reduction, quantification methods to evaluate time-sensitive peak load and emissions impact are much less defined. A number of national laboratories are working to field validate four different GEB software solutions that provide the capability to control multiple building end-use systems in multiple load flexibility modes (i.e., energy efficiency, load shed, load shift, and possible load modulation at the second to sub-second level). To guide the laboratory leads in effective measurement and verification (M&V) practices, two of the laboratories collaborated to define metrics to quantify the impacts of flexible load control on building demand, utility costs, carbon emissions, facility management, and occupant comfort. This paper summarizes the proposed metrics to quantify peak load and emission impacts in the field, decision parameters, approaches to accurately conduct M&V, lessons learned, and outstanding needs and next steps.
Quantifying the annual energy impacts of efficient technologies in commercial buildings has been well established by the building science field. As we move toward enabling grid-interactive efficient buildings (GEB) targeting flexible building operation and carbon reduction, quantification methods to evaluate time-sensitive peak load and emissions impact are much less defined. A number of national laboratories are working to field validate four different GEB software solutions that provide the capability to control multiple building end-use systems in multiple load flexibility modes (i.e., energy efficiency, load shed, load shift, and possible load modulation at the second to sub-second level). To guide the laboratory leads in effective measurement and verification (M&V) practices, two of the laboratories collaborated to define metrics to quantify the impacts of flexible load control on building demand, utility costs, carbon emissions, facility management, and occupant comfort. This paper summarizes the proposed metrics to quantify peak load and emission impacts in the field, decision parameters, approaches to accurately conduct M&V, lessons learned, and outstanding needs and next steps.
A demonstration of frequency-sweep testing using a Bell-214ST single-rotor helicopter was completed in support of the Army's development of an updated MIL-H-8501A, and an LHX (ADS-33) handling-qualities specification. Hover and level-flight (V sub a = 0 knots and V sub a = 90 knots) tests were conducted in 3 flight hours by Army test pilots at the Army Aviation Engineering Flight Activity (AEFA) at Edwards AFB, Calif. Bandwidth and phase-delay parameters were determined from the flight-extracted frequency responses as required by the proposed specifications. Transfer function modeling and verification demonstrates the validity of the frequency-response concept for characterizing closed-loop flight dynamics of single-rotor helicopters -- even in hover. This report documents the frequency-sweep flight-testing technique and data-analysis procedures. Special emphasis is given to piloting and analysis considerations which are important for demonstrating frequency-domain specification compliance.
With the advances in high-computing platform (e.g., advanced graphical processing units or multi-core processors), computationally-intensive software techniques such as the ones used in artificial intelligence or formal methods have provided us with an opportunity to further increase safety in the aviation industry. Some of these techniques have facilitated building safety at design time, like in aircraft engines or software verification and validation, and others can introduce safety benefits during operations as long as we adapt our processes. In this talk, I will present how NASA is taking advantage of these new software techniques to build in safety at design time through advanced software verification and validation, which can be applied earlier and earlier in the design life cycle and thus help also reduce the cost of aviation assurance. I will then show how run-time techniques (such as runtime assurance or data analytics) offer us a chance to catch even more complex problems, even in the face of changing and unpredictable environments. These new techniques will be extremely useful as our aviation systems become more complex and more autonomous.
This paper describes the methods used to specify and implement a complex communications protocol that provides reliable delivery of data in multicast-capable, packet-switching telecommunication networks. The protocol, called the Reliable Multicasting Protocol (RMP), was developed incrementally by two complementary teams using a combination of formal and informal techniques in an attempt to ensure the correctness of the protocol implementation. The first team, called the Design team, initially specified protocol requirements using a variant of SCR requirements tables and implemented a prototype solution. The second team, called the V&V team, developed a state model based on the requirements tables and derived test cases from these tables to exercise the implementation. In a series of iterative steps, the Design team added new functionality to the implementation while the V&V team kept the state model in fidelity with the implementation through testing. Test cases derived from state transition paths in the formal model formed the dialogue between teams during development and served as the vehicles for keeping the model and implementation in fidelity with each other. This paper describes our experiences in developing our process model, details of our approach, and some example problems found during the development of RMP.
Software project managers need tools to estimate and track project goals in a continuous fashion before, during, and after development of a system. In addition, they need an ability to compare the current project status with past project profiles to validate management intuition, identify problems, and then direct appropriate resources to the sources of problems. This paper describes a measurement-based approach to calculating the risk inherent in meeting project goals that leverages past project metrics and existing estimation and tracking models. We introduce the IV&V Goal/Questions/Metrics model, explain its use in the software development life cycle, and describe our attempts to validate the model through the reverse engineering of existing projects.
The NASA Space Medicine program is now developing plans for more extensive use of high-fidelity medical simulation systems. The use of simulation is seen as means to more effectively use the limited time available for astronaut medical training. Training systems should be adaptable for use in a variety of training environments, including classrooms or laboratories, space vehicle mockups, analog environments, and in microgravity. Modeling and simulation can also provide the space medicine development program a mechanism for evaluation of other medical technologies under operationally realistic conditions. Systems and procedures need preflight verification with ground-based testing. Traditionally, component testing has been accomplished, but practical means for "human in the loop" verification of patient care systems have been lacking. Medical modeling and simulation technology offer potential means to accomplish such validation work. Initial considerations in the development of functional requirements and design standards for simulation systems for space medicine are discussed.
Proposal for a technical focus group in the Ice Prediction Workshop that would be tasked with showing convergence of numerical icing solutions. The CRM65 Midspan Hybrid model is proposed as a metric for evaluation.
Autonomy of aerospace systems requires the ability for flight control systems to be able to adapt to complex uncertain dynamic environment. In spite of the five decades of research in adaptive control, the fact still remains that currently no adaptive control system has ever been deployed on any safety-critical or human-rated production systems such as passenger transport aircraft. The problem lies in the difficulty with the certification of adaptive control systems since existing certification methods cannot readily be used for nonlinear adaptive control systems. Research to address the notion of metrics for adaptive control began to appear in the recent years. These metrics, if accepted, could pave a path towards certification that would potentially lead to the adoption of adaptive control as a future control technology for safety-critical and human-rated production systems. Development of certifiable adaptive control systems represents a major challenge to overcome. Adaptive control systems with learning algorithms will never become part of the future unless it can be proven that they are highly safe and reliable. Rigorous methods for adaptive control software verification and validation must therefore be developed to ensure that adaptive control system software failures will not occur, to verify that the adaptive control system functions as required, to eliminate unintended functionality, and to demonstrate that certification requirements imposed by regulatory bodies such as the Federal Aviation Administration (FAA) can be satisfied. This presentation will discuss some of the technical issues with adaptive flight control and related V&V challenges.
An extensive set of unsteady pressure data was acquired along the midspan of a modern transonic fan blade for simulated flutter conditions. The data set was acquired in a nine-blade linear cascade with an oscillating middle blade to provide a database for the influence coefficient method to calculate instantaneous blade loadings. The cascade was set for an incidence of 10 dg. The data were acquired on three stationary blades on each side of the middle blade that was oscillated at an amplitude of 0.6 dg. The matrix of test conditions covered inlet Mach numbers of 0.5, 0.8, and 1.1 and the oscillation frequencies of 200, 300, 400, and 500 Hz. A simple quasiunsteady two-dimensional computer simulation was developed to aid in the running of the experimental program. For high Mach number subsonic inlet flows the blade pressures exhibit very strong, low-frequency, self-induced oscillations even without forced blade oscillations, while for low subsonic and supersonic inlet Mach numbers the blade pressure unsteadiness is quite low. The amplitude of forced pressure fluctuations on neighboring stationary blades strongly depends on the inlet Mach number and forcing frequency. The flowfield behavior is believed to be governed by strong nonlinear effects due to a combination of viscosity, compressibility, and unsteadiness. Therefore, the validity of the quasi-unsteady simplified computer simulation is limited to conditions when the flowfield is behaving in a linear, steady manner. Finally, an extensive set of unsteady pressure data was acquired to help development and verification of computer codes for blade flutter effects.