SEARCH · Search NASA

Results for “System Level Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS2021

Simulation of Landing and Take-Off Noise for Supersonic Transport Aircraft at a Conceptual Design Fidelity Level

The German Aerospace Center has launched an internal project to assess the noise impact associated with supersonic transport aircraft during approach and departure. A dedicated simulation process is established to cover all relevant disciplines, i.e., aircraft and engine design, engine installation effects, flight simulation, and system noise prediction. The core of the simulation process is comprised of methods at the complexity and fidelity level of conceptual aircraft design, i.e., typical overall aircraft design methods and a semi-empirical approach for the noise modeling. Dedicated interfaces allow to process data from high fidelity simulation that will support or even replace initial low fidelity results in the long run. All of the results shown and discussed in this study are limited to the fidelity level of conceptual design. The application of the simulation process to the NASA 55t Supersonic Technology Concept Aeroplane, i.e., based on non-proprietary data for this vehicle, yields similar noise level predictions when compared to the published NASA results. This is used as an initial feasibility check of the new process and confirms the underlying methods and models. Such an initial verification of the process is understood as an essential step due to the lack of available noise data for supersonic transport aircraft in general. The advantageous effect of engine noise shielding on the resulting system noise is demonstrated based on predicted level time histories and certification noise levels. After this initial verification, the process is applied to evaluate a conceptual supersonic transport design based on a PhD thesis with two engines mounted under the wing, which is referred to as aircraft TWO. Full access to this vehicle’s design and performance data allows to investigate the influence of flight procedures on the resulting noise impact along approach and departure. These noise results are then assembled according to proposed Federal Aviation Agency regulations in their Notice of Proposed Rulemaking, e.g., speed limitations, for Supersonic transport noise certification and the regulations from Noise Chapters of the Annex 16 from the International Civil Aviation Organization in order to evaluate the resulting levels as a function of the flight procedure.

noise↗

NASA NTRS2002

Options and Risk for Qualification of Electric Propulsion System

Electric propulsion vehicle systems envelop a wide range of propulsion alternatives including solar and nuclear, which present unique circumstances for qualification. This paper will address the alternatives for qualification of electric propulsion spacecraft systems. The approach taken will be to address the considerations for qualification at the various levels of systems definition. Additionally, for each level of qualification the system level risk implications will be developed. Also, the paper will explore the implications of analysis verses test for various levels of systems definition, while retaining the objectives of a verification program. The limitations of terrestrial testing will be explored along with the risk and implications of orbital demonstration testing. The paper will seek to develop a template for structuring of a verification program based on cost, risk and value return. A successful verification program should establish controls and define objectives of the verification compliance program. Finally the paper will seek to address the political and programmatic factors, which may impact options for system verification.

Bailey, Michelle↗

NASA NTRS2012

Synthetic and Enhanced Vision Systems for NextGen (SEVS) Simulation and Flight Test Performance Evaluation

The Synthetic and Enhanced Vision Systems for NextGen (SEVS) simulation and flight tests are jointly sponsored by NASA's Aviation Safety Program, Vehicle Systems Safety Technology project and the Federal Aviation Administration (FAA). The flight tests were conducted by a team of Honeywell, Gulfstream Aerospace Corporation and NASA personnel with the goal of obtaining pilot-in-the-loop test data for flight validation, verification, and demonstration of selected SEVS operational and system-level performance capabilities. Nine test flights (38 flight hours) were conducted over the summer and fall of 2011. The evaluations were flown in Gulfstream.s G450 flight test aircraft outfitted with the SEVS technology under very low visibility instrument meteorological conditions. Evaluation pilots flew 108 approaches in low visibility weather conditions (600 ft to 2400 ft visibility) into various airports from Louisiana to Maine. In-situ flight performance and subjective workload and acceptability data were collected in collaboration with ground simulation studies at LaRC.s Research Flight Deck simulator.

Shelton, Kevin J.↗

NASA NTRS2014

Visual Advantage of Enhanced Flight Vision System During NextGen Flight Test Evaluation

Synthetic Vision Systems and Enhanced Flight Vision System (SVS/EFVS) technologies have the potential to provide additional margins of safety for aircrew performance and enable operational improvements for low visibility operations in the terminal area environment. Simulation and flight tests were jointly sponsored by NASA's Aviation Safety Program, Vehicle Systems Safety Technology project and the Federal Aviation Administration (FAA) to evaluate potential safety and operational benefits of SVS/EFVS technologies in low visibility Next Generation Air Transportation System (NextGen) operations. The flight tests were conducted by a team of Honeywell, Gulfstream Aerospace Corporation and NASA personnel with the goal of obtaining pilot-in-the-loop test data for flight validation, verification, and demonstration of selected SVS/EFVS operational and system-level performance capabilities. Nine test flights were flown in Gulfstream's G450 flight test aircraft outfitted with the SVS/EFVS technologies under low visibility instrument meteorological conditions. Evaluation pilots flew 108 approaches in low visibility weather conditions (600 feet to 3600 feet reported visibility) under different obscurants (mist, fog, drizzle fog, frozen fog) and sky cover (broken, overcast). Flight test videos were evaluated at three different altitudes (decision altitude, 100 feet radar altitude, and touchdown) to determine the visual advantage afforded to the pilot using the EFVS/Forward-Looking InfraRed (FLIR) imagery compared to natural vision. Results indicate the EFVS provided a visual advantage of two to three times over that of the out-the-window (OTW) view. The EFVS allowed pilots to view the runway environment, specifically runway lights, before they would be able to OTW with natural vision.

Kramer, Lynda J.↗

NASA NTRS2023

Robotic and Crewed Mars Missions Increasing the Demand for Planetary Protection Technology Needs

Planetary protection (PP) policy seeks to avoid harmful contamination by limiting biological and relevant organic contamination from spacecraft as well as preventing adverse changes to Earth’s biosphere when extraterrestial samples are brought back to Earth. The PP policy at NASA was updated in 2021 (NPR 8715.24) and 2022 (NASA-STD-8719.27) to enable missions by expanding the decades old prescriptive requirements to allow for an option of adopting performance-based requirements that are objectivesdriven, risk-informed and case-assured. In parallel, the final PP knowledge gap workshop was completed representing the international consensus on the key areas to be considered in developing crew PP policy. These knowledge gaps focused on key technology development areas in 1) microbial and human health monitoring, 2) technical and operations needed for contamination control and 3) natural transport of contamination on Mars. As robotic missions start to implement performance-based approaches and research and technology efforts commence to inform crew policy the demand for data quality driven verification and validation in relevant space environments. Examples of the types of testing that is envisioned includes test as you fly validation and verification of decontamination systems in a relevant on-orbit and Mars environment, developing lethality curves of terrestrial organisms to further our understanding of the biocidal impacts of Mars and the space environment, and particle transport model validation and verification. Thus, the PP discipline has identified the need for groundbased space environments to perform preliminary testing as validation and verification of flight systems and to advance the technology readiness level prior to further testing on-orbit or lunar environments to prepare for Mars.

J. Nick Benardini↗

NASA NTRSDate not supplied

Robotic and Crewed Mars Missions Increasing the Demand for Planetary Protection Technology Needs

Planetary protection (PP) policy seeks to avoid harmful contamination by limiting biological and relevant organic contamination from spacecraft as well as preventing adverse changes to Earth’s biosphere when extraterrestrial samples are brought back to Earth. The PP policy at NASA was updated in 2021 (NPR 8715.24) and 2022 (NASA-STD-8719.27) to enable missions by expanding the decades old prescriptive requirements to allow for an option of adopting performance-based requirements that are objectives-driven, risk-informed and case-assured. In parallel, the final PP knowledge gap workshop was completed representing the international consensus on the key areas to be considered in developing crew PP policy. These knowledge gaps focused on key technology development areas in 1) microbial and human health monitoring, 2) technical and operations needed for contamination control and 3) natural transport of contamination on Mars. As robotic missions start to implement performance-based approaches and research and technology efforts commence to inform crew policy the demand for data quality driven verification and validation in relevant space environments. Examples of the types of testing that is envisioned includes test as you fly validation and verification of decontamination systems in a relevant on-orbit and Mars environment, developing lethality curves of terrestrial organisms to further our understanding of the biocidal impacts of Mars and the space environment, and particle transport model validation and verification. Thus, the PP discipline has identified the need for ground-based space environments to perform preliminary testing as validation and verification of flight systems and to advance the technology readiness level prior to further testing on-orbit or lunar environments to prepare for Mars.

J Nick Benardini↗

NASA NTRS2010

A Machine-Checked Proof of A State-Space Construction Algorithm

This paper presents the correctness proof of Saturation, an algorithm for generating state spaces of concurrent systems, implemented in the SMART tool. Unlike the Breadth First Search exploration algorithm, which is easy to understand and formalise, Saturation is a complex algorithm, employing a mutually-recursive pair of procedures that compute a series of non-trivial, nested local fixed points, corresponding to a chaotic fixed point strategy. A pencil-and-paper proof of Saturation exists, but a machine checked proof had never been attempted. The key element of the proof is the characterisation theorem of saturated nodes in decision diagrams, stating that a saturated node represents a set of states encoding a local fixed-point with respect to firing all events affecting only the node s level and levels below. For our purpose, we have employed the Prototype Verification System (PVS) for formalising the Saturation algorithm, its data structures, and for conducting the proofs.

Catano, Nestor↗

NASA NTRSDate not supplied

A Formal Verification Framework for Runtime Assurance

The simplex architecture is an instance of Runtime Assurance (RTA) where a trusted component takes control of a safety-critical system when an untrusted component violates a safety property. This paper presents a formalization of the simplex RTA framework in the language of hybrid programs. A feature of this formal verification framework is that, for a given system, a specific instantiation can be created and its safety properties are guaranteed by construction. Instantiations may be kept at varying levels of generality, allowing for black box components, such as ML/AI-based controllers, to be modeled. The framework is written in the Prototype Verification System (PVS) using Plaidypvs, an embedding of differential dynamic logic in PVS. As a proof of concept, the framework is illustrated on an automatic vehicle braking system.

Runtime assurance↗

NASA NTRSDate not supplied

A Formal Verification Framework for Runtime Assurance

Runtime assurance↗

NASA NTRS2012

Verification and Validation Testing of the Bridle and Umbilical Device for Mars Science Laboratory

The Bridle Umbilical Device (BUD) subsystem is used during the Skycrane maneuver of the Mars Science Laboratory (MSL) during the final phases of the Entry Descent and Landing (EDL). During this phase the BUD subsystem will control the deployment of the MSL Rover from the Descent Stage. This paper covers the verification and validation testing of the subsystem. Testing included component through full system level testing. Testing ranged from simple bench top extraction tests to full system deploy drop test that included external disturbances such as the Rover mobility impulse. This paper will discuss the test that were performed, why they were performed and how these test results were used in the overall Verification and Validation of the MSL Skycrane phase.

Gallon, John↗

NASA NTRS2021

Pointing Error Budget Development and Methodology on the Psyche Project

The Psyche mission was selected by NASA as the 14th mission in the Discovery Program in 2017. The Psyche spacecraft utilizes solar electric propulsion, and will journey to the asteroid (16) Psyche during a 3.5 year trajectory after its planned 2022 launch. The spacecraft instrument suite includes a magnetometer, a multispectral imager, a gamma ray neutron spectrometer, and an X-band radio telecommunications system. It also includes the Deep Space Optical Communication technical demonstration. These instruments along with other spacecraft components require pointing accuracy to meet their scientific and engineering performance requirements. Early on in the project development, the team established a methodology by which pointing accuracy (knowledge and control) is analyzed against the system requirements by means of pointing error budgets and requirement allocations. A margin policy was implemented to ensure the instrument and engineering component pointing accuracy requirements will be met during verification and in flight. Psyche’s pointing management framework defines detailed rationales for the system and subsystem error allocations of the top level pointing accuracy requirements, with sufficient project level pointing margin, and supports end-to-end pointing requirement verification. This paper will present an overview of the Psyche project’s pointing error budget development process, and discuss the rationale behind the methodology. Psyche’s pointing budget methodology integrates best practices and lessons learned from heritage missions, while focusing on the specific needs of the Psyche spacecraft and its science instruments. Key challenges in the pointing error budget development will be reviewed, and a deep dive into two key Psyche pointing budgets are presented. The systems engineering of Psyche’s pointing budget methodology outlined in this paper will serve as a resource for future deep space missions.

Lai, Peter↗

NASA NTRS2007

Middleware Trade Study for NASA Domain

This presentation presents preliminary results of a trade study designed to assess three distributed simulation middleware technologies for support of the NASA Constellation Distributed Space Exploration Simulation (DSES) project and Test and Verification Distributed System Integration Laboratory (DSIL). The technologies are: the High Level Architecture (HLA), the Test and Training Enabling Architecture (TENA), and an XML-based variant of Distributed Interactive Simulation (DIS-XML) coupled with the Extensible Messaging and Presence Protocol (XMPP). According to the criteria and weights determined in this study, HLA scores better than the other two for DSES as well as the DSIL

Bowman, Dan↗

NASA NTRS2008

NASA Constellation Distributed Simulation Middleware Trade Study

This paper presents the results of a trade study designed to assess three distributed simulation middleware technologies for support of the NASA Constellation Distributed Space Exploration Simulation (DSES) project and Test and Verification Distributed System Integration Laboratory (DSIL). The technologies are the High Level Architecture (HLA), the Test and Training Enabling Architecture (TENA), and an XML-based variant of Distributed Interactive Simulation (DIS-XML) coupled with the Extensible Messaging and Presence Protocol (XMPP). According to the criteria and weights determined in this study, HLA scores better than the other two for DSES as well as the DSIL.

Hasan, David↗

NASA NTRS2016

Creating Systems Engineering Products with Executable Models in a Model-Based Engineering Environment

Applying systems engineering across the life-cycle results in a number of products built from interdependent sources of information using different kinds of system level analysis. This paper focuses on leveraging the Executable System Engineering Method (ESEM) which automates requirements verification (e.g. power and mass budget margins and duration analysis of operational modes) using executable SysML models. The particular value proposition is to integrate requirements, and executable behavior and performance models for certain types of system level analysis. The models are created with modeling patterns that involve structural, behavioral and parametric diagrams, and are managed by an open source Model Based Engineering Environment (named OpenMBEE). This paper demonstrates how the ESEM is applied in conjunction with OpenMBEE to create key engineering products (e.g. operational concept document) for the Alignment and Phasing System (APS) within the Thirty Meter Telescope (TMT) project, which is under development by the TMT International Observatory (TIO).

MBSE↗

NASA NTRSDate not supplied

Toward Design Assurance of Machine-Learning Airborne Systems

In recent years, Artificial Intelligence (AI) systems, enabled by Machine Learning (ML)technology, have demonstrated impressive progress and provides historic opportunities for the aviation industry. However, several key aspects of ML technology are not compatible with existing design assurance standards and make certification problematic. In this paper, we present a case study of a visual system with a Deep Neural Network (DNN) intended to detect and identify airport runway signs. Different use cases and variants of this system exhibit different levels of criticality ranging from design assurance level (DAL) D to B. We use the case study to illustrate the challenges of certification according to the current standards, such asDO-178C. We present the system design, data generation, training, and verification in detail and describe how the design assurance objectives can be met for a DAL D variant of the system. We also discuss gaps and potential approaches for the higher design assurance levels.

Avionics↗

NASA NTRS2014

Is Model-Based Development a Favorable Approach for Complex and Safety-Critical Computer Systems on Commercial Aircraft?

A system is safety-critical if its failure can endanger human life or cause significant damage to property or the environment. State-of-the-art computer systems on commercial aircraft are highly complex, software-intensive, functionally integrated, and network-centric systems of systems. Ensuring that such systems are safe and comply with existing safety regulations is costly and time-consuming as the level of rigor in the development process, especially the validation and verification activities, is determined by considerations of system complexity and safety criticality. A significant degree of care and deep insight into the operational principles of these systems is required to ensure adequate coverage of all design implications relevant to system safety. Model-based development methodologies, methods, tools, and techniques facilitate collaboration and enable the use of common design artifacts among groups dealing with different aspects of the development of a system. This paper examines the application of model-based development to complex and safety-critical aircraft computer systems. Benefits and detriments are identified and an overall assessment of the approach is given.

Torres-Pomales, Wilfredo↗

NASA NTRS1974

Advanced composite structures

A monograph is presented which establishes structural design criteria and recommends practices to ensure the design of sound composite structures, including composite-reinforced metal structures. (It does not discuss design criteria for fiber-glass composites and such advanced composite materials as beryllium wire or sapphire whiskers in a matrix material.) Although the criteria were developed for aircraft applications, they are general enough to be applicable to space vehicles and missiles as well. The monograph covers four broad areas: (1) materials, (2) design, (3) fracture control, and (4) design verification. The materials portion deals with such subjects as material system design, material design levels, and material characterization. The design portion includes panel, shell, and joint design, applied loads, internal loads, design factors, reliability, and maintainability. Fracture control includes such items as stress concentrations, service-life philosophy, and the management plan for control of fracture-related aspects of structural design using composite materials. Design verification discusses ways to prove flightworthiness.

Source record↗

NASA NTRSDate not supplied

Swarm Mentality: Toward Automatic Swarm State Awareness with Runtime Verification

Cyber-Physical Systems (CPSs) already exhibit impressive performance in all areas of human life, and swarms of CPSs promise to increase their capabilities even further. However, to effectively utilize CPS swarms their complexity of operation has to scale sub-linearly with the number of swarm members. Presenting the swarm to an operator as a single entity almost eliminates the additional per-member overhead entirely. To operate a swarm as one entity, and/or to increase the swarm’s autonomy, the operator and the swarm members need to reason and communicate at the same level of abstraction, i.e. the swarm needs a sense of “self.” Therefore, we require the ability to specify whole swarm properties yet monitor them at the member level. We examine one architecture for achieving this awareness by: 1) Defining a taxonomy for comparing techniques that synthesize this belief-state 2) Propose use of the Runtime Verification formal method to fill this role 3) Present preliminary designs for extending and embedding such a system in the Distributed Spacecraft Autonomy architecture to generate per-member monitors from swarm level specification.

Runtime Verification↗