Search NASA⌕ Search

SEARCH · Search NASA

Results for “logic and verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

249 records · Page 14

Verification of a Motion Cueing Strategy for Stall Recovery Training in a Commercial Transport Simulator

This presentation verifies a motion cueing strategy for improved pilot stall recovery training in commercial transport simulators. Eight airline transport pilots flew a high-altitude stall recovery task in the NASA B747 level-D-certified full flight simulator under three different motion configurations: no motion, baseline motion, and enhanced motion. For each motion condition, pilots performed the task with both baseline aircraft dynamics and aircraft dynamics enhanced with lateral-directional characteristics of the airplane at angle of attack approaching stall. Motion configuration significantly affected: 1) pilot opinions on the helpfulness of motion in performing the task, 2) the maximum roll angle in the stall maneuver, 3) the minimum load factor in the recovery, 4) the number of secondary stick shakers in the stall recovery, and 5) the maximum airspeed in the recovery. The two different aircraft dynamics significantly affected: 1) pilot opinions on the noticeability of the banking roll off near the stall and 2) the maximum roll angle in the stall maneuver. These results indicate that the relatively minor enhancements to the motion logic of heritage commercial transport simulators presented here can significantly improve pilot performance in simulated stall recoveries, and potentially improve stall recovery training.

Zaal, Petrus M. T.↗

Verification of a Motion Cueing Strategy for Stall Recovery Training in a Commercial Transport Simulator

This paper verifies a motion cueing strategy for improved pilot stall recovery training in commercial transport simulators. Eight airline transport pilots flew a high-altitude stall recovery task in the NASA B747 level-D-certified full flight simulator under three different motion configurations: no motion, baseline motion, and enhanced motion. For each motion condition, pilots performed the task with both baseline aircraft dynamics and aircraft dynamics enhanced with lateral-directional characteristics of the airplane at angle of attack approaching stall. Motion configuration significantly affected: 1) pilot opinions on the helpfulness of motion in performing the task, 2) the maximum roll angle in the stall maneuver, 3) the minimum load factor in the recovery, 4) the number of secondary stick shakers in the stall recovery, and 5) the maximum airspeed in the recovery. The two different aircraft dynamics significantly affected: 1) pilot opinions on the noticeability of the banking roll off near the stall and 2) the maximum roll angle in the stall maneuver. These results indicate that the relatively minor enhancements to the motion logic of heritage commercial transport simulators presented here can significantly improve pilot performance in simulated stall recoveries, and potentially improve stall recovery training.

Pilot Performance↗

Bridging the Gap Between Requirements and Model Analysis: Evaluation on Cyber-Physical Challenge Problems

We present a framework for introducing high-level requirement specifications in the automated analysis of dataflow models. By integrating the FRET requirements elicitation tool with the CoCoSim analyzer, our framework enables the analysis of hierarchical Simulink models against requirements written in a restricted English language. More precisely, we support: automatic extraction of Simulink model information and association of high-level requirements with target model signals and components; translation of temporal logic formulas into synchronous dataflow CoCoSpec specifications as well as Simulink monitors; and interpretation of counterexamples produced by the analysis both at the requirement and model level. The features provided by our framework are generic and can be used to integrate other requirements elicitation and Simulink/Lustre analysis tools. We report on the lessons learned from the application of our approach to the Lockheed Martin Cyber-Physical, aerospace-inspired challenge problems. For the analysis, we used the Kind2, Zustre, and Simulink Design Verifier (SLDV) tools.

Simulink↗

Symbolic LTL Compilation for Model Checking: Extended Abstract

In Linear Temporal Logic (LTL) model checking, we check LTL formulas representing desired behaviors against a formal model of the system designed to exhibit these behaviors. To accomplish this task, the LTL formulas must be translated into automata [21]. We focus on LTL compilation by investigating LTL satisfiability checking via a reduction to model checking. Having shown that symbolic LTL compilation algorithms are superior to explicit automata construction algorithms for this task [16], we concentrate here on seeking a better symbolic algorithm.We present experimental data comparing algorithmic variations such as normal forms, encoding methods, and variable ordering and examine their effects on performance metrics including processing time and scalability. Safety critical systems, such as air traffic control, life support systems, hazardous environment controls, and automotive control systems, pervade our daily lives, yet testing and simulation alone cannot adequately verify their reliability [3]. Model checking is a promising approach to formal verification for safety critical systems which involves creating a formal mathematical model of the system and translating desired safety properties into a formal specification for this model. The complement of the specification is then checked against the system model. When the model does not satisfy the specification, model-checking tools accompany this negative answer with a counterexample, which points to an inconsistency between the system and the desired behaviors and aids debugging efforts.

Rozier, Kristin Y.↗

Exploitation of a Validation Hierarchy for Modeling and Simulation

Across engineering there is an evolving need to increase reliance on physics-based simulation to develop, design and optimize engineering systems. This increased reliance on modeling and simulation has highlighted a growing need to transform the confidence that modeling and simulation analysts have in their results into credibility for systems engineers to design and field systems more quickly and with less physical testing. For isolated components of a complex system, where a single discipline may drive product design, this is less of a concern as the relationship is often straightforward and easy to explain. However, when these isolated components are integrated, and are expected to operate in a multi-disciplinary context in which safety critical systems are involved, new concepts and model assurance standards are required. In this paper we address this challenge by showing how a model validation hierarchy can be exploited to identify those model validation experiments that will contribute most to increasing confidence and credibility of modeling and simulation predictions. The approach that is adopted contains four main steps. The first step is the construction of a model validation hierarchy that links subsystems, assemblies, and components to a hierarchy of physical experiments that can be used support model validation. This hierarchy connects the concerns of systems engineers to those of the modeling and simulation analyst in a clear and logical way. The structure and content of this hierarchy is then used in a second step to establish which physical phenomena have the greatest impact on overall system performance metrics. A gap analysis technique, based upon modeling and simulation concerns, is then used to prioritize the important physical phenomenon. Unfortunately, a common outcome of such gap analyses is the identification of many important gaps and so, in the final step of our process, we advocate the use of a global sensitivity analysis as a means to complete the prioritization.

Verification and Validation↗

Exploitation of a Validation Hierarchy for Modeling and Simulation

Across engineering there is an evolving need to increase reliance on physics-based simulation to develop, design and optimize engineering systems. This increased reliance on modeling and simulation has highlighted a growing need to transform the confidence that modeling and simulation analysts have in their results into credibility for systems engineers to design and field systems more quickly and with less physical testing. For isolated components of a complex system, where a single discipline may drive product design, this is less of a concern as the relationship is often straightforward and easy to explain. However, when these isolated components are integrated, and are expected to operate in a multi-disciplinary context in which safety critical systems are involved, new concepts and model assurance standards are required. In this paper we address this challenge by showing how a model validation hierarchy can be exploited to identify those model validation experiments that will contribute most to increasing confidence and credibility of modeling and simulation predictions. The approach that is adopted contains four main steps. The first step is the construction of a model validation hierarchy that links subsystems, assemblies, and components to a hierarchy of physical experiments that can be used support model validation. This hierarchy connects the concerns of systems engineers to those of the modeling and simulation analyst in a clear and logical way. The structure and content of this hierarchy is then used in a second step to establish which physical phenomena have the greatest impact on overall system performance metrics. A gap analysis technique, based upon modeling and simulation concerns, is then used to prioritize the important physical phenomenon. Unfortunately, a common outcome of such gap analyses is the identification of many important gaps and so, in the final step of our process, we advocate the use of a global sensitivity analysis as a means to complete the prioritization.

Verification and Validation↗

Energetic Particles - microturbulence interaction thrust (EP SIWG white paper)

This white paper outlines a strategic approach to Energetic Particle (EP) research, aimed at applying the results to the future burning devices such as ITER. Our goal is to deepen the understanding of the interplay between plasma background microturbulence and diverse species of energetic ions in burning plasma devices. This strategy is poised to advance our knowledge in this crucial area of fusion science, paving the way for significant breakthroughs in plasma physics and fusion energy research. We consider the confinement of energetic ions such as auxiliary heating beams, minority ions from ICRH, and fusion product alpha particles. Recent studies have underscored the potential of EP/microturbulence interaction to enhance fusion plasma performance by stabilizing microturbulence. However, it also poses risks, such as exacerbating Alfvénic eigenmode (AE) instabilities, which could compromise the sustainability of plasma discharge by causing EP losses. The interplay between EPs and background microturbulence is evident in the phenomenon of effective pitch angle scattering, a crucial aspect of the quasilinear (QL) theory. This theory is integral to developing numerically-efficient yet comprehensive and self-consistent approaches, recently employed to investigate the relaxation of energetic particle populations in the holistic modeling of fusion-grade plasmas. The primary objectives of this white paper thrust encompass a dual focus. First is that we need to delve into the mechanisms through which microturbulence engenders effective pitch angle scattering. This investigation will entail the examination of the presence of known or self-consistently predicted spectra of modes accountable for microturbulence. In these explorations, electrostatic microturbulence serves as a logical initial stride towards achieving the trust's objectives. This endeavor is anticipated to yield formulations expressing the parametric dependencies of the effective pitch angle scattering frequency on variables such as thermal plasma electron and/or ion temperatures, as well as their respective thermal conductivities. In our second objective, we aim to delve into the intricate formation of zonal flow (ZF) structures amidst the complex interplay of microturbulence and Alfvenic eigenmodes (AEs). This endeavor poses greater challenges as we seek to unravel the macroscopic manifestations influenced by microturbulence, termed as zonal structures (ZS), stemming from microturbulence-induced ZF. Drawing from this understanding, we anticipate employing a QL approach to yield comprehensive insights into the distribution function of energetic particles (EP) within phase space. This method entails resolving the dominant multidimensional phase space diffusion processes while effectively averaging over the rapid ballistic responses. Nevertheless, substantial strides remain imperative to realize a comprehensive whole-device modeling framework. This entails meticulous verification and validation exercises against experimental observations, as well as rigorous benchmarking against theoretical frameworks and numerical simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Model Checking Degrees of Belief in a System of Agents

Reasoning about degrees of belief has been investigated in the past by a number of authors and has a number of practical applications in real life. In this paper we present a unified framework to model and verify degrees of belief in a system of agents. In particular, we describe an extension of the temporal-epistemic logic CTLK and we introduce a semantics based on interpreted systems for this extension. In this way, degrees of beliefs do not need to be provided externally, but can be derived automatically from the possible executions of the system, thereby providing a computationally grounded formalism. We leverage the semantics to (a) construct a model checking algorithm, (b) investigate its complexity, (c) provide a Java implementation of the model checking algorithm, and (d) evaluate our approach using the standard benchmark of the dining cryptographers. Finally, we provide a detailed case study: using our framework and our implementation, we assess and verify the situational awareness of the pilot of Air France 447 flying in off-nominal conditions.

MAS Verification↗

Synthesis of Correct Digital Controller Models from Specifications by Model Transformation (21-0320)

The design of high consequence controllers (in weapons systems, autonomy, etc.) that do what they are supposed to do is a significant challenge. Testing simply does not come close to meeting the requirements for assurance. Today circuit designers at Sandia (and elsewhere) typically capture the core behavior of their components using state models in tools such as STATEFLOW. They then check that their models meet certain requirements (e.g. “The system bus must not deadlock” or “both traffic lights at an intersection must not be green at the same time”) using tools called model checkers. If the model checker returns “yes” then the property is guaranteed to be satisfied by the model. However, there are several drawbacks to this industry practice: (1) there is a lot of detail to get right, this is particularly challenging when there are multiple components requiring complex coordination (2) any errors returned by the model checker have to be traced back through the design and fixed, necessitating rework, (3) there are severe scalability problems with this approach, particularly when dealing with concurrency. All this places high demands on the designers who now face not only an accelerated schedule but also controllers of increasing complexity. This report describes a new and fundamentally different approach to the construction of safety-critical digital controllers. Instead of directly constructing a complete model and then trying to verify it, the designer can start with an initial abstract (think “sketch”) model plus the requirements, from which a correct concrete model is automatically synthesized. There is no need for post-hoc verification of required functional properties. Having tool to carry this out will significantly impact the nation’s ability to ensure the safety of high-consequence digital systems. The approach has been implemented in a prototype tool, along with a suite of examples, including ones that reflect actual problems faced by designers. Our approach operates on a variant of Statecharts developed at Sandia called Qspecs. Statecharts are a widely used formalism for developing concurrent reactive systems, supporting scalability through allowing state models containing composite states, which are the serial or parallel composition of substates which can themselves contain statecharts. Statecharts enable an incremental style of development, in which states are progressively refined to incorporate greater detail in an incremental model of software development. Our approach formulates a set of constraints from the structure of the models and the requirements and propagates these constraints to a fixpoint. The solution to the constraints is an inductive invariant along with guards on the transitions. We also show how our approach extends to implementation refinement, decomposition, composition, and elaboration. We currently handle safety requirements written in LTL (Linear Temporal Logic)

42 ENGINEERING↗

J-2X Abort System Development

The J-2X is an expendable liquid hydrogen (LH2)/liquid oxygen (LOX) gas generator cycle rocket engine that is currently being designed as the primary upper stage propulsion element for the new NASA Ares vehicle family. The J-2X engine will contain abort logic that functions as an integral component of the Ares vehicle abort system. This system is responsible for detecting and responding to conditions indicative of impending Loss of Mission (LOM), Loss of Vehicle (LOV), and/or catastrophic Loss of Crew (LOC) failure events. As an earth orbit ascent phase engine, the J-2X is a high power density propulsion element with non-negligible risk of fast propagation rate failures that can quickly lead to LOM, LOV, and/or LOC events. Aggressive reliability requirements for manned Ares missions and the risk of fast propagating J-2X failures dictate the need for on-engine abort condition monitoring and autonomous response capability as well as traditional abort agents such as the vehicle computer, flight crew, and ground control not located on the engine. This paper describes the baseline J-2X abort subsystem concept of operations, as well as the development process for this subsystem. A strategy that leverages heritage system experience and responds to an evolving engine design as well as J-2X specific test data to support abort system development is described. The utilization of performance and failure simulation models to support abort system sensor selection, failure detectability and discrimination studies, decision threshold definition, and abort system performance verification and validation is outlined. The basis for abort false positive and false negative performance constraints is described. Development challenges associated with information shortfalls in the design cycle, abort condition coverage and response assessment, engine-vehicle interface definition, and abort system performance verification and validation are also discussed.

Santi, Louis M.↗

FPDetect: Efficient Reasoning About Stencil Programs Using Selective Direct Evaluation

We present FPDetect, a low-overhead approach for detecting logical errors and soft errors affecting stencil computations without generating false positives. We develop an offline analysis that tightly estimates the number of floating-point bits preserved across stencil applications. This estimate rigorously bounds the values expected in the data space of the computation. Violations of this bound can be attributed with certainty to errors. FPDetect helps synthesize error detectors customized for user-specified levels of accuracy and coverage. FPDetect also enables overhead reduction techniques based on deploying these detectors coarsely in space and time. Experimental evaluations demonstrate the practicality of our approach.

97 MATHEMATICS AND COMPUTING↗

Development and Testing of Functionally Operative and Visually Appealing Remote Firing Room Displays and Applications

This internship provided an opportunity for an intern to work with NASA's Ground Support Equipment (GSE) for the Spaceport Command and Control System (SCCS) at Kennedy Space Center as a remote display developer, under NASA technical mentor Kurt Leucht. The main focus was on creating remote displays and applications for the hypergolic and high pressure helium subsystem team to help control the filling of the respective tanks. As a remote display and application developer for the GSE hypergolic and high pressure helium subsystem team the intern was responsible for creating and testing graphical remote displays and applications to be used in the Launch Control Center (LCC) on the Firing Room's computers. To become more familiar with the subsystem, the individual attended multiple project meetings and acquired their specific requirements regarding what needed to be included in the software. After receiving the requirements for the displays, the next step was to create displays that had both visual appeal and logical order using the Display Editor, on the Virtual Machine (VM). In doing so, all Compact Unique Identifiers (CUI), which are associated with specific components within the subsystem, were need to be included in each respective display for the system to run properly. Then, once the display was created it was to be tested to ensure that the display runs as intended by using the Test Driver, also found on the VM. This Test Driver is a specific application that checks to make sure all the CUIs in the display are running properly and returning the correct form of information. After creating and locally testing the display it needed to go through further testing and evaluation before deemed suitable for actual use. For the remote applications the intern was responsible for creating a project that focused on channelizing each component included in each display. The core of the application code was created by setting up spreadsheets and having an auto test generator, generate the complete code structure. This application code was then loaded and ran on a testing environment set to ensure the code runs as anticipated. By the end of the semester-long experience at NASA's Kennedy Space Center, the individual should have gained great knowledge and experience in various areas of both display and application development and testing. They were able to demonstrate this new knowledge obtained by creating multiple successful remote displays that will one day be used by the hypergolic and high pressure helium subsystem team in the LCC's firing rooms to service the new Orion spacecraft. The completed display channelization application will be used to receive verification from NASA quality engineers.

Display Devices↗

ADEPT for Secondary Payloads

Deployable entry vehicles provide an enabling capability for large payloads at destinations across the solar system. The primary advantage of such systems derives from the fundamental limitation of available launch vehicle shroads preventing tried-and-true rigid aeroshell technology from being applied. However, little mission-pull exists for deployable entry vehicle technology for missions where the entry vehicle is the primary payload and can fit within available shrouds. The propensity toward applying rigid aeroshell technology is logical given that deployable concepts are higher risk and provide no marginal scientific benefit for missions where a rigid aeroshell is an option. A movement toward flying smaller spacecraft has emerged in recent years and is revealing novel applications for deployable entry vehicles as secondary payloads. Secondary payloads must minimize interference with the primary payload in order to ease accomodation. Advancements in small spacecraft technology have caught the attention of government entities who are now recognizing the high value proposition of small spacecraft for frequent, incremental technology development and science return rather than the traditional high cost and infrequent big-bang approaches. Worldwide, well over 200 small satellites (mass < 180 kg) have launched in recent years for such purposes as eduation, technology development, science, commerce, and defense. The Adaptable Deployable Entry and Placement Technology (ADEPT), a mechanically-deployable entry vehicle technology, has been under development at NASA since 2011. An Ames Center Innovation Fund (CIF) proposal was recently awarded to study ADEPT for EDL of small payloads. The unique capability of ADEPT for small science payloads comes from its ability to stow within a slender volume and deploy passively to achieve a mass-efficient drag surface with a high heat rate capability. The low ballistic coefficient results in entry heating and mechanical loads that can be met by a revolutionary three-dimensionally woven carbon fabric supported with rib structures. This carbon fabric has test-proven capability as both primary structure and payload thermal protection. This presentation will inform the EDL community of the capability of ADEPT for delivery of small secondary payloads as well as provide status of on-going technology development activities. Results of a mission applications study for secondary payloads to Mars and Venus will be presented. A primary goal of these mission design activities is to integrate high-value verification approaches wherever possible. For example, for some mission applications it is possible to test in NASA arc jet facilities at full-scale. This enables endto- end thermostructural requirement verification with a single test. Another important challenge that needs to be solved is the reliability of the decelerator to achieve the desired shape using simple passive mechanical actuators (such as springs) that do not require power from the primary payload for deployment. A configuration of ADEPT is being prototyped and used to evaluate the functionality and reliability of the deployment mechanism through bench-top testing. The prototype will then be tested in a low speed wind tunnel in late 2014 to evaluate aerodynamic load-carrying capability and deflected shape. Results of the deployment testing and status of wind tunnel test plans will be discussed.

Smith, B.↗

R2U2 in Space: System and Software Health Management for Small Satellites

In order for small but complex systems like rovers, SmallSats, or Unmanned Aircraft (UAS) to operate autonomously, they must have a real-time solution for assessing their own system health. System and Software Health Management (SHM) enables better detection of faulty sensors and software problems, and enables better fault management including mitigation of unpredicted fault scenarios in the absence of a human on-board. In recent work, we have developed a Responsive, Realizable, Unobtrusive Unit (R2U2) for on-board SHM of autonomous UAS and demonstrated its ability to detect faults during flight time. These faults, from sensor failures, to software problems, to malicious security attacks, can present as transient temporal faults that even humans are challenged to find. An R2U2 congfiuration is a modular combination of multiple types of temporal logic runtime observers with fault-specic Bayesian Nets and sensor filters. R2U2 reasons about both on-board hardware and software components; R2U2 itself can be instantiated as an independent FPGA (Field-Programmable Gate Array)-based conguration or as a software component running independently from other software on-board. Small satellites, such as CubeSats, also require on-board SHM and failure mitigation, as limited telemetry bandwidth does not allow the transmission of the entire system state for ground-based health management. However, the autonomous operation of satellites brings a set of challenges different from UAS, including the effects of radiation on non-rad-hard, low-cost components, and the harsher environment of space. We surmise that a new extension of R2U2 could be adapted to help better detect, for example, radiation errors in cheaper COTS (Commercial Off the Shelf) (not rad-hard) components often used in small space systems. Since small satellites often operate in coordination, we will also examine new ways of distributed monitoring of their communication and cooperation and real-time detection of off-nominal situations utilizing multiple satellites. This talk will discuss preliminary work and ideas for building on terrestrial success of system and software health management for the harsher, and differently challenging, environment of space.

Runtime Verification & Validation↗

Real Time On-line Space Research Laboratory Environment Monitoring with Off-line Trend and Prediction Analysis

One of the responsibilities of the NASA Glenn Principal Investigator Microgravity Services is to support NASA sponsored investigators in the area of reduced-gravity acceleration data analysis, interpretation and the monitoring of the reduced-gravity environment on-board various carriers. With the International Space Station currently operational, a significant amount of acceleration data is being down-linked and processed on ground for both the space station onboard environment characterization (and verification) and scientific experiments. Therefore, to help principal investigator teams monitor the acceleration level on-board the International Space Station to avoid undesirable impact on their experiment, when possible, the NASA Glenn Principal Investigator Microgravity Services developed an artificial intelligence monitoring system, which detects in near real time any change in the environment susceptible to affect onboard experiments. The main objective of the monitoring system is to help research teams identify the vibratory disturbances that are active at any instant of time onboard the International Space Station that might impact the environment in which their experiment is being conducted. The monitoring system allows any space research scientist, at any location and at any time, to see the current acceleration level on-board the Space Station via the World Wide Web. From the NASA Glenn s Exploration Systems Division web site, research scientists can see in near real time the active disturbances, such as pumps, fans, compressor, crew exercise, re-boost, extra-vehicular activity, etc., and decide whether or not to continue operating or stopping (or making note of such activity for later correlation with science results) their experiments based on the g-level associated with that specific event. A dynamic graphical display accessible via the World Wide Web shows the status of all the vibratory disturbance activities with their degree of confidence as well as their g-level contribution to the environment. The system can detect both known and unknown vibratory disturbance activities. It can also perform trend analysis and prediction by analyzing past data over many Increments of the space station for selected disturbance activities. This feature can be used to monitor the health of onboard mechanical systems to detect and prevent potential system failure as well as for use by research scientists during their science results analysis. Examples of both real time on-line vibratory disturbance detection and off-line trend analysis are presented in this paper. Several soft computing techniques such as Kohonen s Self-Organizing Feature Map, Learning Vector Quantization, Back-Propagation Neural Networks, and Fuzzy Logic were used to design the system.

Jules, Kenol↗