SEARCH · Search NASA

Results for “assurance tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Dynamic Assurance of Autonomous Systems Through Ground Control Software

Assurance cases have emerged as a way to build trust in complex autonomous systems. Many assurance case justifications for such systems need to be constantly reevaluated based on the current system context and performance. Autonomous systems, especially those deployed in remote environments, often have a ground control system that enables monitoring and remote operations. In this paper, we propose a dynamic assurance framework that aims at connecting the assurance case with the ground control system. We use the ground control system to facilitate dynamic evaluation of quantitative assurance measures that support various justifications in the assurance case. We demonstrate the proposed dynamic assurance framework on the NASA Ames Research Center project Troupe. We use a combination of in-house and external tools to identify the assurance measures, formalize the related requirements, and generate monitors that feed the data to the external ground control system.

dynamic assurance case↗

NASA NTRS1992

Integration of tools for the Design and Assessment of High-Performance, Highly Reliable Computing Systems (DAHPHRS), phase 1

Systems for Space Defense Initiative (SDI) space applications typically require both high performance and very high reliability. These requirements present the systems engineer evaluating such systems with the extremely difficult problem of conducting performance and reliability trade-offs over large design spaces. A controlled development process supported by appropriate automated tools must be used to assure that the system will meet design objectives. This report describes an investigation of methods, tools, and techniques necessary to support performance and reliability modeling for SDI systems development. Models of the JPL Hypercubes, the Encore Multimax, and the C.S. Draper Lab Fault-Tolerant Parallel Processor (FTPP) parallel-computing architectures using candidate SDI weapons-to-target assignment algorithms as workloads were built and analyzed as a means of identifying the necessary system models, how the models interact, and what experiments and analyses should be performed. As a result of this effort, weaknesses in the existing methods and tools were revealed and capabilities that will be required for both individual tools and an integrated toolset were identified.

Scheper, C.↗

NASA NTRS2002

The Effect of Friction on Penetration in Friction Stir Welding

"Friction stir butt welding," as it was originally termed by Wayne Thomas and Christopher Dawes, in the early 1990s, but now commonly called "friction stir welding," has made great progress as a new welding technique. Commercially, friction stir welding (FSW) is finding many applications. Marine Aluminum of Norway is using the process for welding 20-meter aluminum sheets for ferry construction. Japan is using the technique in development work on bullet trains. Sapa of Sweden utilizes FSW in the landing of refrigeration units for cargo ships. In the United States, Boeing is using the technique in the production of Delta rockets. Eclipse Aviation Corporation plans to use FSW to produce a business jet available in August, 2003. Marshall Space Flight Center has been investigating the use of FSW for assembly of the Shuttle's external fuel tank since the late 1990s and hopes to have the process in use by the summer of 2002. In FSW, a cylindrical pin tool of hardened steel, is rotated and plunged into the abutting edges of the parts to be joined. The tool is plunged into the weldment to within about .050 in of the bottom to assure full penetration. As the tool moves along the joint, the tool shoulder helps produce frictional heating, causing the material to plasticize. The metal of the two abutting plates flows from the front of the tool to the back where it cools and coalesces to form a weld in the solid phase.

Steve Rapp↗

NASA NTRS1989

Dynamic analysis of space structures including elastic, multibody, and control behavior

The problem is to develop analysis methods, modeling stategies, and simulation tools to predict with assurance the on-orbit performance and integrity of large complex space structures that cannot be verified on the ground. The problem must incorporate large reliable structural models, multi-body flexible dynamics, multi-tier controller interaction, environmental models including 1g and atmosphere, various on-board disturbances, and linkage to mission-level performance codes. All areas are in serious need of work, but the weakest link is multi-body flexible dynamics.

Pinson, Larry↗

NASA NTRS1994

Production and quality assurance automation in the Goddard Space Flight Center Flight Dynamics Facility

The Flight Dynamics Facility (FDF) at the NASA Goddard Space Flight Center (GSFC) generates numerous products for NASA-supported spacecraft, including the Tracking and Data Relay Satellites (TDRS's), the Hubble Space Telescope (HST), the Extreme Ultraviolet Explorer (EUVE), and the space shuttle. These products include orbit determination data, acquisition data, event scheduling data, and attitude data. In most cases, product generation involves repetitive execution of many programs. The increasing number of missions supported by the FDF has necessitated the use of automated systems to schedule, execute, and quality assure these products. This automation allows the delivery of accurate products in a timely and cost-efficient manner. To be effective, these systems must automate as many repetitive operations as possible and must be flexible enough to meet changing support requirements. The FDF Orbit Determination Task (ODT) has implemented several systems that automate product generation and quality assurance (QA). These systems include the Orbit Production Automation System (OPAS), the New Enhanced Operations Log (NEOLOG), and the Quality Assurance Automation Software (QA Tool). Implementation of these systems has resulted in a significant reduction in required manpower, elimination of shift work and most weekend support, and improved support quality, while incurring minimal development cost. This paper will present an overview of the concepts used and experiences gained from the implementation of these automation systems.

Chapman, K. B.↗

NASA NTRSDate not supplied

Guiding Integration of Formal Verification in Assurance Cases

Assurance cases are being increasingly acknowledged as away to build trust in complex systems with autonomous capabilities. An assurance case is a comprehensive, defensible, and valid justification that a system will function as intended for a specific mission and operating environment. Formal verification is often reserved for the most critical components of such systems. However, formal verification tools are often complex, and their usage is subject to many constraints and contextual dependencies. This can raise challenges both for performing the verification as well as reflecting the verification results appropriately in the assurance case, especially for non-expert users of the verification tool. To address these challenges, we present a tool-supported methodology for integrating formal verification results in an assurance case by capturing key verification method information in a rigorously constructed assurance case. In particular, we capture the tool specification in terms of its inputs, outputs, and assurance constraints as assumptions over inputs and guarantees provided over its outputs. The tool specification is parametrized over the inputs and outputs to both guide the intended application of the tool, as well as to check that the tool has been applied following the stated assumptions and that the guarantees hold. We define a generic tool assurance argument pattern that enables integration of the verification results in the assurance case by allowing custom refinement and automated instantiation for each tool use. We demonstrate our methodology on two formal verification tools and their applications to the verification of neural network properties for the aircraft domain.

Assurance Cases↗

NASA NTRS2004

A Tool for Verification and Validation of Neural Network Based Adaptive Controllers for High Assurance Systems

High reliability of mission- and safety-critical software systems has been identified by NASA as a high-priority technology challenge. We present an approach for the performance analysis of a neural network (NN) in an advanced adaptive control system. This problem is important in the context of safety-critical applications that require certification, such as flight software in aircraft. We have developed a tool to measure the performance of the NN during operation by calculating a confidence interval (error bar) around the NN's output. Our tool can be used during pre-deployment verification as well as monitoring the network performance during operation. The tool has been implemented in Simulink and simulation results on a F-15 aircraft are presented.

Gupta, Pramod↗

NASA NTRS2011

Data Interconnection Exploration

This project involves innovating the way the Quality Assurance organization at the Jet Propulsion Laboratory (JPL) tracks the receiving inspection of JPL Critical Items (JCI) procured from suppliers. The Quality Assurance organization uses a Microsoft Access based front-end to enter items into an inspection queue. The current design has grown to be much more than was expected when the inspection queue system was created in 2007. The goal is to migrate to a web based solution that will allow the handling of more data, multiple input interfaces, and customizable display options. This has been achieved by implementing a divided tables scheme, the use of ColdFusion programming language, and the usage of Web 2.0 technologies such as AJAX and jQuery. These updates will allow for future expansion as well as the standardization of inspection queues for the Quality Assurance organization. When engineers and scientists order flight hardware, they cannot use it straight away. After a spacecraft or a satellite has been launched, it will be impossible to repair; therefore, the parts used must be inspected to make sure they are operating correctly and within the required specifications. The task of inspecting these JPL Critical Items (JCI) falls on the Quality Assurance organization. One of the tools the receiving inspection group uses is a database to maintain a queue of inspections that need to be done and of inspections that have been completed. The current Access interface has worked well but increased amounts of data, multiple input interfaces, and changes to how data is handled have made it necessary to seek a new way of organizing items for inspection. In addition, the different inspection groups have recently been merged and each has different ways of keeping track of inspection information. The ultimate goal is for the new group to have one shared inspection queue and website. To achieve this goal, I have been working with Ian Luczon of Procurement Quality Assurance and 3 Myers Hawkins, another intern, to not only create the new queue for receiving inspection but also a central web portal for the newly combined inspection group.

flight hardware↗

NASA NTRS2021

Systems Engineering and Assurance Modeling (SEAM): A Web-Based Solution for Integrated Mission Assurance

We present an overview of the Systems Engineering and Assurance Modeling (SEAM) platform, a web-browser-based tool which is designed to help engineers evaluate the radiation vulnerabilities and develop an assurance approach for electronic parts in space systems. The SEAM framework consists of three interconnected modeling tools, a SysML compatible system description tool, a Goal Structuring Notation (GSN) visual argument tool, and Bayesian Net and Fault Tree extraction and export tools. The SysML and GSN sections also have a coverage check application that ensures that every radiation fault identified on the SysML side is also addressed in the assurance case in GSN. The SEAM platform works on space systems of any degree of radiation hardness but is especially helpful for assessing radiation performance in systems with commercial-off-the-shelf (COTS) electronic components.

SEAM↗

NASA NTRS1976

Full employment maintenance in the private sector

Operationally, full employment can be accomplished by applying modern computer capabilities, game and decision concepts, and communication feedback possibilities, rather than accepted economic tools, to the problem of assuring invariant full employment. The government must provide positive direction to individual firms concerning the net number of employees that each firm must hire or refrain from hiring to assure national full employment. To preserve free enterprise and the decision making power of the individual manager, this direction must be based on each private firm's own numerical employment projections.

Young, G. A.↗

NASA NTRS2007

Software Process Assurance for Complex Electronics

Complex Electronics (CE) now perform tasks that were previously handled in software, such as communication protocols. Many methods used to develop software bare a close resemblance to CE development. Field Programmable Gate Arrays (FPGAs) can have over a million logic gates while system-on-chip (SOC) devices can combine a microprocessor, input and output channels, and sometimes an FPGA for programmability. With this increased intricacy, the possibility of software-like bugs such as incorrect design, logic, and unexpected interactions within the logic is great. With CE devices obscuring the hardware/software boundary, we propose that mature software methodologies may be utilized with slight modifications in the development of these devices. Software Process Assurance for Complex Electronics (SPACE) is a research project that used standardized S/W Assurance/Engineering practices to provide an assurance framework for development activities. Tools such as checklists, best practices and techniques were used to detect missing requirements and bugs earlier in the development cycle creating a development process for CE that was more easily maintained, consistent and configurable based on the device used.

Plastow, Richard A.↗

NASA NTRS2007

Software Process Assurance for Complex Electronics (SPACE)

Complex Electronics (CE) are now programmed to perform tasks that were previously handled in software, such as communication protocols. Many of the methods used to develop software bare a close resemblance to CE development. For instance, Field Programmable Gate Arrays (FPGAs) can have over a million logic gates while system-on-chip (SOC) devices can combine a microprocessor, input and output channels, and sometimes an FPGA for programmability. With this increased intricacy, the possibility of software-like bugs such as incorrect design, logic, and unexpected interactions within the logic is great. Since CE devices are obscuring the hardware/software boundary, we propose that mature software methodologies may be utilized with slight modifications in the development of these devices. Software Process Assurance for Complex Electronics (SPACE) is a research project that looks at using standardized S/W Assurance/Engineering practices to provide an assurance framework for development activities. Tools such as checklists, best practices and techniques can be used to detect missing requirements and bugs earlier in the development cycle creating a development process for CE that will be more easily maintained, consistent and configurable based on the device used.

Plastow, Richard A.↗

NASA NTRS2019

Challenges in Qualification of Thermal Protection Systems for Extreme Entry Environments

Mahzari, Milad↗

NASA NTRS2016

Distribution and Validation of CERES Irradiance Global Data Products Via Web Based Tools

The CERES SYN1deg product provides climate quality 3-hourly globally gridded and temporally complete maps of top of atmosphere, in atmosphere, and surface fluxes. This product requires efficient release to the public and validation to maintain quality assurance. The CERES team developed web-tools for the distribution of both the global gridded products and grid boxes that contain long term validation sites that maintain high quality flux observations at the Earth's surface. These are found at: http://ceres.larc.nasa.gov/order_data.php. In this poster we explore the various tools available to users to sub-set, download, and validate using surface observations the SYN1Deg and Surface-EBAF products. We also analyze differences found in long-term records from well-maintained land surface sites such as the ARM central facility and high quality buoy radiometers, which due to their isolated nature cannot be maintained in a similar manner to their land based counterparts.

Rutan, David↗

NASA NTRS2019

NASA Armstrong (AFRC) Human Factors Program

Armstrong Flight Research Center is NASA’s premier flight research center. It is located on Edwards AFB in the high desert of California. The AFRC Safety and Mission Assurance Directorates Human Factors Program is one tool that enables Armstrong to be the national center of excellence for conducting leading edge aerospace flight research, airborne science, and airborne astronomy by providing responsive, effective, and adaptive Safety & Mission Assurance support. The AFRC Human Factors Specialist is also a member of the Agency Human Factors Task Force which provides and expands the understanding and impact of Human Factors across the Agency. The Program is managed by the Office of Safety and Mission Assurance at NASA Headquarters.

Kiriokos, Nick C.↗

NASA NTRS2019

Challenges in Qualification of Thermal Protection Systems in Extreme Entry Environments

Planetary entry vehicles employ ablative TPS materials to shield the aeroshell from entry aeroheating environments. To ensure mission success, it must be demonstrated that the heat shield system, including local features such as seams, does not fail at conditions that are suitably margined beyond those expected in flight. Furthermore, its thermal response must be predictable, with acceptable fidelity, by computational tools used in heat shield design. Mission assurance is accomplished through a combination of ground testing and material response modelling. A material's robustness to failure is verified through arcjet testing while its thermal response is predicted by analytical tools that are verified against experimental data. Due to limitations in flight-like ground testing capability and lack of validated high-fidelity computational models, qualification of heat shield materials is often achieved by piecing together evidence from multiple ground tests and analytical simulations, none of which fully bound the flight conditions and vehicle configuration. Extreme heating environments (>2000 W/sq. cm heat flux and >2 atm pressure), experienced during entries at Venus, Saturn and Ice Giants, further stretch the current testing and modelling capabilities for applicable TPS materials. Fully-dense Carbon Phenolic was the material of choice for these applications; however, since heritage raw materials are no longer available, future uses of re-created Carbon Phenolic will require re-qualification. To address this sustainability challenge, NASA is developing a new dual-layer material based on 3D weaving technology called Heat shield for Extreme Entry Environments (HEEET). Regardless of TPS material, extreme environments pose additional certification challenges beyond what has been typical in recent NASA missions. Scope of this presentation: This presentation will give an overview of challenges faced in verifying TPS performance at extreme heating conditions. Examples include: (1) Bounding aeroheating parameters (heat flux, pressure, shear and enthalpy) in ground facilities. How to certify TPS if environments can't be bounded or aeroheating parameters can't be simultaneously achieved. (2) Higher uncertainties in ground test environments (facility calibration and analytical predictions) at extreme conditions. (3) Testing in flows similar to planetary atmosphere composition (H2/He for Gas and Ice Giants). (4) Test sample size limitations for qualifying seam designs. (5) Lack of computational tools capable of simulating all significant aspects of TPS performance (including initiation and propagation of failures). This presentation will provide recommendations on how the EDL community can address these challenges and mitigate some of the risks involved in flying TPS materials at extreme conditions. Examples include: (1) Dedicated activity to understanding TPS failure modes. Develop computational tools capable of modelling fluid interaction with material's thermostructural response. Validate these tools through failure testing. A better understanding of failure mechanisms may eliminate the need to fully bound all aeroheating parameters in ground testing. (2) Enhancements to current testing facilities to simulate flight-like ablation mechanism (ex. testing in Nitrogen at Ames Interaction Heating Facility to limit oxidation in favor of more sublimation). (3) Improved characterization of test conditions with new diagnostic methods and determination of environment uncertainty through rigorous statistical analysis of available data. (4) Design margin policies that are directly tied to uncertainties in ground test environments and modelling fidelity

Mahzari, Milad↗

NASA NTRS1990

A3I visibility modeling project

The Army-NASA Aircrew Aircraft Integration program is supporting a joint project to build a visibility computer-aided design (CAD) tool. CAD has become an essential tool in modern engineering applications. CAD tools are used to create engineering drawings and to evaluate potential designs before they are physically realized. The visibility CAD tool will provide the design engineer with a tool to aid in the location and specification of windows, displays, and control in crewstations. In an aircraft cockpit the location of instruments and the emissive and reflective characteristics of the surfaces must be determined to assure adequate aircrew performance. The visibility CAD tool will allow the designer to ask and answer many of these questions in the context of a three-dimensional graphical representation of the cockpit. The graphic representation of the cockpit is a geometrically valid model of the cockpit design. A graphic model of a pilot, called the pilot manikin, can be placed naturalistically in the cockpit model. The visibility tool has the capability of mapping the cockpit surfaces and other objects modeled in this graphic design space onto the simulated pilot's retinas for a given visual fixation.

Larimer, James↗

NASA NTRS2015

Understanding and Evaluating Assurance Cases

Assurance cases are a method for providing assurance for a system by giving an argument to justify a claim about the system, based on evidence about its design, development, and tested behavior. In comparison with assurance based on guidelines or standards (which essentially specify only the evidence to be produced), the chief novelty in assurance cases is provision of an explicit argument. In principle, this can allow assurance cases to be more finely tuned to the specific circumstances of the system, and more agile than guidelines in adapting to new techniques and applications. The first part of this report (Sections 1-4) provides an introduction to assurance cases. Although this material should be accessible to all those with an interest in these topics, the examples focus on software for airborne systems, traditionally assured using the DO-178C guidelines and its predecessors. A brief survey of some existing assurance cases is provided in Section 5. The second part (Section 6) considers the criteria, methods, and tools that may be used to evaluate whether an assurance case provides sufficient confidence that a particular system or service is fit for its intended use. An assurance case cannot provide unequivocal "proof" for its claim, so much of the discussion focuses on the interpretation of such less-than-definitive arguments, and on methods to counteract confirmation bias and other fallibilities in human reasoning.

Rushby, John↗