Search NASA⌕ Search

SEARCH · Search NASA

Results for “program verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,603 records · Page 89

Anthropometric Measurement Procedures at the Anthropometry and Biomechanics Facility

The Anthropometry and Biomechanics Facility (ABF) at NASA Johnson Space Center (JSC) is the centralized source of anthropometry data at NASA for use in requirement development, engineering design, and verification of human-system integrations such as spacesuits and vehicles. To ensure the collection of consistent, accurate, and valid anthropometry data, ABF has defined anthropometric measurements and anatomical landmarks which are generally based on the Anthropometric Survey for US Army Personnel (ANSUR), but with additional measurements which have been uniquely designed for spacesuit and hardware accommodation purposes. Unlike ANSUR, NASA anthropometry measurements primarily rely on 3D body scanning, a method which allows for explicitly defining the process of collecting measurements and the quality control methods used to ensure measurement reliability. In addition to ABF’s anthropometry measurement definitions and procedures, this presentation will also compare specifics of different measurement techniques ABF uses, for example, laser scanning versus manual measurement methods (e.g., tape measure or anthropometer-based), and the benefits and considerations of each method. The evolution of ABF’s measurement process will also be addressed, as new spaceflight programs have been introduced which have required unique measurements and the need to capture body shape changes over time was identified to be critical for spacesuit fit in some instances.

Garima Gupta↗

Software Users Manual (SUM): Extended Testability Analysis (ETA) Tool

This software user manual describes the implementation and use the Extended Testability Analysis (ETA) Tool. The ETA Tool is a software program that augments the analysis and reporting capabilities of a commercial-off-the-shelf (COTS) testability analysis software package called the Testability Engineering And Maintenance System (TEAMS) Designer. An initial diagnostic assessment is performed by the TEAMS Designer software using a qualitative, directed-graph model of the system being analyzed. The ETA Tool utilizes system design information captured within the diagnostic model and testability analysis output from the TEAMS Designer software to create a series of six reports for various system engineering needs. The ETA Tool allows the user to perform additional studies on the testability analysis results by determining the detection sensitivity to the loss of certain sensors or tests. The ETA Tool was developed to support design and development of the NASA Ares I Crew Launch Vehicle. The diagnostic analysis provided by the ETA Tool was proven to be valuable system engineering output that provided consistency in the verification of system engineering requirements. This software user manual provides a description of each output report generated by the ETA Tool. The manual also describes the example diagnostic model and supporting documentation - also provided with the ETA Tool software release package - that were used to generate the reports presented in the manual

Maul, William A.↗

Ares I-X Roll Control System Development

Project Managers often face challenging technical, schedule and budget issues. This presentation will explore how the Ares I-X Roll Control System Integrated Product Team (IPT) mitigated challenges such as concurrent engineering requirements and environments and evolving program processes, while successfully managing an aggressive project schedule and tight budget. IPT challenges also included communications and negotiations among inter- and intra-government agencies, including the US Air Force, NASA/MSFC Propulsion Engineering, LaRC, GRC, KSC, WSTF, and the Constellation Program. In order to successfully meet these challenges it was essential that the IPT define those items that most affected the schedule critical path, define early mitigation strategies to reduce technical, schedule, and budget risks, and maintain the end-product focus of an "unmanned test flight" context for the flight hardware. The makeup of the IPT and how it would function were also important considerations. The IPT consisted of NASA/MSFC (project management, engineering, and safety/quality) and contractors (Teledyne Brown Engineering and Pratt and Whitney Rocketdyne, who supplied heritage hardware experience). The early decision to have a small focused IPT working "badgelessly" across functional lines to eliminate functional stove-piping allowed for many more tasks to be done by fewer people. It also enhanced a sense of ownership of the products, while still being able to revert back to traditional roles in order to provide the required technical independence in design reviews and verification closures. This presentation will highlight several prominent issues and discuss how they were mitigated and the resulting Lessons Learned that might benefit other projects.

Unger, Ronald J.↗

Quality Control Methods of Tower Data at Kennedy Space Center’s Launch Complex 39-B and the USAF Cape Canaveral 500 Foot Tower

The National Aeronautics and Space Administration (NASA) has long used meteorological data from weather towers located at Kennedy Space Center (KSC) and the United States Air Force’s Eastern Range(ER) in support of their various launch vehicles and climate studies. Some of the most valuable data is gathered at the Launch Complex 39-B (LC39-B) and the 500 foot tower located approximately two miles west of LC39-B and three miles north of the Vehicle Assembly Building (VAB). The data from LC39-B gives NASA Space Launch System (SLS) engineers valuable insight into the weather the vehicle can expect at the pad, while the 500 foot tower has a longer period of record and has been used by the Shuttle and SLS programs. However, numerous data quality (DQ) control issues have arisen when utilizing this data for analysis. In addition, instrumentation tends to deteriorate faster than normal due to the corrosive nature of the high salt content in the air. NASA’s Natural Environments branch has developed several QC databases of these towers, but these studies were for fixed periods of records. EV44 identified a need for a continually updated and QC’ed database of tower data not only to provide along term QC’ed database for vehicle and climate analyses, but also to provide the capability to investigate recent weather events such as downbursts and other high wind events. This study follows the methods developed in prior Natural Environment QC tower databases, which includes variable specific QC thresholds and checks used to generate QC flags. However, this study developed new techniques such as the development and design of the graphical user interface (GUI) for manual verification, and the creation of the final monthly QC files.

Quality Control↗

Exploration Exercise System (EES) Development

Exploration class missions will be required to have an exercise device that is lightweight, has a small footprint, and is capable of providing enough physical stimulus and exercise variability to be an effective countermeasure against muscle and bone loss that results from the microgravity environment. Exploration exercise device prototypes should be evaluated on the ground and in-orbit for feasibility of use in microgravity for long and short duration exploration missions and efficacy of the device to maintain multi-system health and performance. The European Enhanced Exploration Exercise Device (E4D) was selected as the exploration prototype device to be evaluated on ISS for efficacy and feasibility of use as a single multi-modality device for the exercise system for exploration missions. This effort supports the continued development, testing, and verification of E4D hardware and software, internal NASA integration (Human Health and Performance, ISS Vehicle Office, Engineering, and Flight Operations), and external integration across NASA, ESA, and the Danish Aerospace Company (DAC). Providing a feasibility and acceptability assessment from a physiological efficacy and hardware durability standpoint are critical for informing use and risk associated with use on exploration missions. Clearly defined objectives from end users, stakeholders, and Subject Matter Experts (SMEs) will be tested by crewmembers during acute use sessions and long duration use of the exercise device while on ISS. This effort will include a flight study where crewmembers will be asked to exercise using only the E4D during the duration of their mission and participate in a battery of physiological testing to evaluate the efficacy. Hardware is scheduled to launch in FY25 followed by 2 years of operational use after activation and checkout. A final recommendation will be provided to the Artemis program on acceptability of the device for exploration missions. The E4D needs a vibration isolation stabilization (VIS) system that serves as a platform for the exercise hardware to protect the vehicle from loads imparted during exercise. Exploration forward VIS systems will need to protect the vehicle and provide sufficient stabilization for the exerciser during performance of all critical exercises. These enabling capabilities need to be achieved within exploration vehicle power, thermal, mass, and volume limitations.

Kent Lawrence Kalogera↗

Status of the Advanced Reusable Technologies Project

The Advanced Reusable Technologies (ART) Project, part of the Advanced Space Transportation Program Office at the NASA's Marshall Space Flight Center in Huntsville, Ala., focuses on future reusable technologies beyond those being pursued by X-33. The prime objective of the project is to dramatically reduce the cost of access to space. In April 1996, an NRA was issued soliciting proposals for tasks focusing on rocket-based combined cycle propulsion system (RBCC). In August of 1996, five contractors were selected for a two year period to design and ground test their RBCC engine concepts. The work on these contracts should be completed by the end of this year. In March of this year, another NRA was issued to solicit inputs for reusable vehicle and propulsion technologies applicable to earth-to-orbit and in-space transportation. The current RBCC effort is the first of three phases leading to a large scale flight demonstrations of the technology for space launch vehicle propulsion. This first phase will provide initial verification of proposed concepts through ground demonstration of combined rocket/air breathing propulsion technologies. Using the most promising concepts identified in the first phase, the second phase will design, manufacture and ground test flight-type engine(s) to demonstrate actual design weights and performance. In the third phase, the first flight of a sub-scale integrated X-vehicle is planned for 2002. This paper describes the current status, plans and progress of the ART Project.

Hueter, Ume↗

Microthruster Propulsion for the Space Technology 7 (ST7) Technology Demonstration Mission

For future applications to precision formation flying missions, NASA's New Millennium Program is scheduled to test colloid micro-Newton thrusters (CMNTs) on the ST7 technology demonstration mission. These CMNTs are part of a disturbance reduction system (DRS) on the ESA SMART-2 Spacecraft or LISA Pathfinder. The goal of the ST7 DRS is to demonstrate technologies necessary to meet the nanometer precision positioning control requirements of the LISA mission. In order to achieve these goals, the CMNTs are required to demonstrate a thrust resolution of less than 0.1 micro-N and a thrust noise of less than 0.1 micro-N/[square root]Hz for thrust levels between 5 and 30 micro-N. Developed by Busek Co. with support from JPL in testing an design, the CMNT has been developed over the last four years into a flight-ready microthrust system. The development, validation testing, and flight unit production of the CMNTs are described. Development tests and analysis include preliminary wear tests, propellant loading process verification, flow testing, and performance verification. Validation and flight unit verification includes thermal and structural analysis, life testing, thermal and dynamic load testing, and performance verification. Final delivery of the units is planned in 2007 with and planned launch and flight demonstration 2009.

microthruster↗

NASA's Exploration and In-Space Services (NExIS) Division OSAM-1 Propellant Transfer Subsystem Progress 2020

National Aeronautics and Space Administration (NASA)’s Exploration and In-Space Services (NExIS) Division of Goddard Space Flight Center has been developing technology for the On-orbit Servicing, Assembly and Manufacturing Mission 1 (OSAM-1) to robotically refuel heritage and new satellites on-orbit. OSAM-1, formerly known as Restore-L, successfully passed an important NASA milestone called Key Decision Point-C (KDP-C), receiving agency-level approval for its implementation. The decision point also establishes the mission’s official schedule and budget. The OSAM-1 spacecraft, Servicing Payload and the Space Infrastructure Dexterous Robot (SPIDER) payload will refuel a satellite in space, assemble a communications antenna and manufacture a beam. By demonstrating these capabilities, the mission is advancing never-before tested technologies for use in future missions (by NASA and other government organizations and private industry). The mission is funded by the Technology Demonstration Missions program within NASA’s Space Technology Mission Directorate. This paper covers a review of servicing extensibility and critical technologies that are being developed within NExIS with a focus on the fluid transfer refueling technology within the framework of the Propellant Transfer Subsystem (PTS). An overview of the planned initial technology demonstration servicing mission via the OSAM-1 Space Vehicle is provided as an extension of the technology development progress reported in 20181, and 20192. The general objectives, challenges, and key technologies are presented as an introduction to the context of the OSAM-1 mission, and a precursor to the OSAM-1 PTS specific development status. Development and progress of the Hose Management Assembly (HMA) and Propellant Transfer Assembly (PTA) are discussed. HMA risk reduction test results including those of thermal vacuum testing are presented. Important analytical results are discussed and progress of drawings and procedures developed for the fabrication and testing phase are shown. A summary of the PTS overall verification status and design activities prepared for the critical design peer review are presented. Procurement progress is shown with status on long, medium, and short term efforts to acquire the hardware required to support the mission objectives. Technology development, challenges, and testing status are discussed with particular regard to the OSAM-1 specific key assemblies including the PTA and HMA along with the overall integrated flight mockup of the spacecraft to client fluid transfer testing conducted in the servicing testbeds. The paper concludes with key milestones leading to the goal of on-orbit refueling to be demonstrated in 2024. The overall mission Launch Readiness Date (LRD) has been realigned to accommodate budget profiles and incorporation of additional on-orbit assembly and manufacturing demonstration efforts.

Propellant transfer, satellite servicing↗

Basic principles and recent observations of rotationally sampled wind

The concept of rotationally sampled wind speed is described. The unusual wind characteristics that result from rotationally sampling the wind are shown first for early measurements made using an 8-point ring of anemometers on a vertical plane array of meteorological towers. Quantitative characterization of the rotationally sampled wind is made in terms of the power spectral density function of the wind speed. Verification of the importance of the new concept is demonstrated with spectral analyses of the response of the MOD-OA blade flapwise root bending moment and the corresponding rotational analysis of the wind measured immediately upwind of the MOD-OA using a 12-point ring of anemometers on a 7-tower vertical plane array. The Pacific Northwest Laboratory (PNL) theory of the rotationally sampled wind speed power spectral density function is tested successfully against the wind spectrum measured at the MOD-OA vertical plane array. A single-tower empirical model of the rotationally sampled wind speed is also successfully tested against the measurements from the full vertical plane array. Rotational measurements of the wind velocity with hotfilm anemometers attached to rotating blades are shown to be accurate and practical for research on winds at the blades of wind turbines. Some measurements at the rotor blade of a MOD-2 turbine using the hotfilm technique in a pilot research program are shown. They are compared and contrasted to the expectations based upon application of the PNL theory of rotationally sampled wind to the MOD-2 size and rotation rate but without teeter, blade bending, or rotor induction accounted for. Finally, the importance of temperature layering and of wind modifications due to flow over complex terrain is demonstrated by the use of hotfilm anemometer data, and meteorological tower and acoustic doppler sounder data from the MOD-2 site at Goodnoe Hills, Washington.

Connell, James R.↗

Stirling Power Conversion for Lunar Applications

NASA is developing Stirling power convertors for use in nuclear power systems that would provide electricity to users on the lunar surface. NASA’s Radioisotope Power Systems (RPS) Program is maturing advanced dynamic convertor technologies that would increase the efficiency beyond the heritage systems for missions to the Moon and other solar system bodies of interest. Development efforts have focus on Stirling and Brayton designs that meet reliability and robustness requirements for operation in the lunar environment. GRC is also maturing low power convertors in the range of 1-40 watts to power micro-spacecraft or a network of distributed probes and include basic demonstration of in-house designs for convertors and controllers. In addition to RPS applications, conceptual fission systems have been demonstrated using Stirling convertors in multiple electrically heated tests and one test heated by a nuclear reactor. The Stirling convertors used in these fission system concepts include 100 We convertors to enable a 1 kWe system, 1 kWe convertors to enable a 10 kWe system, and 6 kWe convertors to enable a 40 kWe system. The maturation of Stirling power convertors for nuclear applications includes verification of performance in relevant environments and validation of the design with a focus on high reliability and robustness. Over 1 million hours of testing has been accumulated on dozens of convertors since 1999 in the Stirling Research Laboratory at the NASA Glenn Research Center located in Cleveland Ohio, where the longest running convertor is the work record holder at 137,000 hours, or 15.5 years. These maturation efforts have been instrumental in increasing the technology readiness level of Stirling technologies for space applications.

S. Wilson↗

Hazard Analysis for Pneumatic Flipper Suitport/Z-1 Manned Evaluation, Chamber B, Building 32

One of the characteristics of an effective safety program is the recognition and control of hazards before mishaps or failures occur. Conducting potentially hazardous tests necessitates a thorough hazard analysis in order to protect our personnel from injury and our equipment from damage. The purpose of this hazard analysis is to define and address the potential hazards and controls associated with the Z1 Suit Port Test in Chamber B located in building 32, and to provide the applicable team of personnel with the documented results. It is imperative that each member of the team be familiar with the hazards and controls associated with his/her particular tasks, assignments, and activities while interfacing with facility test systems, equipment, and hardware. The goal of this hazard analysis is to identify all hazards that have the potential to harm personnel and/or damage facility equipment, flight hardware, property, or harm the environment. This analysis may also assess the significance and risk, when applicable, of lost test objectives when substantial monetary value is involved. The hazards, causes, controls, verifications, and risk assessment codes have been documented on the hazard analysis work sheets in appendix A of this document. The preparation and development of this report is in accordance with JPR 1700.1, JSC Safety and Health Handbook.

Source record↗

MARGInS: Model-Based Analysis of Realizable Goals in Systems

Under NASAs Constellation effort, the Exploration Technology Development Program funded research toward a system validation capability that applied machine learning and test-case generation techniques to the analysis of black-box system behavior. The behavior analysis capability scaled to spaces of hundreds of input parameters and tens of thousands of test cases. Aerospace systems at the vehicle level, especially those systems which contain some level of autonomy, are best described by hybrid and non-linear mathematics. Even simplified models of such systems need parameter dimensionalities in the hundreds or thousands of parameters in order to capture sufficient fidelity. The System Safety Assessments (such as those described in the SAE ARP 4761A Safety Assessment Process guidelines) for these systems are prone to errorinteractions between the vehicles subsystems are complex, and can display emergent behaviors. NASA captured this new analysis in the Model-based Analysis of Realizable Goals in Systems (MARGInS) tool and applied it to the Pad Abort 1 (PA-1) simulation as part of the independent validation and verification cycle before the PA-1 flight test in May of 2010. MARGInS evaluated the adherence of the high-fidelity simulation to its requirements, and deter- mined the margins to failure from the expected nominal input conditions. Following the PA-1 test, the capabilities within the MARGInS framework have been extended with sophisticated statistical and white-box test case generation techniques and applied to other NASA missions. The frame- work now includes a critical factors analysis that was applied to NASAs Orion simulation and design. NASAs Aeronautics Research Mission Directorate (ARMD) leveraged the existing MARGInS framework for work on aviation safety for civil transport vehicles and for research on autonomy issues. The NASA ARMD effort created a time series output prediction capability that has been used to characterize trajectories for a plane with an adaptive control system, and a safety boundary detection capability that has been applied to an air traffic control concept of operation for the Federal Aviation Administration. The statistical and machine- learning based techniques within MARGInS have been successfully combined with concolic execution to improve the coverage of a critical unit by driving system-level inputs. The use case driving the concolic execution and MARGInS integration was inspired by the Air France 447 disaster in which the loss of a critical functionality (the airspeed calculation from the pitot tubes) led to loss of the entire plane with the people aboard. To illustrate capabilities and limitations, we will highlight the analyses for the applications listed above. We will then discuss the future plans for MARGInS and its interfaces with other tools.

Validation↗

The New NASA Orbital Debris Engineering Model ORDEM2000

The NASA Orbital Debris Program Office at Johnson Space Center has developed a new computer-based orbital debris engineering model, ORDEM2000, which describes the orbital debris environment in the low Earth orbit region between 200 and 2000 km altitude. The model is appropriate for those engineering solutions requiring knowledge and estimates of the orbital debris environment (debris spatial density, flux, etc.). ORDEM2000 can also be used as a benchmark for ground-based debris measurements and observations. We incorporated a large set of observational data, covering the object size range from 10 mm to 10 m, into the ORDEM2000 debris database, utilizing a maximum likelihood estimator to convert observations into debris population probability distribution functions. These functions then form the basis of debris populations. We developed a finite element model to process the debris populations to form the debris environment. A more capable input and output structure and a user-friendly graphical user interface are also implemented in the model. ORDEM2000 has been subjected to a significant verification and validation effort. This document describes ORDEM2000, which supersedes the previous model, ORDEM96. The availability of new sensor and in situ data, as well as new analytical techniques, has enabled the construction of this new model. Section 1 describes the general requirements and scope of an engineering model. Data analyses and the theoretical formulation of the model are described in Sections 2 and 3. Section 4 describes the verification and validation effort and the sensitivity and uncertainty analyses. Finally, Section 5 describes the graphical user interface, software installation, and test cases for the user.

Liou, Jer-Chyi↗

InSight Entry, Descent and Landing Post-Flight Performance Assessment

On November 26, 2018, the Interior Exploration using Seismic Investigations, Geodesy and Heat Transport (InSight) lander successfully touched down on the surface of Mars. NASA Langley Research Center’s (LaRC) Program to Optimize Simulated Trajectories II (POST2) was used during both project development and flight operations to assess the Entry, Descent and Landing (EDL) vehicle performance against related requirements across the expected range of possible environmental and spacecraft conditions. During flight operations, these analyses were used to evaluate the need for updating flight software EDL parameters and the effects of executing a trajectory correction maneuver (TCM). Therefore, the NASA LaRC POST2 simulation had a critical role during the cruise, approach and ultimately EDL phases of the mission. This paper presents results of the final pre- and post- EDL flight performance assessments. A summary of the reconstructed “as-flown” trajectory with a comparison of key EDL metrics to the nominal and three-sigma bound pre-EDL predictions is also provided. Emphasis on the trajectory between entry interface and parachute deploy is provided as this is the period during which deviations from the pre-EDL prediction occurred. The post-flight assessment provides important verification of the POST2 models and analysis techniques used for InSight, providing critical feed-forward information to future lander missions.

Robert W Maddock↗

NASA Experience with Pogo in Human Spaceflight Vehicles

An overview of more than 45 years of NASA human spaceflight experience is presented with respect to the thrust axis vibration response of liquid fueled rockets known as pogo. A coupled structure and propulsion system instability, pogo can result in the impairment of the astronaut crew, an unplanned engine shutdown, loss of mission, or structural failure. The NASA history begins with the Gemini Program and adaptation of the USAF Titan II ballistic missile as a spacecraft launch vehicle. It continues with the pogo experienced on several Apollo-Saturn flights in both the first and second stages of flight. The defining moment for NASA s subsequent treatment of pogo occurred with the near failure of the second stage on the ascent of the Apollo 13 mission. Since that time NASA has had a strict "no pogo" philosophy that was applied to the development of the Space Shuttle. The "no pogo" philosophy lead to the first vehicle designed to be pogo-free from the beginning and the first development of an engine with an integral pogo suppression system. Now, more than 30 years later, NASA is developing two new launch vehicles, the Ares I crew launch vehicle propelling the Orion crew excursion vehicle, and the Ares V cargo launch vehicle. A new generation of engineers must again exercise NASA s system engineering method for pogo mitigation during design, development and verification.

Larsen, Curtis E.↗

Determination of Parachute Joint Factors using Seam and Joint Testing

This paper details the methodology for determining the joint factor for all parachute components. This method has been successfully implemented on the Capsule Parachute Assembly System (CPAS) for the NASA Orion crew module for use in determining the margin of safety for each component under peak loads. Also discussed are concepts behind the joint factor and what drives the loss of material strength at joints. The joint factor is defined as a "loss in joint strength...relative to the basic material strength" that occurs when "textiles are connected to each other or to metals." During the CPAS engineering development phase, a conservative joint factor of 0.80 was assumed for each parachute component. In order to refine this factor and eliminate excess conservatism, a seam and joint testing program was implemented as part of the structural validation. This method split each of the parachute structural joints into discrete tensile tests designed to duplicate the loading of each joint. Breaking strength data collected from destructive pull testing was then used to calculate the joint factor in the form of an efficiency. Joint efficiency is the percentage of the base material strength that remains after degradation due to sewing or interaction with other components; it is used interchangeably with joint factor in this paper. Parachute materials vary in type-mainly cord, tape, webbing, and cloth -which require different test fixtures and joint sample construction methods. This paper defines guidelines for designing and testing samples based on materials and test goals. Using the test methodology and analysis approach detailed in this paper, the minimum joint factor for each parachute component can be formulated. The joint factors can then be used to calculate the design factor and margin of safety for that component, a critical part of the design verification process.

Mollmann, Catherine↗

Development of procedures for calculating stiffness and damping properties of elastomers in engineering applications. Part 1: Verification of basic methods

The primary aim of this investigation was verification of basic methods which are to be used in cataloging elastomer dynamic properties (stiffness and damping) in terms of viscoelastic model constants. These constants may then be used to predict dynamic properties for general elastomer shapes and operating conditions, thereby permitting optimum application of elastomers as energy absorption and/or energy storage devices in the control of vibrations in a broad variety of applications. The efforts reported involved: (1) literature search; (2) the design, fabrication and use of a test rig for obtaining elastomer dynamic test data over a wide range of frequencies, amplitudes, and preloads; and (3) the reduction of the test data, by means of a selected three-element elastomer model and specialized curve fitting techniques, to material properties. Material constants thus obtained have been used to calculate stiffness and damping for comparison with measured test data. These comparisons are excellent for a number of test conditions and only fair to poor for others. The results confirm the validity of the basic approach of the overall program and the mechanics of the cataloging procedure, and at the same time suggest areas in which refinements should be made.

Chiang, T.↗

The Role and Quality of Software Safety in the NASA Constellation Program

In this study, we examine software safety risk in the early design phase of the NASA Constellation spaceflight program. Obtaining an accurate, program-wide picture of software safety risk is difficult across multiple, independently-developing systems. We leverage one source of safety information, hazard analysis, to provide NASA quality assurance managers with information regarding the ongoing state of software safety across the program. The goal of this research is two-fold: 1) to quantify the relative importance of software with respect to system safety; and 2) to quantify the level of risk presented by software in the hazard analysis. We examined 154 hazard reports created during the preliminary design phase of three major flight hardware systems within the Constellation program. To quantify the importance of software, we collected metrics based on the number of software-related causes and controls of hazardous conditions. To quantify the level of risk presented by software, we created a metric scheme to measure the specificity of these software causes. We found that from 49-70% of hazardous conditions in the three systems could be caused by software or software was involved in the prevention of the hazardous condition. We also found that 12-17% of the 2013 hazard causes involved software, and that 23-29% of all causes had a software control. Furthermore, 10-12% of all controls were software-based. There is potential for inaccuracy in these counts, however, as software causes are not consistently scoped, and the presence of software in a cause or control is not always clear. The application of our software specificity metrics also identified risks in the hazard reporting process. In particular, we found a number of traceability risks in the hazard reports may impede verification of software and system safety.

Layman, Lucas↗