Empirical analysis of safety - critical software anomalies post-launch
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
NASA develops, runs, and maintains software systems for which security is of vital importance. Therefore, it is becoming an imperative to develop secure systems and extend the current software assurance capabilities to cover information assurance and cybersecurity concerns of NASA missions. The results presented in this report are based on the information provided in the issue tracking systems of one ground mission and one flight mission. The extracted data were used to create three datasets: Ground mission IVV issues, Flight mission IVV issues, and Flight mission Developers issues. In each dataset, we identified the software bugs that are security related and classified them in specific security classes. This information was then used to create the security vulnerability profiles (i.e., to determine how, why, where, and when the security vulnerabilities were introduced) and explore the existence of common trends. The main findings of our work include:- Code related security issues dominated both the Ground and Flight mission IVV security issues, with 95 and 92, respectively. Therefore, enforcing secure coding practices and verification and validation focused on coding errors would be cost effective ways to improve mission's security. (Flight mission Developers issues dataset did not contain data in the Issue Category.)- In both the Ground and Flight mission IVV issues datasets, the majority of security issues (i.e., 91 and 85, respectively) were introduced in the Implementation phase. In most cases, the phase in which the issues were found was the same as the phase in which they were introduced. The most security related issues of the Flight mission Developers issues dataset were found during Code Implementation, Build Integration, and Build Verification; the data on the phase in which these issues were introduced were not available for this dataset.- The location of security related issues, as the location of software issues in general, followed the Pareto principle. Specifically, for all three datasets, from 86 to 88 the security related issues were located in two to four subsystems.- The severity levels of most security issues were moderate, in all three datasets.- Out of 21 primary security classes, five dominated: Exception Management, Memory Access, Other, Risky Values, and Unused Entities. Together, these classes contributed from around 80 to 90 of all security issues in each dataset. This again proves the Pareto principle of uneven distribution of security issues, in this case across CWE classes, and supports the fact that addressing these dominant security classes provides the most cost efficient way to improve missions' security. The findings presented in this report uncovered the security vulnerability profiles and identified the common trends and dominant classes of security issues, which in turn can be used to select the most efficient secure design and coding best practices compiled by the part of the SARP project team associated with the NASA's Johnson Space Center. In addition, these findings provide valuable input to the NASA IVV initiative aimed at identification of the two 25 CWEs of ground and flight missions.
Explore the source record for details and available documents.
Empirical evaluation of theoretical model of latent class analysis to determine if population of respondents can be divided into finite number of groups or classes - computer programming
Statistical analysis of empirical sound fields propagated from static test firing of large space booster power plants
An empirical analysis of software-system failures is used to study several specific issues in software testing, reliability analysis, and reuse. Failure data from a large software manufacturer and a NASA production environment were collected and analyzed. The systems ranged in size from 30,000 to over 100,000 lines. The results show that (1) the first 15 percent of the test cases detected 67 percent of the high-severity failures and 50 percent of all failures; (2) multiple fault-detection and testing phases may result in a significant increase in reliability or none at all; (3) composite measures of system reliability did not adequately reflect reliability at the function or component level; (4) developers were biased toward portions of systems that would be heavily tested; (5) fault-proneness of reused or modified components was 74 percent less than that of newly developed components; and (6) systems with more reused software had lower component development effort, but not lower component fault-proneness.
Empirical correlation of small hollow sphere impact failure data using dimensional analysis
Berkeley Labs "Utility-Scale Solar", 2022 Edition presents analysis of empirical plant-level data from the U.S. fleet of ground-mounted photovoltaic (PV), PV+battery, and concentrating solar-thermal power (CSP) plants with capacities exceeding 5 MWAC. While focused on key developments in 2021, this report explores trends in deployment, technology, capital and operating costs, capacity factors, the levelized cost of solar energy (LCOE), power purchase agreement (PPA) prices, wholesale market value, and interconnection queue data.
Berkeley Labs "Utility-Scale Solar", 2023 Edition presents analysis of empirical plant-level data from the U.S. fleet of ground-mounted photovoltaic (PV), PV+battery, and concentrating solar-thermal power (CSP) plants with capacities exceeding 5 MWAC. While focused on key developments in 2022, this report explores trends in deployment, technology, capital and operating costs, capacity factors, the levelized cost of solar energy (LCOE), power purchase agreement (PPA) prices, wholesale market value, and interconnection queue data.
Berkeley Labs "Utility-Scale Solar", 2024 Edition presents analysis of empirical plant-level data from the U.S. fleet of ground-mounted photovoltaic (PV), PV+battery, and concentrating solar-thermal power (CSP) plants with capacities exceeding 5 MWAC. While focused on key developments in 2023, this report explores trends in deployment, technology, capital and operating costs, capacity factors, the levelized cost of solar energy (LCOE), power purchase agreement (PPA) prices, wholesale market value, net value, and interconnection queue data.
Living and working on Mars will require model-based computer systems for maintaining and controlling complex life support, communication, transportation, and power systems. This technology must work properly on the first three-year mission, augmenting human autonomy, without adding-yet more complexity to be diagnosed and repaired. One design method is to work with scientists in analog (mars-like) setting to understand how they prefer to work, what constrains will be imposed by the Mars environment, and how to ameliorate difficulties. We describe how we are using empirical requirements analysis to prototype model-based tools at a research station in the High Canadian Arctic.
In this dissertation, we demonstrate that it is possible to develop methods of empirical hardware-counter-based performance analysis for scientific applications running on diverse types of CPUs. Although hardware counters have been used in performance analysis for at least 30 years, the methods used are still limited to particular CPU vendors or even particular generations of CPUs from the same vendor. Our motivating hypothesis is that hardware counter-based measurements could be developed to provide consistent performance information on diverse CPU types. This dissertation proves the hypothesis was correct by demonstrating one such set of metrics.
Neutron multiplicity detectors are useful for a variety of applications including nuclear emergency response, nuclear nonproliferation, safeguards, and criticality safety. When measuring black-box problems (i.e., when the system being measured is completely unknown) with systems that have relatively low detection efficiency, expert analysis is frequently required to determine appropriate bounds for system parameters such as neutron multiplication and neutron leakage. This is because the detection efficiency can vary wildly, which also means that the resulting system parameters can have large variations. This work applies an empirical approach to provide bounds on system parameters (such as system multiplication, neutron leakage, and detector efficiency). The results of this bounding analysis are then used as inputs to provide recommendations to users regarding criticality safety. In addition to describing the method used, this work provides sample results from a measurement campaign performed at the National Criticality Experiments Research Center (NCERC).
Wall shear stress results from stationary-rotor flow tests of five annular gas seals are used to develop entrance and exit region friction factor models. The friction factor models are used in a bulk-flow seal analysis which predicts leakage and rotor-dynamic coefficients. The predictions of the analysis are compared to experimental results and to the predictions of Nelson's analysis (1985). The comparisons are for smooth-rotor seals with smooth and honeycomb-stators. The present analysis predicts the destabilizing cross-coupled stiffness of a seal better than Nelson's analysis. Both analyses predict direct damping well and direct stiffness poorly.
The role of ligand field effects and many-body effects arising from angular momentum coupling and shake effects for the XPS of NiO, as a representative transition metal oxide, have been investigated using rigorous, non-empirical wave functions for single site cluster models. Here it is shown that important features of the XPS arise from proper treatment of angular momentum coupling and it is unnecessary to invoke non-local screening to explain the experimental XPS. Contrary to the usual understanding, it is shown that inclusion of shake excitations in the many body wavefunctions is responsible for the high BE satellites that are observed. The contribution of covalent mixing of metal and ligand orbitals in the closed shells to screening of core-holes is demonstrated.
In the first part of the investigation an analysis is made of base pressure in an inviscid fluid, both for two-dimensional and axially symmetric flow. It is shown that for two-dimensional flow, and also for the flow over a body of revolution with a cylindrical sting attached to the base, there are an infinite number of possible solutions satisfying all necessary boundary conditions at any given free-stream Mach number. For the particular case of a body having no sting attached only one solution is possible in an inviscid flow, but it corresponds to zero base drag. Accordingly, it is concluded that a strictly inviscid-fluid theory cannot be satisfactory for practical applications. An approximate semi-empirical analysis for base pressure in a viscous fluid is developed in a second part of the investigation. The semi-empirical analysis is based partly on inviscid-flow calculations.
The dual cooling system at the California State University Los Angeles Hydrogen Research and Fueling Facility is analysed to predict the output hydrogen temperature in different ambient conditions. Initially, the facility was built with a coil chiller T20 cooling, sufficient for occasional fuelings. A flat plate evaporator system was added in series to resolve any issues for multiple fuelings even in the hottest weather. This study was commenced to verify the set points and determine the control requirements for the dual setup in order to inform future designs. A numerical-empirical model of the cooling system was developed by reverse engineering, using the station experimental measurements and database records. The subsystems are characterized separately but validated as a whole system imposing specific and standard operating conditions. The cooling model is tested with different inputs to validate the pre-set parameter variation of the cooling components. Ten scenarios were investigated to evaluate the fueling output parameters, testing two hydrogen temperature input trends (according to the facility initial conditions) and five ambient temperatures (from 15 °C to 35 °C). In closing, the simulation results have confirmed that the hydrogen output temperature remains within the range imposed by the SAE J2601 for each scenario studied, around -22 °C and -25 °C.
Abstract not provided.