Search NASA⌕ Search

SEARCH · Search NASA

Results for “Software Quality Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

An experiment in software reliability: Additional analyses using data from automated replications

A study undertaken to collect software error data of laboratory quality for use in the development of credible methods for predicting the reliability of software used in life-critical applications is summarized. The software error data reported were acquired through automated repetitive run testing of three independent implementations of a launch interceptor condition module of a radar tracking problem. The results are based on 100 test applications to accumulate a sufficient sample size for error rate estimation. The data collected is used to confirm the results of two Boeing studies reported in NASA-CR-165836 Software Reliability: Repetitive Run Experimentation and Modeling, and NASA-CR-172378 Software Reliability: Additional Investigations into Modeling With Replicated Experiments, respectively. That is, the results confirm the log-linear pattern of software error rates and reject the hypothesis of equal error rates per individual fault. This rejection casts doubt on the assumption that the program's failure rate is a constant multiple of the number of residual bugs; an assumption which underlies some of the current models of software reliability. data raises new questions concerning the phenomenon of interacting faults.

Dunham, Janet R.↗

Colorado & New Mexico Water Resources: Mapping Wetland and Riparian Areas to Support Rio Grande Cutthroat Trout Habitat Restoration

Over the last century, the Rio Grande cutthroat trout (Oncorhynchus clarki virginalis; RGCT) population has declined significantly due to habitat loss, competition, and hybridization with non-native trout species; the species currently occupies roughly 11% of its historic habitat. Conservation efforts led by governmental and private actors have succeeded in increasing RGCT populations since the early 2000s. Vermejo Park Ranch, a privately owned 560,000-acre property, partnered with US Fish and Wildlife Service and Colorado Parks and Wildlife (CPW) to begin the largest native trout restoration initiative in North America. Since 2002, these efforts have included wetland and riparian area restoration and RGCT reintroduction. Current restoration efforts focus on restoring the Costilla Creek Watershed to provide cool water temperatures, improve water quality, and create the necessary habitat requirements for the trout species. To guide these restoration efforts, the Colorado – Fort Collins NASA DEVELOP team produced maps to locate and characterize wetland and riparian areas in the Costilla Creek watershed. The team utilized NASA data from Landsat 8 Operational Land Imager (OLI), as well as Sentinel-2 MultiSpectral Instrument (MSI), Sentinel-1 Synthetic Aperture Radar (SAR), and additional ancillary data for May 2016 to October 2019. In order to produce probability maps of wetland presence, the team used the Software for Assisted Habitat Modeling (SAHM) incorporating predictor variables generated from topographic indices, spectral indices, and radar. The resulting maps allowed Vermejo Ranch and CPW to determine the extent of possible RGCT habitat and identify where habitat restoration efforts may be needed.

Water Resources↗

Acoustic Testing of the Joby Aviation Propeller in the National Full-Scale Aerodynamics Complex 40- by 80-Foot Wind Tunnel

The advanced air mobility sector has progressed in recent years with electric vertical take-Off and landing vehicles at the forefront. In response, the NASA Advanced Air Mobility Project has initiated the Advanced Air Mobility National Campaign to partner with industry to progress this emerging market. This resulted in NASA’s Revolutionary Vertical Lift Technology project to participate to progress research efforts for software tool validation for these advanced air mobility vehicle configurations. Noise has been identified as one of the main obstacles to succeeding in this emerging market for community acceptance. To further understand electric vertical take-Off and landing vehicle noise, an isolated Joby Aviation S4 propeller was tested in the National Full-Scale Aerodynamics Complex 40- by 80-Foot Wind Tunnel to aid in providing high quality performance, loads, and acoustic data. Details of test hardware and setup are described with a focus on acoustics, which includes facility, test model, microphone locations, and data acquisition system details. Additionally, the data processing techniques and completed test matrix for acoustic points are provided. To aid in identifying potential acoustic reflections, an acoustic reflection test was performed prior to the start of the test and highlighted the presence of reflections at every microphone location. Acoustic results are provided for various flight regimes for sweeps of blade pitch, RPM, flow angle, and wind speed. These results show an optimum RPM for a specific thrust level for noise, and further reductions in RPM can increase noise levels. This dataset will be used to evaluate and improve computational tools.

Aviation Propeller↗

The Importance of HRA in Human Space Flight: Understanding the Risks

Human performance is critical to crew safety during space missions. Humans interact with hardware and software during ground processing, normal flight, and in response to events. Human interactions with hardware and software can cause Loss of Crew and/or Vehicle (LOCV) through improper actions, or may prevent LOCV through recovery and control actions. Humans have the ability to deal with complex situations and system interactions beyond the capability of machines. Human Reliability Analysis (HRA) is a method used to qualitatively and quantitatively assess the occurrence of human failures that affect availability and reliability of complex systems. Modeling human actions with their corresponding failure probabilities in a Probabilistic Risk Assessment (PRA) provides a more complete picture of system risks and risk contributions. A high-quality HRA can provide valuable information on potential areas for improvement, including training, procedures, human interfaces design, and the need for automation. Modeling human error has always been a challenge in part because performance data is not always readily available. For spaceflight, the challenge is amplified not only because of the small number of participants and limited amount of performance data available, but also due to the lack of definition of the unique factors influencing human performance in space. These factors, called performance shaping factors in HRA terminology, are used in HRA techniques to modify basic human error probabilities in order to capture the context of an analyzed task. Many of the human error modeling techniques were developed within the context of nuclear power plants and therefore the methodologies do not address spaceflight factors such as the effects of microgravity and longer duration missions. This presentation will describe the types of human error risks which have shown up as risk drivers in the Shuttle PRA which may be applicable to commercial space flight. As with other large PRAs of complex machines, human error in the Shuttle PRA proved to be an important contributor (~12 percent) to LOCV. An existing HRA technique was adapted for use in the Shuttle PRA, but additional guidance and improvements are needed to make the HRA task in space-related PRAs easier and more accurate. Therefore, this presentation will also outline plans for expanding current HRA methodology to more explicitly cover spaceflight performance shaping factors.

Hamlin, Teri↗

Space biology initiative program definition review. Trade study 2: Prototype utilization in the development of space biology hardware

The objective was to define the factors which space flight hardware developers and planners should consider when determining: (1) the number of hardware units required to support program; (2) design level of the units; and (3) most efficient means of utilization of the units. The analysis considered technology risk, maintainability, reliability, and safety design requirements for achieving the delivery of highest quality flight hardware. Relative cost impacts of the utilization of prototyping were identified. The development of Space Biology Initiative research hardware will involve intertwined hardware/software activities. Experience has shown that software development can be an expensive portion of a system design program. While software prototyping could imply the development of a significantly different end item, an operational system prototype must be considered to be a combination of software and hardware. Hundreds of factors were identified that could be considered in determining the quantity and types of prototypes that should be constructed. In developing the decision models, these factors were combined and reduced by approximately ten-to-one in order to develop a manageable structure based on the major determining factors. The Baseline SBI hardware list of Appendix D was examined and reviewed in detail; however, from the facts available it was impossible to identify the exact types and quantities of prototypes required for each of these items. Although the factors that must be considered could be enumerated for each of these pieces of equipment, the exact status and state of development of the equipment is variable and uncertain at this time.

Jackson, L. Neal↗

Compact disk error measurements

The objectives of this project are as follows: provide hardware and software that will perform simple, real-time, high resolution (single-byte) measurement of the error burst and good data gap statistics seen by a photoCD player read channel when recorded CD write-once discs of variable quality (i.e., condition) are being read; extend the above system to enable measurement of the hard decision (i.e., 1-bit error flags) and soft decision (i.e., 2-bit error flags) decoding information that is produced/used by the Cross Interleaved - Reed - Solomon - Code (CIRC) block decoder employed in the photoCD player read channel; construct a model that uses data obtained via the systems described above to produce meaningful estimates of output error rates (due to both uncorrected ECC words and misdecoded ECC words) when a CD disc having specific (measured) error statistics is read (completion date to be determined); and check the hypothesis that current adaptive CIRC block decoders are optimized for pressed (DAD/ROM) CD discs. If warranted, do a conceptual design of an adaptive CIRC decoder that is optimized for write-once CD discs.

Howe, D.↗

Software engineering methodologies and tools

Over the years many engineering disciplines have developed, including chemical, electronic, etc. Common to all engineering disciplines is the use of rigor, models, metrics, and predefined methodologies. Recently, a new engineering discipline has appeared on the scene, called software engineering. For over thirty years computer software has been developed and the track record has not been good. Software development projects often miss schedules, are over budget, do not give the user what is wanted, and produce defects. One estimate is there are one to three defects per 1000 lines of deployed code. More and more systems are requiring larger and more complex software for support. As this requirement grows, the software development problems grow exponentially. It is believed that software quality can be improved by applying engineering principles. Another compelling reason to bring the engineering disciplines to software development is productivity. It has been estimated that productivity of producing software has only increased one to two percent a year in the last thirty years. Ironically, the computer and its software have contributed significantly to the industry-wide productivity, but computer professionals have done a poor job of using the computer to do their job. Engineering disciplines and methodologies are now emerging supported by software tools that address the problems of software development. This paper addresses some of the current software engineering methodologies as a backdrop for the general evaluation of computer assisted software engineering (CASE) tools from actual installation of and experimentation with some specific tools.

Wilcox, Lawrence M.↗

Extraction of Lateral-Directional Stability and Control Derivatives for the Basic F-18 Aircraft at High Angles of Attack

The results of parameter identification to determine the lateral-directional stability and control derivatives of an F-18 research aircraft in its basic hardware and software configuration are presented. The derivatives are estimated from dynamic flight data using a specialized identification program developed at NASA Dryden Flight Research Center. The formulation uses the linearized aircraft equations of motions in their continuous/discrete form and a maximum likelihood estimator that accounts for both state and measurement noise. State noise is used to model the uncommanded forcing function caused by unsteady aerodynamics, such as separated and vortical flows, over the aircraft. The derivatives are plotted as functions of angle of attack between 3 deg and 47 deg and compared with wind-tunnel predictions. The quality of the derivative estimates obtained by parameter identification is somewhat degraded because the maneuvers were flown with the aircraft's control augmentation system engaged, which introduced relatively high correlations between the control variables and response variables as a result of control motions from the feedback control system.

Iliff, Kenneth W.↗

NASA's Design and Development of a Field Goniometer Instrument Using Solid Works

With NASA suffering severe funding cutbacks, engineers at NASA are required to produce state-of-the-art hardware with limited personnel and financial resources. In light of these constraints, the new NASA mandate is to build better, faster and cheaper. In April of 1998, Stennis Space Center's Commercial Remote Sensing Program contracted to the Systems Engineering Division at NASA Ames Research Center to develop a device known as a Field Goniometer. A Field Goniometer is a device that measures bi-directional reflectance of a target, such as vegetation, relative to the sun and an imaging system in an aircraft or spacecraft. The device is able to provide a spectral fingerprint of the surface it is measuring in wavelengths from 350nm-2500nm using a hyperspectral imager. To accomplish this project, several obstacles had to be overcome. First, the design had to be completed in less than four months. Second, due to the complexity of the design, the use of solid modeling was highly desirable but most of the group's solid modelers were assigned to other jobs. Third, the amount of funding available from the customer was one half to one third the funding typically expended for a job of this nature. Our choices for this project were to design with standard 2-D CAD systems currently used in-house or train additional engineers on our existing solids package or purchase a new solid model package. The use of a 2D CAD system was very undesirable due to the complexity of the design. Using our existing solids modeler would have required a learning curve for our engineers that would be incompatible with our schedule. Prior to this project, a member of our design group researched the solid modeling industry and decided to purchase SolidWorks. After examining the product for ease of use, modeling capability, training time required and cost, we decided our highest probability of success would be to design with Solidworks. During the design phase, our fabrication group was able to provide input at the very early stages, which added significant benefit to the final product. Fabrication cost and schedule savings have been realized by having complex part geometries translated directly from the SolidWorks design models to Surfcam and other computer-aided manufacturing (CAM) software. This direct model translation capability optimized the fabrication processes. The end result was that we were able to successfully complete the project on time and on budget. Other advantages of using SolidWorks, as cited by the design team, include a rapid negotiation of the initial learning curve, the ability to develop solid model hardware prototypes (used to communicate the design intent to both the customer and the fabricator), and the ability to work as a team collaborating on a large, complex model. These types of tools and efforts represent our response to NASA's challenge to produce higher quality products within shorter design and fabrication times.

Turner, Mark↗

Enhanced Contact Graph Routing (ECGR) MACHETE Simulation Model

Contact Graph Routing (CGR) for Delay/Disruption Tolerant Networking (DTN) space-based networks makes use of the predictable nature of node contacts to make real-time routing decisions given unpredictable traffic patterns. The contact graph will have been disseminated to all nodes before the start of route computation. CGR was designed for space-based networking environments where future contact plans are known or are independently computable (e.g., using known orbital dynamics). For each data item (known as a bundle in DTN), a node independently performs route selection by examining possible paths to the destination. Route computation could conceivably run thousands of times a second, so computational load is important. This work refers to the simulation software model of Enhanced Contact Graph Routing (ECGR) for DTN Bundle Protocol in JPL's MACHETE simulation tool. The simulation model was used for performance analysis of CGR and led to several performance enhancements. The simulation model was used to demonstrate the improvements of ECGR over CGR as well as other routing methods in space network scenarios. ECGR moved to using earliest arrival time because it is a global monotonically increasing metric that guarantees the safety properties needed for the solution's correctness since route re-computation occurs at each node to accommodate unpredicted changes (e.g., traffic pattern, link quality). Furthermore, using earliest arrival time enabled the use of the standard Dijkstra algorithm for path selection. The Dijkstra algorithm for path selection has a well-known inexpensive computational cost. These enhancements have been integrated into the open source CGR implementation. The ECGR model is also useful for route metric experimentation and comparisons with other DTN routing protocols particularly when combined with MACHETE's space networking models and Delay Tolerant Link State Routing (DTLSR) model.

Segui, John S.↗

Integration of Online Parameter Identification and Neural Network for In-Flight Adaptive Control

An indirect adaptive system has been constructed for robust control of an aircraft with uncertain aerodynamic characteristics. This system consists of a multilayer perceptron pre-trained neural network, online stability and control derivative identification, a dynamic cell structure online learning neural network, and a model following control system based on the stochastic optimal feedforward and feedback technique. The pre-trained neural network and model following control system have been flight-tested, but the online parameter identification and online learning neural network are new additions used for in-flight adaptation of the control system model. A description of the modification and integration of these two stand-alone software packages into the complete system in preparation for initial flight tests is presented. Open-loop results using both simulation and flight data, as well as closed-loop performance of the complete system in a nonlinear, six-degree-of-freedom, flight validated simulation, are analyzed. Results show that this online learning system, in contrast to the nonlearning system, has the ability to adapt to changes in aerodynamic characteristics in a real-time, closed-loop, piloted simulation, resulting in improved flying qualities.

Hageman, Jacob↗

Integration of Online Parameter Identification and Neural Network for In-Flight Adaptive Control

An indirect adaptive system has been constructed for robust control of an aircraft with uncertain aerodynamic characteristics. This system consists of a multilayer perceptron pre-trained neural network, online stability and control derivative identification, a dynamic cell structure online learning neural network, and a model following control system based on the stochastic optimal feedforward and feedback technique. The pre-trained neural network and model following control system have been flight-tested, but the online parameter identification and online learning neural network are new additions used for in-flight adaptation of the control system model. A description of the modification and integration of these two stand-alone software packages into the complete system in preparation for initial flight tests is presented. Open-loop results using both simulation and flight data, as well as closed-loop performance of the complete system in a nonlinear, six-degree-of-freedom, flight validated simulation, are analyzed. Results show that this online learning system, in contrast to the nonlearning system, has the ability to adapt to changes in aerodynamic characteristics in a real-time, closed-loop, piloted simulation, resulting in improved flying qualities.

Hageman, Jacob J.↗

Satellite-To-Satellite Imaging in Support of LEO Optical Navigation, Using the ASTERIA Cubesat

The Arcsecond Space Telescope Enabling Research in Astrophysics (ASTERIA) was a 6-unit CubeSat technology demonstration mission that was built at NASA’s Jet Propulsion Laboratory (JPL) and deployed from the International Space Station (ISS) on November 20th, 2017. After successfully completing its 90-day primary mission that demonstrated arcsecond-level line-of-sight pointing and focal plane thermal stability for exoplanet detection, it entered an extended mission performing onboard software demonstrations alongside science until end of mission in December 2019. At the end of its lifetime it was being used as a demonstration platform for several experiments, including low earth orbit (LEO) optical navigation operations. With its visible light astrometric camera and stable attitude control system, the ASTERIA spacecraft showed itself to be a capable platform for the imaging of geosynchronous satellites from LEO. This paper will describe the imagery attained in flight and also the image processing algorithms that were developed to render that imagery into navigation quality data. These algorithms dealt with hot pixel filtering, noise modeling, attitude registration, star signal rejection and satellite signal identification. Brightness prediction algorithms used for target selection will also be discussed.

Fesq, Lorraine↗

Problem Complexity and LLM: H-M Team Reliability in Challenging Environments

In traditional human-machine operations, the functional decomposition of actions and responsibilities among various agents is assigned a priori. For instance, in current air traffic operations, although assisted by software, human pilots have the ultimate control of aircraft. Multiagent human-machine and machine-machine systems will face problems of varying and potentially unpredicted complexity in future challenging scenarios of planetary, en route, and orbital activities. Hence, it is important to enable dynamic transfer of decision-making to appropriate team members, human or machine, depending on which agent is best equipped to solve that specific problem on a time budget. In this paper, we consider aspects of problem-solving and its modeling that affect the outcomes of decision-making as a function of solution quality and the likelihood of solving the problem on a required time budget. We focus on Large Language Models (LLM) as potential machine teammates and conclude that practical, predictive modeling of their performance, at the current stage of their development, is infeasible. Simple examples help us illustrate that current LLM will require fundamental advancements to provide reliable support in team decision-making, especially in safety-critical and time-critical domains. The study is not meant to diminish the value of the remarkable capabilities of LLM, but rather to gain a better understanding of the technology’s appropriate use and the needed additions.

function allocation↗

Unsteady Pressure-Sensitive-Paint Shot Noise Reduction

In the study of unsteady Pressure-Sensitive Paint (uPSP) image data sets, pixel intensity values collected by Phantom cameras from multiple perspectives are used to calculate the surface pressure of an experimental model. This paper focuses on mitigation of shot noise which is introduced into the image data set by the cameras. Shot noise impacts the quality of data collected, increasing the system error in its pressure value calculations. This paper characterises statistical methods to reduce shot noise within experimental data by taking an average or weighted average across an area of pixels of their respective counts. Each combined-pixel has a higher total effective intensity value and therefore exhibits reduced noise throughout its time history. This is demonstrated by calculating the standard deviations of the combined pixel values through time, which decrease as the combined pixel area increases. Finally, these methods are compared across experimental wind tunnel conditions to examine their effectiveness at different Mach numbers. Ultimately, the results are used to recommend a blur filter type and size which will be applied to the raw image data prior to processing, as well as a minimum camera resolution for future experiments. Downstream of the filter application, the software to convert the 2D image data sets into surface pressure readings on a 3D grid use a ratio of decimation that assigns multiple pixels to each 3D grid node. This decimation ratio will also be aligned with the size of the blur filter, resulting in a more manageable data set size and compromised spatial resolution. Combined with the effect of the blur filter, the resulting pixel intensity readings will exhibit significantly reduced shot noise, reducing the magnitude of uncertainty and error in the final calculated pressure. For future tests, the camera spatial resolution must be sufficient to capture small flow and model features even after the recommended blur filter is applied. The image data set is taken from a uPSP experiment of the Space Launch System Block 1 cargo vehicle model in September 2019.

Lucy Tang↗

Unsteady Pressure-Sensitive Paint (UPSP) Shot Noise Reduction

In the study of unsteady Pressure-Sensitive Paint (uPSP) image data sets, pixel intensity values collected by Phantom cameras from multiple perspectives are used to calculate the surface pressure of an experimental model. This paper focuses on mitigation of shot noise which is introduced into the image data set by the cameras. Shot noise impacts the quality of data collected, increasing the system error in its pressure value calculations. This paper characterises statistical methods to reduce shot noise within experimental data by taking an average or weighted average across an area of pixels of their respective counts. Each combined-pixel has a higher total effective intensity value and therefore exhibits reduced noise throughout its time history. This is demonstrated by calculating the standard deviations of the combined pixel values through time, which decrease as the combined pixel area increases. Finally, these methods are compared across experimental wind tunnel conditions to examine their effectiveness at different Mach numbers. Ultimately, the results are used to recommend a blur filter type and size which will be applied to the raw image data prior to processing, as well as a minimum camera resolution for future experiments. Downstream of the filter application, the software to convert the 2D image data sets into surface pressure readings on a 3D grid use a ratio of decimation that assigns multiple pixels to each 3D grid node. This decimation ratio will also be aligned with the size of the blur filter, resulting in a more manageable data set size and compromised spatial resolution. Combined with the effect of the blur filter, the resulting pixel intensity readings will exhibit significantly reduced shot noise, reducing the magnitude of uncertainty and error in the final calculated pressure. For future tests, the camera spatial resolution must be sufficient to capture small flow and model features even after the recommended blur filter is applied. The image data set is taken from a uPSP experiment of the Space Launch System Block 1 cargo vehicle model in September 2019.

Lucy Tang↗

Development of an information data base for watershed monitoring

Landsat multispectral scanner data, Defense Mapping Agency digital terrain data, conventional maps, and ground data were integrated to create a comprehensive information data base (the Image Based Information System), to monitor the water quality of the Lake Tahoe Basin. Landsat imagery was used as the planimetric base to which all other data were registered. A georeference image plane, which provided an interface between all data planes for the Lake Tahoe Basin data base, was created from the drainage basin map. The data base was used to extract each drainage basin for separate display. The Defense Mapping Agency-created elevation image was processed with VICAR software to produce a component representing slope magnitude, which was cross-tabulated with the drainage basin georeference table. Future applications of the data base include the development of precipitation modeling, surface runoff models, and classification of drainage basin cover types.

Smith, A. Y.↗

Hindlimb Suspension as a Model to Study Ophthalmic Complications in Microgravity Status Report: Optimization of Rat Retina Flat Mounts Staining to Study Vascular Remodeling

Preliminary data from a prior tissue‐sharing experiment has suggested that early growth response protein‐1 (Egr1), a transcription factor involved in various stress responses in the vasculature, is induced in the rat retina after 14 days of hindlimb suspension (HS) and may be evidence that mechanical stress is occurring secondary to the cephalad fluid shift. This mechanical stress could cause changes in oxygenation of the retina, and the subsequent ischemia‐ or inflammation‐driven hypoxia may lead to microvascular remodeling. This microvascular remodeling process can be studied using image analysis of retinal vessels and can be then be quantified by the VESsel GENeration Analysis (VESGEN) software, a computational tool that quantifies remodeling patterns of branching vascular trees and capillary or vasculogenic networks. Our project investigates whether rodent HS is a valid model to study the effects of simulated‐weightlessness on ocular structures and their relationship with intracranial pressure (ICP). One of the hypotheses to be tested is that HS‐induced cephalad fluid shift is accompanied by vascular engorgement that produces changes in retinal oxygenation, leading to oxidative stress, hypoxia, microvascular remodeling, and cellular degeneration. We have optimized the procedure to obtain flat mounts of rat retina, staining of the endothelial lining in vasculature and acquisition of high quality images suitable for VESGEN analysis. Briefly, eyes were fixed in 4% paraformaldehyde for 24 hours and retinas were detached and then mounted flat on microscope slides. The microvascular staining was done with endothelial cell‐specific isolectin binding, coupled to Alexa‐488 fluorophore. Image acquisition at low magnification and high resolution was performed using a new Leica SP8 confocal microscope in a tile pattern across the X,Y plane and multiple sections along the Z‐axis. This new confocal microscope has the added capability of dye separation using the Linear Unmixing method and allows us to remove the autofluorescence originating from the photoreceptor layer. In summary, we have an improved method for studying the retinal microvasculature that will provide an increase in the quality of images captured and will be applied throughout the various animal cohorts of the recentlyinitiated study that will evaluate rodent HS as a model to study ophthalmic complications in microgravity.

Theriot, Corey A.↗