Search NASASearch

SEARCH · Search NASA

Results for “modeling defects metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Modeling defect trends for iterative development

The Employment of Defects (EoD) approach to measuring and analyzing defects seeks to identify and capture trends and phenomena that are critical to managing software quality in the iterative software development lifecycle at JPL.

modeling defects metrics

Additive Manufacturing Model-Based Process Metrics: Reduced Order Modeling of the Laser Powder Bed Fusion Process

The multi-scale and complex process of printing additively manufactured (AM) parts can have unexpected, but predictable, build conditions that result in material microstructure variability. In this work, we describe a fully parallel reduced order modeling approach that has been developed to evaluate the evolution of AM processes, termed the AM moment measure method. This method couples the known sequence of the AM process with a physically informed nearest neighbors’ calculation to map the conditions of a part-scale build. The result is a map of the build that is derived directly from build files or in-situ process monitoring sensors. The methodology and terminology of the approach will be described, and computed build maps will be calculated and compared for various laser powder bed fusion (LPBF) builds of Ti-6Al-4V. Such comparative results develop understanding of how the sequential process actions can affect the LPBF-AM build quality and microstructure variability.

Laser Powder Bed Fusion

Bayesian SegNet for Semantic Segmentation with Improved Interpretation of Microstructural Evolution During Irradiation of Materials

Understanding the relationship between the evolution of microstructures of irradiated LiAlO2pellets and tritium diffusion, retention and release could improve predictions of tritium performance. Given expert-labeled segmented images of irradiated and unirradiated pellets, we trained Deep Convolutional Neural Networks to segment images into defect, grain, and boundary classes. Qualitative microstructural information was calculated from these segmented images to facilitate the comparison of unirradiated and irradiated pellets. We tested modifications to improve the sensitivity of the model, including incorporating meta-data into the model and utilizing uncertainty quantification. The predicted segmentation was similar to the expert-labeled segmentation for most methods of microstructural qualification, including pixel proportion, defect area, and defect density. Overall, the high performance metrics for the best models for both irradiated and unirradiated images shows that utilizing neural network models is a viable alternative to expert-labeled images.

Oostrom, Marjolein T.

Design for Vibration Monitoring: A Methodology for Reliable and Cost-Effective Vibration Monitoring

The purpose of health monitoring systems is to detect failures or defects for increased safety and performance and to provide on-condition maintenance with reduced costs. The problems associated with health monitoring systems include high rates of false alarms and missed failures, which make monitoring an unreliable and costly task. The reason for this is that unaccounted variations invalidate signal modeling assumptions. Our approach was to focus on vibration monitoring of rotating components. We analyzed baseline signals to determine statistical variations, identify and model factors that influence vibrations (pre-production vs. post-production variations), determine hit and false alarm rates with baseline flight data, model and predict effects of defects and variations on vibrations, and develop algorithms and metrics for failure and anomaly detection in the presence of variations.

Tumer, Irem Y.

Correlations of Additive Manufacturing Model-Based Process Metrics With Spatter-Induced Porosity in the Powder Bed Fusion-Laser Beam/Metallic Process

Components fabricated using the powder bed fusion laser beam metallic (PBF-LB/M) additive manufacturing (AM) process comprise a multitude of sequential weld passes. Qualifying materials for components in critical applications requires a thorough understanding of pertinent processing-microstructure-property relationships. Porosity defects have a strong adverse effect on the mechanical properties of a material. The morphology of porosity defects created by lack of fusion in PBF-LB/M often exhibit high aspect ratios that can act as stress concentrators and become crack initiation sites. The occurrence of spatter induced porosity is studied using synchronized AM model-based process metrics and porosity measured by high-resolution X-ray computed tomography. A novel AM process metric is introduced to quantify the relative exposure to spatter ejecta impacts and incorporation throughout the sequence of the PBF-LB/M process. Further characterization using optical metallography and scanning electron microscopy indicated that both keyhole and lack of fusion porosity correlated statistically with the spatter ejecta impact field of the PBF-LB/M process. Both keyhole and lack of fusion porosity can be predicted by the spatter exposure process metric, which can be exploited to control the fusion sequence.

Additive Manufacturing

The development and application of composite complexity models and a relative complexity metric in a software maintenance environment

A great deal of effort is now being devoted to the study, analysis, prediction, and minimization of software maintenance expected cost, long before software is delivered to users or customers. It has been estimated that, on the average, the effort spent on software maintenance is as costly as the effort spent on all other software costs. Software design methods should be the starting point to aid in alleviating the problems of software maintenance complexity and high costs. Two aspects of maintenance deserve attention: (1) protocols for locating and rectifying defects, and for ensuring that noe new defects are introduced in the development phase of the software process; and (2) protocols for modification, enhancement, and upgrading. This article focuses primarily on the second aspect, the development of protocols to help increase the quality and reduce the costs associated with modifications, enhancements, and upgrades of existing software. This study developed parsimonious models and a relative complexity metric for complexity measurement of software that were used to rank the modules in the system relative to one another. Some success was achieved in using the models and the relative metric to identify maintenance-prone modules.

Hops, J. M.

Correlations Between Porosity, Spatter, and Process Metrics for Powder Bed Fusion Laser Beam Metallic Additive Manufacturing

Components fabricated using the powder bed fusion laser beam metallic (PBF-LB/M)additive manufacturing process are the result of a multitude of weld passes conducted sequentially. Qualifying components for aerospace applications requires a thorough understanding of the process-structure-properties relationships. Porosity defects are known to have a strong adverse effect on the mechanical properties of a component. In particular, porosity defects created by lack of fusion have high aspect ratio morphologies leading to stress concentrations that become crack initiation sites. In the present work, the occurrence of spatter induced lack of fusion porosity was studied using synchronized in-situ process monitoring, additive manufacturing model-based process metrics, and high-resolution X-ray computed tomography. The results show that lack of fusion porosity is statistically correlated with unremoved welding spatter ejecta of the PBF-LB/M process and process metrics related to the hatching strategy.

Qualification

A Novel Additive Manufacturing Process Metric for Predicting Spatter-related Porosity in Laser Powder Bed Fusion

Components fabricated using the powder bed fusion laser beam metallic (PBF) additive manufacturing (AM) process comprise a multitude of sequential weld passes. Porosity defects resulting from weld pass inconsistencies are a concern for PBF materials and have a strong adverse effect on the mechanical properties. In an effort to understand and avoid spatter induced porosity, this work aims to provide a novel computational technique that can be used to quantify and predict the sequence-sensitive impact of spatter upon the PBF process stability and consequential porosity in as-printed material. A novel spatter impact AM model-based process metric (AM-PM) is introduced to model and quantify the impact that spatter has on the PBF process. The occurrence of spatter induced porosity is studied using thermal rise, lack of fusion, and spatter impact AM-PMs synchronized with porosity measured by high-resolution X-ray computed tomography. Six cylindrical specimens were designed to compare the AM-PM correlations with porosity across two different laser powers and three hatch scanning strategies. A point field based computational approach is shown to be effective for testing the influence of the different AM-PMs and interrogating the physical process conditions underlying the porosity formation. Further, characterization using optical metallography and scanning electron microscopy indicated that both keyhole and lack of fusion porosity correlated with the spatter impact AM-PM, which can be exploited to predict and control spatter related porosity by the hatch strategy. Efforts to predict porosity composition within PBF material should incorporate the PBF process disturbances that can result from spatter. The spatter impact AM-PM can be readily incorporated into the development of defect prediction models at the part scale.

Additive Manufacturing

Full Life-Cycle Defect Management Assessment: Initial Inspection Data Collection Results and Research Questions for Further Study

It is often the case in software projects that when schedule and budget resources are limited, the Verification and Validation (V&V) activities suffer. Fewer V&V activities can be afforded and moreover, short-term challenges can result in V&V activities being scaled back or dropped altogether. As a result, too often the default solution is to save activities for improving software quality until too late in the life-cycle, relying on late-term code inspections followed by thorough testing activities to reduce defect counts to acceptable levels. As many project managers realize, however, this is a resource-intensive way of achieving the required quality for software. The Full Life-cycle Defect Management Assessment Initiative, funded by NASA s Office of Safety and Mission Assurance under the Software Assurance Research Program, aims to address these problems by: Improving the effectiveness of early life-cycle V&V activities to make their benefits more attractive to team leads. Specifically, we focus on software inspection, a proven method that can be applied to any software work product, long before executable code has been developed; Better communicating this effectiveness to software development teams, along with suggestions for parameters to improve in the future to increase effectiveness; Analyzing the impact of early life-cycle V&V on the effectiveness and cost required for late life-cycle V&V activities, such as testing, in order to make the tradeoffs more apparent. This white paper reports on an initial milestone in this work, the development of a preliminary model of inspection effectiveness across multiple NASA Centers. This model contributes toward reaching our project goals by: Allowing an examination of inspection parameters, across different types of projects and different work products, for an analysis of factors that impact defect detection effectiveness. Allowing a comparison of this NASA-specific model to existing recommendations in the literature regarding how to plan effective inspections. Forming a baseline model which can be extended to incorporate factors describing: the numbers and types of defects that are missed by inspections; how such defects flow downstream through software development phases; how effectively they can be caught by testing activities in the late stages of development. The model has been implemented in a prototype web-enabled decision-support tool which allows developers to enter their inspection data and receive feedback based on a comparison against the model. The tool also allows users to access reusable materials (such as checklists) from projects included in the baseline. Both the tool itself and the model underlying it will continue to be extended throughout the remainder of this initiative. As results of analyzing inspection effectiveness for defect containment are determined, they can be shared via the tool and also via updates to existing training courses on metrics and software inspections. Moreover, the tool will help satisfy key CMMI requirements for the NASA Centers, as it will enable NASA to take a global view across peer review results for various types of projects to identify systemic problems. This analysis can result in continuous improvements to the approach to verification.

Shull, Forrest

How simple is software defect detection?

This study benchmarks several FSS techniques and reports several studies where a large set metrics were reduced to a handful with little loss of detection accuracy. This result raises the possibility that software defect detection may be much simpler than previously believed.

feature subset selection software fault model soft

Software engineering methodologies and tools

Over the years many engineering disciplines have developed, including chemical, electronic, etc. Common to all engineering disciplines is the use of rigor, models, metrics, and predefined methodologies. Recently, a new engineering discipline has appeared on the scene, called software engineering. For over thirty years computer software has been developed and the track record has not been good. Software development projects often miss schedules, are over budget, do not give the user what is wanted, and produce defects. One estimate is there are one to three defects per 1000 lines of deployed code. More and more systems are requiring larger and more complex software for support. As this requirement grows, the software development problems grow exponentially. It is believed that software quality can be improved by applying engineering principles. Another compelling reason to bring the engineering disciplines to software development is productivity. It has been estimated that productivity of producing software has only increased one to two percent a year in the last thirty years. Ironically, the computer and its software have contributed significantly to the industry-wide productivity, but computer professionals have done a poor job of using the computer to do their job. Engineering disciplines and methodologies are now emerging supported by software tools that address the problems of software development. This paper addresses some of the current software engineering methodologies as a backdrop for the general evaluation of computer assisted software engineering (CASE) tools from actual installation of and experimentation with some specific tools.

Wilcox, Lawrence M.

PUMA:POWDER UTILIZATION MODELING APPLICATION

SF-25-084 PUMA a high performance modeling framework to simulate powder processing. It provides a scalable tool for manufacturers to simulate powder pre- and post-processing. The tool can predict the distortion, residual stress, and (for reactive processes) reaction completion fraction of complex parts after curing/debinding, sintering, and infiltration processes. These predictions are key metrics industry uses to optimize these processes to produce dense, defect-free, stable components.

HU, TIANCHEN (GARY)

A Model-Based, Bayesian Solution for Characterization of Complex Damage Scenarios in Aerospace Composite Structures

Ultrasonic damage detection and characterization is commonly used in nondestructive evaluation (NDE) of aerospace composite components. In recent years there has been an increased development of guided wave based methods. In real materials and structures, these dispersive waves result in complicated behavior in the presence of complex damage scenarios. Model-based characterization methods utilize accurate three dimensional finite element models (FEMs) of guided wave interaction with realistic damage scenarios to aid in defect identification and classification. This work describes an inverse solution for realistic composite damage characterization by comparing the wavenumber-frequency spectra of experimental and simulated ultrasonic inspections. The composite laminate material properties are first verified through a Bayesian solution (Markov chain Monte Carlo), enabling uncertainty quantification surrounding the characterization. A study is undertaken to assess the efficacy of the proposed damage model and comparative metrics between the experimental and simulated output. The FEM is then parameterized with a damage model capable of describing the typical complex damage created by impact events in composites. The damage is characterized through a transdimensional Markov chain Monte Carlo solution, enabling a flexible damage model capable of adapting to the complex damage geometry investigated here. The posterior probability distributions of the individual delamination petals as well as the overall envelope of the damage site are determined.

H. Reed

Quantitative software models for the estimation of cost, size, and defects

The presentation will provide a brief overview of the SQI measurement program as well as describe each of these models and how they are currently being used in supporting JPL project, task and software managers to estimate and plan future software systems and subsystems.

software metrics process improvement

Advances in Integrally Formed Metallic Structures

NASA Langley Research Center (LaRC) is applying flow forming technology to aerospace aluminum alloys for the manufacture of integrally stiffened cylinders that meet aircraft fuselage or launch vehicle specifications. High-strength 2xxx series alloys, in various temper/product form conditions, are being compared with medium-strength, very formable AA 6061 as the benchmark. Screening of candidate materials traditionally relies on empirical forming trials, but more recently on metrics derived from constant nominal strain rate tensile testing. In this work, the established hierarchy of formability metrics is adopted as the baseline; tensile area reduction, work hardening exponent, and modulus of resilience. The suite of metrics can be expanded based on phenomenological and mechanistic considerations of plastic flow instabilities to incorporate anisotropy ratio, rate of work hardening, and dynamic strain aging effects. Separate research thrusts at LaRC are aimed at formulating a protocol for scalable production of fully formed, defect-free components: 1) quantifying the extended set of formability metrics from constant and jump strain rate tensile tests with digital image correlation (DIC); 2) using statistically designed experiments on a vertical spin/flow forming facility (WF VUD-600®) to isolate the effect of convenient process variables, such as axial feed rate and thickness reduction; and 3) predicting the effect of feed ratio (roller translation relative to mandrel rotation speeds) on material response via process modeling using the DEFORM® simulation software. Current results will be discussed in terms of correlating intrinsic material properties with the bulk workability characteristics to successfully fabricate cylinders with complex cross-sections.

Aluminum