SEARCH · Search NASA

Results for “Root cause analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18

All sources NASA NTRS DOE OSTI

NASA NTRS2012

A Change Impact Analysis to Characterize Evolving Program Behaviors

Change impact analysis techniques estimate the potential effects of changes made to software. Directed Incremental Symbolic Execution (DiSE) is an intraprocedural technique for characterizing the impact of software changes on program behaviors. DiSE first estimates the impact of the changes on the source code using program slicing techniques, and then uses the impact sets to guide symbolic execution to generate path conditions that characterize impacted program behaviors. DiSE, however, cannot reason about the flow of impact between methods and will fail to generate path conditions for certain impacted program behaviors. In this work, we present iDiSE, an extension to DiSE that performs an interprocedural analysis. iDiSE combines static and dynamic calling context information to efficiently generate impacted program behaviors across calling contexts. Information about impacted program behaviors is useful for testing, verification, and debugging of evolving programs. We present a case-study of our implementation of the iDiSE algorithm to demonstrate its efficiency at computing impacted program behaviors. Traditional notions of coverage are insufficient for characterizing the testing efforts used to validate evolving program behaviors because they do not take into account the impact of changes to the code. In this work we present novel definitions of impacted coverage metrics that are useful for evaluating the testing effort required to test evolving programs. We then describe how the notions of impacted coverage can be used to configure techniques such as DiSE and iDiSE in order to support regression testing related tasks. We also discuss how DiSE and iDiSE can be configured for debugging finding the root cause of errors introduced by changes made to the code. In our empirical evaluation we demonstrate that the configurations of DiSE and iDiSE can be used to support various software maintenance tasks

Rungta, Neha Shyam↗

DOE OSTI2025

Causal relationships of vegetation productivity with root zone water availability and atmospheric dryness at the catchment scale

Abstract. This study explores the causal relationships between catchment water availability, vapor pressure deficit, and gross primary productivity (GPP) across 341 catchments in the contiguous US. Seasonal climatic, hydrological, and vegetation characteristics were represented using the Horton index, ecological aridity index, evaporative fraction index, and carbon uptake efficiency. Statistical methods, including circularity statistics, correlation analysis, and causality tests, were employed to determine the complex interactions between catchment wetness, atmospheric dryness, and vegetation carbon uptake. The results revealed a maximum lag of 2 months in the intra-annual variability of catchment water supply–productivity and atmospheric water demand–productivity relationships, with hysteresis patterns varying with the catchment's hydrological characteristics. In catchments not permanently under water-limited or energy-limited conditions, vegetation experiences hydrological stress during the peak growing period, coinciding with the highest gross primary productivity and carbon uptake efficiency being out of phase with the Horton index and in phase with the evaporative fraction index. Causality analysis highlights strong temporal continuity in GPP seasonal characteristics, with a cause–effect relationship between catchment water supply, atmospheric demand, and vegetation productivity spanning a maximum of 2 months. These findings underscore the need for a comprehensive functional framework that integrates catchment water supply, atmospheric demand, and vegetation productivity to enhance our understanding and predictive capabilities with regard to ecosystem responses to climate change.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS1996

Excess nutrients in hydroponic solutions alter nutrient content of rice, wheat, and potato

Environment has significant effects on the nutrient content of field-grown crop plants. Little is known, however, about compositional changes caused by controlled environments in which plants receive only artificial radiation and soilless, hydroponic culture. This knowledge is essential for developing a safe, nutritious diet in a Controlled Ecological Life-Support System (CELSS). Three crops that are candidates for inclusion in a CELSS (rice, wheat, and white potato) were grown both in the field and in controlled environments where the hydroponic nutrient solution, photosynthetic photon flux (PPF), and CO2 level were manipulated to achieve rapid growth rates. Plants were harvested at maturity, separated into discrete parts, and dried prior to analysis. Plant materials were analyzed for proximate composition (protein, fat, ash, and carbohydrate), total nitrogen (N), nitrate, minerals, and amino-acid composition. The effect of environment on nutrient content varied by crop and plant part. Total N and nonprotein N (NPN) contents of plant biomass generally increased under controlled-environment conditions compared to field conditions, especially for leafy plant parts and roots. Nitrate levels were increased in hydroponically-grown vegetative tissues, but nitrate was excluded from grains and tubers. Mineral content changes in plant tissue included increased phosphorus and decreased levels of certain micronutrient elements under controlled-environment conditions. These findings suggest that cultivar selection, genetic manipulation, and environmental control could be important to obtain highly nutritious biomass in a CELSS.

NASA Discipline Number 61-20↗

NASA NTRS2020

The Role of NASA Engineering & Safety Center (NESC) in Advancing NASA's Earth Science Missions (Past, Present, and Future)

The NASA Engineering & Safety Center (NESC) was established in 2003 to provide an independent technical resource for the resolution of challenging technical problems (through the use of studies, analysis, tests, etc.). Since its inception, NESC has completed nearly 1000 technical assessments for NASA’s Human Exploration and Operation Mission Directorate (HEOMD), Science Mission Directorate (SMD), Space Technology Mission Directorate (STMD), and Aeronautics Research Mission Directorate (ARMD). Of the SMD related assessments, several were for the resolution of technical problems, analysis, or studies related to NASA’s Earth science missions in various phases of the project from design to operation. Some of the recent examples of NESC technical support for NASA (or NOAA) Earth science missions have been for: Soil Moisture Active Passive (SMAP), Deep Space Climate Observatory (DSCOVR), Cyclone Global Navigation Satellite System (CYGNSS), Ice, Cloud, and Land Elevation Satellite (ICESat-II), Joint Polar Satellite System (JPSS), and the soon to be launched collaboration mission with India, NASA-ISRO Synthetic Aperture Radar (NISAR). In this paper, we outline some of the technical challenges faced by these Earth science missions and describe how NESC contributed to their resolution. The case studies cover a wide range of disciplines involving space lidars, radars, electronics, attitude control systems, as well as Micrometeoroid Orbital Debris (MMOD) risk assessment impact to NASA missions. The efforts include strategies for risk mitigation, technical resolution of challenging problems, and failure root cause investigations combined with lessons learned reports to advance discipline knowledge, enhance NASA capabilities, and avoid future problems.

NASA↗

NASA NTRSDate not supplied

Comparing the Electrical Modeling and Thermal Analysis Toolbox Simulation Data to Electrified Aircraft Propulsion Test Hardware Data

A model using the Electrical Modeling and Thermal Analysis Toolbox (EMTAT), a National Aeronautics and Space Administration (NASA)-developed Simulink® model block library of electrical components, was developed to mirror the Hybrid Propulsion Emulation Rig (HyPER) hardware, a laboratory focused on Electrified Aircraft Propulsion (EAP) hardware tests. The goal of the model was to demonstrate the utility of the library by comparing the accuracy of the library models to the performance of real hardware, with the primary metrics being the simulation outputs matching physical test hardware data within 5% of full scale.The objective of this paper is to present the background, setup, testing and results of this comparison. It describes some of the adjustments that were necessary to match the system hardware, as well as next steps in verification and validation. The outputs of the model were compared to the results of several tests in HyPER, and in the process captured an additional torque loss that is still being analyzed for the root cause but has been confirmed in the hardware. Across all the test series, only one key model parameter was outside the target 5% full scale matching, and nearly 70% were within 1%.

Mark E Bell↗

DOE OSTI2023

Validation of density pump-out by pedestal-foot magnetic island formation prior to ELM suppression in KSTAR and DIII-D tokamaks

Abstract TM1 nonlinear two-fluid simulations reveal key characteristics of density pump-out caused by pedestal-foot island formation when applying resonant magnetic perturbation (RMP). These characteristics include a bifurcation in pump-out with a low RMP coil current threshold, a sensitivity of pump-out magnitude to q 95 , and the magnitude of pump-out scaling as the square root of the RMP coil current. Dedicated experiments are carried out in the KSTAR and DIII-D tokamaks to validate these features and show that: (1) a staircase bifurcation in density pump-out is observed when slowly ramping up the n = 1 RMP current, and the density fluctuations are found to be slightly decreased from the pedestal-foot to the pedestal-top; (2) the magnitude of density pump-out becomes weaker when decreasing q 95 from 5.5 to 4.9, and a partial recovery of density pump-out is observed when q 95 is ramped down to lower than 4.9; and (3) analysis of a DIII-D database of n = 3 RMP edge-localized mode control experiments finds that the magnitude of density pump-out is proportional to the square root of RMP coil current Δ n e / n e ∝ I RMP 0.5 . These experimental observations are consistent with TM1 simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2023

Comparing the Electrical Modeling and Thermal Analysis Toolbox Simulation Data to Electrified Aircraft Propulsion Test Hardware Data

A model using the Electrical Modeling and Thermal Analysis Toolbox (EMTAT), a National Aeronautics and Space Administration (NASA)-developed Simulink® model block library of electrical components, was developed to mirror the Hybrid Propulsion Emulation Rig (HyPER) hardware, a laboratory focused on Electrified Aircraft Propulsion (EAP) hardware tests. The goal of the model was to demonstrate the utility of the library by comparing the accuracy of the library models to the performance of real hardware, with the primary metrics being the simulation outputs matching physical test hardware data within 5 percent of full scale. The objective of this paper is to present the background, setup, testing and results of this comparison. It describes some of the adjustments that were necessary to match the system hardware, as well as next steps in verification and validation. The outputs of the model were compared to the results of several tests in HyPER, and in the process captured an additional torque loss that is still being analyzed for the root cause but has been confirmed in the hardware. Across all the test series, only one key model parameter was outside the target 5 percent full scale matching, and nearly 70 percent were within 1 percent.

Mark E. Bell↗

NASA NTRS2024

Validation and Application of Satellite-Derived Sea Surface Temperature Gradients in the Bering Strait and Bering Sea

The Arctic is one of the most important regions in the world’s oceans for understanding the impacts of a changing climate. Yet, it is also difficult to measure because of extreme weather and ice conditions. In this work, we directly compare four datasets from the Group for High-Resolution Sea Surface Temperature (GHRSST) with a NASA Saildrone deployment along the Alaskan Coast and the Bering Sea and Bering Strait. The four datasets used are the Remote Sensing Systems Microwave Infrared Optimally Interpolated (MWIR) product, the Canadian Meteorological Center (CMC) product, the Daily Optimally Interpolated Product (DOISST), and the Operational Sea Surface Temperature and Ice Analysis (OSTIA) product. Spatial sea surface temperature (SST) gradients were derived for both the Saildrone deployment and GHRSST products, with the GHRSST products collocated with the Saildrone deployment. Overall, statistics indicate that the OSTIA product had a correlation of 0.79 and a root mean square difference of 0.11 °C/km when compared with Saildrone. CMC had the highest correlation of 0.81. Scatter plots indicate that OSTIA had the slope closest to one, thus best reproducing the magnitudes of the Saildrone gradients. Differences increased at latitudes > 65°N where sea ice would have a greater impact. A trend analysis was then performed on the gradient fields. Overall, positive trends in gradients occurred in areas along the coastal regions. A negative trend occurred at approximately 60°N. A major finding of this study is that future work needs to revolve around the impact of changing ice conditions on SST gradients. Another major finding is that a northward shift in the southern ice edge occurred after 2010 with a maxima at approximately 2019. This indicates that the shift of the southern ice edge is not gradual but has dramatically increased over the last decade. Future work needs to revolve around examining the possible causes for this northward shift.

Arctic↗

DOE OSTI2021

Evaluation of CMIP6 models in simulating the statistics of extreme precipitation over Eastern Africa

We report the Eastern Africa region experiences frequent extreme precipitation events that can cause destruction of property and environment, and loss of lives. Thus, there is a need to understand how these events may change in the future and how well the global climate models that are used to make projections can simulate precipitation extremes in this region before they can be used in downscaling or flood and drought impact assessment studies. In this work, we evaluated the ability of sixteen Coupled Model Intercomparison Project Phase 6 (CMIP6) models to simulate present-day precipitation extremes over the Eastern Africa region during the two rainy seasons (March–May and September–November). We used nine extreme precipitation indices (including seven (one) indices of wet (dry) extremes) defined by the Expert Team on Climate Change Detection and Indices. The CMIP6 models were evaluated against two gridded observation datasets: Global Precipitation Climatology Project One-Degree Daily Dataset and Tropical Rainfall Measuring Mission Multi-satellite Precipitation Analysis 3B42. Three model performance metrics (percentage bias, normalized root-mean-square error, and pattern correlation coefficient) were employed to further assess the strengths and weakness of the models. Our results show that the multi-model ensemble mean generally provides a better representation of observed precipitation and related extremes compared to individual models when considering all metrics and seasons. Several consistent biases are evident across CMIP6 models, which tend to overestimate the total-wet day precipitation and consecutive wet days, and underestimate very wet days and maximum 5-day precipitation in both seasons. Furthermore, no single model consistently performs best, model performance varies with the season and index under consideration and is generally independent of horizontal resolution.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

NASA NTRS2011

Component-Level Electronic-Assembly Repair (CLEAR) Analysis of the Problem Reporting and Corrective Action (PRACA) Database of the International Space Station On-Orbit Electrical Systems

The NASA Constellation Program is investigating and developing technologies to support human exploration of the Moon and Mars. The Component-Level Electronic-Assembly Repair (CLEAR) task is part of the Supportability Project managed by the Exploration Technology Development Program. CLEAR is aimed at enabling a flight crew to diagnose and repair electronic circuits in space yet minimize logistics spares, equipment, and crew time and training. For insight into actual space repair needs, in early 2008 the project examined the operational experience of the International Space Station (ISS) program. CLEAR examined the ISS on-orbit Problem Reporting and Corrective Action database for electrical and electronic system problems. The ISS has higher than predicted reliability yet, as expected, it has persistent problems. A goal was to identify which on-orbit electrical problems could be resolved by a component-level replacement. A further goal was to identify problems that could benefit from the additional diagnostic and test capability that a component-level repair capability could provide. The study indicated that many problems stem from a small set of root causes that also represent distinct component problems. The study also determined that there are certain recurring problems where the current telemetry instrumentation and built-in tests are unable to completely resolve the problem. As a result, the root cause is listed as unknown. Overall, roughly 42 percent of on-orbit electrical problems on ISS could be addressed with a component-level repair. Furthermore, 63 percent of on-orbit electrical problems on ISS could benefit from additional external diagnostic and test capability. These results indicate that in situ component-level repair in combination with diagnostic and test capability can be expected to increase system availability and reduce logistics. The CLEAR approach can increase the flight crew s ability to act decisively to resolve problems while reducing dependency on Earth-supplied logistics for future Constellation Program missions.

Oeftering, Richard C.↗

NASA NTRS1996

Surveying Dead Trees and CO2-Induced Stressed Trees Using AVIRIS in the Long Valley Caldera

Since 1980 the Long Valley Caldera in the eastern Sierra Nevada (California) has shown signs of renewed volcanic activity. Frequent earthquakes, a re-inflation of the caldera, hydrothermal activity and gas emissions are the outer symptoms of this renewed activity. In 1990 and 1991 several areas of dying trees were found around Mammoth Mountain. The cause of the die off of the trees was first sought in the persistent drought in the preceding years. However, the trees died regardless of age and species. Farrar et al. (1995) started a soil-gas survey in 1994 in the dead-tree areas and found carbon dioxide concentrations ranging from 30 to 96% at soil depths between 30 and 60 cm. CO2 concentrations in the atmosphere are usually around 0.03% and in the soil profile CO2 levels do commonly not exceed 4 to 5%. Although not much is known about the effect of high levels of carbon dioxide in the soil profile on roots, it is most likely that the trees are dying due to oxygen deprivation: the CO2 drives the oxygen out of the soil. So far, four sites of dead trees have been mapped around Mammoth Mountain. The two largest dying trees sites are located near Horseshoe Lake and near Mammoth Mountain Main Lodge covering approximately an area of 10 and 8 ha respectively. Analysis of the gas composition regarding the He-3/He-4 ratio and the percentage biogenic carbon reveals the source of the gas: the magma body beneath the Long Valley Caldera. Until recently it was not known that volcanoes release abundant carbon dioxide from their flanks as diffuse soil emanations. As a result of the magma gas emission around Mammoth Mountain there is an excellent sequence of dead trees, stressed trees, healthy trees and bare soil surfaces. This research site provides excellent opportunities to: (1) Study the capabilities of imaging spectrometry to map stressed (and dead) pine and fir species; (2) Study methods to separate the vivid vegetation, stressed vegetation and dead vegetation from the soil background of glacial deposits and crystalline rocks. The dead tree areas are located on the flanks of Mammoth Mountain (N:37 deg 37' 45" and W:119 deg 02' 05") at an elevation between 2600 and 3000 meters. The area is covered by an open type of Montane Forest. The dominant tree species are Lodgepole Pine (Pinus contorta), the Red Fir (Abies magnifica) and the Jeffrey Pine (Pinus jeffreyi). The soil surface near Horseshoe Lake is generally fairly bright. The surface is covered by glacial deposits (till) consisting mainly of weathered granitic rocks.

deJong, Steven M.↗

NASA NTRSDate not supplied

OVERFLOW Analysis of Supersonic Retropropulsion Testing on a Blunt Mars Entry Vehicle Concept

Supersonic retropropulsion (SRP) flow over a Hypersonic Inflatable Aerodynamic Decelerator (HIAD) blunt-body vehicle was simulated using the Overflow Computational Fluid Dynamics (CFD) solver. Two nozzle configurations were tested (1E and 1F) as a subset of the seven total configurations in the Descent System Study (DSS) testing campaign. A generalized, Adaptive Mesh Refinement (AMR) shock capturing and plume refinement technique was developed and calibrated for producing automatic and unique grid systems optimized for any given testing condition. Solution independence from grid resolution was determined by successively increasing grid refinement until asymptotic convergence of the mean aerodynamic loads was observed. Overflow Reynolds-averaged Navier-Stokes (RANS) solutions produced realistic SRP flow phenomena, including Mach disk normal shocks contained in high-thrust plumes and bow shock triple-points. Solutions for the 1E nozzle configuration were steady. Conversely, a subset of the 1F test conditions were unsteady and exhibited periodic, non-sinusoidal expansions and contractions of the streamwise-oriented plume, resulting in unsteady aerodynamic loads on the vehicle. Initial investigations into the effect of turbulence modeling fidelity demonstrated significant differences between the aerodynamic loads simulated with RANS and Detached Eddy Simulation (DES). Multiple flow mechanisms were identified as root causes of these differences, including bow shock shape augmentation and reduced entrainment due to reduced turbulence in the DES simulations. Initial comparisons of pitching moment control authority and aerodynamic drag performance between the tested nozzle configurations demonstrated that the 1E configuration may be more advantageous for the Mars Entry, Descent, and Landing (EDL) task.

Supersonic Retropropulsion↗

NASA NTRSDate not supplied

OVERFLOW Analysis of Supersonic Retropropulsion Testing on a Blunt Mars Entry Vehicle Concept

Supersonic Retropropulsion↗

NASA NTRS2018

A Quantitative Analysis of Systematic Differences in the Positions and Proper Motions of Gaia DR2 with Respect to VLBI

We have analysed the differences in positions of 9081 matched sources between the GaiaData Release 2 (DR2) and very long baseline interferometry (VLBI) catalogues. The medianposition uncertainty of matched sources in the VLBI catalogue is a factor of two larger thanthe median position uncertainty in Gaia DR2. There are 9 per cent matched sources withstatistically significant offsets between both catalogues. We found that the reported positionalerrors should be rescaled by a factor of 1.3 for VLBI and 1.06 for Gaia and, in addition, the Gaiaerrors should be multiplied by the square root of chi squared per degree of freedom in order tobest fit the normalized position differences to the Rayleigh distribution. We have establishedthat the major contributor to statistically significant position offsets is the presence of opticaljets. Among the sources for which the jet direction was determined, the position offsets areparallel to the jet directions for 62 per cent of the outliers. Among the matched sources withsignificant proper motion, the fraction of objects with proper motion directions parallel tojets is a factor of three greater than on average. Such sources have systematically higher chisquared per degree of freedom. We explain these proper motions as a manifestation of thesource position jitter caused by flares, which we predicted earlier. Therefore, the assumptionthat quasars are fixed points, and thus that differential proper motions determined with respectto quasar photocentres can be regarded as absolute proper motions, should be treated withgreat caution.

Petrov, L.↗

DOE OSTI2021

Fork Experiments in the Hot Cell Using Spent Fuel Rods for International Nuclear Safeguards

This work leveraged the rare availability of 25 full-length pressurized water reactor spent fuel rods and 1 irradiated mixed-oxide rod at an Oak Ridge National Laboratory hot cell. This was done to collect measurement data with two Fork detectors to assess the detectors’ capability of verifying operator declaration data and detecting partial defects in spent fuel, which are the two primary goals of international safeguards on spent nuclear fuel. The data can also be used to benchmark the ORIGEN module, which has been adopted in the International Atomic Energy Agency’s (IAEA’s)/European Atomic Energy Community’s (Euratom’s) Integrated Review and Analysis Program to predict the Fork detector count rates in real time. In this project, the authors first calibrated two Fork detectors—a standard one and a modified one—by using known strong neutron and gamma sources. Then, the authors measured all 26 fuel rods at multiple locations along the length. The fuel rods were then assembled into three arrays—2 × 2, 3 × 3, and 5 × 5—by using specially designed support grids to mimic fuel assemblies and measure the arrays with both detectors. For the 5 × 5 array, 4 and 8 fuel rods of the array were replaced in two separate cases with short stainless-steel rods to mimic two partial defect scenarios, and the arrays were measured before and after the replacements. Polyethylene blocks were used in this experiment to mimic water. The results show that the Fork detectors were able to verify operator declarations and detect partial defects in spent fuel, and the authors were the first to demonstrate this through experiments. A discovery was also made that determined the root cause of the nonlinear response to gamma dose in the ion chambers used in IAEA and Euratom’s Fork detectors. After the experiments, both detectors were retrieved from the hot cell for future use. The data collected in this project will be used in a parallel International Nuclear Safeguards Engagement Program (INSEP) project to enhance the safeguards in the Finnish spent fuel encapsulation plant, and the data will be useful to other projects in the future given the increased safeguards needs due to spent fuel transfer and disposal activities worldwide.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS1989

Implementation of equivalent domain integral method in the two-dimensional analysis of mixed mode problems

An equivalent domain integral (EDI) method for calculating J-intergrals for two-dimensional cracked elastic bodies is presented. The details of the method and its implementation are presented for isoparametric elements. The total and product integrals consist of the sum of an area of domain integral and line integrals on the crack faces. The line integrals vanish only when the crack faces are traction free and the loading is either pure mode 1 or pure mode 2 or a combination of both with only the square-root singular term in the stress field. The EDI method gave accurate values of the J-integrals for two mode I and two mixed mode problems. Numerical studies showed that domains consisting of one layer of elements are sufficient to obtain accurate J-integral values. Two procedures for separating the individual modes from the domain integrals are presented. The procedure that uses the symmetric and antisymmetric components of the stress and displacement fields to calculate the individual modes gave accurate values of the integrals for all problems analyzed. The EDI method when applied to a problem of an interface crack in two different materials showed that the mode 1 and mode 2 components are domain dependent while the total integral is not. This behavior is caused by the presence of the oscillatory part of the singularity in bimaterial crack problems. The EDI method, thus, shows behavior similar to the virtual crack closure method for bimaterial problems.

Raju, I. S.↗

NASA NTRS1980

Microstructure and mechanical properties of bulk and plasma-sprayed y2O3-partially stabilized zirconia

Bulk 8.0 weight percent yttria partially stabilied zirconia (PSZ) was studied by light microscopy, transmission electron microscopy, X-ray analysis, microhardness testing, and fracture toughness testing. The as received PSZ contained spheroidal and grain boundary precipitates up to 4 micrometers in size. Spheroids up to 1.26 micrometers were metastable tetragonal; large spheroids were monoclinic. Grinding the PSZ into powder did not cause a significant amount of tetragonal to transform to monoclinic. This indicates that transformation toughness is not a significant mechanism in PSZ. Aging the PSZ at 1500 C caused the fine tetragonal precipitates to grow from 0.06 to 0.12 micrometers, in 250 minutes. A peak hardness of 1400 kg/sq mm was attained after 50 minutes. Solution annealing and quenching the as received PSZ eliminated the large precipitates, but fine tetragonal precipitates reformed on quenching. Aging at 1500 C caused the fine 0.02 micrometers tetragonal precipitates to grow into plates about 0.10 by 0.50 micrometers. A peak hardness of 1517 kg/sq mm was obtained after 250 minutes. On further aging, monoclinic percipitates formed along grain boundaries. The fracture toughness of the aged and unaged solution annealed and quenched PSZ was found to be between 2 and 3 MN /square root of m cubed. This range of fracture toughness is consistent with PSZ's that do not undergo transformation toughening.

Valentine, P. G.↗

DOE OSTI2020

Holistic Measurement Driven Resilience: Combining Operational Fault and Failure Measurements and Fault Injection for Quantifying Fault Detection, Propagation and Impact. Final report

For HPC systems to date, application resilience to faults and failures has been accomplished by the brute- force method of checkpoint/restart, which allows an application to make forward progress in the face of system and application faults, errors, and failures independent of root cause or end result. It has remained the primary resilience mechanism because we lack a way to identify faults and anticipate consequences early enough to take meaningful mitigating action. However, checkpoint/restart implementations put a tremendous burden on system resources and on the applications themselves and is becoming less feasible at scale. Because we have not yet operated at scales at which checkpoint/restart fails to provide forward progress, despite increasing costs, vendors have had little motivation to provide the instrumentation necessary for early identification of faults and failures. However, as we move from petascale to exascale, component mean time to failure (MTTF) will render the existing techniques ineffectual and/or too expensive. Furthermore, fault recovery mechanisms such as failover and/or error correction introduce performance inconsistency. Instrumentation allowing early indication of problems and tools to enable use of such information by systems, operating systems, and applications offer an alternative, more scalable and less costly solution. In the HMDR project, we built on our experience and expertise developed and accumulated over years of research on design, monitoring, measurement, and assessment of resilient computing systems. Analysis of field data on the current and past generations of extreme-scale systems revealed several challenges that, if not addressed in increasingly larger and more complex systems, may hinder the effectiveness of future exascale computing systems. Specifically, i) file systems and interconnects in current-generation large-scale systems already operate at the margins of resiliency, including consistent performance, and may not scale to larger deployments; ii) automated, software-based failover mechanisms are frequently inadequate and can introduce wider failures, such that failures during recovery may lead to system/application failures, including system-wide outages; and iii) silent data corruption represents a critical fault mode and will require efficient detection mechanisms if next-generation applications are to take full advantage of exascale hardware. To address the above challenges, we assembled a team of world-renowned experts in resilient extreme- scale computing from the University of Illinois (Electrical and Computer Engineering, Computer Science, and NCSA), SNL, LANL, NERSC, and Cray. Our team includes representatives from centers that house many of the largest HPC resources in the world, both today and over the coming years. The team has a unique track record of research in i) system and application failure characterization based on the analysis of field data, ii) data-driven design of fault/error detection mechanisms, and iii) experimental characterization of system/application resiliency. The team includes system owners/operators who provide continuous data collection and access and ensure installation of appropriate analysis tools.

97 MATHEMATICS AND COMPUTING↗