Search NASA⌕ Search

SEARCH · Search NASA

Results for “Reliability Prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

SU-E-T-630: Predictive Modeling of Mortality, Tumor Control, and Normal Tissue Complications After Stereotactic Body Radiotherapy for Stage I Non-Small Cell Lung Cancer

Purpose: While rates of local control have been well characterized after stereotactic body radiotherapy (SBRT) for stage I non-small cell lung cancer (NSCLC), less data are available characterizing survival and normal tissue toxicities, and no validated models exist assessing these parameters after SBRT. We evaluate the reliability of various machine learning techniques when applied to radiation oncology datasets to create predictive models of mortality, tumor control, and normal tissue complications. Methods: A dataset of 204 consecutive patients with stage I non-small cell lung cancer (NSCLC) treated with stereotactic body radiotherapy (SBRT) at the University of Pennsylvania between 2009 and 2013 was used to create predictive models of tumor control, normal tissue complications, and mortality in this IRB-approved study. Nearly 200 data fields of detailed patient- and tumor-specific information, radiotherapy dosimetric measurements, and clinical outcomes data were collected. Predictive models were created for local tumor control, 1- and 3-year overall survival, and nodal failure using 60% of the data (leaving the remainder as a test set). After applying feature selection and dimensionality reduction, nonlinear support vector classification was applied to the resulting features. Models were evaluated for accuracy and area under ROC curve on the 81-patient test set. Results: Models for common events in the dataset (such as mortality at one year) had the highest predictive power (AUC = .67, p < 0.05). For rare occurrences such as radiation pneumonitis and local failure (each occurring in less than 10% of patients), too few events were present to create reliable models. Conclusion: Although this study demonstrates the validity of predictive analytics using information extracted from patient medical records and can most reliably predict for survival after SBRT, larger sample sizes are needed to develop predictive models for normal tissue toxicities and more advanced machine learning methodologies need be consider in the future.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Analyzing degradation data with a random effects spline regression model

This study proposes using a random effects spline regression model to analyze degradation data. Spline regression avoids having to specify a parametric function for the true degradation of an item. A distribution for the spline regression coefficients captures the variation of the true degradation curves from item to item. We illustrate the proposed methodology with a real example using a Bayesian approach. The Bayesian approach allows prediction of degradation of a population over time and estimation of reliability is easy to perform.

97 MATHEMATICS AND COMPUTING↗

Coupling Microstructural Evolution Simulations to Material Property Degradation Predictions for Plasma-Facing Materials

Reliable material performance is required for plasma-facing material (PFM) candidates. Previous research has shown that plasma and neutron radiation exposure induces microstructural changes in PFMs; changes in thermal and electrical conductivities and in material hardening and embrittlement were also observed after neutron irradiation. These material property changes will negatively impact the performance of the PFMs in a fusion reactor. Despite the well-known connection between material microstructure, properties, and performance, there is a need for validated modeling capabilities connecting PFM property degradation with microstructural evolution under fusion-relevant conditions. We are developing a simulation capability to couple plasma-induced microstructural evolution to material property degradation. Our approach relies on deliberate mapping between individual simulation models and experimental characterization for validation. The open-source Multiphysics Object-Oriented Simulation Environment (MOOSE) software was used for this simulation capability development. A MOOSE phase-field model was coupled with the cluster dynamics code, Xolotl, to predict microstructural evolution. Microstructure characterization techniques, including scanning electron microscopy (SEM), transmission electron microscopy (TEM), and laser scanning confocal microscopy (LSCM) are used to validate these microstructural evolution simulations. Calculation of thermal and electrical conductivities with first principles simulations was performed for bulk material and for grain boundaries; these results are used within MOOSE models to calculate effective thermal and electrical conductivities as a function of grain characteristics. Thermoreflectance and four-probe techniques were employed to measure the thermal and electrical conductivities, respectively. A MOOSE crystal plasticity model was adapted to predict microstructure-sensitive deformation behavior, and X-ray diffraction (XRD) was used to collect bulk dislocation density data for validation. After individual simulation validation, these models are coupled to predict material property changes resulting from plasma exposure. We focused here on an experimental design to emphasize the separate effects of moderate thermal loads and plasma exposure using tungsten. Annealing of tungsten was performed under a protective environment for temperatures ranging from 500 C to 1500 C. The plasma exposure was completed in the Tritium Plasma Experiment at Idaho National Laboratory under a deuterium flux of 1e22 D/m^2-s. This incremental approach is employed to build confidence in the modeling capability: separate-effects tests ensure that the models capture key mechanisms from single environmental conditions before predicting PFM property degradation under combined loads. We will show our early results from coupling these simulation models to predict PFM property changes from microstructural evolution. Comparisons of the simulation results with preliminary validation data will be discussed.

36 - MATERIALS SCIENCE↗

Probabilistic Risk Assessment of CO2 Trapping Mechanisms in a Sandstone CO2-EOR Field in Northern Texas, USA

This study employs a polynomial chaos expansion (PCE) technique to develop the reduced order models (ROMs) integrated with the Monte Carlo simulations to quantify uncertainties of CO 2 storage associated with enhanced oil recovery (EOR) in a commercial-scale CO 2 -EOR field. The Morrow B sandstone at the Farnsworth Unit (FWU) EOR field in northern Texas was selected as a case study. A 3-D reservoir model, including simulation of a five-spot injection/production well pattern, was constructed based on the data from well logs and cores, and an updated seismic interpretation in the FWU. Porosity and permeability were considered as sources of uncertainty. The 1000-realization heterogeneous random fields of porosity and permeability were generated based on the variogram analysis on the core measurements of the FWU. Three model outputs of interest include the amount of CO 2 trapped by three trapping mechanisms, i.e. hydrodynamic trapping, oil dissolution trapping, and aqueous dissolution trapping. The total of 25 runs were conducted with the simulations of a 20-year CO 2 -EOR period, and a 20-year monitoring period to develop the ROMs between uncertain model input parameters (i.e., porosity and permeability in this study) and model outputs at the end of simulation for each grid cell using PCE approach. The high coefficient of determination (R 2 ) and small normalized root mean square error (NRMSE) between the simulated (using reservoir modeling) and predicted (using ROMs) CO 2 storage indicate that the ROMs are acceptable and reliable to be used for the predictions. Given the 1000 Monte Carlo samplings of the model input parameters, cumulative distribution functions (CDFs) and uncertainty bounds (10 th and 90 th percentiles) of model outputs were estimated based on ROMs. At the end of simulation, the most injected CO 2 at the FWU was stored by hydrodynamic trapping (between 121,400 and 166,860 tonnes), followed by oil dissolution trapping (between 55,303 and 76,816 tonnes), and aqueous dissolution trapping (between 1979 and 2751 tonnes).

58 GEOSCIENCES↗

Assessment of software methods for estimating protein-protein relative binding affinities

A growing number of computational tools have been developed to accurately and rapidly predict the impact of amino acid mutations on protein-protein relative binding affinities. Such tools have many applications, for example, designing new drugs and studying evolutionary mechanisms. In the search for accuracy, many of these methods employ expensive yet rigorous molecular dynamics simulations. By contrast, non-rigorous methods use less exhaustive statistical mechanics, allowing for more efficient calculations. However, it is unclear if such methods retain enough accuracy to replace rigorous methods in binding affinity calculations. This trade-off between accuracy and computational expense makes it difficult to determine the best method for a particular system or study. Here, eight non-rigorous computational methods were assessed using eight antibody-antigen and eight non-antibody-antigen complexes for their ability to accurately predict relative binding affinities (ΔΔG) for 654 single mutations. In addition to assessing accuracy, we analyzed the CPU cost and performance for each method using a variety of physico-chemical structural features. This allowed us to posit scenarios in which each method may be best utilized. Most methods performed worse when applied to antibody-antigen complexes compared to non-antibody-antigen complexes. Rosetta-based JayZ and EasyE methods classified mutations as destabilizing (ΔΔG < -0.5 kcal/mol) with high (83–98%) accuracy and a relatively low computational cost for non-antibody-antigen complexes. Some of the most accurate results for antibody-antigen systems came from combining molecular dynamics with FoldX with a correlation coefficient (r) of 0.46, but this was also the most computationally expensive method. Overall, our results suggest these methods can be used to quickly and accurately predict stabilizing versus destabilizing mutations but are less accurate at predicting actual binding affinities. This study highlights the need for continued development of reliable, accessible, and reproducible methods for predicting binding affinities in antibody-antigen proteins and provides a recipe for using current methods.

59 BASIC BIOLOGICAL SCIENCES↗

Universality between vector-like and chiral quiver gauge theories: anomalies and domain walls

We study low-energy dynamics of [SU($\textit{N}$)]$^K$ chiral quiver gauge theories in connection with $\mathcal{N}$ = 1 super Yang-Mills (SYM) theory, and quantum chromodynamics with bi-fundamental fermions (QCD(BF)). These theories can be obtained by $\mathbb Z_K$ orbifold projections of $\mathcal{N}$ = 1 SU($\textit{N K}$) SYM theory, but the perturbative planar equivalence does not extend nonperturbatively for $\textit{K}$ ≥ 3. In order to study low-energy behaviors, we analyze these systems using ’t Hooft anomaly matching and reliable semiclassics on $\mathbb R^3 × S^1$. Thanks to ’t Hooft anomaly that involves 1-form center symmetry and discrete chiral symmetry, we predict that chiral symmetry must be spontaneously broken in the confinement phase, and there exist $\textit{N}$ vacua. Theories with even $\textit{K}$ possess a physical θ angle despite the presence of massless fermions, and we further predict the $\textit{N}$-branch structure associated with it; the number of vacua is enhanced to 2$\textit{N}$ at θ = π due to spontaneous $\textit{C P}$ breaking. Both of these predictions are explicitly confirmed by reliable semiclassics on $\mathbb R^3 × S^1$ with the double-trace deformation. Symmetry and anomaly of odd-$\textit{K}$ theories are the same as those of the $\mathcal{N}$ = 1 SYM, and the ones of even-$\textit{K}$ theories are same as those of QCD(BF). We unveil why there exists universality between vector-like and chiral quiver theories, and conjecture that their ground states can be continuously deformed without quantum phase transitions. We briefly discuss anomaly inflow on the domain walls connecting the vacua of the theory and possible anomaly matching scenarios.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

JMP Applications in Photovoltaic Reliability (Presentation)

The ability to accurately predict power delivery over the course of time is of vital importance to the growth of the photovoltaic (PV) industry. Two key cost drivers are the efficiency with which sunlight is converted into power and secondly how this relationship develops over time. The accurate knowledge of power decline over time, also known as degradation rates, is essential and important to all stakeholders--utility companies, integrators, investors, and scientist alike. Outdoor testing plays a vital part in quantifying degradation rates of different technologies in various climates. Due to seasonal changes, however, several complete cycles (typically 3-5 years) need to be completed traditionally to obtain reasonably accurate degradation rates. In a rapidly evolving industry such atime span is often unacceptable and the need exists to determine degradation rates more accurately in a shorter period of time. Advanced time series modeling such as ARIMA (Autoregressive Integrated Moving Average) modeling can be utilized to decrease the required time span and is compared with some non-linear modeling. In addition, it will be demonstrated how the JMP 9 map feature was used toreveal important technological trends by climate.

14 SOLAR ENERGY↗

Particle Filter Based Inference Testing

The primary intent of PAR-FIT (Particle Filter based Inference Testing) is to provide hard inductive evidence that a machine learning model is capable and proven for an individual test input. By examining training data used to form the underlying model functional correlation, an estimate of the reliability that a model will make the correct prediction can be made. The Sequential Probability Ratio Test is used to derive a qualitative evaluation for reliability based on hypothesis testing. The PAR-FIT framework achieves this by implementing a particle filter and the sequential probability ratio test algorithms on the machine learning model training data to determine relevancy of new individual test samples to the training dataset. The kernel function evaluates the local proximity and density of training data used to derive a prediction outcome. Particles are used to probabilistically determine which training data to evaluate for proximity. For test samples that are within a close proximity to and surrounded by multiple training data points, the evaluated reliability of the prediction is high. For test samples that are anomalies not represented by the training dataset, in low density data clusters, or are far from existing data points, the evaluated reliability is low as insufficient training evidence exists to suggest the model is capable of making the correct prediction. Sequential Probability Ratio Test is further used to determine when a hypothesis on whether a signal can be rejected or accepted for use. The ratio test collects sequence information from the particle filter to test whether the signal is anomalous or normal via hypothesis testing of the underlying distributions.

Chen, Edward [Idaho National Laboratory (INL), Ida↗

Structure classification and melting temperature prediction in octet AB solids via machine learning

Machine learning methods are being increasingly used in condensed matter physics and materials science to classify crystals structures and predict material properties. However, the reliability of these methods for a given problem, especially when large data sets are unavailable, has not been well studied. By addressing the tasks of classifying crystal structure and predicting melting temperatures of the octet subset of AB solids, we performed such a study and found potential problems with using machine learning methods on relatively small data sets. At the same time, however, we can reaffirm the potential power of such methods for these tasks. In particular, we uncovered an important new material feature, the excess Born effective charge, that significantly increased the accuracy of the predictions for the classification problem we defined. This discovery leads us to propose a new scale for the degree of ionicity and covalency in these solids. More specifically, we partitioned the crystal structures of a set of 75 octet solids into those that are ionic and covalent bonded and thus performed a binary classification task. We found that using the standard indices (r σ ,r π ), suggested by St. John and Bloch several decades ago, enabled an average success in classification of 92%. Using just r σ and the excess Born effective charge ΔZ A of the A atom enabled an average success of 97%, but we also found relatively large variations about these averages that were dependent on how certain machine learning methods were used and for which a standard deviation was not a proper measure of the degree of confidence we can place in either average. Instead, we calculated and report with 95 % confidence that the traditional classification pair predicts an accuracy in the interval [ 89%, 95%] and the accuracy of the new pair lies in the interval [96 %, 99%]. For melting temperature predictions, the size of our data set was 46. We estimate the root-mean-squared error of our resulting model to be 11% of the mean melting temperature of the data, but we note that if the accuracy of this predicted error is itself measured, our estimated fitting error itself has a root-mean-square error of 50%. In short, what we illustrate is that classification and regression predictions can vary significantly, depending on the details of how machine learning methods are applied to small data sets. This variation makes it important, if not essential, to average the predictions and compute confidence intervals about these averages to report results meaningfully. However, when properly used, these statistical methods can advance our understanding and improve predictions of material properties even for small data sets.

36 MATERIALS SCIENCE↗

Uncertainty quantification in multivariable regression for material property prediction with Bayesian neural networks

With the increased use of data-driven approaches and machine learning-based methods in material science, the importance of reliable uncertainty quantification (UQ) of the predicted variables for informed decision-making cannot be overstated. UQ in material property prediction poses unique challenges, including multi-scale and multi-physics nature of materials, intricate interactions between numerous factors, limited availability of large curated datasets, etc. In this work, we introduce a physics-informed Bayesian Neural Networks (BNNs) approach for UQ, which integrates knowledge from governing laws in materials to guide the models toward physically consistent predictions. To evaluate the approach, we present case studies for predicting the creep rupture life of steel alloys. Experimental validation with three datasets of creep tests demonstrates that this method produces point predictions and uncertainty estimations that are competitive or exceed the performance of conventional UQ methods such as Gaussian Process Regression. Additionally, we evaluate the suitability of employing UQ in an active learning scenario and report competitive performance. The most promising framework for creep life prediction is BNNs based on Markov Chain Monte Carlo approximation of the posterior distribution of network parameters, as it provided more reliable results in comparison to BNNs based on variational inference approximation or related NNs with probabilistic outputs.

36 MATERIALS SCIENCE↗

Filtering log data: finding the needles in the haystack

Log data is an incredible asset for troubleshooting in large-scale systems. Nevertheless, due to the ever-growing system scale, the volume of such data becomes overwhelming, bringing enormous burdens on both data storage and data analysis. To address this problem, we present a 2-dimensional online filtering mechanism to remove redundant and noisy data via feature selection and instance selection. The objective of this work is two-fold: (i) to significantly reduce data volume without losing important information, and (ii) to effectively promote data analysis. We evaluate this new filtering mechanism by means of real environmental data from the production supercomputers at Oak Ridge National Laboratory and Sandia National Laboratory. Our preliminary results demonstrate that our method can reduce more than 85% disk space, thereby significantly reducing analysis time. Moreover, it also facilitates better failure prediction and diagnosis by more than 20%, as compared to the conventional predictive approach relying on RAS (Reliability, Availability, and Serviceability) events alone.

failure prediction↗

Develop a weather-aware climate model to understand and predict extremes and associated power outages and renewable energy shortages with uncertainty-aware and physics-informed machine learning

Focal Area(s): The focus area is predictive modeling through the use of AI techniques and AI-derived model components with a particular emphasis on extreme weather in Atmospheric Science and power outages and shortages in Energy Science. Science Challenge: Predicting weather extremes (e.g., heavy precipitation, strong wind, and large hailstones), and weather-related power system outages and shortages can mitigate economic losses, save lives, support renewables integration, and improve power system resiliency. However, currently, the poor reliability and large uncertainty associated with the weather extreme prediction in the current climate models make the problem intractable. The key challenges are: (1) physical factors like green-house gases (GHGs), aerosols, and land use and land cover (LULC) can significantly impact extreme storms, but the understanding of these impacts is limited, particularly globally; (2) the convective permitting resolutions needed to model severe convective storms and their impacts are computationally prohibitive with global climate models (GCMs); (3) interactions between weather extremes and power system outages are complex and subject to great uncertainty. Current outage prediction models are short lead (~ 3 days), which do not allow for long-time planning of energy production and distribution. Moreover, we have limited capacity to predict weather events leading to sustained shortages in a renewable-energy-dominated power system. These challenges drive motivation for mechanistic understanding and reliable and efficient predictive modeling of extremes and their impacts from the sub-seasonal to long term projections.

54 ENVIRONMENTAL SCIENCES↗

Reliability and performance of a system-on-a-chip by predictive wear-out based activation of functional components

A processor-implemented method for determining aging of a processing unit in a processor the method comprising: calculating an effective aging profile for the processing unit wherein the effective aging profile quantifies the effects of aging on the processing unit; combining the effective aging profile with process variation data, actual workload data and operating conditions data for the processing unit; and determining aging through an aging sensor of the processing unit using the effective aging profile, the process variation data, the actual workload data, architectural characteristics and redundancy data, and the operating conditions data for the processing unit.

97 MATHEMATICS AND COMPUTING↗

Influence of Numerical Modeling Approaches on Damped Behavior of Flexible Beams: Preprint

Composites structures are widely used in aerospace and wind energy applications for their excellent stiffness and strength-to-weight properties. In these structures, structural damping is critical to predict vibration amplitudes, performance, and reliability. Structural damping is of particular interest for slender wings, rotorcraft blades, and wind turbine blades that can exhibit complex vibration phenomena and are frequently modeled with geometrically exact beam theory (GEBT). Standard approaches of stiffness proportional or modal damping merely assign user defined values and cannot predict damping behavior. This work compares stiffness proportional damping to two more advanced damping approaches: modal strain energy and Prony series. The modal strain energy approach uses a sectional analysis tool to calculate the beam stiffness and postprocess internal stresses from GEBT simulations. The internal stresses are then used to calculate modal damping factors. The Prony series is implemented within GEBT to directly model viscoelastic behavior of the composites. These approaches are compared by modeling the evolution of the damping factors of a realistic flexible wind turbine blade with varying rotational speed. Discrepancies between the approaches suggest areas for future modeling development, but differences in nonlinear damping values are less than current uncertainties about the magnitude of structural damping.

17 WIND ENERGY↗

A Fluka study of underground cosmogenic neutron production

Neutrons produced by cosmic muon interactions are important contributors to backgrounds in underground detectors when searching for rare events. Typically such neutrons can dominate the background, as they are particularly difficult to shield and detect. Since actual data is sparse and not well documented, simulation studies must be used to design shields and predict background rates. Thus validation of any simulation code is necessary to assure reliable results. This work compares in detail predictions of the FLUKA simulation code to existing data, and uses this code to report a simulation of cosmogenic backgrounds for typical detectors embedded in a water tank with liquid scintillator shielding.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Digital Twin Empowered PV Power Prediction

The accurate prediction of photovoltaic (PV) power generation is significant to ensure the economic and safe operation of power systems. To this end, the paper proposes a new digital twin (DT) empowered PV power prediction framework that is capable of ensuring reliable data transmission and employing the DT to achieve high accuracy of power prediction. With this framework, considering potential data contamination in the collected PV data, a generative adversarial network is employed to restore the historical data set, which offers a prerequisite to ensure accurate mapping from the physical space to the digital space. Further, a new DT empowered PV power prediction method is proposed. Therein, we model a DT that encompasses a digital physical model for reflecting the physical operation mechanism and a neural network model (i.e., a parallel network of convolution and bidirectional long-short-term memory model) for capturing the hidden spatial-temporal features. The proposed method enables the use of the DT to take advantages of the digital physical model and the neural network model, resulting in enhanced prediction accuracy. Finally, a real data set is conducted to access the effectiveness of the proposed method.

14 SOLAR ENERGY↗