Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistical methods for engineering applications”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Complete Development of Critical Capabilities for TRISO Fission Product Source Term Calculations and Quantify Mechanisms for Pd Penetration of SiC

Overall fission product (FP) release will be an important consideration for the licensing and deployment of advanced reactors utilizing tristructural isotropic (TRISO) fuels. This work focuses on enhancing and applying the BISON models needed to predict FP transport within TRISO particles and particle failure probability, both of which factor directly into release predictions. Specifically, this report details (1) the development of the models needed to predict palladium (Pd) conservation at the engineering scale and the application of those models to characterize Pd fluxes for input into a mechanistic multiscale model for Pd penetration; (2) the refinement of sorption mass transfer models and the development of models for trapping in porous layers, which were applied and compared to particle scans from AGR-2 to provide proof of concept for a method of particle-scale validation that may reduce uncertainties compared to compact-scale validation using data from integral effects tests; (3) the development of a failure-statistics-informed, mesh-independent methodology for applying smeared cracking, enabling further study of the localized multiphysics behaviors associated with cascading particle failure mechanisms; and (4) the preliminary characterization of those coupled multiphysics particle failure behaviors using smeared, nonretentive diffusivities to provide a baseline for future study and to guide ongoing engineering applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Solving inverse problems in stochastic models using deep neural networks and adversarial training

Inverse problems associated with stochastic models constitute a significant portion of scientific and engineering applications. In such cases the unknown quantities are distributions. The applicability of traditional methods is limited because of their demanding assumptions or prohibitive computational consumption; for example, maximum likelihood methods require closed-form density functions, and Markov Chain Monte Carlo needs a large number of simulations. We propose a new method that estimates the unknown distribution by matching the statistical properties between observed and simulated random processes. We leverage the expressive power of neural networks to approximate the unknown distribution and use a discriminative neural network for computing the statistical discrepancies between the observed and simulated random processes. Here we demonstrated numerically that the proposed methods can estimate both the model parameters and learn complicated unknown distributions.

42 ENGINEERING↗

Self-assembly of co-continuous nanostructured copolymer templates with compositional and architectural dispersity

In our previous DOE-supported project (DE-SC0016208), we demonstrated that a particular architecture dubbed ‘randomly end-linked copolymer networks’ (RECNs) led to especially robust self-assembly of disordered cocontinuous nanostructures. Such structures, wherein both microphases are fully percolating in three dimensions, are attractive for a wide-variety of energy-relevant applications including purification membranes, separators in batteries and fuel cells, catalyst supports, and high surface area electrodes. In the current project we sought to substantially extend our fundamental understanding of how different types of randomness in blocky copolymer architecture contribute to the robust formation of disordered cocontinuous nanostructures. To do so, we filled in the sizable gap between the previously studied cases of randomly linked linear multiblock copolymers and RECNs by studying two intermediate cases: (i) random miktoarm star polymers, which contain dispersity in the number of the two chemically-incompatible strands located at each junction and therefore the preferred interfacial curvature of each polymer, and (ii) randomly branched copolymers, which also possess bridging strands that stretch across domains and apply local ‘elastic’ forces to the interfaces. In addition, we studied a different network architecture, statistically crosslinked copolymer networks, that is more straightforward to prepare using chain growth polymerization methods, enabling more facile formation of cocontinuous nanostructures. Finally, we extended our approaches from model systems based on polystyrene and poly(lactic acid) to copolymer architectures containing either (i) polysulfone, an engineering polymer that provides excellent mechanical properties for membrane applications, or (ii) polyacrylonitrile, providing a convenient route to nanoporous carbon materials.

36 MATERIALS SCIENCE↗

Physics guided machine learning using simplified theories

Recent applications of machine learning, in particular deep learning, motivate the need to address the generalizability of the statistical inference approaches in physical sciences. In this Letter, we introduce a modular physics guided machine learning framework to improve the accuracy of such data-driven predictive engines. The chief idea in our approach is to augment the knowledge of the simplified theories with the underlying learning process. To emphasize their physical importance, our architecture consists of adding certain features at intermediate layers rather than in the input layer. To demonstrate our approach, we select a canonical airfoil aerodynamic problem with the enhancement of the potential flow theory. We include the features obtained by a panel method that can be computed efficiently for an unseen configuration in our training procedure. By addressing the generalizability concerns, our results suggest that the proposed feature enhancement approach can be effectively used in many scientific machine learning applications, especially for the systems where we can use a theoretical, empirical, or simplified model to guide the learning module.

42 ENGINEERING↗

Learning planar Ising models

Inference and learning of graphical models are both well-studied problems in statistics and machine learning that have found many applications in science and engineering. However, exact inference is intractable in general graphical models, which suggests the problem of seeking the best approximation to a collection of random variables within some tractable family of graphical models. In this paper, we focus on the class of planar Ising models, for which exact inference is tractable using techniques of statistical physics. Based on these techniques and recent methods for planarity testing and planar embedding, we propose a greedy algorithm for learning the best planar Ising model to approximate an arbitrary collection of binary random variables (possibly from sample data). Given the set of all pairwise correlations among variables, we select a planar graph and optimal planar Ising model defined on this graph to best approximate that set of correlations. Finally, we demonstrate our method in simulations and for two applications: modeling senate voting records and identifying geo-chemical depth trends from Mars rover data.

97 MATHEMATICS AND COMPUTING↗

Unified rational protein engineering with sequence-based deep representation learning

Rational protein engineering requires a holistic understanding of protein function. Here, we apply deep learning to unlabeled amino-acid sequences to distill the fundamental features of a protein into a statistical representation that is semantically rich and structurally, evolutionarily and biophysically grounded. We show that the simplest models built on top of this unified representation (UniRep) are broadly applicable and generalize to unseen regions of sequence space. Our data-driven approach predicts the stability of natural and de novo designed proteins, and the quantitative function of molecularly diverse mutants, competitively with the state-of-the-art methods. UniRep further enables two orders of magnitude efficiency improvement in a protein engineering task. Lastly, UniRep is a versatile summary of fundamental protein features that can be applied across protein engineering informatics.

59 BASIC BIOLOGICAL SCIENCES↗

PATHA: Performance Analysis Tool for HPC Applications

Large science projects rely on complex workflows to analyze terabytes or petabytes of data. These jobs are often running over thousands of CPU cores and simultaneously performing data accesses, data movements, and computation. It is difficult to identify bottlenecks or to debug the performance issues in these large workflows. In order to address these challenges, we have developed Performance Analysis Tool for HPC Applications (PATHA) using the state-of-art open source big data processing tools. Our framework can ingest system logs to extract key performance measures, and apply the most sophisticated statistical tools and data mining methods on the performance data. Furthermore, it utilizes an efficient data processing engine to allow users to interactively analyze a large amount of different types of logs and measurements. To illustrate the functionality of PATHA, we conduct a case study on the workflows from an astronomy project known as the Palomar Transient Factory (PTF). This study processed 1.6 TB of system logs collected on the NERSC supercomputer Edison. Using PATHA, we were able to identify performance bottlenecks, which reside in three tasks of PTF workflow with the dependency on the density of celestial objects.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Closure models for the feedback of energetic particles on plasma turbulence

Energetic particles interact with the plasma surrounding them, resonating with certain types of plasma waves to stabilize them while destabilizing others, and changing the character of the background turbulence in ways that have not been fully quantified or understood. Interaction with the turbulent background plasma is key to the acceleration of many types of energetic particles including high-energy cosmic rays, solar energetic particles, and pick-up ions. The acceleration of particles is a process that would ideally be described by a kinetic model, a type of model that follows a probability distribution function (PDF) for all particles in 7-dimensional (x, y, z, v x , v y , v z , t) space. Because of the high dimensionality of a kinetic model, simulations that solve kinetic equations use the largest computational resources currently available, and are yet unable to simulate a realistic number of particles, reach the large scales necessary for astrophysical problems, and use high-precision numerical methods. Two available alternatives to kinetic plasma models have been explored for this problem, with limited success. One is a multi-fluid model produced by a cumulant discarding closure, which evolves coupled equations for the velocity, magnetic field, and internal energy for both the background plasma and the fluid of energetic particles. However, simulations that solve multi-fluid magnetohydrodynamic (MHD) equations are able to include the interaction with energetic particles only in crude ways, typically as an add-on pressure term. The second alternative is to use a hybrid method to couple a fluid description of the background plasma to a kinetic model or a Fokker–Planck model for the energetic particles. These methods are hampered by the physical modeling of the coupling. In this work, we develop a new model, which follows the PDF for all particles; this can be viewed as a step toward physical realism above a multi-fluid MHD model, while also being more computationally efficient than a kinetic model. The equations we develop model both the background plasma and the energetic particles self-consistently. Over the last decade, similar PDF methods have been developed to a high level of sophistication to model reactive flows and turbulent combustion for engineering applications. For treatment of the feedback of the energetic particles on a background plasma, a PDF closure approach should evaluate the mean characteristics, including the density, with better statistical quality than will particle-sampling procedures.

79 ASTRONOMY AND ASTROPHYSICS↗

SU-E-T-112: An OpenCL-Based Cross-Platform Monte Carlo Dose Engine (oclMC) for Coupled Photon-Electron Transport

Purpose: Low computational efficiency of Monte Carlo (MC) dose calculation impedes its clinical applications. Although a number of MC dose packages have been developed over the past few years, enabling fast MC dose calculations, most of these packages were developed under NVidia’s CUDA environment. This limited their code portability to other platforms, hindering the introduction of GPU-based MC dose engines to clinical practice. To solve this problem, we developed a cross-platform fast MC dose engine named oclMC under OpenCL environment for external photon and electron radiotherapy. Methods: Coupled photon-electron simulation was implemented with standard analogue simulation scheme for photon transport and Class II condensed history scheme for electron transport. We tested the accuracy and efficiency of oclMC by comparing the doses calculated using oclMC and gDPM, a previously developed GPU-based MC code on NVidia GPU platform, for a 15MeV electron beam and a 6MV photon beam in a homogenous water phantom, a water-bone-lung-water slab phantom and a half-slab phantom. We also tested code portability of oclMC on different devices, including an NVidia GPU, two AMD GPUs and an Intel CPU. Results: Satisfactory agreements were observed in all photon and electron cases, with ∼0.48%–0.53% average dose differences at regions within 10% isodose line for electron beam cases and ∼0.15%–0.17% for photon beam cases. It took oclMC 3–4 sec to perform transport simulation for electron beam on NVidia Titan GPU and 35–51 sec for photon beam, both with ∼0.5% statistical uncertainty. The computation was 6%–17% slower than gDPM due to the differences in both physics model and development environment, which is considered not significant for clinical applications. In terms of code portability, gDPM only runs on NVidia GPUs, while oclMC successfully runs on all the tested devices. Conclusion: oclMC is an accurate and fast MC dose engine. Its high cross-platform portability makes it clinically attractive.

60 APPLIED LIFE SCIENCES↗

Combining simulations and data with deep learning and uncertainty quantification for advanced energy modeling

A novel and modern framework for energy modeling is developed in this paper with a focus on nuclear energy modeling and simulation. The framework combines multiphysics simulations and real data, with validation by uncertainty quantification tasks and facilitation by machine and deep learning methods. The hybrid framework is built on the basis of a wide range of physical models, real data, mathematical and statistical methods, and artificial intelligence techniques. The framework is demonstrated in different applications, including quantifying uncertainties in computer simulations, multiphysics coupling, analysis of variance using machine learning surrogate models, deep learning of time series phenomena, and propagating parametric uncertainties of nuclear data. The applications demonstrated are oriented to nuclear engineering simulations, even though majority of the methods are applicable to other energy sources (eg, renewable). Efficient utilization of this framework is expected to yield a much better understanding of the physical phenomena analyzed as well as an improvement in the performance of the energy design/model under construction.

42 ENGINEERING↗

Uncertainty Quantification Study of CTF for the OECD/NEA LWR Uncertainty Analysis in Modeling Benchmark

This work describes the results of a quantitative uncertainty analysis of the thermal-hydraulic subchannel code for nuclear engineering applications, Coolant Boiling in Rod Arrays-Three Field (COBRA-TF). CTF is used, which is a version of COBRA-TF developed in cooperation between the Consortium for Advanced Simulation of Light Water Reactors and North Carolina State University. Four steady-state cases from Phase II Exercise 3 of the Organisation for Economic Co-operation and Development/Nuclear Energy Agency Light Water Reactor Uncertainty Analysis in Modeling (UAM) Benchmark are analyzed using the statistical analysis tool, Design Analysis Kit for Optimization and Terascale Applications (Dakota). The input parameters include boundary condition, geometry, and modeling uncertainties, which are selected using a sensitivity study and then defined based on expert judgment. Here, a forward uncertainty quantification method with Latin hypercube sampling (LHS) is used, where the sample size is based on available computational resources.

42 ENGINEERING↗

Exploiting Machine Learning in Multiscale Modelling of Materials

Recent developments in efficient machine learning algorithms have spurred significant interest in the materials community. The inherently complex and multiscale problems in Materials Science and Engineering pose a formidable challenge. The present scenario of machine learning research in Materials Science has a clear lacunae, where efficient algorithms are being developed as a separate endeavour, while such methods are being applied as ‘black-box’ models by others. The present article aims to discuss pertinent issues related to the development and application of machine learning algorithms for various aspects of multiscale materials modelling. The authors present an overview of machine learning of equivariant properties, machine learning-aided statistical mechanics, the incorporation of ab initio approaches in multiscale models of materials processing and application of machine learning in uncertainty quantification. In addition to the above, the applicability of Bayesian approach for multiscale modelling will be discussed. Critical issues related to the multiscale materials modelling are also discussed.

42 ENGINEERING↗

Accounting for erroneous model structures in biokinetic process models

In engineering practice, model-based design requires not only a good process-based model, but also a good description of stochastic disturbances and measurement errors to learn credible parameter values from observations. However, typical methods use Gaussian error models, which often cannot describe the complex temporal patterns of residuals. Consequently, this results in overconfidence in the identified parameters and, in turn, optimistic reactor designs. Here, we assess the strengths and weaknesses of a method to statistically describe these patterns with autocorrelated error models. This method produces increased widths of the credible prediction intervals following the inclusion of the bias term, in turn leading to more conservative design choices. However, we also show that the augmented error model is not a universal tool, as its application cannot guarantee the desired reliability of the resulting wastewater reactor design.

42 ENGINEERING↗

A Statistical Method Analyzing LED Lumen Depreciation and Projecting LED Life

There is a strong need for a method to represent the potential life of LED products as a critical part of design decisions including cost-effectiveness analysis. The IES LM-80 test method is in place to collect lumen depreciation data but it does not provide for estimation of future long term depreciation. Separate estimation methods are being considered (TM-21) and this paper describes the analysis of a series of LED degradation models and subsequent development of an estimation method. The work involves analysis of a set of engineering models to determine their applicability and define a structure for their use in LED lumen output life based on a lumen output level such as the L70 metric. The analysis has provided valuable information on methods effectively estimating LED life time, and impacts of measurement uncertainties, test duration, interval and other test conditions on selecting degradation models and LED life time projection. A set of guidelines are recommended to estimate LED life from data obtained using the current LM-80 test method.

36 MATERIALS SCIENCE↗

AI for Science: Report on the Department of Energy (DOE) Town Halls on Artificial Intelligence (AI) for Science

The report documents the DOE Town Halls held during 2019 at Argonne National Laboratory, Oak Ridge National Laboratory, Lawrence Berkeley National Laboratory, and in Washington, DC. From July to October 2019, the Argonne, Oak Ridge, and Berkeley National Laboratories hosted a series of four town hall meetings attended by more than 1,000 U.S. scientists and engineers. The goal of the town hall series was to examine scientific opportunities in the areas of artificial intelligence (AI), Big Data, and high-performance computing (HPC) in the next decade, and to capture the big ideas, grand challenges, and next steps to realizing these opportunities. In this report and in the Department of Energy (DOE) laboratory community, we use the term “AI for Science” to broadly represent the next generation of methods and scientific opportunities in computing, including the development and application of AI methods (e.g., machine learning, deep learning, statistical methods, data analytics, automated control, and related areas) to build models from data and to use these models alone or in conjunction with simulation and scalable computing to advance scientific research. The AI for Science town hall discussions focused on capturing the transformational uses of AI that employ HPC and/or data analysis, leveraging data sets from HPC simulations or instruments and user facilities, and addressing scientific challenges unique to DOE user facilities and the agency’s wide-ranging fundamental and applied science enterprise.

36 MATERIALS SCIENCE↗

mystic : software for autonomous discovery and design under uncertainty

Throughout the diverse range of science and engineering applications, there is a growing desire to develop computational methods that can reliably predict the behavior of complex systems. Specifically, there is a strategic need for tools that can robustly forecast the behavior of complex physical systems, where data may be high-dimensional, noisy, or sparse, and models of the system may be time-dependent or include uncertainty. We use mystic to build tools that leverage statistical learning, physics-informed learning, and active learning in the efficient generation of reliably predictive surrogates for complex physical systems. mystic is a robust, proven, open-source optimization and uncertainty quantification toolkit with over a decade of use in the design and optimization of neutron instrumentation, solar-powered drones, and gasguns, and in iterative tuning of models for Raman spectroscopy and elastoplastic materials strength. Recent developments have focused on automated learning of statistically robust surrogates under uncertainty, with applications in materials in extreme environments, nanostructures, materials simulations and strength models, and the failure of shielding under particle radiation. In 2020, McKerns demonstrated active learning of optimally robust surrogates with respect to new simulated data for molecular dynamics simulations of materials mixing in warm dense matter, and is currently applying active learning to the automated steering of particle accelerator beams and the optimal design and control of quantum optical sensor instrumentation.

42 ENGINEERING↗

Sensitivity-Uncertainty Based Nuclear Criticality Safety Validation

These are slides from a seminar given to the University of Mexico Nuclear Engineering Department. Whisper is a statistical analysis package developed to support nuclear criticality safety validation. It uses the sensitivity profile data for an application as computed by MCNP6 along with covariance files for the nuclear data to determine a baseline upper-subcritical-limit for the application. Whisper and its associated benchmark files are developed and maintained as part of MCNP6, and will be distributed with all future releases of MCNP6. Although sensitivity-uncertainty methods for NCS validation have been under development for 20 years, continuous-energy Monte Carlo codes such as MCNP could not determine the required adjoint-weighted tallies for sensitivity profiles. The recent introduction of the iterated fission probability method into MCNP led to the rapid development of sensitivity analysis capabilities for MCNP6 and the development of Whisper. Sensitivity-uncertainty based methods represent the future for NCS validation – making full use of today’s computer power to codify past approaches based largely on expert judgment. Validation results are defensible, auditable, and repeatable as needed with different assumptions and process models. The new methods can supplement, support, and extend traditional validation approaches.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Multi-fidelity Uncertainty Quantification for Homogenization Problems in Structure-Property Relationships from Crystal Plasticity Finite Elements

Crystal plasticity finite element method (CPFEM) has been an integrated computational materials engineering (ICME) workhorse to study materials behaviors and structure-property relationships for the last few decades. These relations are mappings from the microstructure space to the materials properties space. Due to the stochastic and random nature of microstructures, there is always some uncertainty associated with materials properties, for example, in homogenized stress-strain curves. For critical applications with strong reliability needs, it is often desirable to quantify the microstructure-induced uncertainty in the context of structure-property relationships. However, this uncertainty quantification (UQ) problem often incurs a large computational cost because many statistically equivalent representative volume elements (SERVEs) are needed. In this article, we apply a multi-level Monte Carlo (MLMC) method to CPFEM to study the uncertainty in stress-strain curves, given an ensemble of SERVEs at multiple mesh resolutions. By using the information at coarse meshes, we show that it is possible to approximate the response at fine meshes with a much reduced computational cost. We focus on problems where the model output is multi-dimensional, which requires us to track multiple quantities of interest (QoIs) at the same time. In conclusion, our numerical results show that MLMC can accelerate UQ tasks around 2.23x, compared to the classical Monte Carlo (MC) method, which is widely known as ensemble average in the CPFEM literature.

36 MATERIALS SCIENCE↗