Search NASA⌕ Search

SEARCH · Search NASA

Results for “Parameter estimation using data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,135 records · Page 63

Nuclear data uncertainty propagation and modeling uncertainty impact evaluation in neutronics core simulation

Uncertainty analysis is a critical requirement in reactor simulation as it is used to quantify the reliability of best-estimate calculation. A comprehensive uncertainty analysis should characterize all sources of uncertainties in a computationally-feasible and scientifically-defendable manner. Here we employ a well-established reduced order modeling (ROM) based uncertainty quantification methodology to propagate uncertainties throughout neutronic calculations. ROM relies on recent advances in randomized data mining techniques applied to large data streams. In our proposed implementation, the nuclear data uncertainties are first propagated from multi-group level through lattice physics calculation to generate few-group parameter uncertainties, described using a vector of mean values and a covariance matrix. Employing an ROM-based compression of the covariance matrix, the few-group uncertainties are then propagated through downstream core simulation in a computationally efficient manner. This straightforward approach, albeit efficient as compared to brute force forward and/or adjoint-based methods, often employs a number of assumptions that have been unquestioned in the literature of neutronic uncertainty analysis. This manuscript argues that these assumptions could introduce another source of uncertainty referred to as modeling uncertainties, whose magnitude needs to be quantified in tandem with nuclear data uncertainties. Thus, our primary goal is to explore the interactions between these two uncertainty sources in order to assess whether modeling uncertainties have an impact on parameter uncertainties. To explore this endeavor, the impact of a number of modeling assumptions on core attributes uncertainties is quantified. The study employs a CANDU reactor model, with Serpent and NEWT as lattice physics solvers and NESTLE-C as core simulator. The modeling assumptions investigated include those related with the uncertainty propagation method employed, e.g., deterministic vs. stochastic, the few-group energy structure employed to represent the cross-sections, the resonance treatment in lattice physics calculation, the reference values for the cross-section, and the number of samples employed to render ROM compression. Results indicate that some of the modeling assumptions could have a non-negligible impact on the core responses propagated uncertainties, highlighting the need for a more comprehensive approach to combine parameter and modeling uncertainties.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Parameter Estimation for Gravitational-wave Bursts with the BayesWave Pipeline

We provide a comprehensive multi-aspect study of the performance of a pipeline used by the LIGO-Virgo Collaboration for estimating parameters of gravitational-wave bursts. We add simulated signals with four different morphologies (sine-Gaussians (SGs), Gaussians, white-noise bursts, and binary black hole signals) to simulated noise samples representing noise of the two Advanced LIGO detectors during their first observing run. We recover them with the BayesWave (BW) pipeline to study its accuracy in sky localization, waveform reconstruction, and estimation of model-independent waveform parameters. BW localizes sources with a level of accuracy comparable for all four morphologies, with the median separation of actual and estimated sky locations ranging from 25.°1 to 30.°3. This is a reasonable accuracy in the two-detector case, and is comparable to accuracies of other localization methods studied previously. As BW reconstructs generic transient signals with SG wavelets, it is unsurprising that BW performs best in reconstructing SG and Gaussian waveforms. The BW accuracy in waveform reconstruction increases steeply with the network signal-to-noise ratio (S/N{sub net}), reaching a 85% and 95% match between the reconstructed and actual waveform below S/N{sub net}≈20 and S/N{sub net}≈50, respectively, for all morphologies. The BW accuracy in estimating central moments of waveforms is only limited by statistical errors in the frequency domain, and is also affected by systematic errors in the time domain as BW cannot reconstruct low-amplitude parts of signals that are overwhelmed by noise. The figures of merit we introduce can be used in future characterizations of parameter estimation pipelines.

79 ASTRONOMY AND ASTROPHYSICS↗

A stochastic model for tumor geometry evolution during radiation therapy in cervical cancer

Purpose: To develop mathematical models to predict the evolution of tumor geometry in cervical cancer undergoing radiation therapy. Methods: The authors develop two mathematical models to estimate tumor geometry change: a Markov model and an isomorphic shrinkage model. The Markov model describes tumor evolution by investigating the change in state (either tumor or nontumor) of voxels on the tumor surface. It assumes that the evolution follows a Markov process. Transition probabilities are obtained using maximum likelihood estimation and depend on the states of neighboring voxels. The isomorphic shrinkage model describes tumor shrinkage or growth in terms of layers of voxels on the tumor surface, instead of modeling individual voxels. The two proposed models were applied to data from 29 cervical cancer patients treated at Princess Margaret Cancer Centre and then compared to a constant volume approach. Model performance was measured using sensitivity and specificity. Results: The Markov model outperformed both the isomorphic shrinkage and constant volume models in terms of the trade-off between sensitivity (target coverage) and specificity (normal tissue sparing). Generally, the Markov model achieved a few percentage points in improvement in either sensitivity or specificity compared to the other models. The isomorphic shrinkage model was comparable to the Markov approach under certain parameter settings. Convex tumor shapes were easier to predict. Conclusions: By modeling tumor geometry change at the voxel level using a probabilistic model, improvements in target coverage and normal tissue sparing are possible. Our Markov model is flexible and has tunable parameters to adjust model performance to meet a range of criteria. Such a model may support the development of an adaptive paradigm for radiation therapy of cervical cancer.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

FY2022 Progress on Imbibition Testing in Containment Science

Estimation of two-phase fluid flow properties is important to understand and predict water and gas movement through the vadose zone for agricultural, hydrogeological, and engineering applications, such as for vapor-phase contaminant transport and/or containment of noble gases in the subsurface. In this second progress report of FY22, we present two ongoing activities related to imbibition testing on volcanic rock samples. We present the development of a new analytical solution predicting the temperature response observed during imbibition into dry samples, as discussed in our previous first progress report for FY22. We also illustrate the use of a multi-modal capillary pressure distribution to simulate both early- and late-time imbibition data collected on tuff core that can exhibit multiple pore types. These FY22 imbibition tests were conducted for an extended period (i.e., far beyond the time required for the wetting front to reach the top of the sample), which is necessary for parameter estimation and characterization of two different pore types within the samples.

42 ENGINEERING↗

Exploring the Sensitivity of Photosynthesis and Stomatal Resistance Parameters in a Land Surface Model

Abstract Land surface models, like the Common Land Model component of the ParFlow integrated hydrologic model (PF-CLM), are used to estimate transpiration from vegetated surfaces. Transpiration rates quantify how much water moves from the subsurface through the plant and into the atmosphere. This rate is controlled by the stomatal resistance term in land surface models. The Ball–Berry stomatal resistance parameterization relies, in part, on the rate of photosynthesis, and together these equations require the specification of 20 input parameters. Here, the active subspace method is applied to 2100 year-long PF-CLM simulations, forced by atmospheric data from California, Colorado, and Oklahoma, to identify which input parameters are important and how they relate to three quantities of interest: transpiration, stomatal resistance from the sunlit portion of the canopy, and stomatal resistance from the shaded portion. The slope (mp) and intercept (bp) parameters associated with the Ball–Berry parameterization are consistently important for all locations, along with five parameters associated with ribulose bisphosphate carboxylase/oxygenase (RuBisCO)- and light-limited rates of photosynthesis [CO2 Michaelis–Menten constant at 25°C (kc25), maximum ratio of oxygenation to carboxylation (ocr), quantum efficiency at 25°C (qe25), maximum rate of carboxylation at 25°C (vcmx25), and multiplier in the denominator of the equation used to compute the light-limited rate of photosynthesis (wj1)]. The importance of these input parameters, quantified by the active variable weight, and the relationship between the input parameters and quantities of interest vary seasonally and diurnally. Input parameter values influence transpiration rates most during midday, summertime hours when fluxes are large. This research informs model users about which photosynthesis and stomatal resistance parameters should be more carefully selected. Quantifying sensitivities associated with the stomatal resistance term is necessary to better understand transpiration estimates from land surface models.

54 ENVIRONMENTAL SCIENCES↗

Quantifying Error in Photovoltaic Installation Metadata: Preprint

In this research, we quantify the level of metadata error for a fleet of 2860 photovoltaic (PV) systems, using metadata values provided by fleet owners. Using satellite imagery and time series analysis techniques available in open-source Python packages Panel-Segmentation and PVAnalytics, respectively, we evaluate the accuracy of PV system metadata such as location, azimuth, tilt, and mounting configuration (fixed tilt vs. tracking). We find that approximately 75% of provided latitude-longitude coordinates are within 190 meters of the actual solar installation. We were unable to link 7.8% of latitude-longitude coordinates to any solar installation via satellite imagery analysis. We evaluate the level of error in owner-provided mounting configuration (fixed tilt vs. single-axis tracking), finding only 8 systems with an incorrect mounting configuration. When evaluating azimuth and tilt parameters, we find that approximately 64% of the data is correct, with data for 860 systems (approximately 30%) not provided by system owners. To illustrate the importance of having correct solar metadata, we evaluate how incorrect metadata affects solar performance estimates by modeling system AC energy output at ground-truth vs. incorrect latitude-longitude coordinates, mounting configurations, and azimuth-tilt configurations. Energy output estimates can vary significantly if incorrect metadata parameters are used, with incorrect mounting configuration leading to the largest discrepancy with over 20% variation in expected energy output.

azimuth↗

SU-E-QI-03: Compartment Modeling of Dynamic Brain PET - The Effect of Scatter and Random Corrections On Parameter Errors

Purpose: To investigate the effects of corrections for random and scattered coincidences on kinetic parameters in brain tumors, by using ten Monte Carlo (MC) simulated dynamic FLT-PET brain scans. Methods: The GATE MC software was used to simulate ten repetitions of a 1 hour dynamic FLT-PET scan of a voxelized head phantom. The phantom comprised six normal head tissues, plus inserted regions for blood and tumor tissue. Different time-activity-curves (TACs) for all eight tissue types were used in the simulation and were generated in Matlab using a 2-tissue model with preset parameter values (K1,k2,k3,k4,Va,Ki). The PET data was reconstructed into 28 frames by both ordered-subset expectation maximization (OSEM) and 3D filtered back-projection (3DFBP). Five image sets were reconstructed, all with normalization and different additional corrections C (A=attenuation, R=random, S=scatter): Trues (AC), trues+randoms (ARC), trues+scatters (ASC), total counts (ARSC) and total counts (AC). Corrections for randoms and scatters were based on real random and scatter sinograms that were back-projected, blurred and then forward projected and scaled to match the real counts. Weighted non-linearleast- squares fitting of TACs from the blood and tumor regions was used to obtain parameter estimates. Results: The bias was not significantly different for trues (AC), trues+randoms (ARC), trues+scatters (ASC) and total counts (ARSC) for either 3DFBP or OSEM (p<0.05). Total counts with only AC stood out however, with an up to 160% larger bias. In general, there was no difference in bias found between 3DFBP and OSEM, except in parameter Va and Ki. Conclusion: According to our results, the methodology of correcting the PET data for randoms and scatters performed well for the dynamic images where frames have much lower counts compared to static images. Generally, no bias was introduced by the corrections and their importance was emphasized since omitting them increased bias extensively.

60 APPLIED LIFE SCIENCES↗

THE MOST METAL-POOR STARS. I. DISCOVERY, DATA, AND ATMOSPHERIC PARAMETERS

We report the discovery of 34 stars in the Hamburg/ESO Survey for metal-poor stars and the Sloan Digital Sky Survey that have [Fe/H] {approx}< -3.0. Their median and minimum abundances are [Fe/H] = -3.1 and -4.1, respectively, while 10 stars have [Fe/H] < -3.5. High-resolution, high signal-to-noise spectroscopic data-equivalent widths and radial velocities-are presented for these stars, together with an additional four objects previously reported or currently being investigated elsewhere. We have determined the atmospheric parameters, effective temperature (T {sub eff}), and surface gravity (log g), which are critical in the determination of the chemical abundances and the evolutionary status of these stars. Three techniques were used to derive these parameters. Spectrophotometric fits to model atmosphere fluxes were used to derive T {sub eff}, log g, and an estimate of E(B - V); H{alpha}, H{beta}, and H{gamma} profile fitting to model atmosphere results provided the second determination of T {sub eff} and log g; and finally, we used an empirical T {sub eff}-calibrated H{delta} index, for the third, independent T {sub eff} determination. The three values of T {sub eff} are in good agreement, although the profile fitting may yield systematically cooler T {sub eff} values, by {approx}100 K. This collective data set will be analyzed in future papers in the present series to utilize the most metal-poor stars as probes of conditions in the early universe.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Energy Survey Year 3 results: calibration of lens sample redshift distributions using clustering redshifts with BOSS/eBOSS

ABSTRACT We present clustering redshift measurements for Dark Energy Survey (DES) lens sample galaxies used in weak gravitational lensing and galaxy clustering studies. To perform these measurements, we cross-correlate with spectroscopic galaxies from the Baryon Acoustic Oscillation Survey (BOSS) and its extension, eBOSS. We validate our methodology in simulations, including a new technique to calibrate systematic errors that result from the galaxy clustering bias, and we find that our method is generally unbiased in calibrating the mean redshift. We apply our method to the data, and estimate the redshift distribution for 11 different photometrically selected bins. We find general agreement between clustering redshift and photometric redshift estimates, with differences on the inferred mean redshift found to be below |Δz| = 0.01 in most of the bins. We also test a method to calibrate a width parameter for redshift distributions, which we found necessary to use for some of our samples. Our typical uncertainties on the mean redshift ranged from 0.003 to 0.008, while our uncertainties on the width ranged from 4 to 9 per cent. We discuss how these results calibrate the photometric redshift distributions used in companion papers for DES Year 3 results.

79 ASTRONOMY AND ASTROPHYSICS↗

Petroleum Refinery Jobs and Economic Development Impact (JEDI) Model User Reference Guide

The Jobs and Economic Development Impact (JEDI) models, developed through the National Renewable Energy Laboratory (NREL), are user-friendly tools utilized to estimate the economic impacts at the local level of constructing and operating fuel and power generation projects for a range of conventional and renewable energy technologies. The JEDI Petroleum Refinery Model User Reference Guide was developed to assist users in employing and understanding the model. This guide provides information on the model's underlying methodology, as well as the parameters and references used to develop the cost data utilized in the model. This guide also provides basic instruction on model add-in features, operation of the model, and a discussion of how the results should be interpreted. Based on project-specific inputs from the user, the model estimates job creation, earning and output (total economic activity) for a given petroleum refinery. This includes the direct, indirect and induced economic impacts to the local economy associated with the refinery's construction and operation phases. Project cost and job data used in the model are derived from the most current cost estimations available. Local direct and indirect economic impacts are estimated using economic multipliers derived from IMPLAN software. By determining the regional economic impacts and job creation for a proposed refinery, the JEDI Petroleum Refinery model can be used to field questions about the added value refineries may bring to the local community.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

An Efficient Bayesian Method for Advancing the Application of Deep Learning in Earth Science

Despite their wide and successful applications, deep learning (DL) models are prone to overfitting for small training datasets, produce a poor predictive performance for uncertain data, and provide point estimations without any indication of the accuracy and credibility. These limitations of the deterministic DL models hinder their effective application in Earth system science where the labelled data are sparse, noisy and incomplete with large uncertainty and where the predictive uncertainty quantification is needed for scientific understanding and policy decision making. Integration of Bayesian inference into DL models adds an estimate of uncertainty and regularization in the predictions. However, traditional Bayesian methods are computationally unaffordable and inflexible for high-dimensional problems, which limits their application to DL systems that typically have millions of model parameters. In this effort, we propose an efficient and general-purpose Bayesian inference method to advance DL model optimization and uncertainty quantification, so as to facilitate the adoption of DL in Earth sciences. In a demonstration, we integrate the proposed Bayesian method with a feedforward neural network (NN) to build a fast-to-evaluate surrogate of the complex Energy Exascale Earth System Land Model for efficient modeling. The formulated Bayesian NN, using a small number of training data, produces an accurate prediction with high credibility, whereas with the same small training size, the deterministic NN cannot yield a reasonable estimation and does not provide confidence information. The proposed Bayesian method is computationally efficient and flexible, capable of integration with diverse network variants such as convolutional NNs and recurrent NNs to advance the application of DL in Earth sciences.

Lu, Dan↗

Simplified Model and Approach to Transform Infrared Surface Temperature to Film Effectiveness in a Conjugate Heat Transfer Experiment

In the pursuit of more efficient gas turbines, film cooling is a critical technology. This article describes a simplified engineering model based on a one-dimensional thermal resistance network. The model is used to relate film-cooling effectiveness and heat transfer augmentation to local overall cooling effectiveness in a conjugate flat plate experiment. Here, this article presents experimental proof-of-concept data to demonstrate the potential for this model. In contrast to previous approaches, neither the wall heat flux nor the adiabatic wall temperature is required to estimate the local film-cooling performance parameters. The model predicts surface temperatures that are within the experimental uncertainties over the range for which the model is trained and to within five percent when the model is extrapolated to higher coolant channel Reynolds numbers. This article is relevant to conjugate test rigs that can measure the hot-surface temperature distribution with and without film cooling. This information may also be relevant to designers as a method to approximate surface temperatures or used as an approximate heat transfer model for optimization studies.

advanced turbines↗

Simplified Model and Approach to Transform Infrared Surface Temperature to Film Effectiveness in a Conjugate Heat Transfer Experiment

This paper describes a simplified engineering model based on a one-dimensional thermal resistance network. The model is used to develop a new method to relate film cooling effectiveness and heat transfer augmentation to local overall cooling effectiveness in a conjugate flat plate experiment. This paper presents experimental proof-of-concept data to demonstrate the potential for this model. In contrast to previous approaches, neither the wall heat flux nor the adiabatic wall temperature is required to estimate the local film cooling performance parameters. The model predicts surface temperatures that are within the experimental uncertainties over the range for which the model is trained, and to within five percent when the model is extrapolated to higher coolant channel Reynolds numbers. This paper is relevant to conjugate test rigs that can measure the hot surface temperature distribution with and without film cooling. This information may also be relevant to designers as a method to approximate surface temperatures or used as an approximate heat transfer model for optimization studies.

advanced gas turbines↗

A Poisson method application to the assessment of the earthquake hazard in the North Anatolian Fault Zone, Turkey

North Anatolian Fault (NAF) is one from the most important strike-slip fault zones in the world and located among regions in the highest seismic activity. The NAFZ observed very large earthquakes from the past to present. The aim of this study; the important parameters of Gutenberg-Richter relationship (a and b values) estimated and this parameters taking into account, earthquakes were examined in the between years 1900-2015 for 10 different seismic source regions in the NAFZ. After that estimated occurrence probabilities and return periods of occurring earthquakes in fault zone in the next years, and is being assessed with Poisson method the earthquake hazard of the NAFZ. The Region 2 were observed the largest earthquakes for the only historical period and hasn’t been observed large earthquake for the instrumental period in this region. Two historical earthquakes (1766, M{sub S}=7.3 and 1897, M{sub S}=7.0) are included for Region 2 (Marmara Region) where a large earthquake is expected in the next years. The 10 different seismic source regions are determined the relationships between the cumulative number-magnitude which estimated a and b parameters with the equation of LogN=a-bM in the Gutenberg-Richter. A homogenous earthquake catalog for M{sub S} magnitude which is equal or larger than 4.0 is used for the time period between 1900 and 2015. The database of catalog used in the study has been created from International Seismological Center (ISC) and Boğazici University Kandilli observation and earthquake research institute (KOERI). The earthquake data were obtained until from 1900 to 1974 from KOERI and ISC until from 1974 to 2015 from KOERI. The probabilities of the earthquake occurring are estimated for the next 10, 20, 30, 40, 50, 60, 70, 80, 90 and 100 years in the 10 different seismic source regions. The highest earthquake occur probabilities in 10 different seismic source regions in the next years estimated that the region Tokat-Erzincan (Region 9) %99 with an earthquake occur probability for magnitude 6.5 which the return period 24.7 year, %92 with an earthquake occur probability for magnitude 7 which the return period 39.1 year, %80 with an earthquake occur probability for magnitude 7.5 which the return period 62.1 year, %64 with an earthquake occur probability for magnitude 8 which the return period 98.5 year. For the Marmara Region (Region 2) in the next 100 year estimated that %89 with an earthquake occur probability for magnitude 6 which the return period 44.9 year, %45 with an earthquake occur probability for magnitude 6.5 which the return period 87 year, %45 with an earthquake occur probability for magnitude 7 which the return period 168.6 year.

58 GEOSCIENCES↗

Predicting Nanoparticle Suspension Viscoelasticity for Multimaterial 3D Printing of Silica–Titania Glass

A lack of predictive methodology is frequently a major bottleneck in materials development for additive manufacturing. Hence, exploration of new printable materials often relies on the serendipity of trial and error approaches, which is time-consuming, labor-intensive, and costly. In this paper, we present an approach to overcome these issues by quantifying and controlling the viscoelasticity of inks for multimaterial 3D printing of silica–titania glass using direct ink writing (DIW). We formulate simple silica and silica–titania inks from a suspension of fumed silica nanoparticles in an organic solvent with a dissolved molecular titania precursor. We use a small set of experimental rheological data and estimates of interaction potentials from colloidal theory to develop a predictive tool that allows us to design and obtain compatible inks that are matched both in desired rheological properties (viscosity profiles and elastic modulus) as well as solids loading. The model incorporates silica particle volume fraction, particle size, particle size distribution, and titania precursor concentration, and captures the effects of all formulation parameters on the measured viscoelasticity in a single curve. We validate the ink formulations predicted by the model and find that the materials can be very well matched in rheological properties as desired for 3D printing. Using the DIW and heat treatment methods we have reported previously, we use these inks to print and process a fully transparent glass with spatial change in dopant composition and refractive index. Finally, we believe that this approach can be extended to other colloidal systems and allow predictive ink formulation design for desired printability in direct ink write manufacturing.

36 MATERIALS SCIENCE↗

Neural network-based single material beam-hardening correction for X-ray CT in Additive Manufacturing

Beam-hardening (BH) artifacts are ubiquitous in X-ray CT scans of dense metal additively manufactured (AM) parts. While linearization approaches are useful for correcting beam-hardened data from single material objects, they either require a calibration scan or detailed system and material composition information. In this paper, we introduce a neural network-based, material-agnostic method to correct beam-hardening artifacts. We train a neural network to map the acquired beam-hardened projection values and the corresponding estimated thickness of the part based on an initial segmentation to beam-hardening related parameters, which can be used to compute the coefficients of a linearizing correction polynomial. A key strength of our approach is that, once the network is trained, it can be used for correcting beam hardening from a variety of materials without any calibration scans or detailed system and material composition information. Furthermore, our method is robust to errors in the estimated thickness due to the typical challenge of obtaining an accurate initial segmentation from reconstructions impacted by BH artifacts. We demonstrate the utility of our method to obtain high-quality CT reconstructions from a collection of AM parts -- suppressing cupping and streaking artifacts

Rahman, Obaid↗

Artificial neural networks estimate evapotranspiration for Miscanthus × giganteus as effectively as empirical model but with fewer inputs

Estimating actual evapotranspiration (ET) is particularly crucial for addressing how vegetation affects the water balance of ecosystems. ET estimation can be complex with empirical models due to their many parameters and reliance on aridity. In contrast, artificial neural networks (ANNs) could potentially estimate ET with fewer and more common meteorological parameters. In this study, we trained two ANNs, one using a feed-forward approach (FFN) and the other a nonlinear auto-regressive network (NARX), to predict ET and compared them to the commonly used empirical model Granger and Gray (GG). We trained our models on a nine-year eddy covariance (EC) dataset for Miscanthu s × giganteus ( M . × giganteus ) from Illinois (UIEF), then tested them using out-of-sample data from both UIEF and a different location in Iowa (SABR) to compare the accuracy of FFN, NARX, and GG models in estimating daily ET. A combination of air temperature (T a ) and solar radiation (R s ) was chosen as inputs due to the highest R 2 for FFN (R 2 = 0.79, 0.81, and 0.79 for training, testing, and validation, respectively) and only T a for NARX (R 2 = 0.70 for out-of-sample validation). The predictive power of the FFN model was superior to the NARX and GG models at the UIEF site (R 2 = 0.84, 0.70, and 0.83 for out-of-sample validation, respectively). Our analysis showed that ANN approaches are as accurate as empirical approaches for estimating ET but use fewer inputs.

54 ENVIRONMENTAL SCIENCES↗

Quantum-Inspired Bayesian Sampling for Uncertainty Quantification and Machine Learning (Final Technical Report)

With increasing simulation and measurement data, machine learning and artificial intelligence have been widely used in computational decision-making of complex engineering systems. The resulting tools, such as uncertainty quantification solvers, reinforcement learning, and physics-informed machine learning, have achieved great success in critical DOE tasks such as material discovery and design, energy system modeling and control, and numerical weather and climate prediction. A core topic in scientific machine learning and artificial intelligence is Bayesian inference: given an observed data set, people want to estimate the posterior distribution of a (possibly large) number of hidden parameters. Due to the flexibility and weak assumptions, Bayesian sampling has been the mainstream Bayesian inference solvers despite the rapid progress of approximate Bayesian inference. Classical Bayesian sampling methods such as Markov-chain Monte Carlo suffer from a low-acceptance rate due to the random walk nature, therefore state-of-the-art techniques use Hamiltonian Monte Carlo and its variants to efficiently draw posterior samples in a high dimension. The key idea of Hamiltonian Monte Carlo and its variants is to simulate the Hamiltonian dynamics of a classical particle with a fixed mass, and their performance significantly degrades when the posterior distribution is highly spiky or has multiple modes. Leveraging the idea of quantum physics, this project has investigated new theory, algorithms and applications of Bayesian inference (especially Bayesian sampling). The main results include: (1) novel quantum-inspired Bayesian sampling methods that can lead to better accuracy for challenging multi-modal or spiky distributions, (2) more scalable machine learning framework leveraging tensor-compressed Bayesian inference, and (3) Bayesian and sampling approaches for verifying the robustness of continuous and binary neural networks.

97 MATHEMATICS AND COMPUTING↗