Search NASASearch

SEARCH · Search NASA

Results for “Bayesian inverse problems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

32 records · Page 2

Karhunen–Loève deep learning method for surrogate modeling and approximate Bayesian parameter estimation

We evaluate the performance of the Karhunen-Loève Deep Neural Network (KL-DNN) framework for surrogate modeling and approximate Bayesian parameter estimation in partial differential equation models. In the surrogate model, the Karhunen-Loève (KL) expansions are used for the dimensionality reduction of the number of unknown parameters and variables, and a deep neural network is employed to relate the reduced space of parameters to that of the state variables. The KL-DNN surrogate model is used to formulate a maximum-a-posteriori-like least-squares problem, which is randomized to draw samples of the posterior distribution of the parameters. We test the proposed framework for a hypothetical unconfined aquifer via comparison with the forward MODFLOW and inverse PEST++ iterative ensemble smoother (IES) solutions as well as the state-of-the-art Fourier neural operator (FNO) and deep operator networks (DeepONets) operator learning surrogate models. Our results show that the KL-DNN surrogate model outperforms FNO and DeepONet for forward predictions. For solving inverse problems, the randomized algorithm provides the same or more accurate Bayesian predictions of the parameters than IES as evidenced by the higher log-predictive probability of both the estimated parameter field and the forecast hydraulic head. The posterior mean obtained from the randomized algorithm is closer to the reference parameter field than that obtained with FNO as the maximum a posteriori estimate.

Approximate Bayesian inference

Leveraging differentiable programming in the inverse problem of neutron stars

Neutron stars (NSs) probe the high-density regime of the nuclear equation of state (EOS). However, inferring the EOS from observations of NSs is a computationally challenging task. Here, in this work, we efficiently solve this inverse problem by leveraging differential programming in two ways. First, we enable full Bayesian inference in under one hour of wall time on a GPU by using gradient-based samplers, without requiring pretrained machine learning emulators. Moreover, we demonstrate efficient scaling to high-dimensional parameter spaces. Second, we introduce a novel gradient-based optimization scheme that recovers the EOS of a given NS mass-radius curve. We demonstrate how our framework can reveal consistencies or tensions between nuclear physics and astrophysics. First, we show how the breakdown density of a metamodel description of the EOS can be determined from NS observations. Second, we demonstrate how degeneracies in EOS modeling using nuclear empirical parameters can influence the inverse problem during gradient-based optimization. Looking ahead, our approach opens up new theoretical studies of the relation between NS properties and the EOS, while effectively tackling the data analysis challenges brought by future detectors.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS

Desmearing Bonse–Hart USANS data using Bayesian Gaussian process regression

Ultra-small-angle neutron scattering (USANS) enables access to micrometer-scale structures but is intrinsically affected by strong, anisotropic resolution smearing arising from slit-geometry optics. As a result, recovery of the intrinsic scattering intensity constitutes an ill-posed inverse problem, and commonly used iterative desmearing methods lack rigorous uncertainty quantification. We present a Bayesian desmearing framework for slit-geometry USANS based on Gaussian process regression. In this approach, the scattering intensity is modeled as a smooth random function, and the instrumental point spread function is incorporated explicitly as a forward operator. The resulting formulation yields a closed-form maximum a posteriori solution with well-defined credibility intervals. Computational benchmarks and experimental validation using combined USANS and small-angle neutron scattering (SANS) measurements demonstrate that the framework enables stable desmearing, suppresses experimental noise, and preserves physically meaningful structural features under realistic conditions.

Tung, Chi-Huan [Oak Ridge National Laboratory (ORN

Adaptive Interface-PINNs (AdaI-PINNs) for inverse problems: Determining material properties for heterogeneous systems

Here, we determine spatially varying discontinuous material properties using a domain-decomposition based physics-informed neural networks (PINNs) framework named the Adaptive Interface-PINNs or AdaI-PINNs (Roy et al., 2024). We propose the use of distinct neural networks for the field variables and material properties within each material, utilizing adaptive activation functions. While the neural networks across different materials share the same weights and biases, their activation functions are uniquely tailored using a hyperparameter that influences the slope of the activation function. The proposed framework is tested on several one-dimensional and two-dimensional benchmark examples, and its performance is compared with conventional PINNs and existing domain-decomposition PINNs frameworks, namely, the Multi-domain physics-informed neural network (M-PINN), and the eXtended physics-informed neural networks (XPINNs). The results demonstrate that the proposed approach can determine randomly distributed discontinuous material properties with an L 2 error of $\mathscr{O}$ (10 -3 ) for the material property and the root-mean-square error of $\mathscr{O}$ (10 -3 ) for the primary variable while the other approaches yield errors that are approximately two orders of magnitude larger (that is, $\mathscr{O}$ (10 -1 )). Moreover, the spatial distribution of material properties obtained using the proposed framework is in close agreement with the true distribution, whereas the other approaches fare much worse. Additionally, the proposed approach is approximately 40% faster than its competitors, indicating its potential as a robust alternative for solving inverse problems in heterogeneous materials.

36 MATERIALS SCIENCE

Efficient Optimization of Plasma Radiation Detector Configurations using Imperfect Inference Models

The configurations of instruments fielded on an experiment affect the amount of information captured and the quality of subsequent inference. Here, we investigate the problem of optimizing plasma x-ray radiation detectors in a magneto-inertial fusion experiment at Sandia National Laboratories. It is impossible to directly measure properties such as the temperature of the thermonuclear fusion plasma produced in these experiments because of the extreme environment and destructive nature of the experiment. Among other diagnostics, several detectors are placed with significant standoff from the fusion target to capture the x-rays emitted by the fusion plasma, which can be used to infer some of its properties. To optimize the configuration of these detectors, a high-fidelity model (HFM) is used for simulating outputs and a low-fidelity model (LFM) is used for inference. We develop methods based on A- and L-optimality criteria that are efficient to compute while explicitly accounting for the discrepancy between the HFM and the LFM. The method allows us to find detector configurations that perform similarly to or better than the configuration obtained using an existing sampling-based optimization method while decreasing computational time by a factor of 50. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Bayesian optimization

Multi-Modal Bayesian Neural Network Surrogates with Conjugate Last-Layer Estimation

As data collection and simulation capabilities advance, multi-modal learning, the task of learning from multiple modalities and sources of data, is becoming an increasingly important area of research. Surrogate models that learn from data of multiple auxiliary modalities to support the modeling of a highly expensive quantity of interest have the potential to aid outer loop applications such as optimization, inverse problems, or sensitivity analyses when multi-modal data are available. We develop two multi-modal Bayesian neural network surrogate models and leverage conditionally conjugate distributions in the last layer to estimate model parameters using stochastic variational inference (SVI). We provide a method to perform this conjugate SVI estimation in the presence of partially missing observations. Here, we demonstrate improved prediction accuracy and uncertainty quantification compared to unimodal surrogate models for both scalar and time series data.

97 MATHEMATICS AND COMPUTING

Optimal Power Management for Large-Scale Battery Energy Storage Systems via Bayesian Inference

Large-scale battery energy storage systems (BESS) have found ever-increasing use across industry and society to accelerate clean energy transition and improve energy supply reliability and resilience. However, their optimal power management poses significant challenges: the underlying high-dimensional nonlinear nonconvex optimization lacks computational tractability in real-world implementation, and the uncertainty of the exogenous power demand makes exact optimization difficult. This paper presents a new solution framework to address these bottlenecks. The solution pivots on introducing power-sharing ratios to specify each cell’s power quota from the output power demand. To find the optimal power-sharing ratios, we formulate a nonlinear model predictive control (NMPC) problem to achieve power-loss-minimizing BESS operation while complying with safety, cell balancing, and power supply-demand constraints. We then propose a parameterized control policy for the power-sharing ratios, which utilizes only three parameters, to reduce the computational demand in solving the NMPC problem. This policy parameterization allows us to translate the NMPC problem into a Bayesian inference problem for the sake of 1) computational tractability, and 2) overcoming the nonconvexity of the optimization problem. We leverage the ensemble Kalman inversion technique to solve the parameter estimation problem. Concurrently, a low-level control loop is developed to seamlessly integrate our proposed approach with the BESS to ensure practical implementation. This low-level controller receives the optimal power-sharing ratios, generates output power references for the cells, and maintains a balance between power supply and demand despite uncertainty in output power. We conduct extensive simulations and experiments on a 20-cell prototype to validate the proposed approach.

Battery energy storage systems (BESSs)

E-PINNs: Epistemic Physics-Informed Neural Networks

Physics-informed neural networks (PINNs) have demonstrated promise as a framework for solving forward and inverse problems involving partial differential equations. Despite recent progress in the field, it remains challenging to quantify uncertainty in these networks. While techniques such as Bayesian PINNs (B-PINNs) provide a principled approach to capturing epistemic uncertainty through Bayesian inference, they can be computationally expensive for large-scale applications. In this work, we propose Epistemic Physics-Informed Neural Networks (E-PINNs), a framework that uses a small network, the epinet, to efficiently quantify epistemic uncertainty in PINNs. The proposed approach works as an add-on to existing, pre-trained PINNs with a small computational overhead. We demonstrate the applicability of the proposed framework in various test cases and compare the results with B-PINNs using Hamiltonian Monte Carlo (HMC) posterior estimation and dropout-equipped PINNs (Dropout-PINNs). In our experiments, E-PINNs achieve calibrated coverage with competitive sharpness at substantially lower cost. We demonstrate that when B-PINNs produce narrower bands, they under-cover in our tests. E-PINNs also show better calibration than Dropout-PINNs in these examples, indicating a favorable accuracy-efficiency trade-off.

AI for Science

Joint state-parameter estimation for the reduced fracture model via the united filter

Here, in this paper, we introduce an effective United Filter method for jointly estimating the solution state and physical parameters in flow and transport problems within fractured porous media. Fluid flow and transport in fractured porous media are critical in subsurface hydrology, geophysics, and reservoir geomechanics. Reduced fracture models, which represent fractures as lower-dimensional interfaces, enable efficient multi-scale simulations. However, reduced fracture models also face accuracy challenges due to modeling errors and uncertainties in physical parameters such as permeability and fracture geometry. To address these challenges, we propose a United Filter method, which integrates the Ensemble Score Filter (EnSF) for state estimation with the Direct Filter for parameter estimation. EnSF, based on a score-based diffusion model framework, produces ensemble representations of the state distribution without deep learning. Meanwhile, the Direct Filter, a recursive Bayesian inference method, estimates parameters directly from state observations. The United Filter combines these methods iteratively: EnSF estimates are used to refine parameter values, which are then fed back to improve state estimation. Numerical experiments demonstrate that the United Filter method surpasses the state-of-the-art Augmented Ensemble Kalman Filter, delivering more accurate state and parameter estimation for reduced fracture models. This framework also provides a robust and efficient solution for PDE-constrained inverse problems with uncertainties and sparse observations.

Bayesian inference

Diagnostics: Chapter 8 of the special issue: on the path to tokamak burning plasma operation

This chapter presents the activity conducted by the ITPA topical group (TG) on Diagnostics over about the last 15 years. Following a general introduction of the ITER Diagnostics led by their measurement roles, the document is organized in several subchapters detailing the design support, research and development activity conducted by each of the specialist working groups (WGs) of the TG. Please note that the magnetic diagnostics were supported at the TG without a specific WG. Their status is included in the general introduction. In the following some highlights of the subchapter’s contents are provided. Recent advances in ITER first wall (FW) diagnostics for the measurements of plasma-metallic wall interaction in support of the ITER research plan are reported. An InfraRed imaging Video Bolometer for ITER has been developed and tested on several tokamaks to measure the radiated power loss. A laser-induced breakdown spectroscopy (LIBS) technique which utilizes a pulsed laser beam to ablate locally by forming a crater, will measure local tritium inventory in the FW material. Real-time Residual Gas Analyzers will measure the neutral gas composition in a divertor port and an equatorial port during plasma operation. Due to the full metallic FW environment, the plasma-wall interaction in ITER will face several challenges such as the compromised radiated power and divertor heat flux measurements by reflection. Ray tracing and analysis codes have been developed to eliminate and correct the effects of reflection in the measurements. The characteristics of the reflecting surfaces depending on the roughness and angle of the incidence have been measured by dedicated experiments, and the results were applied to the reflection elimination. For the measurement of the metallic impurity radiation induced by eroded metallic atoms, a vacuum ultraviolet spectrometer has been developed and tested. An extensive thermonuclear diagnostic suite will be required to support the operation of ITER and the planned experimental program for future burning plasma experiments. Due to the harsh environmental conditions, the implementation of diagnostic systems in ITER is a major challenge. These conditions include high levels of neutron and gamma fluxes, neutron heating, particle bombardment. Therefore, the selection and design of diagnostic systems must take into account a number of phenomena previously unseen in diagnostic design. For this reason, the measurement of neutrons and confined or lost fast ions, with particular emphasis on alpha particles, is critical to ITER. The diagnostics associated with these measurements will be important for future plasma-burning experiments at ITER. The high neutron emission and very large plasma size in ITER make neutron diagnostics the main diagnostic method used to measure plasma parameters such as fusion power, fusion power density, ion temperature, energy of fast ions and their spatial distributions in the plasma core. Active spectroscopy techniques are methods where a neutral particle beam is injected into the plasma and information on plasma parameters is extracted from the measurement of line emission resulting from the beam-plasma interaction, either by plasma ions or by beam atoms. Spatial localization is achieved by crossing the beamline and multiple observation lines. The ITER plasma will be a high temperature, moderately dense, fully ionized collisional plasma. The plasma facing surfaces are principally metallic being fashioned from beryllium or tungsten but many other elements, arising from either structural or from operational needs, may enter this plasma. The energy range of the emitted photons range from meV (infra-red) to multi keV (x-rays) and originate from all areas of the plasma volume. The primary role of passive emission diagnostics is to identify what is in the plasma from spectral signatures. Extracting quantitative information from these measurements such as impurity content, ion temperature, rotation, degree of detachment and radiated power depends on calibrated instruments, a physics model of the atomic and molecular processes and plasma transport and an analysis workflow that takes into account environmental effects such as reflections. The particular needs for ITER have prompted a multi-machine, many-year effort to address all these aspects and this chapter reviews the work on diagnostic design, experiments and new analysis techniques. An overview of the laser diagnostics to be implemented on ITER is also provided in this paper. This includes descriptions of the Thomson scattering in the core, edge and divertor regions, polarimetry and interferometry diagnostics used for measuring plasma density and also measurements of helium density in the divertor using Laser Induced Flourescence. Techniques which can allow improvements on current measurements are also addressed in particular expanding poloidal polarimetry measurements to measure field fluctuations and proposed use of dispersion interferometery which has a number of advantages over existing methods. This paper identifies particular areas where further research and testing on existing tokamaks is useful even at this advanced stage to inform the design of diagnostics for ITER. Outstanding areas of concern for the implementation of laser diagnostics, in particular with a view to reliable operation are identified. An overview of the latest developments of microwave diagnostic systems and techniques is given. The primary focus is the contributions for ITER—the next step burning plasma experiment—which is supplemented by describing recent progress of techniques applicable for fusion experiments beyond ITER. The contributions are intentionally kept concise, and are being supplemented by a rich list of references for further studies. Radiation induced effects are receiving continuous and well-deserved attention of the ITER diagnostic community and they are in many cases one of the primary design drivers of the ITER diagnostic systems. The paper summarizes recent progress in this area focusing primarily on the ITER diagnostics but in some cases provides also outlook for the possible solutions for even more demanding radiation environment of fusion reactors beyond ITER. Despite advancements in the area of modeling and simulation of various radiation induced effects, experimental testing in a nuclear environment as close as possible to the target one is still seen as unavoidable for proper qualification of particular diagnostic functional elements. Recent advancement within three diagnostic areas: optical diagnostics, magnetics and bolometers is covered. Encouraging results on qualification of silica glass vacuum window assemblies are presented. In the area of magnetic sensors, progress of irradiation tests performed on ITER in-vessel LTCC inductive sensors is presented with outlook for novel technological approaches to inductive sensors utilizing thick printing and photolithography technologies being highlighted. Summary of advancements in the area of steady state magnetic field sensors based on Hall effect is given. New results of neutron irradiation test of the ITER borosilicate glass inserts for vacuum electrical feedthroughs are summarized finding negligible swelling at target level of neutron fluence. Off-line irradiation tests of fiber optic current sensors for plasma current measurement demonstrated that both for gamma doses up to 5 MGy and a total neutron fluence up to 10 15 cm −2 , radiation induced changes are still compatible with required measurement accuracy on ITER. The ITER bolometers are given as an example how considering radiation effects may influence the diagnostic design. Finally, outlook for future main R&D directions is outlined. All optical and laser-based diagnostics in ITER will be using mirrors to guide plasma radiation toward detectors, cameras and sensors. In the hostile plasma, radiation and particle environment the optical characteristics of diagnostic mirrors will degrade directly affecting the entire performance of involved diagnostic systems. An assessment of factors affecting mirror performance is provided. Among the prime adverse factors are deposition of plasma impurities, sputtering of mirror surface and steam ingress in the vicinity of mirrors. Within the International Tokamak Physics Activity with active support by ITER central team and domestic agencies, the structured research and development (R&D) program on mitigation of risks for diagnostic mirrors is underway. Within this program the mirror material development, the passive mitigation of mirror degradation by using diagnostic ducts and shutters along with an active mirror recovery program comprising the in-situ mirror cleaning and calibration is underway. Recent developments in diagnostic mirror R&D are described in this Chapter along with an example of their implementation of R&D solutions in ITER Infrared Thermography diagnostic. An assessment of still open engineering and physics questions, considerations on mirror risks during an early phase of ITER operation are given along with an overview of diagnostic mirror evolution in the late ITER operation stage toward the demonstration fusion power plant. Several crucial areas of diagnostic R&D outlined in ITER Research Plan are addressed. The basic control groups in a fusion reactor can be broken-down in five categories: (1) plasma position, magnetic configuration, and plasma current control, (2) profile control and confinement optimization, (3) MHD control and suppression, (4) edge dissipation control, radiation and plasma exhaust control and (5) break-down optimization. These categories are coupled via the physics (a control action in one domain will affect the other domains) and via shared actuators (e.g. ECRH for impurity accumulation avoidance, current density distribution control and MHD suppression). Consequently, a supervisory control system should determine the priority of the various control tasks, their couplings, and the interfaces with the safety and interlock system. For the systematic development of the various controllers taking the complexity of the plasma and the control system into account, a model-based approach is required. A short historical overview is given of the developments in systems and control theory and control engineering with special emphasis on those developments that are most relevant for Nuclear Fusion research and operation. An overview is given of the state of the field of fusion plasma control for the control categories. It will be shown how synthetic diagnostics are being developed in ITER and how they are used in diagnostic design and design validation and how they can be in model-based controller synthesis using relatively simple models. In modern control methods, multiple diagnostics are used to constrain relatively simple models. The constrained models provide an estimate for the state. This opens the route to state controllers, such as model predictive control. A major challenge in nuclear fusion research is the coherent combination of data from heterogeneous diagnostics and modeling codes for machine control and safety as well as physics studies. Measured data from different diagnostics often provide information about the same subset of physical parameters. Additionally, information provided by some diagnostics might be needed for the analysis of other diagnostics. A joint analysis of complementary and redundant data allows, e.g. to improve the reliability of parameter estimation, to increase the spatial and temporal resolution of profiles, to obtain synergistic effects, to consider diagnostics interdependencies and to find and resolve data inconsistencies. Physics-based modeling and parameter relationships provide additional information improving the treatment of ill-posed inversion problems. A coherent combination of all kind of available information within a probabilistic framework allows for improved data analysis results. The concept of integrated data analysis (IDA) in the framework of Bayesian probability theory is outlined and contrasted with conventional data analysis. Components of the probabilistic approach are summarized and specific ingredients beneficial for data analysis at fusion devices are discussed.

ITER

Scalable Algorithms for Inverse Problems With High-Dimensional Parameter Spaces

Inverse problems, which involve inferring unknown parameters from observed data, present significant computational challenges, especially in large-scale settings with high-dimensional unknown parameters and nonlinear relationships between the unknowns and observations. Bayesian inference provides an approach for addressing these problems, often relying on sequential sampling methods like Markov chain Monte Carlo (MCMC) to approximate the posterior distribution of the parameters. However, MCMC methods become computationally demanding as the dimensionality of the problem increases, particularly in large-scale systems where likelihood evaluations rely on solving partial differential equations (PDEs) on large spatial domains with finely resolved meshes. To overcome these limitations, recent advancements have focused on designing scalable computa tional techniques – for both PDE simulations and sampling strategies – to make Bayesian methods feasible for high-dimensional problems.

97 MATHEMATICS AND COMPUTING

Gaussian processes for inferring parton distributions

The extraction of parton distribution functions (PDFs) from experimental or lattice QCD data is an ill-posed inverse problem, where regularization strongly impacts both systematic uncertainties and the reliability of the results. We study a framework based on Gaussian Process Regression (GPR) to reconstruct PDFs from lattice QCD matrix elements. Within a Bayesian framework, Gaussian processes serve as flexible priors that encode uncertainties, correlations, and constraints without imposing rigid functional forms. We investigate a wide range of kernel choices, mean functions, and hyperparameter treatments. We quantify information gained from the data using the Kullback-Leibler divergence. Synthetic data tests demonstrate the consistency and robustness of the method. Our study establishes GPR as a systematic and non-parametric approach to PDF reconstruction, offering controlled uncertainty estimates and reduced model bias in lattice QCD analyses.

hadronic spectroscopy

Hamiltonian parameter inference from resonant inelastic x-ray scattering with active learning

Identifying model Hamiltonians is a vital step toward creating predictive models of materials. Here, in this study, we combine Bayesian optimization with the EDRIXS numerical package to infer Hamiltonian parameters from resonant inelastic x-ray scattering (RIXS) spectra within the single atom approximation. To evaluate the efficacy of our method, we test it on experimental RIXS spectra of NiPS 3 , NiCl 2 , Ca 3 ⁢LiOsO 6 , and Fe 2⁢ O 3 , and demonstrate that it can reproduce results obtained from hand-fitted parameters to a precision similar to expert human analysis while providing a more systematic mapping of parameter space. Our work provides a key first step toward solving the inverse scattering problem to extract effective multi-orbital models from information-dense RIXS measurements, which can be applied to a host of quantum materials. We also propose atomic model parameter sets for two materials, Ca 3⁢ LiOsO 6 and Fe 2⁢ O 3 , that were previously missing from the literature.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND

Sequential spectral line analysis for accurate density and temperature diagnosis of laboratory opacity measurements

The accuracy of iron opacity calculated in stellar interiors has been questioned since the discovery of the “solar problem” and the discrepancies between the measured and modeled iron opacity reported in 2015. Experimental opacity benchmarks require accurate temperature and density measurements, which were inferred by analyzing tracer magnesium spectra in those experiments. Could the observed discrepancy be explained by insufficient accuracy in the inferred temperature, density, and their uncertainties? Previous analyses may have yielded biased results due to three limitations: (1) simultaneous multi-line fitting, (2) approximations in line-shape models, and (3) exclusion of certain spectral lines due to insufficient background characterization. Notably, the first issue is a common concern for many inversion methods, including Bayesian inferences. We present a refined analysis method that overcomes these limitations, applied to three categories of iron opacity experiments (Anchor 1, 2, and 3). In particular, the sequential fitting method yields unbiased results with more realistic uncertainties by accounting for line inconsistencies in the parameter uncertainties. The average electron temperature and density values are 162 ± 6 eV and (7.0 ± 1.9) × 10 21 cm −3 for six Anchor 1 experiments, 189 ± 7 eV and (3.4 ± 0.3) × 10 22 cm −3 for 21 Anchor 2 experiments, and 201 ± 6 eV and (4.8 ± 1.1) × 10 22 cm −3 for nine Anchor 3 experiments. These results show ∼4% temperature and ∼20% density reproducibility over a decade, which also aligns with the inferred parameter uncertainties. In conclusion, the resulting temperature and density uncertainties lead to a quasi-continuum iron opacity variation of ±4%–7% for wavelengths below 9.5 Å, which is insufficient to explain the significant model-data discrepancies reported in 2015.

Absorption spectroscopy