Interpretable A-posteriori error indication for graph neural network surrogate models
Not Available
Barwey, Shivam (ORCID:0000000217171805)↗
SEARCH · Search NASA
Results for “error indicators”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Parametric model-order-reduction development for unsteady convection
A time-averaged error indicator with POD- h Greedy is developed to drive parametric model order reduction (pMOR) for 2D unsteady natural convection in a high-aspect ratio slot parameterized with the Prandtl number, Rayleigh number, and slot angle with respect to the gravity. The error indicator is extended to accommodate the energy equation and Leray regularization. Despite being two-dimensional and laminar, the target flow regime presents several challenges: 1) there is a bifurcation in the angle parameter space; 2) the solution can be multivalued, even at steady state; and 3) the solution exhibits spatio-temporal chaos at several points in the parameter space. The authors explore several reduced-order models (ROMs) and demonstrate that Leray-regularized Galerkin ROMs provide a robust solution approach for this class of flows. They further demonstrate that error-indicated pMOR can efficiently predict several QOIs, such as mean flow, mean Nusselt number and mean turbulent kinetic energy, even in the presence of a bifurcation. Finally, they show that spatio-temporal chaos can lead to lack of reproducibility in both the full-order model and the reduced-order model and that the variance in the full-order model provides a lower bound on the pMOR error in these cases.
leray regularization↗
Projection-Based Model Reduction for Coupled Conduction—Enclosure Radiation Systems
We report a projection-based reduced order model (pROM) methodology has been developed for transient heat transfer problems involving coupled conduction and enclosure radiation. The approach was demonstrated on two test problems of varying complexity. The reduced order models demonstrated substantial speedups (up to 185×) relative to the full order model with good accuracy (less than 3% L ∞ error). An attractive feature of pROMs is that there is a natural error indicator for the ROM solution: the final residual norm at each time-step of the converged ROM solution. Using example test cases, we discuss how to interpret this error indicator to assess the accuracy of the ROM solution. The approach shows promise for many-query applications, such as uncertainty quantification and optimization. The reduced computational cost of the ROM relative to the full-order model (FOM) can enable the analysis of larger and more complex systems as well as the exploration of larger parameter spaces.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Time-series machine-learning error models for approximate solutions to parameterized dynamical systems
This work proposes a machine-learning framework for modeling the error incurred by approximate solutions to parameterized dynamical systems. In particular, we extend the machine-learning error models (MLEM) framework proposed in Ref. Freno and Carlberg (2019) to dynamical systems. The proposed Time-Series Machine-Learning Error Modeling (T-MLEM) method constructs a regression model that maps features – which comprise error indicators that are derived from standard a posteriori error-quantification techniques – to a random variable for the approximate-solution error at each time instance. The proposed framework considers a wide range of candidate features, regression methods, and additive noise models. We consider primarily recursive regression techniques developed for time-series modeling, including both classical time-series models (e.g., autoregressive models) and recurrent neural networks (RNNs), but also analyze standard non-recursive regression techniques (e.g., feed-forward neural networks) for comparative purposes. Finally, numerical experiments conducted on multiple benchmark problems illustrate that the long short-term memory (LSTM) neural network, which is a type of RNN, outperforms other methods and yields substantial improvements in error predictions over traditional approaches.
42 ENGINEERING↗
Shadow Lagrangian dynamics for superfluidity
Motivated by a similar approach for Born-Oppenheimer molecular dynamics, this paper proposes an extended "shadow" Lagrangian density for quantum states of superfluids. The extended Lagrangian contains an additional field variable that is forced to follow the wave function of the quantum state through a rapidly oscillating extended harmonic oscillator. By considering the adiabatic limit for large frequencies of the harmonic oscillator, we can derive the two equations of motions, a Schrödinger-type equation for the quantum state and a wave equation for the extended field variable. The equations are coupled in a nonlinear way, but each equation individually is linear with respect to the variable that it defines. The computational advantage of this new system is that it can be easily discretized using linear time stepping methods, where we propose to use a Crank-Nicolson-type approach for the Schrödinger equation and an extended leapfrog scheme for the wave equation. Furthermore, the difference between the quantum state and the extended field variable defines a consistency error that should go to zero if the frequency tends to infinity. By coupling the time-step size in our discretization to the frequency of the harmonic oscillator we can extract an easily computable consistency error indicator that can be used to estimate the numerical error without additional costs. The findings are illustrated in numerical experiments.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
A unified hp-HDG framework for Friedrichs' PDE systems
Here, this work proposes a unified hp-adaptivity framework for hybridized discontinuous Galerkin (HDG) method for a large class of partial differential equations (PDEs) of Friedrichs' type. In particular, we present unified hp-HDG formulations for abstract one-field and two-field structures and prove their well-posedness. In order to handle non-conforming interfaces we simply take advantage of HDG built-in mortar structures. With split-type mortars and the approximation space of trace, a numerical flux can be derived via Godunov approach and be naturally employed without any additional treatment. As a consequence, the proposed formulations are parameter-free. We perform several numerical experiments for time-independent and linear PDEs including elliptic, hyperbolic, and mixed-type to verify the proposed unified hp-formulations and demonstrate the effectiveness of hp-adaptation. Two adaptivity criteria are considered: one is based on a simple and fast error indicator, while the other is rigorous but more expensive using an adjoint-based error estimate. The numerical results show that these two approaches are comparable in terms of convergence rate even for problems with strong gradients, discontinuities, and singularities.
97 MATHEMATICS AND COMPUTING↗
Tolerating memory stack failures in multi-stack systems
Memory management circuitry and processes operate to improve reliability of a group of memory stacks, providing that if a memory stack or a portion thereof fails during the product's lifetime, the system may still recover with no errors or data loss. A front-end controller receives a block of data requested to be written to memory, divides the block into sub-blocks, and creates a new redundant reliability sub-block. The sub-blocks are then written to different memory stacks. When reading data from the memory stacks, the front-end controller detects errors indicating a failure within one of the memory stacks, and recovers corrected data using the reliability sub-block. The front-end controller may monitor errors for signs of a stack failure and disable the failed stack.
Mappouras, Georgios↗
gLaSDI: Parametric physics-informed greedy latent space dynamics identification
A parametric adaptive physics-informed greedy Latent Space Dynamics Identification (gLaSDI) method is proposed for accurate, efficient, and robust data-driven reduced-order modeling of high-dimensional nonlinear dynamical systems. In the proposed gLaSDI framework, an autoencoder discovers intrinsic nonlinear latent representations of high-dimensional data, while dynamics identification (DI) models capture local latent-space dynamics. Here, an interactive training algorithm is adopted for the autoencoder and local DI models, which enables identification of simple latent-space dynamics and enhances accuracy and efficiency of data-driven reduced-order modeling. To maximize and accelerate the exploration of the parameter space for the optimal model performance, an adaptive greedy sampling algorithm integrated with a physics-informed residual-based error indicator and random-subset evaluation is introduced to search for the optimal training samples on the fly. Further, to exploit local latent-space dynamics captured by the local DI models for an improved modeling accuracy with a minimum number of local DI models in the parameter space, a -nearest neighbor convex interpolation scheme is employed. The effectiveness of the proposed framework is demonstrated by modeling various nonlinear dynamical problems, including Burgers equations, nonlinear heat conduction, and radial advection. The proposed adaptive greedy sampling outperforms the conventional predefined uniform sampling in terms of accuracy. Compared with the high-fidelity models, gLaSDI achieves 17 to 2,658× speed-up with 1 to 5% relative errors.
97 MATHEMATICS AND COMPUTING↗
A parallel p ‐adaptive discontinuous Galerkin method for the Euler equations with dynamic load‐balancing on tetrahedral grids
Abstract A novel p ‐adaptive discontinuous Galerkin (DG) method has been developed to solve the Euler equations on three‐dimensional tetrahedral grids. Hierarchical orthogonal basis functions are adopted for the DG spatial discretization while a third order TVD Runge‐Kutta method is used for the time integration. A vertex‐based limiter is applied to the numerical solution in order to eliminate oscillations in the high order method. An error indicator constructed from the solution of order and is used to adapt degrees of freedom in each computational element, which remarkably reduces the computational cost while still maintaining an accurate solution. The developed method is implemented with under the Charm++ parallel computing framework. Charm++ is a parallel computing framework that includes various load‐balancing strategies. Implementing the numerical solver under Charm++ system provides us with access to a suite of dynamic load balancing strategies. This can be efficiently used to alleviate the load imbalances created by p ‐adaptation. A number of numerical experiments are performed to demonstrate both the numerical accuracy and parallel performance of the developed p ‐adaptive DG method. It is observed that the unbalanced load distribution caused by the parallel p ‐adaptive DG method can be alleviated by the dynamic load balancing from Charm++ system. Due to this, high performance gain can be achieved. For the testcases studied in the current work, the parallel performance gain ranged from 1.5× to 3.7×. Therefore, the developed p ‐adaptive DG method can significantly reduce the total simulation time in comparison to the standard DG method without p ‐adaptation.
97 MATHEMATICS AND COMPUTING↗
Adaptive immersed isogeometric level-set topology optimization
Here, this paper presents for the first time an adaptive immersed approach for level-set topology optimization using higher-order truncated hierarchical B-spline discretizations for design and state variable fields. Boundaries and interfaces are represented implicitly by the iso-contour of one or multiple level-set functions. An immersed finite element method, the eXtended IsoGeometric Analysis, is used to predict the physical response. The proposed optimization framework affords different adaptively refined higher-order B-spline discretizations for individual design and state variable fields. The increased continuity of higher-order B-spline discretizations together with local refinement enables direct control over the accuracy of the representation of each field while simultaneously reducing computational cost compared to uniformly refined discretizations. A flexible mesh adaptation strategy enables local refinement based on geometric measures or physics-based error indicators. These adaptive discretization and analysis approaches are integrated into gradient-based optimization schemes, evaluating the design sensitivities using the adjoint method. Numerical studies illustrate the features of the proposed framework with static, linear elastic, multi-material, two- and three-dimensional problems. The examples provide insight into the effect of refining the design variable field on the optimization result and the convergence rate of the optimization process. Using coarse higher-order B-spline discretizations for level-set fields promotes the development of smooth designs and suppresses the emergence of small features. Moreover, adaptive mesh refinement for state variable fields results in a reduction of overall computational cost. Higher-order B-spline discretizations are especially interesting when evaluating gradients of state variable fields due to their higher inter-element continuity.
36 MATERIALS SCIENCE↗
Impacts of simultaneous operating faults on cooling performance of a high efficiency residential heat pump
Not provided.
Construction & Building Technology↗
Dyn$\mathrm{AMO}$: Multi-agent reinforcement learning for dynamic anticipatory mesh optimization with applications to hyperbolic conservation laws
Here we introduce DynAMO, a reinforcement learning paradigm for Dynamic Anticipatory Mesh Optimization. Adaptive mesh refinement is an effective tool for optimizing computational cost and solution accuracy in numerical methods for partial differential equations. However, traditional adaptive mesh refinement approaches for time-dependent problems typically rely only on instantaneous error indicators to guide adaptivity. As a result, standard strategies often require frequent remeshing to maintain accuracy. In the DynAMO approach, multi-agent reinforcement learning is used to discover new local refinement policies that can anticipate and respond to future solution states by producing meshes that deliver more accurate solutions for longer time intervals. By applying DynAMO to discontinuous Galerkin methods for the linear advection and compressible Euler equations in two dimensions, we demonstrate that this new mesh refinement paradigm can outperform conventional threshold-based strategies while also generalizing to different mesh sizes, remeshing and simulation times, and initial conditions.
97 MATHEMATICS AND COMPUTING↗
Heterogeneous Composition of Oxygen-Evolving Complexes in Crystal Structures of Dark-Adapted Photosystem II
Photosystem II (PSII) is a homodimeric protein complex that catalyzes water oxidation at the oxygen-evolving complex (OEC), a heterocubanoid calcium-tetra-manganese cluster. Here, we analyze the omit electron-density peaks of the OEC’s metal ions in five X-ray free-electron laser PSII structures at a resolution between 2.15 Å and 1.95 Å. The omit peaks can be described by the total number of electrons and approximated by the variance of electron density distribution when the distributions are spherically symmetric. We show that the number of electrons of metal centers are different in the two OECs of PSII dimers, implying that either the oxidation states and/or occupancies of individual metal ions are different in the two monomers. In either case, we find that the two OECs of dark-adapted PSII dimers in crystals are not fully synchronized in the same expected S 1 state. Differences in redox states of the OEC in PSII only partially account for the observation that the electron densities integrate to a smaller number of electrons than expected. Differences between the determined and expected relative electron numbers are much larger than the estimated errors, indicating heterogeneity in the OEC composition. Here, the reported findings suggest that two OECs of dark-adapted PSII crystals are typically not fully synchronized in the S 1 state and likely generate heterogeneity in the crystallographical data of PSII intermediate structures.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Crowdsourcing the Frontier: Advancing Hybrid Physics‐ML Climate Simulation via a $\$$50,000 Kaggle Competition
Subgrid machine-learning (machine learning [ML]) parameterizations have the potential to introduce a new generation of climate models that incorporate the effects of higher-resolution physics without incurring the prohibitive computational cost associated with more explicit physics-based simulations. However, important issues, ranging from online instability to inconsistent online performance, have limited their operational use for long-term climate projections. To more rapidly drive progress in solving these issues, domain scientists and ML researchers opened up the offline aspect of this problem to the broader ML and data science community with the release of ClimSim, a NeurIPS Data sets and Benchmarks publication, and an associated Kaggle competition. This paper reports on the downstream results of the Kaggle competition by coupling emulators inspired by the winning teams' architectures to an interactive climate model (including full cloud microphysics, a regime historically prone to online instability) and systematically evaluating their online performance. Our results demonstrate that online stability in the low-resolution real-geography setting is reproducible across multiple diverse architectures, which we consider a key milestone. All tested architectures exhibit strikingly similar offline and online biases, though their responses to architecture-agnostic design choices (e.g., expanding the list of input variables) can differ significantly. Multiple Kaggle-inspired architectures achieve state-of-the-art results on certain metrics such as zonal mean bias patterns and global Root Mean Squared Error, indicating that crowdsourcing the essence of the offline problem is one path to improving online performance in hybrid physics-AI climate simulation.
Environmental sciences↗
Deciphering baryonic feedback with galaxy clusters
Abstract Upcoming cosmic shear analyses will precisely measure the cosmic matter distribution at low redshifts. At these redshifts, the matter distribution is affected by galaxy formation physics, primarily baryonic feedback from star formation and active galactic nuclei. Employing measurements from theMagneticumandIllustrisTNGsimulations and a dark matter + baryon (DMB) halo model, this paper demonstrates that Sunyaev-Zel'dovich (SZ) effect observations of galaxy clusters, whose masses have been calibrated using weak gravitational lensing, can constrain the baryonic impact on cosmic shear with statistical and systematic errors subdominant to the measurement errors of DES-Y3 and LSST-Y1, with systematic errors on S 8 and Ω m reaching 10% and 50% of the statistical errors, respectively. For LSST-Y6 and Roman surveys, these systematic errors increase to 150% and 100% of the statistical errors, indicating the necessity for further model developments for future surveys. We further dissect the contributions from different scales and halos with different masses to cosmic shear, highlighting the dominant role of SZ clusters at scales critical for cosmic shear analyses. These findings suggest a promising avenue for future joint analyses of Cosmic Microwave Background (CMB) and lensing surveys.
Astronomy & Astrophysics↗
Parton physics from a heavy-quark operator product expansion: Lattice QCD calculation of the fourth moment of the pion distribution amplitude
The pion light-cone distribution amplitude (LCDA) is an essential nonperturbative input for a range of high-energy exclusive processes in quantum chromodynamics. Building on our previous work, the continuum limit of the fourth Mellin moment of the pion LCDA is determined in quenched QCD using quark masses which correspond to a pion mass of 𝑚 𝜋 = 550 MeV. This calculation finds ⟨𝜉 2 ⟩ = 0.202(8)(9) and ⟨𝜉 4 ⟩ = 0.039(28)(11) where the first error indicates the combined statistical and systematic uncertainty from the analysis and the second indicates the uncertainty from working with Wilson coefficients computed to next-to-leading order. These results are presented in the $\overline{\textrm{MS}}$ scheme at a renormalization scale of 𝜇 = 2 GeV.
Detmold, William [Massachusetts Inst. of Technolog↗
On Feature, Classifier and Detector Fusers for 235U Signatures Using Gamma Spectral Counts
Three types of information fusion strategies are studied to assess the performance of classifiers for detecting low-level 235 U radiation sources, using features obtained from gamma spectra of NaI detectors. These three strategies are based on using two spectral region features, fusing eight classifiers of diverse designs, and fusing multiple detectors located at different positions around the source. The inner, middle and outer groups of detectors, within a formation of two concentric circles and a spiral of 21 detectors, are identified based on their distance to the source, which is located at the center. This study provides two main qualitative insights into this classification task. First, the fusion of detectors leads to an overall improved classification performance, least in the inner group, most in the outer group, and in between for the middle group. Second, several classifiers and fusers achieve lower training error which does not translate to lower generalization error, indicating their over-fitting to training data.
Rao, Nageswara↗
Global models predict clouds at the wrong time of day: Does it matter for radiation and climate?
Accurate prediction of future climate change hinges upon the ability of Earth system models (ESMs) to simulate clouds and their radiative effects. Even if an ESM can simulate the correct clouds, a systematic error in the amount of sunlight reflected by clouds (and, thus, cloud radiative effect) can exist if the clouds are simulated at the incorrect time of day. In this work, we develop an analytical model connecting diurnal cloud biases to emergent mean state radiative biases. With the use of satellite observations, we demonstrate that there are errors in the time of day that clouds are occurring in ESMs that would cause bias in shortwave cloud radiative effect (SWCRE) that is greater than 45% of the total SWCRE bias, but such errors in the cloud diurnal cycle are masked by other compensating errors, indicating that these ESMs are getting the right answer for the wrong reasons.
Geosciences↗