Search NASA⌕ Search

SEARCH · Search NASA

Results for “Derived quantities preservation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Error-Bounded Learned Scientific Data Compression with Preservation of Derived Quantities

Scientific applications continue to grow and produce extremely large amounts of data, which require efficient compression algorithms for long-term storage. Compression errors in scientific applications can have a deleterious impact on downstream processing. Thus, it is crucial to preserve all the “known” Quantities of Interest (QoI) during compression. To address this issue, most existing approaches guarantee the reconstruction error of the original data or primary data (PD), but cannot directly control the problem of preserving the QoI. In this work, we propose a physics-informed compression technique that is composed of two parts: (i) reduction of the PD with bounded errors and (ii) preservation of the QoI. In the first step, we combine tensor decompositions, autoencoders, product quantizers, and error-bounded lossy compressors to bound the reconstruction error at high levels of compression. In the second step, we use constraint satisfaction post-processing followed by quantization to preserve the QoI. To illustrate the challenges of reducing the reconstruction errors of the PD and QoI, we focus on simulation data generated by a large-scale fusion code, XGC, which can produce tens of petabytes in a single day. The results show that our approach can achieve a high compression amount while accurately preserving the QoI within scientifically acceptable bounds.

97 MATHEMATICS AND COMPUTING↗

Online and Scalable Data Compression Pipeline with Guarantees on Quantities of Interest

Data compression is becoming critical for data-intensive scientific applications. Scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Prior work has shown that a pipeline can be built to guarantee error on the primary data (PD) within user-defined bounds and achieve near-floating point QoI errors. In this paper, we present novel computational approaches for accelerating the pipeline and demonstrate results that enable concurrent execution of compression in parallel with the simulation nodes. This allows compression, including the writing of the required compression data, for the previous time step to be completed while the simulation proceeds with the current time step. Overall, the approach presented in this paper results in a 6–8 times improvement in computational overhead compared to previous work. These results were obtained using data generated by a large-scale fusion code called XGC, which produces hundreds of terabytes of data in a single day.

Banerjee, Tania↗

Scalable Hybrid Learning Techniques for Scientific Data Compression

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms that limit errors to primary data (PD), scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Here, this article presents a physics-informed compression technique implemented as an end-to-end, scalable, GPU-based pipeline for data compression that addresses this requirement. Our hybrid compression technique combines machine learning techniques and standard compression methods. Specifically, we combine an autoencoder, an error-bounded lossy compressor to provide guarantees on raw data error, and a constraint satisfaction post-processing step to preserve the QoIs within a minimal error (generally less than floating point error). The effectiveness of the data compression pipeline is demonstrated by compressing nuclear fusion simulation data generated by a large-scale fusion code, XGC, which produces hundreds of terabytes of data in a single day. Our approach works within the ADIOS framework and results in compression by a factor of more than 150 while requiring only a few percent of the computational resources necessary for generating the data, making the overall approach highly effective for practical scenarios.

ITER↗

Multilevel Techniques for Compression and Reduction of Scientific Data-Quantitative Control of Accuracy in Derived Quantities

Although many compression algorithms are focused on preserving pointwise values of the data, application scientists are generally more concerned with derived quantities. Equally well, the user may even be willing to accept a high level of lossiness in the compression provided that the compressed data respect certain invariants, such as mass conservation. In the current work, we develop a mathematical framework and techniques that enable data to be adaptively compressed while maintaining a specified tolerance on a class of user-prescribed quantities. Here, the algorithm is used to augment the functionality of the data reduction package MGARD developed in previous work and the functionality is illustrated by a range of application including data from computational simulation of autocatalytic reaction simulation, turbulent combustion simulation, experimental data obtained from magnetic confinement fusion experiment, and simulation of turbulent flow along a rectangular channel. In each case, we consider one or more relevant quantities of interest and reduce the data so as to preserve these quantities.

97 MATHEMATICS AND COMPUTING↗

Fast Algorithms for Scientific Data Compression

Many scientific simulations and experiments generate terabytes to petabytes of data daily, necessitating data compression techniques. Unlike video and image compression, scientists require methods that accurately preserve primary data (PD) and derived quantities of interest (QoIs). In our previous work, we demonstrated the effectiveness of hybrid compression techniques that combine machine learning with traditional approaches. This paper presents innovative computational techniques aimed at expediting the compression pipeline. Our experiments, conducted on two distinct platforms with a large-scale XGC-based fusion simulation, demonstrate that the overhead incurred by these new approaches is less than one percent of the computational resources needed for the simulation.

Banerjee, Tania↗

Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles

Abstract We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO (2), SO (3), and SO (4), and of the Lorentz group S O ( 1 , 3 ) . Other examples include squeeze mapping, piecewise discontinuous labels, and SO (10), demonstrating that our method is completely general, with many possible applications in physics and data science. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.

97 MATHEMATICS AND COMPUTING↗

Conservative High-Order Time Integration for Lagrangian Hydrodynamics

In tis study, we develop novel time integration methods for the compressible Euler equations in the Lagrangian frame that are of arbitrary high order and exactly preserve the mass, momentum, and total energy of the system. The equations are considered in nonconservative form, that is, common for staggered grid hydrodynamics (SGH) methods; namely, the evolved quantities are mass, momentum, and internal energy. A general family of time integration schemes is formulated, and practical pairs for orders three and four are derived. Numerical results on standard hydrodynamics benchmarks confirm the high-order convergence on smooth problems and the exact numerical preservation of all physically conserved quantities.

97 MATHEMATICS AND COMPUTING↗

Kaon condensation in the linear sigma model at finite density and temperature

Basing on the Cornwall-Jackiw-Tomboulis effective action approach we formulate a theoretical formalism for studying kaon condensation in the linear sigma model at finite density and temperature. We derive the renormalized effective potential in the Hartree-Fock approximation, which preserves the Goldstone theorem. This quantity is then used to consider physical properties of kaon matter.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Nonperturbative comparison of QCD effective charges

We study the nonperturbative behavior of two versions of the QCD effective charge, one obtained from the pinch technique gluon self-energy, and one from the ghost-gluon vertex. Despite their distinct theoretical origin, due to a fundamental identity relating various ingredients appearing in their respective definitions, the two effective charges are almost identical in the entire range of physical momenta, and coincide exactly in the deep infrared, where they freeze at a common finite value. Specifically, the dressing function of the ghost propagator is related to the two form factors in the Lorentz decomposition of a certain Green's function, appearing in a variety of field-theoretic contexts. The central identity, which is valid only in the Landau gauge, is derived from the Schwinger-Dyson equations governing the dynamics of the aforementioned quantities. The renormalization procedure that preserves the validity of the identity is carried out, and various relevant kinematic limits and physically motivated approximations are studied in detail. A crucial ingredient in this analysis is the infrared finiteness of the gluon propagator, which is inextricably connected with the aforementioned freezing of the effective charges. Some important issues related to the consistent definition of the effective charge in the presence of such a gluon propagator are resolved. We finally present a detailed numerical study of a special set of Schwinger-Dyson equations, whose solutions determine the nonperturbative dynamics of the quantities composing the two effective charges.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Preserving Lagrangian Structure in Nonlinear Model Reduction with Application to Structural Dynamics

Our work proposes a model-reduction methodology that preserves Lagrangian structure and achieves computational efficiency in the presence of high-order nonlinearities and arbitrary parameter dependence. As such, the resulting reduced-order model retains key properties such as energy conservation and symplectic time-evolution maps. We focus on parameterized simple mechanical systems subjected to Rayleigh damping and external forces, and consider an application to nonlinear structural dynamics. To preserve structure, the method first approximates the system's “Lagrangian ingredients''---the Riemannian metric, the potential-energy function, the dissipation function, and the external force---and subsequently derives reduced-order equations of motion by applying the (forced) Euler--Lagrange equation with these quantities. Moreover, from the algebraic perspective, key contributions include two efficient techniques for approximating parameterized reduced matrices while preserving symmetry and positive definiteness: matrix gappy proper orthogonal decomposition and reduced-basis sparsification. Our results for a parameterized truss-structure problem demonstrate the practical importance of preserving Lagrangian structure and illustrate the proposed method's merits: it reduces computation time while maintaining high accuracy and stability, in contrast to existing nonlinear model-reduction techniques that do not preserve structure.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Bound-Preserving Reconstruction of Tensor Quantities for Remap in ALE Fluid Dynamics

We analyze several new and existing approaches for limiting tensor quantities in the context of deviatoric stress remapping in an ALE numerical simulation of elastic flow. Remapping and limiting of the tensor component-by-component is shown to violate radial symmetry of derived variables such as elastic energy or force. Therefore, we have extended the symmetry-preserving Vector Image Polygon algorithm, originally designed for limiting vector variables. This limiter constrains the vector (in our case a vector of independent tensor components) within the convex hull formed by the vectors from surrounding cells – an equivalent of the discrete maximum principle in scalar variables. We compare this method with a limiter designed specifically for deviatoric stress limiting which aims to constrain the J 2 invariant that is proportional to the specific elastic energy and scale the tensor accordingly. We also propose a method which involves remapping and limiting the J 2 invariant independently using known scalar techniques. The deviatoric stress tensor is then scaled to match this remapped invariant, which guarantees conservation in terms of elastic energy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Integrability Breaking from Backscattering

Herein we analyze the onset of diffusive hydrodynamics in the one-dimensional hard-rod gas subject to stochastic backscattering. While this perturbation breaks integrability and leads to a crossover from ballistic to diffusive transport, it preserves infinitely many conserved quantities corresponding to even moments of the velocity distribution of the gas. In the limit of small noise, we derive the exact expressions for the diffusion and structure factor matrices, and show that they generically have off diagonal components. We find that the particle density structure factor is non-Gaussian and singular near the origin, with a return probability showing logarithmic deviations from diffusion.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Variational formulation of classical and quantum models for intense laser pulse propagation

Highlights: •We consider the theoretical description of intense laser pulses propagating through gases. •We derived reduced models using Lagrangian and Hamiltonian formulations. •We obtain models where the atomic electrons are treated classically or quantum-mechanically. •We derive a number of conserved quantities of the reduced models. -- Abstract: We consider the theoretical description of intense laser pulses propagating through gases. Starting from a first-principles description of both the electromagnetic field and the electron motion within the gas atoms, we derive a hierarchy of reduced models. We obtain a parallel set of models, where the atomic electrons are treated classically on the one hand, and quantum-mechanically on the other. By working consistently in either a Lagrangian formulation or a Hamiltonian formulation, we ensure that our reduced models preserve the variational structure of the parent models. Taking advantage of the Hamiltonian formulation, we deduce a number of conserved quantities of the reduced models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Large Deformation Constitutive Laws for Isotropic Thermoelastic Materials

We examine the approximations made in using Hooke's law as a constitutive relation for an isotropic thermoelastic material subjected to large deformation by calculating the stress evolution equation from the free energy. For a general thermoelastic material, we employ the volume-preserving part of the deformation gradient to facilitate volumetric/shear strain decompositions of the free energy, its first derivatives (the Cauchy stress and entropy), and its second derivatives (the specific heat, Grueneisen tensor, and elasticity tensor). Specializing to isotropic materials, we calculate these constitutive quantities more explicitly. For deformations with limited shear strain, but possibly large changes in volume, we show that the differential equations for the stress components involve new terms in addition to the traditional Hooke's law terms. These new terms are of the same order in the shear strain as the objective derivative terms needed for frame indifference; unless the latter terms are negligible, the former cannot be neglected. We also demonstrate that accounting for the new terms requires that the deformation gradient be included as a field variable.

36 MATERIALS SCIENCE↗

Freely decaying turbulence in two-dimensional electrostatic gyrokinetics

In magnetized plasmas, a turbulent cascade occurs in phase space at scales smaller than the thermal Larmor radius ('sub-Larmor scales') [Tatsuno et al., Phys. Rev. Lett. 103, 015003 (2009)]. When the turbulence is restricted to two spatial dimensions perpendicular to the background magnetic field, two independent cascades may take place simultaneously because of the presence of two collisionless invariants. In the present work, freely decaying turbulence of two-dimensional electrostatic gyrokinetics is investigated by means of phenomenological theory and direct numerical simulations. A dual cascade (forward and inverse cascades) is observed in velocity space as well as in position space, which we diagnose by means of nonlinear transfer functions for the collisionless invariants. We find that the turbulence tends to a time-asymptotic state, dominated by a single scale that grows in time. A theory of this asymptotic state is derived in the form of decay laws. Each case that we study falls into one of three regimes (weakly collisional, marginal, and strongly collisional), determined by a dimensionless number D{sub *}, a quantity analogous to the Reynolds number. The marginal state is marked by a critical number D{sub *}=D{sub 0} that is preserved in time. Turbulence initialized above this value become increasingly inertial in time, evolving toward larger and larger D{sub *}; turbulence initialized below D{sub 0} become more and more collisional, decaying to progressively smaller D{sub *}.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Well-Balanced, Conservative Finite Difference Algorithm for Atmospheric Flows

The numerical simulation of meso-, convective-, and microscale atmospheric flows requires the solution of the Euler or the Navier-Stokes equations. Nonhydrostatic weather prediction algorithms often solve the equations in terms of derived quantities such as Exner pressure and potential temperature (and are thus not conservative) and/or as perturbations to the hydrostatically balanced equilibrium state. This paper presents a well-balanced, conservative finite difference formulation for the Euler equations with a gravitational source term, where the governing equations are solved as conservation laws for mass, momentum, and energy. Preservation of the hydrostatic balance to machine precision by the discretized equations is essential because atmospheric phenomena are often small perturbations to this balance. The proposed algorithm uses the weighted essentially nonoscillatory and compact-reconstruction weighted essentially nonoscillatory schemes for spatial discretization that yields high-order accurate solutions for smooth flows and is essentially nonoscillatory across strong gradients; however, the well-balanced formulation may be used with other conservative finite difference methods. The performance of the algorithm is demonstrated on test problems as well as benchmark atmospheric flow problems, and the results are verified with those in the literature.

Ghosh, Debojyoti↗

Hybrid learning techniques for scientific data reduction with performance guarantees

The research initiatives supported by the U.S. Department of Energy (DOE) Grant DE-SC0022265 are fundamentally aimed at pioneering advanced machine learning (ML) techniques for scientific data compression within high-performance computing (HPC) environments. This comprehensive body of work addresses the critical challenge posed by the exponential growth of data generated by scientific simulations in domains such as fusion energy, climate modeling, and computational fluid dynamics (CFD). A core objective is to develop compression algorithms that achieve substantial data reduction—often by orders of magnitude—while rigorously ensuring the fidelity of both the primary data (PD) and scientifically crucial derived quantities of interest (QoI). The methodologies deployed under this grant integrate sophisticated deep learning architectures, prominently featuring autoencoders, advanced generative models like conditional diffusion, and hybrid learning techniques. Key innovations include the development of Guaranteed Autoencoders (GAE) and the Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) framework, which provide explicit, instance-level error bounds on reconstructed data. Furthermore, specialized strategies such as nonlinear constraint satisfaction are employed to preserve the integrity of QoI, a vital requirement for the trustworthiness of downstream scientific analyses. This research also focuses on the design and implementation of scalable, GPU-accelerated software pipelines that seamlessly integrate into existing HPC workflows, ensuring both computational efficiency and practical applicability. The CAESAR framework, for example, unifies foundation and generative models to create an adaptive and efficient compression solution for spatio-temporal scientific data. Collectively, these efforts represent a significant advancement in mitigating the scientific data deluge, enabling more effective data management, accelerated scientific discovery, and optimized utilization of HPC resources.

97 MATHEMATICS AND COMPUTING↗