Search NASA⌕ Search

SEARCH · Search NASA

Results for “Derived quantities preservation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Error-Bounded Learned Scientific Data Compression with Preservation of Derived Quantities

Scientific applications continue to grow and produce extremely large amounts of data, which require efficient compression algorithms for long-term storage. Compression errors in scientific applications can have a deleterious impact on downstream processing. Thus, it is crucial to preserve all the “known” Quantities of Interest (QoI) during compression. To address this issue, most existing approaches guarantee the reconstruction error of the original data or primary data (PD), but cannot directly control the problem of preserving the QoI. In this work, we propose a physics-informed compression technique that is composed of two parts: (i) reduction of the PD with bounded errors and (ii) preservation of the QoI. In the first step, we combine tensor decompositions, autoencoders, product quantizers, and error-bounded lossy compressors to bound the reconstruction error at high levels of compression. In the second step, we use constraint satisfaction post-processing followed by quantization to preserve the QoI. To illustrate the challenges of reducing the reconstruction errors of the PD and QoI, we focus on simulation data generated by a large-scale fusion code, XGC, which can produce tens of petabytes in a single day. The results show that our approach can achieve a high compression amount while accurately preserving the QoI within scientifically acceptable bounds.

97 MATHEMATICS AND COMPUTING↗

Online and Scalable Data Compression Pipeline with Guarantees on Quantities of Interest

Data compression is becoming critical for data-intensive scientific applications. Scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Prior work has shown that a pipeline can be built to guarantee error on the primary data (PD) within user-defined bounds and achieve near-floating point QoI errors. In this paper, we present novel computational approaches for accelerating the pipeline and demonstrate results that enable concurrent execution of compression in parallel with the simulation nodes. This allows compression, including the writing of the required compression data, for the previous time step to be completed while the simulation proceeds with the current time step. Overall, the approach presented in this paper results in a 6–8 times improvement in computational overhead compared to previous work. These results were obtained using data generated by a large-scale fusion code called XGC, which produces hundreds of terabytes of data in a single day.

Banerjee, Tania↗

Scalable Hybrid Learning Techniques for Scientific Data Compression

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms that limit errors to primary data (PD), scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Here, this article presents a physics-informed compression technique implemented as an end-to-end, scalable, GPU-based pipeline for data compression that addresses this requirement. Our hybrid compression technique combines machine learning techniques and standard compression methods. Specifically, we combine an autoencoder, an error-bounded lossy compressor to provide guarantees on raw data error, and a constraint satisfaction post-processing step to preserve the QoIs within a minimal error (generally less than floating point error). The effectiveness of the data compression pipeline is demonstrated by compressing nuclear fusion simulation data generated by a large-scale fusion code, XGC, which produces hundreds of terabytes of data in a single day. Our approach works within the ADIOS framework and results in compression by a factor of more than 150 while requiring only a few percent of the computational resources necessary for generating the data, making the overall approach highly effective for practical scenarios.

ITER↗

A Variational Assimilation Method for Satellite and Conventional Data: a Revised Basic Model 2B

A variational objective analysis technique that modifies observations of temperature, height, and wind on the cyclone scale to satisfy the five 'primitive' model forecast equations is presented. This analysis method overcomes all of the problems that hindered previous versions, such as over-determination, time consistency, solution method, and constraint decoupling. A preliminary evaluation of the method shows that it converges rapidly, the divergent part of the wind is strongly coupled in the solution, fields of height and temperature are well-preserved, and derivative quantities such as vorticity and divergence are improved. Problem areas are systematic increases in the horizontal velocity components, and large magnitudes of the local tendencies of the horizontal velocity components. The preliminary evaluation makes note of these problems but detailed evaluations required to determine the origin of these problems await future research.

Achtemeier, Gary L.↗

Multilevel Techniques for Compression and Reduction of Scientific Data-Quantitative Control of Accuracy in Derived Quantities

Although many compression algorithms are focused on preserving pointwise values of the data, application scientists are generally more concerned with derived quantities. Equally well, the user may even be willing to accept a high level of lossiness in the compression provided that the compressed data respect certain invariants, such as mass conservation. In the current work, we develop a mathematical framework and techniques that enable data to be adaptively compressed while maintaining a specified tolerance on a class of user-prescribed quantities. Here, the algorithm is used to augment the functionality of the data reduction package MGARD developed in previous work and the functionality is illustrated by a range of application including data from computational simulation of autocatalytic reaction simulation, turbulent combustion simulation, experimental data obtained from magnetic confinement fusion experiment, and simulation of turbulent flow along a rectangular channel. In each case, we consider one or more relevant quantities of interest and reduce the data so as to preserve these quantities.

97 MATHEMATICS AND COMPUTING↗

Fast Algorithms for Scientific Data Compression

Many scientific simulations and experiments generate terabytes to petabytes of data daily, necessitating data compression techniques. Unlike video and image compression, scientists require methods that accurately preserve primary data (PD) and derived quantities of interest (QoIs). In our previous work, we demonstrated the effectiveness of hybrid compression techniques that combine machine learning with traditional approaches. This paper presents innovative computational techniques aimed at expediting the compression pipeline. Our experiments, conducted on two distinct platforms with a large-scale XGC-based fusion simulation, demonstrate that the overhead incurred by these new approaches is less than one percent of the computational resources needed for the simulation.

Banerjee, Tania↗

Deep learning symmetries and their Lie groups, algebras, and subalgebras from first principles

Abstract We design a deep-learning algorithm for the discovery and identification of the continuous group of symmetries present in a labeled dataset. We use fully connected neural networks to model the symmetry transformations and the corresponding generators. The constructed loss functions ensure that the applied transformations are symmetries and the corresponding set of generators forms a closed (sub)algebra. Our procedure is validated with several examples illustrating different types of conserved quantities preserved by symmetry. In the process of deriving the full set of symmetries, we analyze the complete subgroup structure of the rotation groups SO (2), SO (3), and SO (4), and of the Lorentz group S O ( 1 , 3 ) . Other examples include squeeze mapping, piecewise discontinuous labels, and SO (10), demonstrating that our method is completely general, with many possible applications in physics and data science. Our study also opens the door for using a machine learning approach in the mathematical study of Lie groups and their properties.

97 MATHEMATICS AND COMPUTING↗

Conservative High-Order Time Integration for Lagrangian Hydrodynamics

In tis study, we develop novel time integration methods for the compressible Euler equations in the Lagrangian frame that are of arbitrary high order and exactly preserve the mass, momentum, and total energy of the system. The equations are considered in nonconservative form, that is, common for staggered grid hydrodynamics (SGH) methods; namely, the evolved quantities are mass, momentum, and internal energy. A general family of time integration schemes is formulated, and practical pairs for orders three and four are derived. Numerical results on standard hydrodynamics benchmarks confirm the high-order convergence on smooth problems and the exact numerical preservation of all physically conserved quantities.

97 MATHEMATICS AND COMPUTING↗

The evolution of impact basins - Cooling, subsidence, and thermal stress

The present study is concerned with an assessment of the contribution of thermal contraction and thermal stress to the topography and tectonics of large lunar impact basins. Exploratory models are developed, giving attention to the temperature structure following basin formation, the subsequent cooling of the basin region, and the resulting thermal displacements and stresses as functions of time. The subsidence and stress at the surface are compared with topography and tectonic features in the comparatively well-preserved Orientale basin. The results of the comparison are used as a basis to derive approximate constraints on the quantity and distribution of heat implanted during the basin-formation process.

Bratt, S. R.↗

Preserving Lagrangian Structure in Nonlinear Model Reduction with Application to Structural Dynamics

Our work proposes a model-reduction methodology that preserves Lagrangian structure and achieves computational efficiency in the presence of high-order nonlinearities and arbitrary parameter dependence. As such, the resulting reduced-order model retains key properties such as energy conservation and symplectic time-evolution maps. We focus on parameterized simple mechanical systems subjected to Rayleigh damping and external forces, and consider an application to nonlinear structural dynamics. To preserve structure, the method first approximates the system's “Lagrangian ingredients''---the Riemannian metric, the potential-energy function, the dissipation function, and the external force---and subsequently derives reduced-order equations of motion by applying the (forced) Euler--Lagrange equation with these quantities. Moreover, from the algebraic perspective, key contributions include two efficient techniques for approximating parameterized reduced matrices while preserving symmetry and positive definiteness: matrix gappy proper orthogonal decomposition and reduced-basis sparsification. Our results for a parameterized truss-structure problem demonstrate the practical importance of preserving Lagrangian structure and illustrate the proposed method's merits: it reduces computation time while maintaining high accuracy and stability, in contrast to existing nonlinear model-reduction techniques that do not preserve structure.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Bound-Preserving Reconstruction of Tensor Quantities for Remap in ALE Fluid Dynamics

We analyze several new and existing approaches for limiting tensor quantities in the context of deviatoric stress remapping in an ALE numerical simulation of elastic flow. Remapping and limiting of the tensor component-by-component is shown to violate radial symmetry of derived variables such as elastic energy or force. Therefore, we have extended the symmetry-preserving Vector Image Polygon algorithm, originally designed for limiting vector variables. This limiter constrains the vector (in our case a vector of independent tensor components) within the convex hull formed by the vectors from surrounding cells – an equivalent of the discrete maximum principle in scalar variables. We compare this method with a limiter designed specifically for deviatoric stress limiting which aims to constrain the J 2 invariant that is proportional to the specific elastic energy and scale the tensor accordingly. We also propose a method which involves remapping and limiting the J 2 invariant independently using known scalar techniques. The deviatoric stress tensor is then scaled to match this remapped invariant, which guarantees conservation in terms of elastic energy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Integrability Breaking from Backscattering

Herein we analyze the onset of diffusive hydrodynamics in the one-dimensional hard-rod gas subject to stochastic backscattering. While this perturbation breaks integrability and leads to a crossover from ballistic to diffusive transport, it preserves infinitely many conserved quantities corresponding to even moments of the velocity distribution of the gas. In the limit of small noise, we derive the exact expressions for the diffusion and structure factor matrices, and show that they generically have off diagonal components. We find that the particle density structure factor is non-Gaussian and singular near the origin, with a return probability showing logarithmic deviations from diffusion.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Development of the mare regolith - Some model considerations

This investigation uses results obtained in an earlier Monte Carlo study by Oberbeck et al. (1973) to shed light on the consequences of mare-regolith origin by impact comminution of primarily local basaltic rocks by evaluating regolith growth and mixing as a function of time. The study demonstrates that regolith growth is self-regulated and has the same trend and nearly the same terminal growth rates whatever the history of bombardment: rapid initial accumulation followed by diminishing rates of growth. Mixing and all other processes investigated are growth regulated. Mixing increases as growth slows, but never to the extent that the regolith is homogenized. Because the average regolith is never homogenized, products of growth-regulated processes are preserved in the stratigraphy. This model indicates that deeper levels contain thinner depositional units, lesser quantities of meteoritic and exotic components, and more debris derived from shallow levels in the mare basalts than material in near-surface layers.

Quaide, W.↗

Variational formulation of classical and quantum models for intense laser pulse propagation

Highlights: •We consider the theoretical description of intense laser pulses propagating through gases. •We derived reduced models using Lagrangian and Hamiltonian formulations. •We obtain models where the atomic electrons are treated classically or quantum-mechanically. •We derive a number of conserved quantities of the reduced models. -- Abstract: We consider the theoretical description of intense laser pulses propagating through gases. Starting from a first-principles description of both the electromagnetic field and the electron motion within the gas atoms, we derive a hierarchy of reduced models. We obtain a parallel set of models, where the atomic electrons are treated classically on the one hand, and quantum-mechanically on the other. By working consistently in either a Lagrangian formulation or a Hamiltonian formulation, we ensure that our reduced models preserve the variational structure of the parent models. Taking advantage of the Hamiltonian formulation, we deduce a number of conserved quantities of the reduced models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Large Deformation Constitutive Laws for Isotropic Thermoelastic Materials

We examine the approximations made in using Hooke's law as a constitutive relation for an isotropic thermoelastic material subjected to large deformation by calculating the stress evolution equation from the free energy. For a general thermoelastic material, we employ the volume-preserving part of the deformation gradient to facilitate volumetric/shear strain decompositions of the free energy, its first derivatives (the Cauchy stress and entropy), and its second derivatives (the specific heat, Grueneisen tensor, and elasticity tensor). Specializing to isotropic materials, we calculate these constitutive quantities more explicitly. For deformations with limited shear strain, but possibly large changes in volume, we show that the differential equations for the stress components involve new terms in addition to the traditional Hooke's law terms. These new terms are of the same order in the shear strain as the objective derivative terms needed for frame indifference; unless the latter terms are negligible, the former cannot be neglected. We also demonstrate that accounting for the new terms requires that the deformation gradient be included as a field variable.

36 MATERIALS SCIENCE↗

Freely decaying turbulence in two-dimensional electrostatic gyrokinetics

In magnetized plasmas, a turbulent cascade occurs in phase space at scales smaller than the thermal Larmor radius ('sub-Larmor scales') [Tatsuno et al., Phys. Rev. Lett. 103, 015003 (2009)]. When the turbulence is restricted to two spatial dimensions perpendicular to the background magnetic field, two independent cascades may take place simultaneously because of the presence of two collisionless invariants. In the present work, freely decaying turbulence of two-dimensional electrostatic gyrokinetics is investigated by means of phenomenological theory and direct numerical simulations. A dual cascade (forward and inverse cascades) is observed in velocity space as well as in position space, which we diagnose by means of nonlinear transfer functions for the collisionless invariants. We find that the turbulence tends to a time-asymptotic state, dominated by a single scale that grows in time. A theory of this asymptotic state is derived in the form of decay laws. Each case that we study falls into one of three regimes (weakly collisional, marginal, and strongly collisional), determined by a dimensionless number D{sub *}, a quantity analogous to the Reynolds number. The marginal state is marked by a critical number D{sub *}=D{sub 0} that is preserved in time. Turbulence initialized above this value become increasingly inertial in time, evolving toward larger and larger D{sub *}; turbulence initialized below D{sub 0} become more and more collisional, decaying to progressively smaller D{sub *}.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Well-Balanced, Conservative Finite Difference Algorithm for Atmospheric Flows

The numerical simulation of meso-, convective-, and microscale atmospheric flows requires the solution of the Euler or the Navier-Stokes equations. Nonhydrostatic weather prediction algorithms often solve the equations in terms of derived quantities such as Exner pressure and potential temperature (and are thus not conservative) and/or as perturbations to the hydrostatically balanced equilibrium state. This paper presents a well-balanced, conservative finite difference formulation for the Euler equations with a gravitational source term, where the governing equations are solved as conservation laws for mass, momentum, and energy. Preservation of the hydrostatic balance to machine precision by the discretized equations is essential because atmospheric phenomena are often small perturbations to this balance. The proposed algorithm uses the weighted essentially nonoscillatory and compact-reconstruction weighted essentially nonoscillatory schemes for spatial discretization that yields high-order accurate solutions for smooth flows and is essentially nonoscillatory across strong gradients; however, the well-balanced formulation may be used with other conservative finite difference methods. The performance of the algorithm is demonstrated on test problems as well as benchmark atmospheric flow problems, and the results are verified with those in the literature.

Ghosh, Debojyoti↗