Search NASA⌕ Search

SEARCH · Search NASA

Results for “Tensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

FLYING SERVING: On-the-Fly Parallelism Switching for Large Language Model Serving

Production LLM serving must simultaneously deliver high throughput, low latency, and sufficient context capacity under non-stationary traffic and mixed request requirements. Data parallelism (DP) maximizes throughput by running independent replicas, while tensor parallelism (TP) reduces per-request latency and pools memory for long-context inference. However, existing serving stacks typically commit to a static parallelism configuration at deployment; adapting to bursts, priorities, or long-context requests is often disruptive and slow. We present Flying Serving, a vLLM-based system that enables online DP-TP switching without restarting engine workers. Flying Serving makes reconfiguration practical by virtualizing the state that would otherwise force data movement: (i) a zero-copy Model Weights Manager that exposes TP shard views on demand, (ii) a KV Cache Adaptor that preserves request KV state across DP/TP layouts, (iii) an eagerly initialized Communicator Pool to amortize collective setup, and (iv) a deadlock-free scheduler that coordinates safe transitions under execution skew. Across three popular LLMs and realistic serving scenarios, Flying Serving improves performance by up to 4.79 × under high load and 3.47 × under low load while supporting latency- and memory-driven requests.

Gao, Shouwei [ORNL]↗

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

FTTN is a test suite to evaluate the numerical behaviors of matrix accelerators of GPUs (NVIDIA Tensor Cores and AMD Matrix Cores) in a quick and simple setting. Matrix accelerators are heavily used in today's computationally intense applications to speed up matrix multiplications. This test suite provides a comprehensive study on the numerical behaviors of these accelerators, including support for subnormals, rounding modes, extra precision bits and FMA features. Is there

Laguna Peralta, Ignacio↗

TT-SFV

The code uses tensor train decompositions to provide a low-rank framework for the stochastic finite volume method.

Walton, Steven↗

thor

The THOR Project (Tensors for High-dimensional Object Representations)

Korobkin, Oleg↗

TensorSearch v1

TensorSearch is a novel parallel similarity search paradigm designed to identify known patterns in high-dimensional tensors.

Dong, Bin↗

sparsett

Python module for working with sparse tensors.

Lilly, Jeremy [Los Alamos National Lab]↗

Enhancing Short-Range Weather Forecasts through Temporal Variation Encoding: A Multiperiod Embedding Approach

Machine learning (ML) techniques have emerged as promising approaches to improve regional weather forecast accuracy and reliability through data-driven methods. We propose a novel ML-based weather forecasting model, the Multiperiod Embed Net (MPENet). A key distinguishing feature of MPENet is its explicit utilization of the inherent cyclic nature in weather dynamics, unlike the autoregressive strategies commonly used in other ML weather forecasting approaches. Critical cyclic structures are identified via Fourier analyses of dynamic time series. Cyclicity in the convolutional representation is achieved by transforming one-dimensional time series of meteorological variables into two-dimensional tensors based on identified periods. This approach enables the model to leverage intrinsic weather patterns, enhancing regional forecast performance. To demonstrate the effectiveness of MPENet, we conduct a comparative analysis with Nvidia’s FourCastNet. Both models are trained on High-Resolution Rapid Refresh (HRRR) data from 2015 to 2022, over a 192 km × 192 km region in Tennessee. The comparisons are performed locally at two specific locations known to have different weather dynamics due to orographic effects: Crossville, on the relatively flat Cumberland Plateau with fewer topographic airflow disruptions, and Oak Ridge, in the ridge-and-valley region, where airflow is heavily influenced by surrounding valleys and mountains. Our results indicate that FourCastNet achieves strong accuracy at very short lead times, while MPENet maintains competitive skill and shows advantages in capturing temporal evolution over longer periods. Cross-correlation analyses of MPENet and FourCastNet predictions with the HRRR data suggest that encoding critical cyclicity into the network architecture leads to improvements in the forecasting skill.

Artificial intelligence↗

Exploiting universal nonlocal dispersion in optically active materials for spectro-polarimetric computational imaging

Recent years have seen significant advancements in exploring novel light-matter interactions such as hyperbolic dispersion within natural crystals. However, current studies have predominantly concentrated on local optical response of materials characterized by a dielectric tensor without spatial dispersion. Here, we investigate the nonlocal response in optically-active crystals with screw symmetries, revealing their lossless, super-dispersive properties compared to traditional optical response functions. We leverage this universal nonlocal dispersion, i.e. the dispersion of optical rotatory power, to explore a novel spectral de-multiplexing scheme compared to conventional gratings, prisms and metasurfaces. We design and demonstrate an ‘Nonlocal-Cam’ - a camera that exploits nonlocal dispersion through sampling of polarized spectral states and the application of computational spectral reconstruction algorithms. The Nonlocal-Cam captures information in both laboratory and outdoor field experiments which is unavailable to traditional intensity cameras - the spectral texture of polarization. Merging the fields of nonlocal electrodynamics and computational imaging, our work paves the way for exploiting nonlocal optics of optically active materials in a variety of applications, from biological microscopy to physics-driven machine vision and remote sensing.

Wang, Xueji [Purdue Univ., West Lafayette, IN (Uni↗

HydraGNN_Predictive_GFM_2024 - Ensemble of predictive graph foundation models for ground state atomistic materials modeling

We provide the ensemble of fifteen pre-trained graph foundation models (GFMs) for atomistic materials modeling applications. Each one of the fifteen GFMs has been trained on five open-source datasets that (once aggregated) amount to over 154 million atomistic structures, which cover over two-thirds of the natural elements of the periodic table and that comprises a broad set of organic and inorganic compounds. This vast set of atomistic structures comprises ground state configurations that are dynamically stable (i.e., equilibrated structures with atomic forces approximately close to zero values) as well as dynamically unstable structures (i.e., non-equilibrium structures with non-negligible non-zero values of atomic forces). The ensemble of datasets aggregated does NOT include excited states. The datasets have been curated to remove atomistic structures with spectral norm of the force tensor above 100 eV/angstrom. Moreover, a linear term of the energy was computed for each dataset using a linear regression model that uses the chemical concentration of each natural element as regressor. The linear term predicted by the linear regression model has been subtracted from each original energy value to perform a re-alignment of the energy values across different electronic structures approximation theories performed to generate the diverse multi-source, multi-fidelity datasets. The folder "ADIOS_files" contains the set of pre-processed datasets in Adaptable I/O System (ADIOS) format (https://www.exascaleproject.org/research-project/adios/) that have been used for the development and training of GFMs in this work. The "ADIOS_files" directory contains 6 sub-directories named as follows: - ANI1x-v3.bp - MPTrj-v3.bp - OC2020-20M-v3.bp - OC2020-v3.bp - OC2022-v3.bp - qm7x-v3.bp Each sub-directory contains the pre-processed datasets converted in Adaptable I/O System (ADIOS) format (https://www.exascaleproject.org/research-project/adios/) that have been used to the development, training, and performance testing of the ensemble go predictive graph foundation models. Each GFM was developed using HydraGNN (https://github.com/ORNL/HydraGNN) as underlying graph neural network (GNN) architecture. The multi-task learning (MTL) capability of HydraGNN was used to simultaneously train the GFMs on labeled values for direct predictions of energy (a total system property of an atomistic structure that measures the chemical stability) and atomic forces (an atomic level property of an atomistic structure that measures the dynamical stability). The hyper parameters of the GFM have been tuned using scalable hyperparameter optimization (HPO) algorithms implemented in the software DeepHyper (https://github.com/deephyper/deephyper). The pre-training of each HPO trial was performed using distributed data parallelism (DDP) to scale the training across 128 compute nodes of the exascale OLCF supercomputer Frontier. Each HPO trial was trained only for 10 epochs and an early stopping was performed to avoid wasting significant computational resources on GNN architectures that were clearly underperforming. For each HPO trial, the 'omnistat' tool developed by (AMD Research - Advanced Micro Device) was used to measure the total energy consumption in kWh. The ensemble of GFMs was obtained by selecting the fifteen best performing HPO trials. Four models have been selected for their clear advantage in accuracy, and these are the GFMs with IDs 229, 156, 147, 260. Additional eleven models have been selected based on judicious balance between accuracy and energy consumption needed for training, and these are the GFMs with IDs 165, 78, 137, 1, 175, 171, 181, 67, 179, 167, 351. Each selected GFM of the ensemble was continued to cumulate a total of at most 30 epochs. In some cases, the total number of epochs actually performed was les than 30 due to two combined factors: (1) the size of the GFM (i.e., the number of model parameters to train) and (2) the total wall-clock time for which the computational resources could be allocated on OLCF-Frontier. The "Ensemble_of_models" directory contains 15 sub-directories named as follows: - gfm_0.229 - gfm_0.156 - gfm_0.147 - gfm_0.260 - gfm_0.165 - gfm_0.78 - gfm_0.137 - gfm_0.1 - gfm_0.175 - gfm_0.171 - gfm_0.181 - gfm_0.67 - gfm_0.179 - gfm_0.167 - gfm_0.351 Each one of these sub-directories refers to one of the fifteen HPO trials that have been selected to continue the pre-training with at most 30 epochs. With each sub-directory associated with a specific HPO trial, the following files can be found: - config.json: file for argument parsing to develop and train an HydraGNN architecture - gfm_0.ID_epoch_N.pk: file with model parameters for HPO ID trial after N epochs of training The ensemble of fifteen GFM architectures was used for (1) ensemble averaging to stabilize the predictions of energy and atomic forces after pre-training for post-processing analysis and (2) ensemble uncertainty quantification (UQ). The code used to develop, pre-train, and load the pre-trained models for post-processing analysis is available on the ORNL-GitHub at the following link: https://github.com/ORNL/HydraGNN/tree/Predictive_GFM_2024

36 MATERIALS SCIENCE↗

Building epsilon near zero materials from layered uniaxial metamaterials

Recently, there has been an explosion of activity in the fields of optics and photonics with the advent of fabrication techniques which enable the design of metamaterials which possess properties not encountered in the natural world. In this work, we are concerned with zero permittivity materials and a new scheme to design metamaterials for which all components of the dielectric tensor are approximately zero. Our approach involves the alternate layering of many, very thin, slices of two constituent metamaterials, a uniaxial layered medium and a uniaxial nanowire array. With a simple optimization strategy we demonstrate a candidate configuration which very nearly satisfies our design goal of zero permittivity.

Gray, Stephen K. [Argonne National Laboratory (ANL↗

Unexpected symmetry breaking in ferroelectric wurtzite thin films on silicon observed by optical second harmonic generation

Optical second harmonic generation (SHG) exists as a popular tool for probing materials with broken inversion symmetry in the physical and biological sciences. SHG polarimetry can reveal material anisotropy with high sensitivity, including point group and phase transitions. Here, we probe ferroelectric wurtzite films with a nominal 6 mm symmetry under a normal reflection geometry using SHG microscopy and discover an unexpected symmetry breaking. Symmetry considerations would normally forbid the detection of the SHG signal when light propagates along the polar 6-fold rotation axis. Yet a uniquely anisotropic SHG response is observed in this geometry in Al 1-x B x N, Al 1-x Sc x N, Zn 1-x Mg x O, and AlN/Al 1-x Sc x N heterostructures grown on silicon that can be modeled by an average monoclinic symmetry of point group m. A significant enhancement of the SHG signal corresponding to up to a 5.3× increase in the SHG intensity (hence ∼2.3 × in effective SHG tensor coefficient) is observed at antiparallel polar domain walls, suggesting local cooperative alignment of symmetry-breaking structural distortions. Namely, it is found that the monoclinic mirror plane is oriented predominantly perpendicular to the walls. Such increases in domain wall SHG thus reveal that subtle symmetry breaking can be a pathway to large property enhancements.

36 MATERIALS SCIENCE↗

Machine-Learning-Based Multiscale Methods for 3D Modelling of Granular Materials by Incorporating History-Dependent State Variables

Over the past decades, the prevalence of machine learning (ML) methods has made the development of ML-based constitutive models for granular materials undoubtedly a popular subject. Numerous studies have been made to feature the loading path or history-dependent stress-strain response of granular media using neural networks. In this work, a novel finite element method (FEM)–ML multiscale approach was developed by incorporating internal variables to improve the simulation accuracy of 3D history-dependent granular materials for the first time. To this end, a surrogate constitutive model based on the single-step-based multi-layer perceptron (MLP) neural network was used to replace representative volume element (RVE) simulations conducted by the discrete element method (DEM) in the multiscale FEM–DEM approach. Although the prediction principle of the MLP aligns with the FEM algorithm, artificially added internal variables are required to differentiate the loading history. To address this issue, history variables associated with the Frobenius norm are proposed to be fed into the MLP coupled with the strain tensor to extract the history-dependent behaviour of granular assemblies. The developed FEM–ML approach was demonstrated in 3D conventional triaxial compression (CTC) simulations. Compared to the multiscale FEM–DEM approach, the proposed FEM–ML method exhibits a significantly improved computational efficiency.

granular materials↗

Phase-field modeling of orientation-dependent crack growth in ductile single crystals with anisotropic elasticity

Crack growth in ductile single crystals (DuSCs) is orientation dependent due to the anisotropies of crystal plasticity and elastic tensor. This study develops a phase-field model incorporating both crystal plasticity and crack growth and proposes a general method to decompose the elastic energy into compressive and tensile parts to prevent crack growth under compression in the phase-field description. The phase-field model, in combination with three Euler angles, is employed to simulate orientation-dependent crack growth in DuSCs. The contributions from crystal plasticity and anisotropic elasticity are compared, and the former is found to dominate in the anisotropy of crack growth in copper single crystals. Furthermore, the simulation results demonstrate that crystal orientation strongly affects the heterogeneous distribution of plastic strain and the interaction between plastic strain and crack growth. High-throughput phase-field simulations are performed with exhaustive crystal orientations, and the results are explained based on the anisotropy of the Taylor factor.

Computational Solid Mechanics↗

Joint Inversion of Regional Waveform, First-Motion Polarity, and Synthetic Aperture Radar Surface Displacement for the Fourth and Sixth North Korean Declared Nuclear Explosions

Here, this study analyzed the Democratic People’s Republic of Korea’s (DPRK) fourth (DPRK4, 6 January 2016 M w 4.49) and sixth (DPRK6, 7 September 2017 M w 5.2) declared nuclear tests, employing a joint seismic and Interferometric Synthetic Aperture Radar (InSAR) inversion to improve understanding of these events and enhance moment tensor (MT) inversion capabilities. The recent efforts have focused on employing seismic waveform and InSAR geodetic deformation data separately to analyze these and the previous nuclear tests (e.g., Chiang et al., 2018; Myers et al., 2018; Wang et al., 2018). Building upon our previous work (Chi-Durán et al., 2021), we performed a joint regional waveform, first-motion (FM) polarity, and surface displacement inversion, which demonstrated improved source-type discrimination, a revised MT solution with reduced scalar moment uncertainty, and an independently constrained location. In this article, we build on the previous results for DPRK6 by including an analysis using a four-layered velocity model with free-surface topography to compute the near-source static deformation Green’s functions. The model consists of a 50 m basalt layer (⁠V P = 2.07 km/s, V S = 1.2 km/s⁠), a 250 m stratified volcanic deposit layer (⁠V P = 1.73 km/s, V S = 1.0 km/s⁠), a 700 m weathered granodiorite layer (⁠V P = 2.5 km/s, V S = 1.3 km/s⁠⁠), and a granodiorite half-space (⁠V P = 5.35 km/s, V S = 3.09 km/s⁠⁠). The half-space shares the velocity of the regional MDJ2 velocity model (Ford et al., 2010), which has proven effective for waveform inversion in the region. This model considers the range of reported values for various lithologies and weathering effects. Our findings show that using the layered velocity model enhances the recovery of source location and depth for both the explosions by improving fits and reducing uncertainties. The joint inversion also improves source-type discrimination and better constrains the scalar seismic moment necessary for downstream yield estimation.

58 GEOSCIENCES↗

Geometric Interpretation of the Cluster Location Problem Part II: Application to the Pahala, Hawaii, Earthquake Sequence

In the companion “Theory” article, we presented a new framing of the seismic location problem in terms of differential geometry (Harris et al., 2025). From that viewpoint, we developed a “project and correct” approach for estimating the relative locations of earthquakes. Here, in this study, we use project and correct to estimate high-precision relative locations of events from an earthquake sequence beneath the town of Pahala, Hawaii, using high-precision correlation-derived picks. The sequence was active from 2020 through 2022 and produced many highly correlated signals at Hawaii Volcano Observatory (HVO) stations on the island of Hawaii. The data we inverted consisted of 2882 events with observations at 5 HVO stations. For comparison with the travel-time image, we also produced conventional hypocenter solutions using both the Bayesloc program (Myers et al., 2007, 2009) and a purpose-built double-difference code. There were obvious structural elements in the resulting image, the resolution of which we used to test the performance of the project and the correct algorithm. For the projection step, we first produced a 3D local basis using an singular value decomposition (SVD) of the 2882 groups of times. Projection of the travel-time vectors into this basis resulted in an image with structures similar to those produced by our conventional locators, but with distortion as predicted by theory. Removing the distortion requires an inverse operator generated from the metric tensor at the geometric centroid of the events. We compared two approaches to obtaining such an inverse operator. The first uses an estimate of the geographic centroid of the event cloud from the centroid of the travel-time data. The second approach uses the centroid of the conventionally produced locations. The first approach produces a corrected image very similar to the conventional results, but with a rotation. The corrected image produced using the conventionally derived centroid is a near-exact match to the conventional locations.

Dodge, Douglas A. [Lawrence Livermore National Lab↗

Source Characterization at Low Yields from Physics Experiment One A

The detonation of a well-recorded coupled explosion at the well-characterized Nevada National Security Site, as part of Physics Experiment One, has provided us with an opportunity to compare and contrast methods and results of yield estimation and other event characterization methods. Yield estimates are made using several methods, including local/regional magnitudes, waveform envelopes, acoustic amplitudes, joint seismoacoustic yield, and moment tensors. We include in our analysis a discussion and comparison of applicability, calibrations, assumptions, and uncertainties involved in each. With the exception of magnitude-based methods, all the techniques were more or less successful in recovering the known yield. It is, however, useful to be cognizant of requirements and calibrations, such as station coverage, emplacement conditions, propagation characterization, and uncertainties, to apply the methods to other areas with less complete information. We demonstrate that we can be successful at monitoring low-yield explosions using a variety of methods assuming that the signal-to-noise ratio is adequate at recording stations, and that the material properties are taken into account. Depth estimates are also important, particularly if one allows the possibility of a surface explosion.

Pasyanos, Michael E. [Lawrence Livermore National ↗

AK112: Full Waveform Inversion Tomography of Alaska Improves Waveform Fits While Imaging Crustal, Mantle, and Slab Structure

We report a full waveform inversion tomography model of Alaska and the surrounding regions, inferring radially anisotropic shear and isotropic compressional wavespeeds by fitting complete waveforms from 120 regional earthquakes. Our multiscale approach inverted time–frequency phase misfits (maximum period of 100 s), starting with a minimum period of 40 s and ending at 20 s in 7 stages and 112 total iterations. The model (AK112) was evaluated by computing the misfits for 36 independent validation events. We find that misfit reductions were large and equal (∼55%) for both the inversion and validation data sets, providing confidence in the model. AK112 also provides much better waveform fits compared to other reported models for the region, including an isotropic version of itself, highlighting the importance of anisotropy. The model resolves known crustal, upper mantle, and slab structure to depths of 100 km with new detail: sedimentary basins in the Alaskan Shelf, Cook Inlet, and Colville basins, among others; discontinuous lithospheric structure across major terrane boundaries; and subducting slab geometry and back‐arc volcanic sources. In addition to tectonic interpretations, the model enables full waveform simulations for long‐period earthquake ground motions and source characterization (e.g., moment tensor and finite‐fault inversion).

Rodgers, Arthur [Lawrence Livermore National Labor↗

The 10 September 2025 M w 4.1 Earthquake in Northeastern Utah, United States: An Archetypal Continental Mantle Event

The 10 September 2025 M w 4.1 earthquake in northeastern Utah, United States, had a focal depth 68 km beneath sea level, which is ∼20–25 km greater than estimates of local crustal thickness, making it a rare example of a continental mantle earthquake (CME). The focal depth is well resolved from arrival-time inversion (nearest station ∼13 km away) and moment tensor inversion of regional waveforms. Similar to other CMEs in the Intermountain West, there were no obvious aftershocks or foreshocks, and the waveforms were enriched in high-frequency energy. Spectral modeling gives a stress drop of ∼80 MPa and a radiation efficiency of ∼0.08, albeit with large uncertainties. The high stress drop and low radiation efficiency are consistent with a dissipative source process such as thermal runaway. Also similar to previous Intermountain West CMEs, the event occurred along the boundary of the Archean Wyoming craton, where pressure–temperature conditions favor ductile deformation. We hypothesize that edge-driven or regional-scale mantle convection produces increased strain rates near the craton boundary that make either conventional brittle failure or thermal runaway feasible at relatively high pressure–temperature conditions. High conductivity inferred around the edge of the craton may suggest that fluids also contribute to CME occurrence.

Koper, Keith D. [Univ. of Utah, Salt Lake City, UT↗