Search NASA⌕ Search

SEARCH · Search NASA

Results for “large-scale computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

FitCache: A Transparent Drop-In Framework for Multi-Tier Caching to Accelerate Distributed Deep Learning Workloads

Training in Deep learning (DL) remains highly compute- and data-intensive, with I/O becoming a critical bottleneck as models and datasets scale. Recent studies report that data loading can dominate training time, especially on large-scale HPC systems with shared parallel file systems (PFS). Existing caching approaches either rely on single-tier designs or require intrusive modifications to training pipelines, limiting their portability and effectiveness. In this work, we present FitCache, a transparent drop-in framework for multi-tier caching to accelerate distributed DL training by coordinating fast local memory (e.g., DRAM, Persistent Memory (PMem)) and NVMe as hierarchical caches atop PFS. Our design adapts to hardware diversity, i.e., if NVMe is missing, memory transparently acts as a caching tier, ensuring stable performance. FitCache transparently intercepts I/O requests and issues concurrent fetches across all tiers, returning data from the fastest responder without centralized metadata or static redirection paths. FitCache adapts to dynamic workloads and heterogeneous clusters while maintaining POSIX compatibility. Experiments on Frontier (2048 GPUs) and smaller research clusters show that FitCache reduces training time by up to 40% and per-batch I/O latency by up to 71.6% compared to Lustre Orion PFS, offering a drop-in solution for scalable DL training.

Hu, Guangxing [ORNL] (ORCID:0009000283203614)↗

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗

RADAI: A Large-Scale Realistic Dataset for Radiation Detection Algorithm Development

Open, realistic datasets are essential for developing and benchmarking radiation detection algorithms, yet they remain scarce. The Radiological Anomaly Detection and Identification (RADAI) project was develop to create datasets that meet the training and testing needs for sophisticated radiation detection algorithms. The RADAI dataset is a large-scale synthetic resource that integrates high-fidelity Monte Carlo simulations with realistic urban scenarios to capture both background variability and source signatures. RADAI models construction-material NORM, people and vehicles, urban clutter, and dynamic environmental effects such as cosmic-ray and rain-induced transients, and they provide list-mode detector data with motion and response modeling suitable for algorithm training and evaluation. The RADAI project resulted in three publicly-released complementary datasets together with an online scoring portal for standardized performance assessment and an open software toolkit that supports data access, augmentation, model development, and evaluation. These resources enable reproducible comparisons across methods and promote rigorous studies at the scale required by contemporary machine learning. By grounding algorithm development in realistic, well-documented conditions, RADAI supports progress toward more robust detection, identification, and localization in complex urban environments.

Ghawaly, James M. [Division of Computer Science an↗

Biomanufacturing and Scale-Up: Pathways to Biochemicals, Biofuels, and Biomaterials

Advancing the bioeconomy requires the development of large-scale microbial bioprocesses capable of converting waste carbon streams into biofuels, biochemicals, and biomaterials at industrially relevant scales. While biomanufacturing has been successfully demonstrated at the laboratory scale for a wide range of chemicals, only a few have reached industrial-scale production. This is partly due to the inherent complexity of microbial systems, which rely on living cells with intricate metabolic pathways that are highly sensitive to environmental changes, making large-scale production difficult to optimize and predict. As a result, scaling-up bioprocesses remains a high-stakes challenge that requires deeper exploration. This involves integrating feedstock and microbial selection, upstream and downstream processes, and computational modelling, among other research efforts. Bulk and specialty chemicals derived from biological processes also face competition from fossil-based production routes, which have been refined through decades of technological advancements. While biologically derived molecules may offer more environmentally friendly production pathways than traditional chemical manufacturing, their widespread adoption depends on achieving cost parity-or superiority-relative to fossil-based methods. This emphasizes the importance of holistic research, including techno-economic analyses and life cycle assessments, to ensure both economic viability and environmental sustainability. This editorial and special issue explores state-of-the-art strategies for converting waste carbon sources into valuable products. It discusses how enzymes, single microbes (e.g., extremophiles), and microbiomes (e.g., through division of labor) can be integrated with upstream and downstream process innovations-such as consolidated bioprocessing and in situ product recovery-to improve the efficiency and scalability of biomanufacturing. The editorial further highlights the role of computational modelling in understanding, predicting, and controlling bioprocess performance across scales, and concludes by emphasizing the importance of techno-economic modelling to identify technologies that can move to market.

09 BIOMASS FUELS↗

Algebraic Multigrid with Filtering: An Efficient Preconditioner for Interior Point Methods in Large-Scale Contact Mechanics Optimization

Large-scale contact mechanics simulations are crucial in many engineering fields such as structural design and manufacturing. In the frictionless case, contact can be modeled by minimizing an energy functional; however, these problems are often nonlinear, nonconvex, and increasingly difficult to solve as mesh resolution increases. In this work, we employ a Newton-based interior-point (IP) filter line-search method, an effective approach for large-scale constrained optimization. While this method converges rapidly, each iteration requires solving a large saddle-point linear system that becomes ill-conditioned as the optimization process converges, largely due to IP treatment of the contact constraints. Such ill-conditioning can hinder solver scalability and increase iteration counts with mesh refinement. Here, to address this, we introduce a novel preconditioner, algebraic multigrid with filtering (AMGF), tailored to the Schur complement of the saddle-point system. Building on the classical AMG solver, commonly used for elasticity, we augment it with a specialized subspace correction that filters near null space components introduced by contact interface constraints. Through theoretical analysis and numerical experiments on a range of linear and nonlinear contact problems, we demonstrate that the proposed solver achieves mesh independent convergence and maintains robustness against the ill-conditioning that notoriously plagues IP methods. These results indicate that AMGF makes contact mechanics simulations more tractable and broadens the applicability of Newton-based IP methods in challenging engineering scenarios. More broadly, AMGF is well suited for problems, optimization or otherwise, where solver performance is limited by a low-dimensional subspace, such as those arising from localized constraints, interface conditions, or model heterogeneities. This makes the method widely applicable beyond contact mechanics and constrained optimization.

Mathematics and Computing↗

GP Cosmology Surrogate v1.0

GP Cosmology Surrogate is a Python library for building and training a generalized multi-output Gaussian process (GP) framework of @takhtaganov2021cosmic. In this approach, the surrogate is constructed sequentially, guided by a Bayesian optimization acquisition function that targets reduction of emulation error in the regions most consistent with the observational data. This adaptive design concentrates computational resources where they have the greatest impact on inference accuracy. The library supports efficient training for separable GP kernels, which allows the use of Kronecker algebra to handle high-dimensional input spaces and large numbers of correlated outputs. This makes it well suited for applications such as modeling cosmological power spectra, large-scale physical simulations, and multi-output hyperparameter tuning. By combining scalable multi-output GP modeling with data-driven adaptive sampling, GPsurrogate enables parameter inference and optimization with substantially fewer simulations than conventional space-filling designs.

Lukic, Zarija [Lawrence Berkeley National Laborato↗

ORBIT-2 Dataset for Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling

This dataset release corresponds to the work conducted in ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling, where large-scale AI methods were applied to improve climate and weather resolution. The collection integrates four widely used, publicly available datasets: ERA5, PRISM, DAYMET, and IMERG. To prepare the data for ORBIT-2 model training and evaluation, we applied a preprocessing pipeline that generates paired low-resolution and high-resolution samples, enabling supervised downscaling experiments. The transformation from coarse to fine scales was performed using bilinear regridding, consistent with the procedures described in WeatherBench2, a community benchmark for weather and climate AI models. This dataset supports the development and evaluation of foundation models designed for weather and climate downscaling at exascale. Additional details on methodology and applications can be found in Wang et al., ORBIT-2 (arXiv:2505.04802, 2025).

54 ENVIRONMENTAL SCIENCES↗

Enabling Exascale Hardware and Software Design through Scalable System Virtualization (Final Report)

In this grant, we enhanced the Palacios virtual machine monitor to increase its scalability and suitability for addressing exascale system software design issues. This included a wide range of research on core Palacios features, large-scale system emulation, fault injection, perfomrance monitoring, and VMM extensibility. This research resulted in large number of high-impact publications in well-known venues, the support of a number of students, and the graduation of two Ph.D. students and one M.S. student. In addition, our enhanced version of the Palacios virtual machine monitor has been adopted as a core element of the Hobbes operating system under active DOE-funded research and development.

97 MATHEMATICS AND COMPUTING↗

Intelligently Partitioned Phasor-EMT Hybrid Simulations of Large-Scale, High-IBR Power Systems

As the penetration level of power electronics-interfaced renewables such as photovoltaics (PV) and wind has surged in modern electric grids, new operational risks caused by the dynamics of those inverter-based resources (IBRs) are emerging in parallel. Lessons learned from various grid events include that the impact of IBRs on system-level grid stability will become prominent along with the increase of renewables and that the short-timescale dynamic impacts of IBRs on grid stability are not fully captured by current commercial dynamic simulation tools [1] [2]. For example, IBRs can be controlled to mitigate those destabilizing interactions, but conventional phasor-domain tools (e.g. PSS/E, PSLF) often cannot capture that; likewise, the existing electromagnetic transient (EMT) simulation tools (e.g. PSCAD, EMTP) can simulate detailed IBR controls, but for large power systems with many IBRs, slow simulation speeds severely impede the ability to study dynamic events [3] [4]. Massively paralleling simulations using high-performance computing (HPC) can help address this, especially now that cloud-based HPC capability is widely available, but today s EMT tools are not HPC-compatible, and parallelization of dynamic simulation solvers is not trivial because each region can dynamically affect the others. Thus, dynamic simulation of grids with very large numbers of IBRs potentially poses a barrier to the ongoing energy transition.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Impacts of Small-Scale Heterogeneity on Large-Scale Subsurface Flow

Discussion of NETL's CT scanning and core characterization capabilities, followed by a rapid review of several recent publications that utilize these capabilities to answer reservoir questions at the micro scale with relevance to field scale operations.

core characterization↗

Proposed New STELLA-2 Tests

In 2025, KAERI and Argonne initiated a collaboration based on software validation using data from tests performed at KAERI’s STELLA-2 facility. STELLA-2 is a large-scale sodium thermal-hydraulic test facility that was originally developed to support KAERI’s development of the PGSFR design concept. KAERI has performed a large number of tests at STELLA-2, providing valuable data to support sodium fast reactor code validation. KAERI will be conducting new tests in 2026, targeting system conditions that were not achieved during previous test campaigns. KAERI has requested from Argonne proposed tests that could be performed during the upcoming test campaign. This report documents Argonne’s proposed tests in fulfillment of KAERI’s request.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Confinement Exploiting Arrays of Cross-Flow Turbines (ConExT) (Final Scientific/Technical Report)

Final technical report for the ARPA-E SHARKS project: Confinement Exploiting Arrays of Cross-Flow Turbines (ConExT). This involved collaboration by the University of Washington, University of Wisconsin, National Renewable Energy Laboratory, and Oberon Insights. Cost-effective, large-scale utilization of tidal and river current resources requires turbine arrays. Most array concepts involve multiple, staggered rows of turbines analogous to wind farms. However, in water, turbines that have an appreciable projected area (i.e., the projected area over a full revolution) relative to a channel’s cross-sectional area can theoretically extract far more energy than when operating in isolation. This suggests substantial benefits to a confinement-exploiting approach to array layout, in which turbines are more densely clustered in a single row spanning a channel. The objective of this project was to move this concept from theory to practice, as well as establishing environmental and economic trade-offs. This objective was accomplished through scale-model experimentation, high-fidelity computational fluid dynamic simulation, and integrated techno-economic modeling.

16 TIDAL AND WAVE POWER↗

A Large-Scale Hardware Experiment Demonstration of Operating High Inverter-Based Resource Power Systems With Grid-Forming Inverters

This paper presents experimental hardware results from a microgrid system as the penetration level of grid-forming (GFM) inverters increases. The experiment aims to showcase the advantages of GFM inverters in enhancing system stability and to investigate the operational challenges in systems relying entirely on inverter-based resources (IBRs). Five test scenarios are devised to progressively increase GFM inverter penetration levels: 0% (S1), 19% (S2), 37% (S3), 68% (S4), and 100% (S5). To ensure consistency, identical loading conditions and dynamic events are applied across all scenarios. The conducted tests include load step changes, output variation of grid-following (GFL) inverters during islanded mode, transition operations (such as synchronization to the grid and islanding), and rateof- change-of-frequency (ROCOF) and voltage jump tests during grid-connected mode. Key findings from the tests are summarized as follows: (1) Scenario S1 proved most challenging for load steps, and GFL variations because of insufficient GFM capacity, leaving the diesel generator unable to handle transient ridethrough; (2) Scenario S5 was the most difficult for transition operations, because the lack of a diesel generator to maintain stiff bus voltage resulted in unexpected reactive power flows during synchronization, causing the point of common coupling (PCC) breaker to trip; (3) Scenarios S4 and S5 were particularly challenging for ROCOF tests because of minimal system inertia, leading to large transients that triggered breaker trips; and (4) Scenario S4 exhibited the strongest voltage recovery capability because of the presence of the diesel generator and a higher number of GFM inverters, both of which possess the highest capacity for reactive power injection.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Multiscale and Machine Learning Modeling for Process-informed Microstructure Prediction in Additively Manufactured Materials using MALAMUTE

The Advanced Materials and Manufacturing Technologies (AMMT) program under the Department of Energy Office of Nuclear Energy aims to develop and qualify additively manufactured materials for nuclear applications. One key challenge to this is the microstructural variability observed in the additively manufactured products and their impact on the properties and performance of the material in extreme environments. AMMT is using a combination of high-throughput experimental and modeling techniques to accelerate qualification. Conventionally, in-situ and ex-situ characterizations and testing are performed to correlate different aspects of the additive manufacturing process to the final product and its performance. However, adopting a trial-and-error approach to experimentally evaluate the vast range of process parameters required to capture microstructural variability is cost-prohibitive. Modeling and simulation provide a comparatively inexpensive way to understand and correlate the microstructural evolution to the processing conditions. The modeling and simulation work-packages within the AMMT program aims to use physics-based and machine learning models to develop a digital twin for additive manufacturing that can correlate the process conditions to the final product and establish a process-structure-property-performance (PSPP) correlation. The melting and subsequent solidification that occurs during the additive process is a complex phenomenon that requires multiscale multiphysics analysis. This work package focuses on understanding the role of process variabilities on the unique microstructural characteristics of additively manufactured materials. Microstructural features at the subgrain level, such as compositional micro-heterogeneity and dislocation cells, are of particular interest here since they can influence the creep properties and radiation performance. Idaho National Laboratory’s Multiphysics Object-Oriented Simulation Environment (MOOSE), specifically the MOOSE Application Library for Advanced Manufacturing UTilitiEs (MALAMUTE) software, provides an ideal platform for developing the multiphysics multiscale model to explore the intricacies of the microstructural evolution during the AM processes within a single framework. Furthermore, given that such full-fidelity simulations can be computationally intensive, reduced order models are necessary to explore the PSPP space for additively manufactured materials in an efficient, reliable, and cost-effective way. This work focuses on capturing the microstructural variabilities at the subgrain level that are often missing in the part-scale models. In fiscal year 2025, we significantly advanced upon our work in the last fiscal year, in terms of the predictive capabilities of the physics-based and ML models, by adding the capabilities to capture subgrain-level micro-segregation during solidification using phase-field model and to predict the time-dependent dynamics of the AM process through the MOGPAR model. The alloy solidification model in MOOSE incorporates the thermodynamic properties and free energy relevant to 316 stainless steel. The model demonstrates the Cr and Ni segregation that occurs during solidification, including that the rate of solidification. The microstructural evolution model is connected to the process conditions via the surrogate model developed in this work. This enables predictions of the final microstructure in conjunctions with the manufacturing process. This work supports AMMT's rapid qualification goals by laying the foundation for an efficient and cost-effective model establishing the PSPP correlation for AM. The generated microstructures and predicted micro-segregation can be used by other work packages under AMMT to evaluate the properties and environmental response of the material at the mesoscale. Thus, this work helps to identify the key microstructural features at the subgrain level that are significant in property and performance predictions of additively manufactured components. This work will also provide inputs to the large-scale process variability models to reevaluate and validate assumptions and simplifications made in the part-scale models. Furthermore, through active learning this work can help identify the data need from both modeling and experimental sides for development of a robust digital twin for additive manufacturing and accelerate the AMMT's qualification efforts.

36 - MATERIALS SCIENCE↗

ODIN: Probing the LAE Ly α Luminosity Function across Cosmic Time and Different Environments

The ubiquity and relative ease of discovery make 2 ≲ z ≲ 5 Lyα emitting galaxies (LAEs) ideal tracers for large-scale structure of the distant Universe. In addition, because Lyα is a resonance line, but frequently observed at large equivalent width, it is potentially a probe of galaxy evolution. The LAE Lyα luminosity function (LF) is an essential measurement for making progress on both of these topics. Although several studies have computed the LAE LF, very few have delved into how the function varies with environment. The large area and depth of the One-hundred-deg 2 DECam Imaging in Narrowbands (ODIN) survey makes such measurements possible at the cosmic noon redshifts of z ∼ 2.4, 3.1, and 4.5. In this initial work, we present algorithms needed to rigorously compute the LAE LF, and test them on the ∼16,000 ODIN LAEs found in the extended COSMOS field. Using these limited samples, we find weak evidence that protocluster environments suppress the numbers of faint LAEs compared to the field. We also find that the LF decreases in number density and evolves towards a steeper faint-end slope over cosmic time from z ∼ 4.5 to z ∼ 2.4.

Lyman-alpha galaxies↗

On the Properties of Cosmological Ionization Fronts

We investigate the properties of cosmological ionization fronts during the epoch of reionization using the Cosmic Reionization on Computers simulations. By analyzing reionization timing maps, we characterize ionization front velocities and curvatures and their dependence on the density structure of the intergalactic medium (IGM). The velocity distribution of ionization fronts in the simulations indicates that while the barrier-crossing analytical model captures the overall shape in high-velocity regions, it fails to reproduce the low-velocity tail, highlighting the non-Gaussian nature of the IGM’s density field. Ionization front velocities are inversely correlated with local density, propagating faster in underdense regions and more slowly in overdense environments. Faster ionization fronts also lead to higher postionization temperatures, reaching a plateau at ∼2 × 10$^{4}$ K for velocities exceeding 3000 km s$^{−1}$. Examining curvature statistics further establishes a connection between ionization front structure and the normalized density contrast ν, with trends in overdense regions aligning well with barrier-crossing model predictions, while deviations appear in underdense environments due to model limitations. These results provide a detailed characterization of ionization front dynamics and their interaction with the underlying density field, bridging small-scale reionization physics with large-scale observables such as the 21 cm signal and the IGM’s thermal history.

79 ASTRONOMY AND ASTROPHYSICS↗

High-Resolution ESM Projections for Energy Applications Over the CONUS

Assessing energy resources under future scenarios requires high-resolution meteorological information that is physically consistent and suitable for regional-scale analysis. While Earth system model (ESM) projections provide valuable large-scale information, their coarse resolution and systematic biases limit direct applicability for energy system modeling and planning. In this study, we develop a high-resolution dynamical downscaling framework based on the Weather Research and Forecasting (WRF) model to translate global-scale ESM data into energy-relevant regional projections over the contiguous United States (CONUS). The framework identifies an optimized WRF configuration through numerical experiments and evaluates raw and bias-corrected ESM initial and boundary conditions, with soil moisture (SM) and soil temperature (ST) bias correction implemented as an integral part of the bias-corrected ESM forcing to improve land-atmosphere coupling prior to WRF dynamical downscaling. Using an optimized WRF configuration at 4-km resolution, we show that raw ESM forcing introduces systematic dry and cold soil biases that propagate into pronounced warm biases in near-surface air temperature and positive biases in solar irradiance, particularly during summer. Applying bias-corrected atmospheric forcing together with bias-corrected SM and ST substantially reduces these downstream biases and improves the surface energy balance and near-surface atmospheric fields. These results demonstrate that bias-aware treatment of initial conditions is critical for producing high-resolution downscaled projections suitable for energy system modeling and planning applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗

There and Back Again: Reimagining Cryogenic Cooling for Scalable Arrays of Dilution Refrigerators for future Quantum Datacenters

While pulse tube cryocoolers enabled the rapid expansion of dilution refrigerator technology over the past two decades, the transition to large-scale quantum systems is now driving a reassessment of the DR’s higher-temperature-stage cooling strategies and how these systems can be effectively scaled in a modular way. Quasi-wet architectures based on centralized cryoplants and forced-flow helium distribution offer compelling advantages in energy efficiency, operational cost, and scalability. With appropriate redundancy, standardized interfaces, and optimized distribution system designs, these architectures will provide a practical and robust path forward for the next generation of quantum computing infrastructure.

Hansen, B. [Fermilab]↗