Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multi-tier Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

5 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

FitCache: A Transparent Drop-In Framework for Multi-Tier Caching to Accelerate Distributed Deep Learning Workloads

Training in Deep learning (DL) remains highly compute- and data-intensive, with I/O becoming a critical bottleneck as models and datasets scale. Recent studies report that data loading can dominate training time, especially on large-scale HPC systems with shared parallel file systems (PFS). Existing caching approaches either rely on single-tier designs or require intrusive modifications to training pipelines, limiting their portability and effectiveness. In this work, we present FitCache, a transparent drop-in framework for multi-tier caching to accelerate distributed DL training by coordinating fast local memory (e.g., DRAM, Persistent Memory (PMem)) and NVMe as hierarchical caches atop PFS. Our design adapts to hardware diversity, i.e., if NVMe is missing, memory transparently acts as a caching tier, ensuring stable performance. FitCache transparently intercepts I/O requests and issues concurrent fetches across all tiers, returning data from the fastest responder without centralized metadata or static redirection paths. FitCache adapts to dynamic workloads and heterogeneous clusters while maintaining POSIX compatibility. Experiments on Frontier (2048 GPUs) and smaller research clusters show that FitCache reduces training time by up to 40% and per-batch I/O latency by up to 71.6% compared to Lustre Orion PFS, offering a drop-in solution for scalable DL training.

Hu, Guangxing [ORNL] (ORCID:0009000283203614)↗
DOE OSTI2024

Multitiered computational methodology for extracting three-dimensional rotational diffusion coefficients from x-ray photon correlation spectroscopy data without structural information

X-ray photon correlation spectroscopy (XPCS) is a powerful technique for analyzing particle systems by investigating their dynamics in suspensions across a broad range of temporal and spatial scales. This is done by illuminating samples with coherent x-ray beams and calculating the correlation function of the obtained x-ray scattering images. XPCS is uniquely suited for studying Brownian dynamics, consisting of translational and rotational diffusion. While traditional XPCS image analysis techniques can extract translational diffusion components, they are unable to estimate rotational diffusion coefficients. Here, we introduce a methodology that combines the angular-temporal cross-correlation analysis and a algorithmic framework called Multi-Tiered Estimation for Correlation Spectroscopy in 3D for estimating three-dimensional rotational diffusion coefficients from XPCS images of three-dimensional particle systems. We demonstrate our methodology for extracting rotational diffusion coefficients from XPCS data by applying it to simulated noisy x-ray images of systems of crossing nanotubes and proteins that evolve under translational and rotational Brownian motion for different diffusion rates. Furthermore, our results show that our approach determines rotational diffusion coefficients within a few percent error.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

A U.S. scientific community review of carbon cycle science gaps and opportunities to better support earth system science and carbon management

Greenhouse gas (GHG) emissions continue to grow, while natural carbon reservoirs are becoming increasingly vulnerable to anthropogenic pressures, climate extremes, and disturbance. These changes are impacting humans, ecosystems, and natural resources worldwide. Tracking and mitigating GHG emissions require a pivot to operational monitoring of regional carbon flux and stock changes. The current GHG observing system is addressing needs at two distinct scales: 1) Local scale (< 1 km), related to anthropogenic point source emissions, and 2) global scales (> 1000 km), related to land and ocean carbon sinks. More focus on intermediate (10–1000 km) scales is needed to more effectively monitor progress in reducing carbon emissions, enhancing removals, and maintaining sinks. Representatives from carbon cycle biomass and flux communities across United States government agencies and academic institutions met in September 2024 to discuss the rationale and scientific context for more effectively implementing an operational system for GHG monitoring in support of urban and national carbon management needs. To guide development of this system, we propose a multi-tiered global spaceborne observing framework for carbon flux and stock, prioritizing: 1) frequent GHG partial columns for carbon emissions and removals; 2) continuous time series and data fusion of biomass from Lidar and Synthetic Aperture Radar (SAR) for carbon stocks, and 3) expanded coverage of tropical, high latitude, and oceanic regions to monitor carbon cycle tipping points and feedbacks. This system should be complemented by expanded surface and airborne networks for oceanic and terrestrial/aquatic ecosystems for calibration, ground truthing, and study of under-sampled regions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

An Efficient Storage-Driven Machine Learning Model for Performance in the Era of Multimodal Scientific Data

Scientific workflows are increasingly relying on machine learning (ML), simulation, and hybrid techniques to predict, understand, and optimize the behavior of complex experiments. High-performance computing has greatly improved researchers’ ability to acquire diverse data modalities in these workflows. Recent studies suggest that the performance of machine learning models can be improved by integrating data from various sources. Unfortunately, these workloads pose unprecedent pressure on the network storage to meet the demands associated with accessing these multimodal data. To mitigate the impact of intensive IO, we propose a solution that utilizes a multi-tier High-Performance Computing (HPC) distributed storage and data processing framework, placing computation where the data resides for better performance. By adopting this project, the scientific community will gain new opportunities to explore multimodal storage-driven possibilities, integrating multiple scientific data sources with advanced streaming frameworks. Additionally, our framework effectively utilizes computing resources and bridges the gaps identified by HPC experts. Our proposed approach tackles scalability and persistence challenges by leveraging native persistency, which has posed difficulties in traditional approaches. Furthermore, we seek to enhance fault-tolerance and load-balance of computations by leveraging real-time streaming in diverse scientific computing environments, thereby propelling advanced scientific computing research into the next generation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

SURVEILLANCE DETECTION FOR TRANSPORTATION OPERATIONS PERSONNEL TO PREVENT HIJACKING, THEFT, SABOTAGE, AND MALICIOUS SECURITY EVENTS DURING TRANSPORTING NUCLEAR MATERIAL

The secure transportation of high-consequence materials, including nuclear and radiological assets, is a critical global priority in the face of escalating terrorism, security threats, and violent protests targeting these operations. Effective surveillance detection—the ability to identify, assess, and respond to potential threats across a continuum of scenarios—is paramount in addressing these challenges. This paper outlines a phased, multi-tiered training program designed to strengthen the surveillance detection capabilities of organizations responsible for nuclear material transport. The proposed training program adopts a progressive approach, gradually increasing in technical complexity to provide participants with comprehensive knowledge and tools for implementing robust security strategies. It targets a wide spectrum of stakeholders, including competent authorities, regulators, inspectors, shippers, carriers, law enforcement, and emergency response personnel, equipping them to plan, evaluate, and safeguard nuclear material transportation effectively. Each phase of the program emphasizes distinct elements of the surveillance detection continuum and transport security, focusing on critical topics such as threat identification, adversary task timelines, protective methodologies, and attack mitigation strategies. The training framework is anchored in technical exchanges and scenario-driven courses that reflect real-world complexities and challenges. By addressing the surveillance detection continuum comprehensively—from early threat assessment to active countermeasures—the program reinforces global efforts to secure nuclear assets. It aligns with international security objectives and fosters a strong security culture within participating organizations, ensuring personnel are prepared to counter potential threats and maintain the safe, secure movement of these materials. Ultimately, this initiative aims to enhance preparedness, security, and response capabilities, supporting the global mission to safeguard high-consequence materials against evolving threats.

Zineddin, Dr. Z. [ORNL] (ORCID:0009000848740725)↗