Search NASA⌕ Search

SEARCH · Search NASA

Results for “large scale network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Data Federation Challenges in Remote Near-Real-Time Fusion Experiment Data Processing

Fusion energy experiments and simulations provide critical information needed to plan future fusion reactors. As next-generation devices like ITER move toward long-pulse experiments, analyses, including AI and ML, should be performed in a wide range of time and computing constraints, from near-real-time constraints, between-shot analysis, and to campaign-wide long-term analysis. However, the data volume, velocity, and variety make it extremely challenging for analyses using only local computational resources. Researchers need the ability to compose and execute workflows spanning edge resources to large-scale high-performance computing facilities.We present Delta, a system to address data analysis challenges, including AI/ML, in fusion science, by leveraging the ADIOS I/O library and middleware, to support executing science workflows over the wide area network for near-real-time streaming. We discuss the data federation challenges in performing remote workflows, focusing on on-going research work in (1) managing, reducing, and streaming data to minimize I/O and data movement overheads, (2) decompressing and reorganizing data for analysis, and (3) executing workflows for automated data analysis. We introduce examples for deep-learning based data analysis for the fusion domain and demonstrate how we use Delta to construct end-to-end workflows for a fusion device in Korea, connecting a remote DOE facility in the USA. The capability demonstrated by this project is the basis for improving the state of the art for near-real-time data federation amongst remote facilities.

Choi, Jong Youl↗
DOE OSTI2025

A constraint-based framework for exploring the impact of multireaction dependencies on metabolic functions

Abstract Metabolism operates under physico-chemical constraints that result in multireaction dependencies. Understanding how multireaction dependencies affect metabolic phenotypes remains challenging, hindering their biotechnological applications. Here, we propose the concept of a forcedly balanced complex that allows to efficiently determine the effects of specific multireaction dependencies on metabolic network functions in constrained-based models. Using this concept, we found that the fraction of multireaction dependencies induced by forcedly balanced complexes in genome-scale metabolic networks followed power law with exponential cut-off. We identified forcedly balanced complexes that are lethal in cancer but have little effect on growth in healthy tissue models. In addition, these forcedly balanced complexes are largely specific to models of particular cancer types. Therefore, multireaction dependencies resulting from forced balancing of complexes represent an innovative means to control cancers that, we argue, can be implemented via transporter engineering. The presented constraint-based approaches pave the way for using multireaction dependencies in metabolic engineering for diverse biotechnological applications.

Küken, Anika↗
DOE OSTI2020

Machine learning enabled discovery of application dependent design principles for two-dimensional materials

Abstract The unique electronic and mechanical properties of two-dimensional (2D) materials make them promising next-generation candidates for a variety of applications. Large-scale searches for high-performing 2D materials are limited to calculating descriptors with computationally demanding first-principles density functional theory. In this work, we alleviate this issue by extending and generalizing crystal graph convolutional neural networks to systems with planar periodicity and train an ensemble of models to predict thermodynamic, mechanical and electronic properties. We carry out a screening of nearly 45,000 structures for two separate applications: mechanical strength and photovoltaics. By collecting statistics of the screened candidates, we investigate structural and compositional design principles that impact the properties of the structures surveyed. Our approach recovers some well-accepted design rules: hybrid organic-inorganic perovskites with lead and tin tend to be good candidates for solar cell applications and titanium based MXenes usually have high stiffness coefficients. Interestingly, other members of the group 4 elements also contribute to increasing the mechanical strength of MXenes. For all-inorganic perovskites, we discover some compositions that have not been deeply studied in the field of photovoltaics and thus open up paths for further investigation. We open-source the code-base to spur further development in this space.

Venturi, Victor (ORCID:0000000156727549)↗
DOE OSTI2023

Fundamental effective temperature measurements for eclipsing binary stars – IV. Selection of new benchmark stars and first results for HD 22064

I describe the selection and initial characterization of 20 eclipsing binary stars that are suitable for calibration and testing of stellar models and data analysis algorithms used by the PLATO mission and spectroscopic surveys. The binary stars selected are F-/G-type dwarf stars with M-type dwarf companions that contribute less than 2 per cent of the flux at optical wavelengths. The light curves typically show well-defined total eclipses with very little variability between the eclipses. I have used near-infrared spectra obtained by the APOGEE survey to measure the spectroscopic orbit for both stars in HD 22064. Combined with an analysis of the TESS light curve, I derive the following masses and radii: M 1 = 1.35 ± 0.03M ⊙ , M 2 = 0.58 ± 0.01M ⊙ , R 1 = 1.554 ± 0.014R ⊙ , R 2 = 0.595 ± 0.008R ⊙ . Using R 1 and the parallax from Gaia EDR3, I find that the primary star’s angular diameter is θ = 0.1035 ± 0.0009 mas. The apparent bolometric flux of the primary star is ${\mathcal {F}}_{{\oplus },0} = (7.51\pm 0.09)\times 10^{-9}$ erg cm -2 s -1 . Hence, this F2V star has an effective temperature $T_{\rm eff,1} = 6763{\rm \, K} \pm 39{\rm \, K}$. HD 22064 is an ideal benchmark star that can be used for ‘end-to-end’ tests of the stellar parameters measured by large-scale spectroscopic surveys or stellar parameters derived from asteroseismology with PLATO. The techniques described here for HD 22064 can be applied to the other eclipsing binaries in the sample in order to create an all-sky network of such benchmark stars.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Young but fading radio sources: searching for remnants among compact steep-spectrum radio sources

The incidence of young but fading radio sources provides important information on the life cycle of radio emission in radio-loud active galactic nuclei. Despite its importance for constraining the models of radio source evolution, there are no systematic studies of remnants in complete samples of young radio sources. We report results of the study of 18 compact steep-spectrum (CSS) radio sources, selected from the statistically complete B3-VLA (Very Large Array) CSS sample, characterized by a steep optically thin spectrum (α ≥ 1.0) and no core detection in earlier studies. Our deep multifrequency VLA, pc-scale Very Long Baseline Array, and enhanced Multi Element Remotely Linked Interferometer Network (e-MERLIN) observations allowed us to locate the core component in 10 objects. In three CSS sources, there is no clear evidence of present-time active regions, suggesting that they are likely in a remnant phase. Among sources with core detection, we find three objects that have no clear active regions (hotspots) at the edges of the radio structure, suggesting that the radio emission may have just restarted. Our results support a power-law distribution of the source ages, although the poor statistics prevents us from setting solid constraints on the percentage of remnants and restarted sources in subpopulations of radio sources.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Simulating lossy Gaussian boson sampling with matrix-product operators

Gaussian boson sampling, a computational model that is widely believed to admit quantum supremacy, has already been experimentally demonstrated and is claimed to surpass the classical simulation capabilities of even the most powerful supercomputers today. However, whether the current approach limited by photon loss and noise in such experiments prescribes a scalable path to quantum advantage is an open question. Here, to understand the effect of photon loss on the scalability of Gaussian boson sampling, we analytically derive the asymptotic operator entanglement entropy scaling, which relates to the simulation complexity. As a result, we observe that efficient tensor network simulations are likely possible under the N out ∝ √N scaling of the number of surviving photons N out in the number of input photons N. We numerically verify this result using a tensor network algorithm with U⁡(1) symmetry, and we overcome previous challenges due to the large local Hilbert-space dimensions in Gaussian boson sampling with hardware acceleration. Additionally, we observe that increasing the photon number through larger squeezing does not increase the entanglement entropy significantly. Finally, we numerically find the bond dimension necessary for fixed accuracy simulations, providing more direct evidence for the complexity of tensor networks.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2026

HydraGNN v5.0

HydraGNN v5.0 expands the code base into a more portable, scalable, and flexible framework for scientific graph learning, with particular strength in atomistic machine-learning interatomic potentials and large-scale distributed training. The release adds Fully Sharded Data Parallel (FSDP) support alongside existing DDP and DeepSpeed paths, including FSDP-aware checkpointing and optimizer integration, and introduces a configurable multi-precision training workflow supporting FP32, BF16, and FP64 across GPUs and Intel XPUs. For atomistic modeling, HydraGNN v5.0 strengthens its MLIP capabilities through dynamic graph construction at every forward pass, energy-conserving force prediction via automatic differentiation, and per-atom energy loss formulations, while extending EGNN models to properly handle periodic boundary conditions. The release also broadens model expressiveness through graph-level attribute conditioning, adds new multi-task and model-parallel extensions such as MACE support and encoder/decoder branch optimization, and expands application coverage with integrated examples for datasets including OC25, Nabla2-DFT, QCML, Open Polymers 2026, and OPF. In parallel, HydraGNN v5.0 improves production readiness through performance optimizations for large-scale runs, stratified sampling and linear-regression preprocessing utilities, and tested installation scripts for DOE supercomputers including Frontier, Aurora, Perlmutter, and Andes. Overall, the release advances HydraGNN as a robust software platform for scalable graph neural networks across materials science, chemistry, and scientific machine learning workflows

Lupo Pasini, Massimiliano [Oak Ridge National Labo↗
DOE OSTI2023

Design and implementation of I/O performance prediction scheme on HPC systems through large-scale log analysis

Abstract Large-scale high performance computing (HPC) systems typically consist of many thousands of CPUs and storage units used by hundreds to thousands of users simultaneously. Applications from large numbers of users have diverse characteristics, such as varying computation, communication, memory, and I/O intensity. A good understanding of the performance characteristics of each user application is important for job scheduling and resource provisioning. Among these performance characteristics, I/O performance is becoming increasingly important as data sizes rapidly increase and large-scale applications, such as simulation and model training, are widely adopted. However, predicting I/O performance is difficult because I/O systems are shared among all users and involve many layers of software and hardware stack, including the application, network interconnect, operating system, file system, and storage devices. Furthermore, updates to these layers and changes in system management policy can significantly alter the I/O behavior of applications and the entire system. To improve the prediction of the I/O performance on HPC systems, we propose integrating information from several different system logs and developing a regression-based approach to predict the I/O performance. Our proposed scheme can dynamically select the most relevant features from the log entries using various feature selection algorithms and scoring functions, and can automatically select the regression algorithm with the best accuracy for the prediction task. The evaluation results show that our proposed scheme can predict the write performance with up to 90% prediction accuracy and the read performance with up to 99% prediction accuracy using the real logs from the Cori supercomputer system at NERSC.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Crossing the Cleft: Communication Challenges Between Neuroscience and Artificial Intelligence

Historically, neuroscience principles have heavily influenced artificial intelligence (AI), for example the influence of the perceptron model, essentially a simple model of a biological neuron, on artificial neural networks. More recently, notable recent AI advances, for example the growing popularity of reinforcement learning, often appear more aligned with cognitive neuroscience or psychology, focusing on function at a relatively abstract level. At the same time, neuroscience stands poised to enter a new era of large-scale high-resolution data and appears more focused on underlying neural mechanisms or architectures that can, at times, seem rather removed from functional descriptions. While this might seem to foretell a new generation of AI approaches arising from a deeper exploration of neuroscience specifically for AI, the most direct path for achieving this is unclear. Here we discuss cultural differences between the two fields, including divergent priorities that should be considered when leveraging modern-day neuroscience for AI. For example, the two fields feed two very different applications that at times require potentially conflicting perspectives. We highlight small but significant cultural shifts that we feel would greatly facilitate increased synergy between the two fields.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Machine Learning for Synchrophasor Analysis

The report presents results from the development of a cloud-based, Big Data analysis framework for power systems. The computational pipeline uses the Apache Spark framework running in an OpenStack cloud infrastructure. A real-world phasor measurement unit (PMU) dataset has been used to carry out the analysis. Several Machine Learning (ML) methods have been developed and implemented for event and anomaly detection and classification. Actual examples of power system events detection and analysis using synchrophasor data are presented. It has been shown that applications of the cloud-based computing environment and the Apache Spark framework enable a significant increase in the computational efficiency of large-scale PMU data analysis.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2020

Optimizing the hypre solver for manycore and GPU architectures

The solution of large-scale combustion problems with codes such as Uintah on modern computer architectures requires the use of multithreading and GPUs to achieve performance. Uintah uses a low-Mach number approximation that requires iteratively solving a large system of linear equations. The Hypre iterative solver has solved such systems in a scalable way for Uintah, but the use of OpenMP with Hypre leads to at least slowdown due to OpenMP overheads. The proposed solution uses the MPI Endpoints within Hypre, where each team of threads acts as a different MPI rank. This approach minimizes OpenMP synchronization overhead and performs as fast or (up to 1.44) faster than Hypre's MPI-only version, and allows the rest of Uintah to be optimized using OpenMP. The profiling of the GPU version of Hypre shows the bottleneck to be the launch overhead of thousands of micro-kernels. The GPU performance was improved by fusing these micro-kernels and was further optimized by using Cuda-aware MPI, resulting in an overall speedup of 1.16—1.44 compared to the baseline GPU implementation. The above optimization strategies were published in the International Conference on Computational Science 2020 [1]. This work extends the previously published research by carrying out the second phase of communication-centered optimizations in Hypre to improve its scalability on large-scale supercomputers. Additionally, this includes an efficient non-blocking inter-thread communication scheme, communication-reducing patch assignment, and expression of logical communication parallelism to a new version of the MPICH library that utilizes the underlying network parallelism [2]. The above optimizations avoid communication bottlenecks previously observed during strong scaling and improve performance by up to 2 on 256 nodes of Intel Knight's Landing processor.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Acid–Base Chemistry of a Model IrO 2 Catalytic Interface

Iridium oxide (IrO 2 ) is one of the most efficient catalytic materials for the oxygen evolution reaction (OER), yet the atomic scale structure of its aqueous interface is largely unknown. Herein, the hydration structure, proton transfer mechanisms and acid-base properties of the rutile IrO 2 (110)-water interface are investigated using ab-initio based deep neural-network potentials and enhanced sampling simulations. The proton affinities of the different surface sites are characterized by calculating their acid dissociation constants, which yield a point of zero-charge in good agreement with experiments. A large fraction (≈ 80%) of adsorbed water dissociation is observed, together with a short lifetime (≈ 0.5 ns) of the resulting terminal hydroxy groups, due to rapid proton exchanges between adsorbed H 2 O and adjacent OH species. As a result, this rapid surface proton transfer supports the suggestion that the rate-determining step in the OER may not involve proton transfer across the double layer into solution, as indicated by recent experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Prokaryotic responses to a warm temperature anomaly in northeast subarctic Pacific waters

Recent studies on marine heat waves describe water temperature anomalies causing changes in food web structure, bloom dynamics, biodiversity loss, and increased plant and animal mortality. However, little information is available on how water temperature anomalies impact prokaryotes (bacteria and archaea) inhabiting ocean waters. This is a nontrivial omission given their integral roles in driving major biogeochemical fluxes that influence ocean productivity and the climate system. Here we present a time-resolved study on the impact of a large-scale warm water surface anomaly in the northeast subarctic Pacific Ocean, colloquially known as the Blob, on prokaryotic community compositions. Multivariate statistical analyses identified significant depth- and season-dependent trends that were accentuated during the Blob. Moreover, network and indicator analyses identified shifts in specific prokaryotic assemblages from typically particle-associated before the Blob to taxa considered free-living and chemoautotrophic during the Blob, with potential implications for primary production and organic carbon conversion and export.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

ROBIN (RuciO/BIgData Express/SENSE) A Next-Generation High-Performance Data Service Platform

Increasingly, scientific research discoverydepends on the analysis of extremely large amounts of data. Thisdata is gathered through very large scientific instruments, verylarge numbers of small devices, and mid-scale instruments.These devices generate exponentially increasing volumes of data.Such data is often obtained, analyzed, stored, visualized, andtransferred at and among sites world-wide by largecollaborations of science communities. Managing and movingextremely large volumes of data across today’s networks is aspecial multidimensional challenge. Also, existing datamanagement and movement services and tools often areinadequate to address all specific requirements. This paperdescribes the various components of this challenge and howthose issues can be addressed by ROBIN, a uniquecomprehensive set of integrated services designed specificallyfor managing and moving extremely large amounts of data overlong distances, e.g., thousands of miles around the globe. Thispaper also describes the results of initial experiments using thatset of integrated services.

Wu, Wenji↗
DOE OSTI2020

Multi-Stage and Multi-Timescale Robust Co-Optimization Planning for Reliable and Sustainable Power Systems. Final Report

In this project, Clarkson University, in collaboration with Southern Methodist University and University of Pittsburgh, conducted the research to model, design, and implement a sophisticated generation and transmission co-optimization planning decision tool, called Multi-stage and Multi-timescale robust Co-Optimization Planning (MMCOP). The MMCOP decision tool intends to facilitate generation and transmission co-optimization planning of emerging power systems, while mitigating risks and uncertainties in both short-term operation dynamics and long-term policy and technology changes. Long-term power system planning aims at optimizing asset utilization by investing in a proper mix of various generation technologies and transmission lines to supply the future load growth. In particular, the Clean Power Plan (CPP), which is designed to combat climate change and reduce carbon emissions by setting a national limit on carbon pollution from power plants, may dramatically change the landscape of the power industry by further promoting clean energy and phasing out emissions-intensive generation technologies. In addition, novel non-wire alternatives (e.g., demand response (DR), distributed generation (DG), energy efficiency (EE), and smart grid technologies) and the computational complexity for large-scale systems significantly complicate the system planning procedure even further. However, existing conventional planning approaches neglect short-term variability and uncertainty of renewable energy, hourly chronological operation details, and physical nonlinear characteristics of the alternating current transmission network. As a result, existing conventional planning approaches may not work properly, and power systems reliability could be in jeopardy. In observing the limitations of existing conventional planning approaches and addressing new challenges of emerging power systems, the main scope of this project to develop co-optimization planning models within a multi-stage and multi-timescale framework. In particular, random contingencies, key uncertainty factors, and AC power flows are included to derive expansion plans while considering both long-term reliability and short-term flexibility.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

A Dynamic Pore Network Model for Imbibition Simulation Considering Corner Film Flow

Wetting films can develop in the corners of angular pores under strong wetting conditions. Modeling the dynamics of corner film remains elusive using direct numerical simulations because of the significant scale difference between main meniscus and corner film flow. In this paper, the modified interacting capillary bundle model (ICB), developed in our previous work to describe accurately corner film dynamics in a single square tube, is incorporated into a single-pressure dynamic pore network model (DPNM) to simulate imbibition in strongly wetting porous media with corner film flow. The traditional pore network is decomposed into several layers of interacting subpore networks where the 0th layer of subpore network simulates the main meniscus flow and higher layers the corner film flow. The fluid flow between different layers is captured by interlayer throats. In addition, the snap-off mechanism caused by the thickening of wetting corner film is considered. The accuracy of the developed model is validated for four cases: spontaneous imbibition in a single square tube, wetting fluid redistribution through corner films under a capillary pressure difference, snap off in a narrow throat connecting two large pores, and imbibition dynamics in a real microfluidic porous geometry. The validated model is then used to simulate both spontaneous and controlled imbibition in a pore network with random pore size distribution. Finally, the interaction between corner film and main meniscus flow in porous media is analyzed from a pore-scale perspective.

58 GEOSCIENCES↗
DOE OSTI2021

Inference of neutrino flavor evolution through data assimilation and neural differential equations

The evolution of neutrino flavor in dense environments such as core-collapse supernovae and binary compact object mergers constitutes an important and unsolved problem. Its solution has potential implications for the dynamics and heavy-element nucleosynthesis in these environments. In this paper, we build upon recent work to explore inference-based techniques for the estimation of model parameters and neutrino flavor evolution histories. Here, we combine data assimilation, ordinary differential equation solvers, and neural networks to craft an inference approach tailored for nonlinear dynamical systems. Using this architecture, and a simple two-neutrino-beam, two-flavor model, we compare the performances of nine different optimization algorithms and expand upon previous assessments of the efficacy of inference for tackling problems in flavor evolution. We find that employing this new architecture, together with evolutionary optimization algorithms, accurately captures flavor histories in the small-scale model and allows us to quickly explore both model parameters and initial flavor content. In future work we plan to extend these inference techniques to large numbers of neutrinos.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Genome-Wide Transcription Factor DNA Binding Sites and Gene Regulatory Networks in Clostridium thermocellum

Clostridium thermocellum is a thermophilic bacterium recognized for its natural ability to effectively deconstruct cellulosic biomass. While there is a large body of studies on the genetic engineering of this bacterium and its physiology to-date, there is limited knowledge in the transcriptional regulation in this organism and thermophilic bacteria in general. The study herein is the first report of a large-scale application of DNA-affinity purification sequencing (DAP-seq) to transcription factors (TFs) from a bacterium. We applied DAP-seq to > 90 TFs in C. thermocellum and detected genome-wide binding sites for 11 of them. We then compiled and aligned DNA binding sequences from these TFs to deduce the primary DNA-binding sequence motifs for each TF. These binding motifs are further validated with electrophoretic mobility shift assay (EMSA) and are used to identify individual TFs’ regulatory targets in C. thermocellum . Our results led to the discovery of novel, uncharacterized TFs as well as homologues of previously studied TFs including RexA-, LexA-, and LacI-type TFs. We then used these data to reconstruct gene regulatory networks for the 11 TFs individually, which resulted in a global network encompassing the TFs with some interconnections. As gene regulation governs and constrains how bacteria behave, our findings shed light on the roles of TFs delineated by their regulons, and potentially provides a means to enable rational, advanced genetic engineering of C. thermocellum and other organisms alike toward a desired phenotype.

59 BASIC BIOLOGICAL SCIENCES↗