Search NASA⌕ Search

SEARCH · Search NASA

Results for “large scale network”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

FlowPM: Distributed TensorFlow implementation of the FastPM cosmological N-body solver

Here, we present FlowPM, a Particle-Mesh (PM) cosmological N-body code implemented in Mesh-TensorFlow for GPU-accelerated, distributed, and differentiable simulations. We implement and validate the accuracy of a novel multi-grid scheme based on multiresolution pyramids to compute large-scale forces efficiently on distributed platforms. We explore the scaling of the simulation on large-scale supercomputers and compare it with corresponding Python based PM code, finding on an average 10x speed-up in terms of wallclock time. We also demonstrate how this novel tool can be used for efficiently solving large scale cosmological inference problems, in particular reconstruction of cosmological fields in a forward model Bayesian framework with hybrid PM and neural network forward model. We provide skeleton code for these examples and the entire code is publicly available at https://github.com/modichirag/flowpm[Formula presented].

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Foundations of Rigorous Cyber Experimentation

This report presents the results of the “Foundations of Rigorous Cyber Experimentation” (FORCE) Laboratory Directed Research and Development (LDRD) project. This project is a companion project to the “Science and Engineering of Cyber security through Uncertainty quantification and Rigorous Experimentation” (SECURE) Grand Challenge LDRD project. This project leverages the offline, controlled nature of cyber experimentation technologies in general, and emulation testbeds in particular, to assess how uncertainties in network conditions affect uncertainties in key metrics. We conduct extensive experimentation using a Firewheel emulation-based cyber testbed model of Invisible Internet Project (I2P) networks to understand a de-anonymization attack formerly presented in the literature. Our goals in this analysis are to see if we can leverage emulation testbeds to produce reliably repeatable experimental networks at scale, identify significant parameters influencing experimental results, replicate the previous results, quantify uncertainty associated with the predictions, and apply multi-fidelity techniques to forecast results to real-world network scales. The I2P networks we study are up to three orders of magnitude larger than the networks studied in SECURE and presented additional challenges to identify significant parameters. The key contributions of this project are the application of SECURE techniques such as UQ to a scenario of interest and scaling the SECURE techniques to larger network sizes. This report describes the experimental methods and results of these studies in more detail. In addition, the process of constructing these large-scale experiments tested the limits of the Firewheel emulation-based technologies. Therefore, another contribution of this work is that it informed the Firewheel developers of scaling limitations, which were subsequently corrected.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Global droughts connected by linkages between drought hubs

Abstract Quantifying the spatial and interconnected structure of regional to continental scale droughts is one of the unsolved global hydrology problems, which is important for understanding the looming risk of mega-scale droughts and the resulting water and food scarcity and their cascading impact on the worldwide economy. Using a Complex Network analysis, this study explores the topological characteristics of global drought events based on the self-calibrated Palmer Drought Severity Index. Event Synchronization is used to measure the strength of association between the onset of droughts at different spatial locations within the time lag of 1-3 months. The network coefficients derived from the synchronization network indicate a highly heterogeneous connectivity structure underlying global drought events. Drought hotspot regions such as Southern Europe, Northeast Brazil, Australia, and Northwest USA behave as drought hubs that synchronize regionally and with other hubs at inter-continental or even inter-hemispheric scale. This observed affinity among drought hubs is equivalent to the ‘rich-club phenomenon’ in Network Theory, where ‘rich’ nodes (here, drought hubs) are tightly interconnected to form a club, implicating the possibility of simultaneous large-scale droughts over multiple continents.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗
DOE OSTI2022

Scalable algorithms for physics-informed neural and graph networks

Physics-informed machine learning (PIML) has emerged as a promising new approach for simulating complex physical and biological systems that are governed by complex multiscale processes for which some data are also available. In some instances, the objective is to discover part of the hidden physics from the available data, and PIML has been shown to be particularly effective for such problems for which conventional methods may fail. Unlike commercial machine learning where training of deep neural networks requires big data, in PIML big data are not available. Instead, we can train such networks from additional information obtained by employing the physical laws and evaluating them at random points in the space–time domain. Such PIML integrates multimodality and multifidelity data with mathematical models, and implements them using neural networks or graph networks. Here, we review some of the prevailing trends in embedding physics into machine learning, using physics-informed neural networks (PINNs) based primarily on feed-forward neural networks and automatic differentiation. For more complex systems or systems of systems and unstructured data, graph neural networks (GNNs) present some distinct advantages, and here we review how physics-informed learning can be accomplished with GNNs based on graph exterior calculus to construct differential operators; we refer to these architectures as physics-informed graph networks (PIGNs). We present representative examples for both forward and inverse problems and discuss what advances are needed to scale up PINNs, PIGNs and more broadly GNNs for large-scale engineering problems.

42 ENGINEERING↗
DOE OSTI2023

Evaluation of global teleconnections in CMIP6 climate projections using complex networks

In climatological research, the evaluation of climate models is one of the central research subjects. As an expression of large-scale dynamical processes, global teleconnections play a major role in interannual to decadal climate variability. Their realistic representation is an indispensable requirement for the simulation of climate change, both natural and anthropogenic. Therefore, the evaluation of global teleconnections is of utmost importance when assessing the physical plausibility of climate projections. We present an application of the graph-theoretical analysis tool δ-MAPS, which constructs complex networks on the basis of spatio-temporal gridded data sets, here sea surface temperature and geopotential height at 500 hPa. Complex networks complement more traditional methods in the analysis of climate variability, like the classification of circulation regimes or empirical orthogonal functions, assuming a new non-linear perspective. While doing so, a number of technical tools and metrics, borrowed from different fields of data science, are implemented into the δ-MAPS framework in order to overcome specific challenges posed by our target problem. Those are trend empirical orthogonal functions (EOFs), distance correlation and distance multicorrelation, and the structural similarity index. δ-MAPS is a two-stage algorithm. In the first place, it assembles grid cells with highly coherent temporal evolution into so-called domains. In a second step, the teleconnections between the domains are inferred by means of the non-linear distance correlation. We construct 2 unipartite and 1 bipartite network for 22 historical CMIP6 climate projections and 2 century-long coupled reanalyses (CERA-20C and 20CRv3). Potential non-stationarity is taken into account by the use of moving time windows. The networks derived from projection data are compared to those from reanalyses. Our results indicate that no single climate projection outperforms all others in every aspect of the evaluation. But there are indeed models which tend to perform better/worse in many aspects. Differences in model performance are generally low within the geopotential height unipartite networks but higher in sea surface temperature and most pronounced in the bipartite network representing the interaction between ocean and atmosphere.

58 GEOSCIENCES↗
DOE OSTI2023

All-polymer organic solar cells with nano-to-micron hierarchical morphology and large light receiving angle

Distributed photovoltaics in living environment harvest the sunlight in different incident angles throughout the day. The development of planer solar cells with large light-receiving angle can reduce the requirements in installation form factor and is therefore urgently required. Here, thin film organic photovoltaics with nano-sized phase separation integrated in micro-sized surface topology is demonstrated as an ideal solution to proposed applications. All-polymer solar cells, by means of a newly developed sequential processing, show large magnitude hierarchical morphology with facilitated exciton-to-carrier conversion. The nano fibrilar donor-acceptor network and micron-scale optical field trapping structure in combination contributes to an efficiency of 19.06% (certified 18.59%), which is the highest value to date for all-polymer solar cells. Furthermore, the micron-sized surface topology also contributes to a large light-receiving angle. A 30% improvement of power gain is achieved for the hierarchical morphology comparing to the flat-morphology devices. These inspiring results show that all-polymer solar cell with hierarchical features are particularly suitable for the commercial applications of distributed photovoltaics due to its low installation requirement.

14 SOLAR ENERGY↗
DOE OSTI2022

Sensory stimulation for upper limb amputations modulates adaptability of cortical large-scale systems and combination of somatosensory and visual inputs

Abstract Touch-like phantom limb sensations can be elicited through targeted transcutaneous electrical nerve stimulation (tTENS) in individuals with upper limb amputation. The corresponding impact of sensory stimulation on cortical activity remains an open question. Brain network research shows that sensorimotor cortical activity is supported by dynamic changes in functional connections between relevant brain regions. These groups of interconnected regions are functional modules whose architecture enables specialized function and related neural processing supporting individual task needs. Using electroencephalographic (EEG) signals to analyze modular functional connectivity, we investigated changes in the modular architecture of cortical large-scale systems when participants with upper limb amputations performed phantom hand movements before, during, and after they received tTENS. We discovered that tTENS substantially decreased the flexibility of the default mode network (DMN). Furthermore, we found increased interconnectivity (measured by a graph theoretic integration metric) between the DMN, the somatomotor network (SMN) and the visual network (VN) in the individual with extensive tTENS experience. While for individuals with less tTENS experience, we found increased integration between DMN and the attention network. Our results provide insights into how sensory stimulation promotes cortical processing of combined somatosensory and visual inputs and help develop future tools to evaluate sensory combination for individuals with amputations.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

An intercomparison of wall fluxes in a turbulent thermal convection chamber: Direct numerical simulations and wall-modeled large-eddy simulations enhanced by machine learning

Thermal convection in a closed chamber is driven by a warm bottom, a cold top, and side walls at various temperatures. Although wall fluxes are the source of convection energy, accurately modeling these fluxes (i.e., the wall model) is challenging. In large-eddy simulations (LESs), many wall models are traditionally derived from the canonical boundary layer, which may be unsuitable for thermal convection bounded by both horizontal and vertical walls. This study conducts a model intercomparison of dry convection in a cubic-meter chamber using three direct numerical simulations (DNSs) and four LESs with different wall models. The LESs employ traditional wall models, a new wall model employing physics-aware neural networks, and a refined grid near the walls. The experiment involves four cases with varying sidewall temperatures. Our results show that LESs capture the main flow features and the trends of mean fluxes. The physics-aware neural networks and refined wall grids can improve the temporally averaged local fluxes when the large-scale circulation has a preferred direction. Even without the local improvement of wall fluxes, the LES flow quantities (temperature and velocities) can still largely match those in DNSs, provided the mean flux largely matches the DNSs. Additionally, DNSs reveal that a variation in corner treatments has minimal impacts on the flow quantities away from corners. Finally, LESs underestimate the mean fluxes of the entire wall due to their inability to resolve corner regions, but their mean flux away from the corner can better match DNS.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

An implementation of neural simulation-based inference for parameter estimation in ATLAS

Neural simulation-based inference (NSBI) is a powerful class of machine-learning-based methods for statistical inference that naturally handles high-dimensional parameter estimation without the need to bin data into low-dimensional summary histograms. Such methods are promising for a range of measurements, including at the Large Hadron Collider, where no single observable may be optimal to scan over the entire theoretical phase space under consideration, or where binning data into histograms could result in a loss of sensitivity. This work develops a NSBI framework for statistical inference, using neural networks to estimate probability density ratios, which enables the application to a full-scale analysis. It incorporates a large number of systematic uncertainties, quantifies the uncertainty due to the finite number of events in training samples, develops a method to construct confidence intervals, and demonstrates a series of intermediate diagnostic checks that can be performed to validate the robustness of the method. As an example, the power and feasibility of the method are assessed on simulated data for a simplified version of an off-shell Higgs boson couplings measurement in the four-lepton final states. This approach represents an extension to the standard statistical methodology used by the experiments at the Large Hadron Collider, and can benefit many physics analyses.

frequentist statistics↗
DOE OSTI2024

Machine-learning based approach to examine ecological processes influencing the diversity of riverine dissolved organic matter composition

Dissolved organic matter (DOM) assemblages in freshwater rivers are formed from mixtures of simple to complex compounds that are highly variable across time and space. These mixtures largely form due to the environmental heterogeneity of river networks and the contribution of diverse allochthonous and autochthonous DOM sources. Most studies are, however, confined to local and regional scales, which precludes an understanding of how these mixtures arise at large, e.g., continental, spatial scales. The processes contributing to these mixtures are also difficult to study because of the complex interactions between various environmental factors and DOM. Here we propose the use of machine learning (ML) approaches to identify ecological processes contributing toward mixtures of DOM at a continental-scale. We related a dataset that characterized the molecular composition of DOM from river water and sediment with Fourier-transform ion cyclotron resonance mass spectrometry to explanatory physicochemical variables such as nutrient concentrations and stable water isotopes ( 2 H and 18 O). Using unsupervised ML, distinctive clusters for sediment and water samples were identified, with unique molecular compositions influenced by environmental factors like terrestrial input and microbial activity. Sediment clusters showed a higher proportion of protein-like and unclassified compounds than water clusters, while water clusters exhibited a more diversified chemical composition. We then applied a supervised ML approach, involving a two-stage use of SHapley Additive exPlanations (SHAP) values. In the first stage, SHAP values were obtained and used to identify key physicochemical variables. These parameters were employed to train models using both the default and subsequently tuned hyperparameters of the Histogram-based Gradient Boosting (HGB) algorithm. The supervised ML approach, using HGB and SHAP values, highlighted complex relationships between environmental factors and DOM diversity, in particular the existence of dams upstream, precipitation events, and other watershed characteristics were important in predicting higher chemical diversity in DOM. Our data-driven approach can now be used more generally to reveal the interplay between physical, chemical, and biological factors in determining the diversity of DOM in other ecosystems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Intense cyclic heating effects on thermo-fracture and thermal shock of solid tungsten and open-cell tungsten foam

Here we investigate here the effects of transient (cyclic) arc-jet plasma and laser heating on fracture behavior of W-foam and solid tungsten. The two key parameters that control the foam thermomechanical response are its density and mean cell size expressed in Pores Per Inch (PPI). Tungsten foam samples were fabricated with Chemical Vapor Deposition (CVD) with variety of PPI and relative density. These were tested under two types of qualitatively different conditions: (1) high-enthalpy arc-jet, and (2) high-power cyclic laser heating. None of the foam samples showed macroscopic through-thickness cracks. However, distributed micro-cracks were observed on ligaments and their triple junctions. Under the same loading conditions, W-foam and solid tungsten showed similar crack network pattern and characteristic length-scale. However, Crack Opening Displacement (COD) was twice as large in solid W as compared to W-foam. Foam samples that have been previously exposed to a low-pressure helium plasma showed significant changes in their surface forming nano-texture fuzz which was removed by subsequent testing in the arc-jet. Extensive fracture and re-crystallization were observed in the thin solid W disk that was fully-constrained from expansion. Thicker and fully-constrained solid W disks did not display recrystallization, grain growth, and extensive cracking. However, thicker disks that were free to expand showed some recrystallization and extensive through-thickness cracks due to less effective cooling and thus higher temperatures. Laser beam testing showed no visible damage formation at 0.19 GW/m 2 and 0.38 GW/m 2 for both low-density (23%) and high-density (43%) foams at low pulses (100-1000). Micro-cracks were observed after 10,000 pulses at 0.19 GW/m 2 in both foams, and in low-density foam after 100,000 at 0.38 GW/m 2 . The nature of thermomechanical damage in W-foam exposed to extreme power (GW/m 2 ) short-duration laser pulses was found to be qualitatively similar to that of high power (MW/m 2 ) long-duration arc-jet.

36 MATERIALS SCIENCE↗
DOE OSTI2023

EXSCLAIM!: Harnessing materials science literature for self-labeled microscopy datasets

This work introduces the EXSCLAIM! toolkit for the automatic extraction, separation, and caption-based natural language annotation of images from scientific literature. EXSCLAIM! is used to show how rule-based natural language processing and image recognition can be leveraged to construct an electron microscopy data set containing thousands of keyword-annotated nanostructure images. Moreover, it is demonstrated how a combination of statistical topic modeling and semantic word similarity comparisons can be used to increase the number and variety of keyword annotations on top of the standard annotations from EXSCLAIM! With large-scale imaging datasets constructed from scientific literature, users are well positioned to train neural networks for classification and recognition tasks specific to microscopy-tasks often otherwise inhibited by a lack of sufficient annotated training data.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Large-scale spatially explicit analysis of carbon capture at cellulosic biorefineries

The large-scale production of cellulosic biofuels would involve spatially distributed systems including biomass fields, logistics networks and biorefineries. Better understanding of the interactions between landscape-related decisions and the design of biorefineries with carbon capture and storage (CCS) in a supply chain context is needed to enable efficient systems. Here we analyse the cost and greenhouse gas mitigation potential for cellulosic biofuel supply chains in the US Midwest using realistic spatially explicit land availability and crop productivity data and consider fuel conversion technologies with detailed CCS design for their associated CO 2 streams. Optimization methods identify trade-offs and design strategies leading to systems with attractive environmental and economic performance. Strategic and operational decisions depend on underlying spatial features and are sensitive to biofuel demand and CCS incentives. US CCS incentives neglect to motivate greenhouse gas mitigation from all supply chain emission sources, which leverage spatial interactions between CCS, electricity prices and the biomass landscape.

09 BIOMASS FUELS↗
DOE OSTI2022

A Stability Analysis Tool for Bulk Power Systems Using Black-Box Models of Inverter-based Resources

This paper presents a small-signal stability analysis tool for large-scale power systems with high penetration of inverter-based resources (IBRs). Firstly, a network transfer function matrix (NTFM), which represents the information of the system topology, transmission lines, loads, IBRs locations, etc., is derived to model the entire power system network. Secondly, small-signal perturbation method is applied to obtain the sequence impedance/admittance responses of IBRs considering the frequency cross-coupling effects. With the obtained NTFM as well as IBRs' models, a multi-input, multi-output (MIMO) feedback system is constructed, and the generalized Nyquist criterion (GNC)-based stability method is employed to analyze the stability of the entire power system. Different testing cases based on a modified IEEE-14 bus system are leveraged to verify the proposed stability analysis tool.

Sun, Dongsen↗
DOE OSTI2023

A Stability Analysis Tool for Bulk Power Systems Using Black-Box Models of Inverter-Based Resources

This paper presents a small-signal stability analysis tool for large-scale power systems with high penetration of inverter-based resources (IBRs). Firstly, a network transfer function matrix (NTFM), which represents the information of the system topology, transmission lines, loads, IBRs locations, etc., is derived to model the entire power system network. Secondly, small-signal perturbation method is applied to obtain the sequence impedance/admittance models of the block-box IBRs considering the frequency cross-coupling effects. With the obtained NTFM as well as IBR models, a multi-input, multi-output (MIMO) feedback system is constructed, and the generalized Nyquist criterion (GNC)-based stability method is employed to analyze the stability of the entire power system. Furthermore, based on the developed stability analysis method, sensitivity analysis is conducted on an unstable case to identify which parameter has a high impact on the system stability. As a result, different test cases based on a modified IEEE 14- bus system as well as a reduced 240-bus WECC system are studied to verify the proposed stability analysis tool.

42 ENGINEERING↗
DOE OSTI2020

A Two-Stage Decomposition Approach for AC Optimal Power Flow

The alternating current optimal power flow (AC-OPF) problem is critical to power system operations and planning, but it is generally hard to solve due to its nonconvex and large-scale nature. Furthermore, this paper proposes a scalable decomposition approach in which the power network is decomposed into a master network and a number of subnetworks, where each network has its own AC-OPF subproblem. This formulates a two-stage optimization problem and requires only a small amount of communication between the master and subnetworks. The key contribution is a smoothing technique that renders the response of a subnetwork differentiable with respect to the input from the master problem, utilizing properties of the barrier problem formulation that naturally arises when subproblems are solved by a primal-dual interior-point algorithm. Consequently, existing efficient nonlinear programming solvers can be used for both the master problem and the subproblems. The advantage of this framework is that speedup can be obtained by processing the subnetworks in parallel, and it has convergence guarantees under reasonable assumptions. The formulation is readily extended to instances with stochastic subnetwork loads. Numerical results show favorable performance and illustrate the scalability of the algorithm which is able to solve instances with more than 11 million buses.

24 POWER TRANSMISSION AND DISTRIBUTION↗