Search NASA⌕ Search

SEARCH · Search NASA

Results for “Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Neural networks for modeling and control of particle accelerators

Charged particle accelerators support a wide variety of scientific, industrial, and medical applications. They range in scale and complexity from systems with just a few components for beam acceleration and manipulation, to large scientific user facilities that span many kilometers and have hundreds-to-thousands of individually-controllable components. Specific operational requirements must be met by adjusting the many controllable variables of the accelerator. Meeting these requirements can be challenging, both in terms of the ability to achieve specific beam quality metrics in a reliable fashion and in terms of the time needed to set up and maintain the optimal operating conditions. One avenue toward addressing this challenge is to incorporate techniques from the fields of machine learning (ML) and artificial intelligence (AI) into the way particle accelerators are modeled and controlled. While many promising approaches within AI/ML could be used for particle accelerators, this dissertation focuses on approaches based on neural networks. Neural networks are particularly well-suited to modeling, control, and diagnostic analysis of nonlinear systems, as well as systems with large parameter spaces. They are also very appealing for their ability to process high-dimensional data types, such as images and time series (both of which are ubiquitous in particle accelerators). In this work, key studies that demonstrated the potential utility of modern neural network-based approaches to modeling and control of particle accelerators are presented. The context for this work is important: at the start of this work in 2012, there was little interest in AI/ML in the particle accelerator community, and many of the advances in neural networks and deep learning that enabled its present success had not yet been made at that time. As such, this work was both an exploration of possible application areas and a generator of proof-of-concept demonstrations in these areas.

43 PARTICLE ACCELERATORS↗

New Techniques and Data for Understanding the Global Soil Respiration Flux

Abstract Soil respiration ( R s ; the soil surface‐to‐atmosphere CO 2 flux) has been measured in the field for decades, but only recently have we begun to assemble and leverage these small‐scale but extensive data. Recently, Zhao et al. (2017, https://doi.org/10.1002/2016ef000480 ) applied a novel artificial neural network model to the problem of estimating the global R s flux and understanding its variations between regions and biomes. Their results point to a convergence in estimates of global R s , and the power of leveraging the long record of observed R s in global ecosystems, but also to uncertainties about soils' response to climate change. It will take a combination of long‐term studies, data syntheses, modeling intercomparisons, and probably a new generation of sampling networks and experiments to fully resolve these questions.

Bond‐Lamberty, Ben↗

Multi-Node Thermal System Model for Lithium-Ion Battery Packs: Preprint

Temperature is one of the main factors that controls the degradation in lithium ion batteries. Accurate knowledge and control of cell temperatures in a pack helps the battery management system (BMS) to maximize cell utilization and ensure pack safety and service life. In a pack with arrays of cells, a cells temperature is not only affected by its own thermal characteristics but also by its neighbors, the cooling system and pack configuration, which increase the noise level and the complexity of cell temperatures prediction. This work proposes to model lithium ion packs thermal behavior using a multi-node thermal network model, which predicts the cell temperatures by zones. The model was parametrized and validated using commercial lithium-ion battery packs. neighbors, the cooling system and pack configuration, which increase the noise level and the complexity of cell temperatures prediction. This work proposes to model lithium ion packs thermal behavior using a multi-node thermal network model, which predicts the cell temperatures by zones. The model was parametrized and validated using commercial lithium-ion battery packs.

25 ENERGY STORAGE↗

Performance Evaluation of Vertical Federated Machine Learning Against Adversarial Threats on Wide-Area Control System: Preprint

Federated machine learning (FL) is gaining significant popularity to develop cybersecurity solutions in power grids because of its advanced capability to support decentralized data handing at local devices, its privacy preservation, and its low-bandwidth requirement. However, the evolving adversarial machine learning (AML) threats raise significant concerns for the cybersecurity of FL architectures. The FL-based split neural network (SplitNN) achieves high performance through the decentralized training of local neural network models while preserving data privacy across multiple entities. In this paper, we propose a methodology for evaluating the performance of a vertical FLbased anomaly detector against different types of AML attacks, including denial-of-service attacks, adversarial data injection attacks, and replay attacks on the trained local models deployed in the grid network. For a case study, we consider the modified IEEE 13-bus system, and we develop SplitNN-based binary and multiclass classification models to detect, locate, and identify different types of data integrity attacks on the volt-watt control with two pooling layers: maximum pooling and AvgPool. Our experimental results, computed through performance metrics, reveal that the severity of these AML attacks varies with the integrated pooling mechanism, the type of classification model, and the nature of the cyberattack. Further, the AML attacks negatively impacted the prediction time per sample for the pretrained SplitNN during the online testing.

adversarial threats↗

Fifth-Generation District Heating and Cooling Substations: Demand Response with Artificial Neural Network-Based Model Predictive Control

District heating and cooling (DHC) is considered one of the most sustainable technologies to meet the heating and cooling demands of buildings in urban areas. The fifth-generation district heating and cooling (5GDHC) concept, often referred to as ambient loops, is a novel solution emerging in Europe and has become a widely discussed topic in current energy system research. 5GDHC systems operate at a temperature close to the ground and include electrically driven heat pumps and associated thermal energy storage in a building-sited energy transfer station (ETS) to satisfy user comfort. This work presents new strategies for improving the operation of these energy transfer stations by means of a model predictive control (MPC) method based on recurrent artificial neural networks. The results show that, under simple time-of-use utility rates, the advanced controller outperforms a rule-based controller for smart charging of the domestic hot water (DHW) thermal energy storage under specific boundary conditions. By exploiting the available thermal energy storage capacity, the MPC controller is capable of shifting up to 14% of the electricity consumption of the ETS from on-peak to off-peak hours. Therefore, the advanced control implemented in 5GDHC networks promotes coupling between the thermal and the electric sector, producing flexibility on the electric grid.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Spiral waves in externally excited neuronal network: Solvable model with a monotonically differentiable magnetic flux

Spiral waves are particular spatiotemporal patterns connected to specific phase singularities representing topological wave dislocations or nodes of zero amplitude, witnessed in a wide range of complex systems such as neuronal networks. The appearance of these waves is linked to the network structure as well as the diffusion dynamics of its blocks. We report a novel form of the Hindmarsh-Rose neuron model utilized as a square neuronal network, showing the remarkable multistructure of dynamical patterns ranging from characteristic spiral wave domains of spatiotemporal phase coherence to regions of hyperchaos. The proposed model comprises a hyperbolic memductance function as the monotone differentiable magnetic flux. Hindmarsh-Rose neurons with an external electromagnetic excitation are considered in three different cases: no excitation, periodic excitation, and quasiperiodic excitation. We performed an extensive study of the neuronal dynamics including calculation of equilibrium points, bifurcation analysis, and Lyapunov spectrum. We have found the property of antimonotonicity in bifurcation scenarios with no excitation or periodic excitation and identified wide regions of hyperchaos in the case of quasiperiodic excitation. Furthermore, the formation and elimination of the spiral waves in each case of external excitation with respect to stimuli parameters are investigated. We have identified novel forms of Hindmarsh-Rose bursting dynamics. Our findings reveal multipartite spiral wave formations and symmetry breaking spatiotemporal dynamics of the neuronal model that may find broad practical applications. © 2019 Author(s).

60 APPLIED LIFE SCIENCES↗

CANA v1.0.0: efficient quantification of canalization in automata networks

The biomolecular networks underpinning cell function exhibit canalization, or the buffering of fluctuations required to function in a noisy environment. We present a new major release of $\tt{CANA}$, v1.0.0, an open-source Python package for understanding canalization in automata network models, discrete dynamical systems in which activation of biomolecular entities (e.g. transcription of genes) is modeled as the activity of coupled automata. One understudied putative mechanism for canalization is the functional equivalence of biomolecular regulators (e.g. among the transcription factors for a gene). We study this mechanism using the theory of symmetry in discrete functions. We present a new exact method, $\tt{schematodes}$, for finding maximal symmetry groups among the inputs to discrete functions, and integrate it into $\tt{CANA}$. The $\tt{schematodes}$ method substantially outperforms the inexact method of previous $\tt{CANA}$ versions both in speed and accuracy. We apply $\tt{CANA}$ v1.0.0 to study symmetry in 74 experimentally supported automata network models from the Cell Collective (CC) repository. The symmetry distribution is significantly different in the CC than in random automata with the same in-degree (connectivity) and bias (average output) (Kolmogorov–Smirnov test, P ≪ .001). Its spread is much wider than in a null model (IQR 0.31 versus IQR 0.20 with equal medians), demonstrating that the CC is enriched in functions with extreme symmetry or asymmetry.

Boolean networks↗

Measurement and modelling of reactive transport in geological barriers for nuclear waste containment

Compacted clays are considered as excellent candidates for barriers to radionuclide transport in future repositories for nuclear waste due to their very low hydraulic permeability. Diffusion is the dominant transport mechanism, controlled by a nano-scale pore system. Assessment of the clays' long-term containment function requires adequate modelling of such pore systems and their evolution. Existing characterisation techniques do not provide complete pore space information for effective modelling, such as pore and throat size distributions and connectivity. Special network models for reactive transport are proposed here using the complimentary character of the pore space and the solid phase. Here, this balances the insufficient characterisation information and provides the means for future mechanical–physical–chemical coupling. The anisotropy and heterogeneity of clays is represented using different length parameters and percentage of pores in different directions. Resulting networks are described as mathematical graphs with efficient discrete calculus formulation of transport. Opalinus Clay (OPA) is chosen as an example. Experimental data for the tritiated water (HTO) and U(VI) diffusion through OPA are presented. Calculated diffusion coefficients of HTO and uranium species are within the ranges of the experimentally determined data in different clay directions. This verifies the proposed pore network model and validates that uranium complexes are diffusing as neutral species in OPA. In the case of U(VI) diffusion the method is extended to account for sorption and convection. Finally, rather than changing pore radii by coarse grained mathematical formula, physical sorption is simulated in each pore, which is more accurate and realistic.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Hydropower Optimization Using Artificial Neural Network Surrogate Models of a High-Fidelity Hydrodynamics and Water Quality Model

Hydropower operations optimization subject to environmental constraints is limited by challenges associated with dimensionality and spatial and temporal resolution. The need for high-fidelity hydrodynamic and water quality models within optimization schemes is driven by improved computational capabilities, increased requirements to meet specific points of compliance with greater resolution, and the need to optimize operations of not just single reservoirs but systems of reservoirs. This study describes an important advancement for computing hourly power generation schemes for a hydropower reservoir using high-fidelity models, surrogate modeling techniques, and optimization methods. The predictive power of the high-fidelity hydrodynamic and water quality model CE-QUAL-W2 is successfully emulated by an artificial neural network, then integrated into a genetic algorithm optimization approach to maximize hydropower generation subject to constraints on dam operations and water quality. This methodology is applied to a multipurpose reservoir near Nashville, Tennessee, USA. The model successfully reproduced high-fidelity reservoir information while enabling 6.8% and 6.6% increases in hydropower production value relative to actual operations for dissolved oxygen (DO) limits of 5 and 6 mg/L, respectively, while witnessing an expected decrease in power generation at more restrictive DO constraints. Exploration of simultaneous temperature and DO constraints revealed capability to address multiple water quality constraints at specified locations. Here, the reduced computational requirements of the new modeling approach demonstrated an ability to provide decision support for reservoir operations scheduling while maintaining high-fidelity hydrodynamic and water quality information as part of the optimization decision support routines.

13 HYDRO ENERGY↗

Microstructure from joint analysis of experimental data and ab initio interactions: Hydrogenated amorphous silicon

A study of the formation of voids and molecular hydrogen in hydrogenated amorphous silicon is presented based upon a hybrid approach that involves inversion of experimental nuclear magnetic resonance data in conjunction with ab initio total-energy relaxations in an augmented solution space. The novelty of this approach is that the voids and molecular hydrogen appear naturally in the model networks unlike conventional approaches, where voids are created artificially by removing silicon atoms from the networks. Two representative models with 16 and 18 at. % of hydrogen are studied in this work. The result shows that the microstructure of the a-Si:H network consists of several microvoids and few molecular hydrogen for concentration above 15 at. % H. The microvoids are highly irregular in shape and size, and have a linear dimension of 5–7 Å. The internal surface of a microvoid is found to be decorated with 4–9 hydrogen atoms in the form of monohydride Si–H configurations as observed in nuclear magnetic resonance experiments. The microstructure consists of (0.9–1.4)% hydrogen molecules of total hydrogen in the networks. These observations are consistent with the outcome of infrared spectroscopy, nuclear magnetic resonance, and calorimetry experiments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Beyond toy models: distilling tensor networks in full AdS/CFT

We present a general procedure for constructing tensor networks that accurately reproduce holographic states in conformal field theories (CFTs). Given a state in a large-N CFT with a static, semiclassical gravitational dual, we build a tensor network by an iterative series of approximations that eliminate redundant degrees of freedom and minimize the bond dimensions of the resulting network. We argue that the bond dimensions of the tensor network will match the areas of the corresponding bulk surfaces. For “tree” tensor networks (i.e., those that are constructed by discretizing spacetime with nonintersecting Ryu-Takayanagi surfaces), our arguments can be made rigorous using a version of one-shot entanglement distillation in the CFT. Using the known quantum error correcting properties of AdS/CFT, we show that bulk legs can be added to the tensor networks to create holographic quantum error correcting codes. These codes behave similarly to previous holographic tensor network toy models, but describe actual bulk excitations in continuum AdS/CFT. By assuming some natural generalizations of the “holographic entanglement of purification” conjecture, we are able to construct tensor networks for more general bulk discretizations, leading to finer-grained networks that partition the information content of a Ryu-Takayanagi surface into tensor-factorized subregions. While the granularity of such a tensor network must be set larger than the string/Planck scales, we expect that it can be chosen to lie well below the AdS scale. However, we also prove a no-go theorem which shows that the bulk-to-boundary maps cannot all be isometries in a tensor network with intersecting Ryu-Takayanagi surfaces.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

CO 2 storage in the Paluxy formation at the Kemper County CO 2 storage complex: Pore network properties and simulated reactive permeability evolution

The Paluxy formation is being considered as a prospective CO 2 reservoir at the Kemper County CO 2 Storage Complex. Herein, the pore and pore-throat size distributions and connectivity of the Paluxy formation is evaluated through analysis of 3D X-ray Computed Tomography images. In spite of resolution limitations that constrain the pore-throat sizes detectable by imaging, the permeability contributing pore-throats are successfully characterized through 3D imaging analysis. Image-obtained pore and pore-throat size distributions and pore connectivity are then utilized to construct pore network models and simulate permeability. After CO 2 is injected, it will dissolve into formation brine and create conditions favorable for dissolution of primary minerals and precipitation of secondary minerals. These reactions will alter the porosity and permeability of the system to varying degrees depending on the spatial location of reactions. In this research, the possible porosity-permeability evolution is simulated using pore network models considering mineral reactions occurring uniformly and non-uniformly throughout the network. For a given change in porosity, there is a large range of possible permeability outcomes. Depending on the extent and spatial location of mineral reactions, permeability may decrease by more than one order of magnitude as minerals precipitate. During dissolution, simulated permeability increases as much as 500%.

03 NATURAL GAS↗

Thinking outside the channel: Modeling nitrogen cycling in networked river ecosystems

Agricultural and urban development alters nitrogen and other biogeochemical cycles in rivers worldwide. Because such biogeochemical processes cannot be measured empirically across whole river networks, simulation models are critical tools for understanding river-network biogeochemistry. However, limitations inherent in current models restrict our ability to simulate biogeochemical dynamics among diverse river networks. We illustrate these limitations using a river-network model to scale up in situ measures of nitrogen cycling in eight catchments spanning various geophysical and land-use conditions. Our model results provide evidence that catchment characteristics typically excluded from models may control river-network biogeochemistry. Based on our findings, we identify important components of a revised strategy for simulating biogeochemical dynamics in river networks, including approaches to modeling terrestrial-aquatic linkages, hydrologic exchanges between the channel, floodplain/riparian complex, and subsurface waters, and interactions between coupled biogeochemical cycles.

54 ENVIRONMENTAL SCIENCES↗

Holographic measurement and bulk teleportation

Holography has taught us that spacetime is emergent and its properties depend on the entanglement structure of the dual theory. In this paper, we describe how changes in the entanglement due to a local projective measurement (LPM) on a subregion A of the boundary theory modify the bulk dual spacetime. We find that LPMs destroy portions of the bulk geometry, yielding post-measurement bulk spacetimes dual to the complementary unmeasured region A c that are cut off by end-of-the-world branes. Using a bulk calculation in AdS 3 and tensor network models of holography (in particular, the HaPPY code and random tensor networks), we show that the portions of the bulk geometry that are preserved after the measurement depend on the size of A and the state we project onto. The post-measurement bulk dual to A c includes regions that were originally part of the entanglement wedge of A prior to measurement. This suggests that LPMs performed on a boundary subregion A teleport part of the bulk information originally encoded in A into the complementary region A c . In semiclassical holography an arbitrary amount of bulk information can be teleported in this way, while in tensor network models the teleported information is upper-bounded by the amount of entanglement shared between A and A c due to finite-N effects. When A is the union of two disjoint subregions, the measurement triggers an entangled/disentangled phase transition between the remaining two unmeasured subregions, corresponding to a connected/disconnected phase transition in the bulk description. Our results shed new light on the effects of measurement on the entanglement structure of holographic theories and give insight on how bulk information can be manipulated from the boundary theory. They could also represent a first step towards a holographic description of measurement-induced phase transitions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Integrating the Design of Desalination Technologies into Produced Water Network Optimization

The oil and gas energy sector uses billions of gallons of water for hydraulic fracturing each year to extract oil and gas. The water injected into the ground for fracturing along with naturally occurring formation water from oil wells surfaces back in the form of produced water. Produced water can contain high concentrations of total dissolved solids and is unfit for reuse outside the oil and gas industry without desalination. In semi-arid shale plays, produced water desalination for beneficial reuse could play a crucial role in alleviating water shortages and addressing extreme drought conditions. In this poster we co-optimize the design and operation of desalination technologies along with operational decisions across produced water networks. A multi-period produced water network model with simplified split-fraction-based desalination nodes is developed. Rigorous steady-state desalination mathematical models based on mechanical vapor recompression are developed and embedded at the desalination sites in the network model. An optimal common design across all periods is ensured using global capacity constraints. The solution approach is demonstrated for multi-period planning problems on networks from the PARETO open-source library. Model formulation and challenges associated with scalability are discussed.

Naik, Sakshi↗

Integrating the Design of Desalination Technologies into Produced Water Network Optimization

The oil and gas energy sector uses billions of gallons of water for hydraulic fracturing each year to extract oil and gas. The water injected into the ground for fracturing along with naturally occur-ring formation water from the oil wells surfaces back in the form of produced water. Produced water can contain high concentrations of total dissolved solids and is unfit for reuse outside the oil and gas industry without desalination. In semi-arid shale plays, produced water desalination for beneficial reuse could play a crucial role in alleviating water shortages and addressing extreme drought conditions. In this paper we co-optimize the design and operation of desalination technologies along with operational decisions across produced water networks. A multi-period produced water network model with simplified split-fraction-based desalination nodes is developed. Rigorous steady-state desalination mathematical models based on mechanical vapor recompression are developed and embedded at the desalination sites in the network model. An optimal common design is ensured across all periods using global capacity constraints. The solution approach is demonstrated for multi-period planning problems on networks from the PARETO open-source library. Model formulation and challenges associated with scalability are discussed.

Naik, Sakshi↗

Simultaneously improving accuracy and computational cost under parametric constraints in materials property prediction tasks

Abstract Modern data mining techniques using machine learning (ML) and deep learning (DL) algorithms have been shown to excel in the regression-based task of materials property prediction using various materials representations. In an attempt to improve the predictive performance of the deep neural network model, researchers have tried to add more layers as well as develop new architectural components to create sophisticated and deep neural network models that can aid in the training process and improve the predictive ability of the final model. However, usually, these modifications require a lot of computational resources, thereby further increasing the already large model training time, which is often not feasible, thereby limiting usage for most researchers. In this paper, we study and propose a deep neural network framework for regression-based problems comprising of fully connected layers that can work with any numerical vector-based materials representations as model input. We present a novel deep regression neural network, iBRNet, with branched skip connections and multiple schedulers, which can reduce the number of parameters used to construct the model, improve the accuracy, and decrease the training time of the predictive model. We perform the model training using composition-based numerical vectors representing the elemental fractions of the respective materials and compare their performance against other traditional ML and several known DL architectures. Using multiple datasets with varying data sizes for training and testing, We show that the proposed iBRNet models outperform the state-of-the-art ML and DL models for all data sizes. We also show that the branched structure and usage of multiple schedulers lead to fewer parameters and faster model training time with better convergence than other neural networks. Scientific contribution: The combination of multiple callback functions in deep neural networks minimizes training time and maximizes accuracy in a controlled computational environment with parametric constraints for the task of materials property prediction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

HydroForecast Long-term: Improving hydropower’s resilience to climate change through accurate climate-scale

With hydrologic patterns and water availability across the globe shifting due to climate change, advancements in hydrologic prediction systems can help significantly reduce the uncertainties that utilities and water supply entities have in their decision making. Understanding and estimating hydrology at the climate scale is critical for managing water resources under changing climate scenarios. This project focuses on integrating state-of-the-art neural network modeling with downscaled climate projections to deliver the reliable water supply projections decades into the future to meet an urgent need from hydropower operators and water utilities. In this Phase 1 DOE SBIR proposal, we developed and validated a theory-guided neural network model, HydroForecast Long-term, for climate-scale hydrology and implemented the model within existing HydroForecast infrastructure. HydroForecast Long-term combines the most accurate streamflow modeling system with a flexible and scalable data architecture to generate water supply projections out to the year 2100. This report illustrates that we have achieved our four objectives: 1) create a prototype of HydroForecast Long-term, building the neural network prediction model, 2) build an automated data input pipeline that processes large amounts of data from the latest global temperature and precipitation climate models; 3) benchmark the accuracy of the hydrologic model over the recent two decades over a large set of diverse basins, and 4) create a set of output visuals and summary metrics informed by customer feedback that connect the data to critical decision points. This work empowers water users to make data-informed decisions supporting a resilient, renewable-powered grid and water system. The results advance the Department of Energy’s mission by addressing critical gaps in water supply planning under climate change.

13 HYDRO ENERGY↗