Search NASA⌕ Search

SEARCH · Search NASA

Results for “Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

Air Quality Impacts of Liquefied Natural Gas In the South Coast Air Basin Of California

The effects of liquefied natural gas (LNG) on pollutant emission inventories and air quality in the South Coast Air Basin of California were evaluated using recent LNG emission measurements by Lawrence Berkeley National Laboratory and the Southern California Gas Company (SoCalGas), and with a state-of-the-art air quality model. Pollutant emissions can be affected by LNG owing to differences in composition and physical properties, including the Wobbe index, a measure of energy delivery rate. This analysis uses LNG distribution scenarios developed by modeling Southern California gas flows, including supplies from the LNG receiving terminal in Baja California, Mexico. Based on these scenarios, the projected penetratino of LNG in the South Coast Air Basin is expected to be limited. In addition, the increased Wobbe index of delivered gas (resulting from mixtures of LNG and conventional gas supplies) is expected to cause increases smaller than 0.05 percent in overall (area-wide) emissions of nitrogen oxides (NOx). BAsed on the photochemical state of the South Coast Air Basin, any increase in NOx is expected to cause an increase in the highest local ozone concentrations, and this is reflected in model results. However, the magnitude of the increase is well below the generally accepted accuracy of the model and would not be discernible with the existing monitoring network. Modeling of hypothetical scenarios indicates that discernible changes to ambient ozone and particulate matter concentrations would occur only at LNG distribution rates that are not achievable with current or planned infrastructure and with Wobbe index vlaues that exceed current gas quality tariffs. Results of these hypothetical scenarios are presented for consideration of any proposed substantial expansion of LNG supply infrastructure in Southern California.

03 NATURAL GAS↗

Surrogate Model of Flexible Research Platform EnergyPlus Models to Enable Sensitivity Analysis

This letter report describes the surrogate models developed from the EnergyPlus model of Oak Ridge National Laboratory’s Flexible Research Platform. Two data-driven black-box models were developed, and the outputs of the surrogate models were compared with the EnergyPlus model. The two models developed are a multilayer perceptron deep learning model, and a long short-term memory (LSTM) neural network model. The three factors for selecting the black-box models are scalability, computation time, and accuracy. A total of 107 input variables were the dominant variables in determining the outputs of building energy consumptions and thermal comfort. A total of 54 output variables were identified as the prediction targets, including the system- and zone-level outputs. The large set of the simulation cases were generated by integrating sensor errors into an emulator based on EnergyPlus and Python EMS, which includes advanced control sequences from ASHRAE Guideline 36-2018: High-Performance Sequences of Operation. The surrogate models were developed based on a set of large-scale simulation runs (i.e., 4,000 runs) on a cloud platform. The comparison analysis shows that the two black-box models had good accuracy for predicting new outputs for sensitivity analysis using the root mean square error metric. As a next step, the developed surrogate models will be used to perform sensitivity analysis for different sensor impacts (e.g., sensor types, sensor locations).

42 ENGINEERING↗

1D Modeling for the Development of a Digital Twin for Hydropower Systems with Applications for a Testing Rig

Modeling and simulation constitute two important parts in constructing a sensible digital twin to mimic the dynamics of hydropower systems. Because of the physical nature of a hydropower system, the basic modeling should cover the water flow systems from the reservoir to the penstock (inlet water pipes), penstock to hydro turbine, and hydro turbine to generator and from the linkage of the hydropower systems to the grid. This report describes initial attempts to model these dynamic components, including the formulation of the linearized state space model for hydro turbine systems using the well-known six-coefficients linearization method and the formulation of the voltage and power dynamical models of a synchronous generator. To validate the accuracy of the proposed model, data collected from Norwegian University of Science and Technology were used to obtain relevant parameters for the model, and the desired simulation results were obtained. Additionally, neural network modeling and learning were also developed and applied to model the generation torque and water flow rate subsystems to demonstrate a potential learning scheme, which can be used in the development of a digital twin.

13 HYDRO ENERGY↗

Estimating vehicle fuel economy from overhead camera imagery and application for traffic control

In this work, we explore the ability to estimate vehicle fuel consumption using imagery from overhead fisheye lens cameras deployed as traffic sensors. We utilize this information to simulate vision-based control of a traffic intersection, with a goal of improving fuel economy with minimal impact to mobility. We introduce the ORNL Overhead Vehicle Dataset (OOVD), consisting of a data set of paired, labeled vehicle images from a ground-based camera and an overhead fisheye lens traffic camera. The data set includes segmentation masks based on Gaussian mixture models for vehicle detection. We show the dataset utility through three applications: the estimate of fuel consumption based on segmentation bounding boxes, vehicle discrimination for those vehicles with largest bounding boxes, and a fine-grained classification on a limited number of vehicle makes and models using a pre-trained set of convolutional neural network models. We compare these results with estimates based on a large open-source data set based on web-scraped imagery. Finally, we show the utility of the approach using reinforcement learning in a traffic simulator using the open source Simulation of Urban Mobility (SUMO) package. Our results show the feasibility of the approach for controlling traffic lights for better fuel efficiency based solely on visual vehicle estimates from commercial, fisheye lens cameras.

Karnowski, Thomas↗

CyBERT: Cybersecurity Claim Classification by Fine-Tuning the BERT Language Model

We introduce CyBERT, a cybersecurity feature claims classifier based on bidirectional encoder representations from transformers and a key component in our semi-automated cybersecurity vetting for industrial control systems (ICS). To train CyBERT, we created a corpus of labeled sequences from ICS device documentation collected across a wide range of vendors and devices. This corpus provides the foundation for fine-tuning BERT’s language model, including a prediction-guided relabeling process. We propose an approach to obtain optimal hyperparameters, including the learning rate, the number of dense layers, and their configuration, to increase the accuracy of our classifier. Fine-tuning all hyperparameters of the resulting model led to an increase in classification accuracy from 76% obtained with BertForSequenceClassification’s original architecture to 94.4% obtained with CyBERT. Furthermore, we evaluated CyBERT for the impact of randomness in the initialization, training, and data-sampling phases. CyBERT demonstrated a standard deviation of ±0.6% during validation across 100 random seed values. Finally, we also compared the performance of CyBERT to other well-established language models including GPT2, ULMFiT, and ELMo, as well as neural network models such as CNN, LSTM, and BiLSTM. The results showed that CyBERT outperforms these models on the validation accuracy and the F1 score, validating CyBERT’s robustness and accuracy as a cybersecurity feature claims classifier.

97 MATHEMATICS AND COMPUTING↗

Thermal Analysis of the X-38 Aft Fin During Re-Entry

This document contains the details of the thermal analysis of the X-38 aft fin during re-entry. This analysis was performed in order to calculate temperature response of the aft fin components. This would be provided as input to a structural analysis and would also define the operating environment for the electromechanical actuator (EMA). The calculated structural temperature response would verify the performance of the thermal protection system (TPS). The geometric representation of the aft fin was derived from an I-DEAS finite element model that was used for structural analysis. The thermal mass network model was derived from the geometric representation.

Hong, Andrew E.↗

Modeling and Simulation of Pore Scale Multiphase Fluid Flow and Reactive Transport in Fractured and Porous Media

In the subsurface fluids play a critical role by transporting dissolved minerals, colloids and contaminants (sometimes over long distances), by mediating dissolution and precipitation processes and enabling chemical transformations in solution and at mineral surfaces. Although the complex geometries of fracture apertures, fracture networks and pore spaces may make it difficult to accurately predict fluid flow in saturated (single-phase) subsurface systems, well developed methods are available. The simulation of multiphase fluid flow in the subsurface is much more challenging because of the large density and/or viscosity ratios found in important applications (water/air in the vadose zone, water/oil, water/gas, gas/oil and water/oil/gas in oil reservoirs, water/air/non-aqueous phase liquids (NAPL) in contaminated vadose zone systems and gas/molten rock in volcanic systems, for example). In addition, the complex behavior of fluid-fluid-solid contact lines, and its impact on dynamic contact angles, must also be taken into account, and coupled with the fluid flow. Pore network models and simple statistical physics based models such as the invasion percolation and diffusion-limited aggregation models have been used quite extensively. However, these models for multiphase fluid flow are based on simplified models for pore space geometries and simplified physics. Other methods such a lattice Boltzmann and lattice gas models, molecular dynamics, Monte Carlo methods, and particle methods such as dissipative particle dynamics and smoothed particle hydrodynamics are based more firmly on first principles, and they do not require simplified pore and/or fracture geometries. However, they are less (in some cases very much less) computationally efficient that pore network and statistical physics models. Recently a combination of continuum computation fluid dynamics, fluid-fluid interface tracking or capturing and simple models for the dependence of contact angles on fluid velocity at the contact line has been used to simulate multiphase fluid flow in fracture apertures, fracture networks and pore spaces. Fundamental conservation principles - conservation of momentum, and conservation of mass (or conservation of volume for incompressible fluids) and conservation of energy, as well as symmetries (Galilean invariance and isotropy) are central to the physics of fluids and the models used to simulate them. In molecular and mesoscale models observance of these conservation principles and symmetries at the microscopic level leads to macroscopic fluid dynamics that can be represented by the Navier Stokes equation. The remarkable fact that the flow of all simpe fluids, irrespective of their chemical nature, can be described by the Navier-Stokes equation is a result of these conservation principles and symmetries acting on the molecular level.

99 GENERAL AND MISCELLANEOUS↗

Reinforced dynamics for enhanced sampling in large atomic and molecular systems

A new approach for efficiently exploring the configuration space and computing the free energy of large atomic and molecular systems is proposed, motivated by an analogy with reinforcement learning. There are two major components in this new approach. Like metadynamics, it allows for an efficient exploration of the configuration space by adding an adaptively computed biasing potential to the original dynamics. Like deep reinforcement learning, this biasing potential is trained on the fly using deep neural networks, with data collected judiciously from the exploration and an uncertainty indicator from the neural network model playing the role of the reward function. Parameterization using neural networks makes it feasible to handle cases with a large set of collective variables. This has the potential advantage that selecting precisely the right set of collective variables has now become less critical for capturing the structural transformations of the system. Finally, the method is illustrated by studying the full-atom explicit solvent models of alanine dipeptide and tripeptide, as well as the system of a polyalanine-10 molecule with 20 collective variables.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Predicting Small Molecule Transfer Free Energies by Combining Molecular Dynamics Simulations and Deep Learning

Accurately predicting small molecule partitioning and hydrophobicity is critical in the drug discovery process. There are many heterogeneous chemical environments within a cell and entire human body. For example, drugs must be able to cross the hydrophobic cellular membrane to reach their intracellular targets, and hydrophobicity is an important driving force for drug–protein binding. Atomistic molecular dynamics (MD) simulations are routinely used to calculate free energies of small molecules binding to proteins, crossing lipid membranes, and solvation but are computationally expensive. Machine learning (ML) and empirical methods are also used throughout drug discovery but rely on experimental data, limiting the domain of applicability. We present atomistic MD simulations calculating 15,000 small molecule free energies of transfer from water to cyclohexane. This large data set is used to train ML models that predict the free energies of transfer. We show that a spatial graph neural network model achieves the highest accuracy, followed closely by a 3D-convolutional neural network, and shallow learning based on the chemical fingerprint is significantly less accurate. A mean absolute error of ~4 kJ/mol compared to the MD calculations was achieved for our best ML model. We also show that including data from the MD simulation improves the predictions, tests the transferability of each model to a diverse set of molecules, and show multitask learning improves the predictions. This work provides insight into the hydrophobicity of small molecules and ML cheminformatics modeling, and our data set will be useful for designing and testing future ML cheminformatics methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Parallel Alternative for Energy-Efficient Neural Network Training and Inferencing

Energy efficiency of training and inferencing with large neural network models is a critical challenge facing the future of sustainable large-scale machine learning workloads. This paper introduces an alternative strategy, called phantom parallelism, to minimize the net energy consumption of traditional tensor (model) parallelism, the most energy-inefficient component of large neural network training. The approach is presented in the context of feed-forward network architectures as a preliminary, but comprehensive, proof-of-principle study of the proposed methodology. We derive new forward and backward propagation operators for phantom parallelism, implement them as custom autograd operations within an end-to-end phantom parallel training pipeline and compare its parallel performance and energy-efficiency against those of conventional tensor parallel training pipelines. Formal analyses that predict lower bandwidth and FLOP counts are presented with supporting empirical results on up to 256 GPUs that corroborate these gains. Experiments are shown to deliver ∼50% reduction in the energy consumed to train FFNs using the proposed phantom parallel approach when compared with conventional tensor parallel methods. Additionally, the proposed approach is shown to train smaller phantom models to the same model loss on smaller GPU counts as larger tensor parallel models on larger GPU counts offering the possibility for even greater energy savings.

Seal, Sudip [ORNL] (ORCID:0000000332330656)↗

Metabolic network reconstruction and flux variability analysis of storage synthesis in developing oilseed rape (Brassica napus L.) embryos

Computational simulation of large-scale biochemical networks can be used to analyze and predict the metabolic behavior of an organism, such as a developing seed. Based on the biochemical literature, pathways databases and decision rules defining reaction directionality we reconstructed bna572, a stoichiometric metabolic network model representing Brassica napus seed storage metabolism. In the highly compartmentalized network about 25% of the 572 reactions are transport reactions interconnecting nine subcellular compartments and the environment. According to known physiological capabilities of developing B. napus embryos, four nutritional conditions were defined to simulate heterotrophy or photoheterotrophy, each in combination with the availability of inorganic nitrogen (ammonia, nitrate) or amino acids as nitrogen sources. Based on mathematical linear optimization the optimal solution space was comprehensively explored by flux variability analysis, thereby identifying for each reaction the range of flux values allowable under optimality. The range and variability of flux values was then categorized into flux variability types. Across the four nutritional conditions, approximately 13% of the reactions have variable flux values and 10-11% are substitutable (can be inactive), both indicating metabolic redundancy given, for example, by isoenzymes, subcellular compartmentalization or the presence of alternative pathways. About one-third of the reactions are never used and are associated with pathways that are suboptimal for storage synthesis. Fifty-seven reactions change flux variability type among the different nutritional conditions, indicating their function in metabolic adjustments. This predictive modeling framework allows analysis and quantitative exploration of storage metabolism of a developing B. napus oilseed.

59 BASIC BIOLOGICAL SCIENCES↗

Modeling Temporal Behavior in Large Networks: A Dynamic Mixed-Membership Model

Given a large time-evolving network, how can we model and characterize the temporal behaviors of individual nodes (and network states)? How can we model the behavioral transition patterns of nodes? We propose a temporal behavior model that captures the 'roles' of nodes in the graph and how they evolve over time. The proposed dynamic behavioral mixed-membership model (DBMM) is scalable, fully automatic (no user-defined parameters), non-parametric/data-driven (no specific functional form or parameterization), interpretable (identifies explainable patterns), and flexible (applicable to dynamic and streaming networks). Moreover, the interpretable behavioral roles are generalizable, computationally efficient, and natively supports attributes. We applied our model for (a) identifying patterns and trends of nodes and network states based on the temporal behavior, (b) predicting future structural changes, and (c) detecting unusual temporal behavior transitions. We use eight large real-world datasets from different time-evolving settings (dynamic and streaming). In particular, we model the evolving mixed-memberships and the corresponding behavioral transitions of Twitter, Facebook, IP-Traces, Email (University), Internet AS, Enron, Reality, and IMDB. The experiments demonstrate the scalability, flexibility, and effectiveness of our model for identifying interesting patterns, detecting unusual structural transitions, and predicting the future structural changes of the network and individual nodes.

97 MATHEMATICS AND COMPUTING↗

Stress effects on flow and transport in three-dimensional fracture networks

We investigate the effects of various external stress regimes on fracture apertures, fluid flow, and solute transport in three-dimensional fracture networks. We use well-established geomechanics equations coupled with discrete fracture network modeling to characterize changes in primary flow paths within a complex network as a function of stress magnitude and orientation. These changes manifest in the alterations of the fluid flow field and are measured in terms of Eulerian and Lagrangian flow observables including solute transport, which is a key problem in many hydrologic applications. Changes in primary flow paths affect the solute transport in the network by promoting anomalously early arrival or long tailing behavior. However, early time arrival is not ubiquitous in anisotropically stressed networks and in most cases there is a delayed arrival of solute, which is attributed to (i) the presence of low-velocity zones normal to the flow direction, (ii) the angle between flow direction and major compressive principal stress directions, and (iii) changes in the primary flow paths (i.e., increases in tortuosity and active network structure). Overall, flows become more channelized in anisotropically stressed fracture networks than in unstressed and isotropically stressed networks.

58 GEOSCIENCES↗

Gene loss during a transition to multicellularity

Multicellular evolution is a major transition associated with momentous diversification of multiple lineages and increased developmental complexity. The volvocine algae comprise a valuable system for the study of this transition, as they span from unicellular to undifferentiated and differentiated multicellular morphologies despite their genomes being similar, suggesting multicellular evolution requires few genetic changes to undergo dramatic shifts in developmental complexity. Here, the evolutionary dynamics of six volvocine genomes were examined, where a gradual loss of genes was observed in parallel to the co-option of a few key genes. Protein complexes in the six species exhibited novel interactions, suggesting that gene loss could play a role in evolutionary novelty. This finding was supported by gene network modeling, where gene loss outpaces gene gain in generating novel stable network states. These results suggest gene loss, in addition to gene gain and co-option, may be important for the evolution developmental complexity.

59 BASIC BIOLOGICAL SCIENCES↗

Entanglement phase transitions in random stabilizer tensor networks

Here we explore a class of random tensor network models with “stabilizer” local tensors which we name random stabilizer tensor networks (RSTNs). For RSTNs defined on a two-dimensional square lattice, we perform extensive numerical studies of entanglement phase transitions between volume-law and area-law entangled phases of the one-dimensional boundary states. These transitions occur when either (a) the bond dimension D of the constituent tensors is varied or (b) the tensor network is subject to random breaking of bulk bonds, implemented by forced measurements. In the absence of broken bonds, we find that the RSTN supports a volume-law entangled boundary state with bond dimension D ≥ 3 where D is a prime number, and an area-law entangled boundary state for D = 2. Upon breaking bonds at random in the bulk with probability p, there exists a critical measurement rate p c for each D ≥ 3 above which the boundary state becomes area-law entangled. To explore the conformal invariance at these entanglement transitions for different prime D, we consider tensor networks on a finite rectangular geometry with a variety of boundary conditions, and extract universal operator scaling dimensions via extensive numerical calculations of the entanglement entropy, mutual information, and mutual negativity at their respective critical points. Our results at large D approach known universal data of percolation conformal field theory, while showing clear discrepancies at smaller D, suggesting a distinct entanglement transition universality class for each prime D. We further study universal entanglement properties in the volume-law phase and demonstrate quantitative agreement with the recently proposed description in terms of a directed polymer in a random environment.

36 MATERIALS SCIENCE↗

Gene network analysis of poplar root transcriptome in response to drought stress identifies a PtaJAZ3PtaRAP2.6-centered hierarchical network

Using time-series transcriptomic data from poplar roots undergoing polyethylene glycol (PEG)-induced drought stress, we built a genetic network model of the involved putative molecular responses. We found that the network resembled a hierarchical structure. The highest hierarchical level in this structure is occupied by 9 genes, which we called superhubs because they were primarily connected to 18 hub genes, which are then connected to 2,934 terminal genes. We were only able to regenerate transgenic plants overexpressing two of the superhubs, suggesting that the majority of the superhubs might interfere with the regeneration process and did not allow recovery of transgenic plants. The two superhubs encode proteins with closest homology to JAZ3 and RAP2.6 genes of Arabidopsis and were consequently named PtaJAZ3 and PtaRAP2.6. PtaJAZ3 and PtaRAP2.6 overexpressing transgenic lines showed a significant increase in both root elongation and lateral root proliferation and these responses were specific for the drought stress conditions and were highly correlated with the levels of overexpression of the transgenes. Several lines of evidence suggest of regulatory interactions between the two superhubs. Both superhubs were significantly induced by methyl jasmonate (MeJA). Because jasmonate signaling involves ubiquitin-mediated proteasome degradation, treatment with proteasome inhibitor abolished the MeJA induction for both genes. PtaRAP2.6 was upregulated in PtaJAZ3 transgenics but PtaJAZ3 expression was not affected in the PtaRAP2.6 overexpressors. The discovery of the two genes and further future insights into the associated mechanisms can lead to improved understanding and novel approaches to regulate root architecture in relation to drought stress.

59 BASIC BIOLOGICAL SCIENCES↗

Satellite image analysis using neural networks

The tremendous backlog of unanalyzed satellite data necessitates the development of improved methods for data cataloging and analysis. Ford Aerospace has developed an image analysis system, SIANN (Satellite Image Analysis using Neural Networks) that integrates the technologies necessary to satisfy NASA's science data analysis requirements for the next generation of satellites. SIANN will enable scientists to train a neural network to recognize image data containing scenes of interest and then rapidly search data archives for all such images. The approach combines conventional image processing technology with recent advances in neural networks to provide improved classification capabilities. SIANN allows users to proceed through a four step process of image classification: filtering and enhancement, creation of neural network training data via application of feature extraction algorithms, configuring and training a neural network model, and classification of images by application of the trained neural network. A prototype experimentation testbed was completed and applied to climatological data.

Sheldon, Roger A.↗

Beyond Fine Tuning: Adding capacity to leverage few labels

In this paper we present a technique to train neural network models on small amounts of data. Current methods for training neural networks on small amounts of rich data typically rely on strategies such as fine-tuning a pre-trained neural networks or the use of domain-specific hand-engineered features. Here we take the approach of treating network layers, or entire networks, as modules and combine pre-trained modules with untrained modules, to learn the shift in distributions between data sets. The central impact of using a modular approach comes from adding new representations to a network, as opposed to replacing representations via fine-tuning. Using this technique, we are able surpass results using standard fine-tuning transfer learning approaches, and we are also able to significantly increase performance over such approaches when using smaller amounts of data.

data science↗