Search NASA⌕ Search

SEARCH · Search NASA

Results for “Network modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

PlantSegNet: 3D point cloud instance segmentation of nearby plant organs with identical semantics

In this study, we introduce PlantSegNet, a novel neural network model for instance segmentation of nearby objects with similar geometric structures. Our work addresses the challenges of instance segmentation of plant point clouds, including the difficulty of annotating and labeling point clouds, the loss of local structural information in neural network components, and the generation of large numbers of incorrect small clusters due to poor choices of the loss function. One of the key contributions of our approach is a digital twin of sorghum, i.e., a procedural sorghum model, which was used to generate point clouds of sorghum fields. This allowed us to create a large-scale, annotated, synthetic dataset of sorghum plants that we used to train our PlantSegNet model. We demonstrated the effectiveness of our method in segmenting instances of sorghum leaves grown in outdoor field settings. To the best of our knowledge, this is the first study to address this specific instance segmentation problem for plants grown in such a setting. We compared our proposed method with other state-of-the-art methods for indoor settings, including SGPN and TreePartNet, on both synthetic and real data. Furthermore, our results show that PlantSegNet outperforms these methods regarding accuracy, robustness, and efficiency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

FiberFlex: Real-time FPGA-based Intelligent and Distributed Fiber Sensor System for Pedestrian Recognition

In recent years, security monitoring of public places and critical infrastructure has heavily relied on the widespread use of cameras, raising concerns about personal privacy violations. To balance the need for effective security monitoring with the protection of personal privacy, we explore the potential of optical fiber sensors for this application. This article proposes FiberFlex, an intelligent and distributed fiber sensor system. Ultizing Field Programmable Gate Arrays (FPGA) high-level synthesis (HLS) acceleration, FiberFlex offers real-time pedestrian detection by co-designing the entire pipeline of optical signal acquisition, processing, and recognition networks based on the principles of optical fiber sensing. As a promising alternative to traditional camera-based monitoring systems, FiberFlex achieves pedestrian detection by analyzing the vibration patterns caused by pedestrian footsteps, enabling security monitoring while preserving individual privacy. FiberFlex comprises three modules: First , fiber-optic sensing system: A fiber-optic distributed acoustic sensing (DAS) system is built and used to measure the ground vibration waves generated by people walking. Second , algorithms: We first collect the training data by measuring the ground vibration waves, label the data, and use the data to train the neural network models to perform pedestrian recognition. Third , hardware accelerators: We use HLS tools to design hardware modules on FPGA for data collection and pre-processing and integrate them with the downstream neural network accelerators to perform in-line real-time pedestrian detection. The final detection results are sent back from FPGA to the host CPU. We implement our system FiberFlex with the in-house built DAS system and AMD/Xilinx Kintex7 FPGA KC705 board and verify the whole system using the real-world collected data. We conduct recognition tests on five test subjects of varying ages, heights, and weights in a fixed sensing area. Each subject experienced 20 real-time recognition tests using their daily walking habits, and the subjects were given adequate rest between tests. After 100 tests on five test subjects, the overall real-time recognition accuracy exceeded \(88.0\%\) . The whole system uses 55 W of power, 33 W in the optical DAS system and 22 W in the FPGA. Relying on its end-to-end interdisciplinary design, FiberFlex seamlessly combines fiber-optic sensors with FPGA accelerators to enable low-power real-time security monitoring without compromising privacy, making it a valuable addition to the existing security monitoring network. According to FiberFlex, more valuable research can be conducted in the future, such as fall monitoring for the elderly, migration of identification networks between different application scenarios, and improvement of anti-interference performance in more complex environments. In future perception networks, where the “eyes” are not feasible, let’s use fiber optic touch instead.

Distributed↗
DOE OSTI2016

Assessing Inhalation Exposures Associated with Contamination Events in Water Distribution Systems

When a water distribution system (WDS) is contaminated, short-term inhalation exposures to airborne contaminants could occur as the result of domestic water use. The most important domestic sources of such exposures are likely to be showering and the use of aerosol-producing humidifiers, i.e., ultrasonic and impeller (cool-mist) units. A framework is presented for assessing the potential effects of short-term, system-wide inhalation exposures that could result from such activities during a contamination event. This framework utilizes available statistical models for showering frequency and duration, available exposure models for showering and humidifier use, and experimental results on both aerosol generation and the volatilization of chemicals during showering. New models for the times when showering occurs are developed using time-use data for the United States. Given a lack of similar models for how humidifiers are used, or the information needed to develop them, an analysis of the sensitivity of results to assumptions concerning humidifier use is presented. The framework is applied using network models for three actual WDSs. Simple models are developed for estimating upper bounds on the potential effects of system-wide inhalation exposures associated with showering and humidifier use. From a system-wide, population perspective, showering could result in significant inhalation doses of volatile chemical contaminants, and humidifier use could result in significant inhalation doses of microbial contaminants during a contamination event. From a system-wide perspective, showering is unlikely to be associated with significant doses of microbial contaminants. In conclusion, given the potential importance of humidifiers as a source of airborne contaminants during a contamination event, an improved understanding of the nature of humidifier use is warranted.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study

Neural scaling laws play a pivotal role in the performance of deep neural networks and have been observed in a wide range of tasks. However, a complete theoretical framework for understanding these scaling laws remains underdeveloped. In this paper, we explore the neural scaling laws for deep operator networks, which involve learning mappings between function spaces, with a focus on the Chen and Chen style architecture. These approaches, which include the popular Deep Operator Network (DeepONet), approximate the output functions using a linear combination of learnable basis functions and coefficients that depend on the input functions. We establish a theoretical framework to quantify the neural scaling laws by analyzing its approximation and generalization errors. We articulate the relationship between the approximation and generalization errors of deep operator networks and key factors such as network model size and training data size. Moreover, we address cases where input functions exhibit low-dimensional structures, allowing us to derive tighter error bounds. These results also hold for deep ReLU networks and other similar structures. Our results offer a partial explanation of the neural scaling laws in operator learning and provide a theoretical foundation for their applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Geomechanics-Based Stochastic Analysis of Injection- Induced Seismicity

The production of geothermal energy from dry and low permeability reservoirs is achieved by water circulation in natural and/or man-made fractures, and is referred to as enhanced or engineered geothermal systems (EGS). Often, the permeable zones have to be created by stimulation, a process which involves fracture initiation and/or activation of discontinuities such as faults and joints due to pore pressure and the in-situ stress perturbations. The stimulation of a rock mass is often accompanied by multiple microseismic events. Micro-seismic events associated with rock failure in shear, and shear slip on new or pre-existing fracture planes and possibly their propagations. The microseismic signals contain information about the sources of energy that can be used for understanding the hydraulic fracturing process and the created reservoir properties. Detection and interpretation of microseismic events is useful for estimating the stimulated zone, created reservoir permeability and fracture growth, and geometry of the geological structures and the in-situ stress state. The process commonly is referred to as seismicity-based reservoir characterization (SBRC). Although, progress has been made by scientific & geothermal communities for quantitative and qualitative analysis of reservoir stimulation using SBRC several key questions remain unresolved in the analysis of micro-seismicity namely, variation of seismic activity with injection rate, delayed micro-seismicity, and the relation of stimulated zone to the injected volume and its rate, and the resulting reservoir permeability. In addition, the current approach to SBRC does not consider the full range of relevant poroelastic and thermoelastic phenomena and neglects the uncertainty in rock properties and in-situ stress in the data inversion process. The objective of this research and technology developments was to develop a 3D SBRC model that addresses these shortcomings by taking into account hydro-thermo-poro-mechanical mechanisms associated with injection and utilizing a state-of-the-art stochastic inversion procedure. The approach proposed herein is innovative and significantly improves the existing SBCR technology (e.g., Shapiro et al. 2003) for geothermal reservoirs in several ways. First, the current scope of the SBRC is limited with respect to the physical processes considered and the rock properties used. Usually, the geomechanics analyses within SBRC is limited to the pore pressure diffusion in the rock mass, which is modeled using a time-dependent parabolic equation and solved using a finite element algorithm with either a line or a point source. However, water injection induces both poroelastic and thermoelastic stresses in the rock mass which affect the stress state. In fact, it has been suggested that thermoelastic stresses can play a dominant role in reservoir seismicity (Ghassemi et al., 2007). We include these important effects by using a fully-coupled poro-thermoelastic constitutive equations for the rock mass which will be solved using a 3D finite element model with more realistic injection geometries such as multiple injection/extraction sources (and in fractures), uncertainty in the material parameters and the in-situ stress distribution to better reflect the pore pressure and stress distributions. In addition, we developed a 3D stochastic fracture network model to study MEQ generation in fracture rocks. The model was verified using laboratory experiments, and calibrated and applied to Newberry EGS stimulation. In previous SBRC approaches, the triggering of micro-seismicity is modeled base on the assumption that the prior stochastic criticality model of the rock mass is a valid and adequate description. However, this assumption often does not hold in the field. Thus, we improved upon the current SBRC approach by using the micro-seismic responses to estimate the hydraulic diffusivity as well as the criticality distribution itself within the field. In this way, instead of relying on our a priori knowledge of criticality distribution, we combine an initial probabilistic description of criticality with the information contained in microseismic measurements to arrive at criticality solutions that are conditioned on both field data and our prior knowledge. Previous SBRC have relied upon a deterministic inversion approach to estimate the permeability, and the extent of the stimulated zone, whereas a stochastic inversion algorithm that recognizes and quantifies the uncertainties in the prior model, the time evolution of pore pressure distributions (modeling errors), and the observed seismic events is developed and used herein to realistically assess the quality of the solution. Finally, we developed a technique for processing discrete MEQ data to estimate fracture network properties such as dip and dip directions. The approach was successfully applied to the Fenton Hill HRD experiment and the Newberry EGS with results in good agreement with field observations.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Towards interpretable Cryo-EM: disentangling latent spaces of molecular conformations

Molecules are essential building blocks of life and their different conformations (i.e., shapes) crucially determine the functional role that they play in living organisms. Cryogenic Electron Microscopy (cryo-EM) allows for acquisition of large image datasets of individual molecules. Recent advances in computational cryo-EM have made it possible to learn latent variable models of conformation landscapes. However, interpreting these latent spaces remains a challenge as their individual dimensions are often arbitrary. The key message of our work is that this interpretation challenge can be viewed as an Independent Component Analysis (ICA) problem where we seek models that have the property of identifiability. That means, they have an essentially unique solution, representing a conformational latent space that separates the different degrees of freedom a molecule is equipped with in nature. Thus, we aim to advance the computational field of cryo-EM beyond visualizations as we connect it with the theoretical framework of (nonlinear) ICA and discuss the need for identifiable models, improved metrics, and benchmarks. Moving forward, we propose future directions for enhancing the disentanglement of latent spaces in cryo-EM, refining evaluation metrics and exploring techniques that leverage physics-based decoders of biomolecular systems. Moreover, we discuss how future technological developments in time-resolved single particle imaging may enable the application of nonlinear ICA models that can discover the true conformation changes of molecules in nature. The pursuit of interpretable conformational latent spaces will empower researchers to unravel complex biological processes and facilitate targeted interventions. This has significant implications for drug discovery and structural biology more broadly. More generally, latent variable models are deployed widely across many scientific disciplines. Thus, the argument we present in this work has much broader applications in AI for science if we want to move from impressive nonlinear neural network models to mathematically grounded methods that can help us learn something new about nature.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1987

Steady-State Thermal-Analysis Program For Microcomputers

Nodal-network model of heat flow implemented by computer program. Steady State Thermal Analysis Program, STEADY, provides thermal designer with quick and convenient method for calculation of heat loads and temperatures. Used on small nodal networks for conceptual or preliminary thermal design and analysis. Accepts up to 20 nodes of fixed or variable temperatures, with constant or temperature-dependent thermal conductivities, and any set of consistent units. Written in FORTRAN 77.

Petrick, S. W.↗
DOE OSTI2016

An analysis of image storage systems for scalable training of deep neural networks

This study presents a principled empirical evaluation of image storage systems for training deep neural networks. We employ the Caffe deep learning framework to train neural network models for three different data sets, MNIST, CIFAR-10, and ImageNet. While training the models, we evaluate five different options to retrieve training image data: (1) PNG-formatted image files on local file system; (2) pushing pixel arrays from image files into a single HDF5 file on local file system; (3) in-memory arrays to hold the pixel arrays in Python and C++; (4) loading the training data into LevelDB, a log-structured merge tree based key-value storage; and (5) loading the training data into LMDB, a B+tree based key-value storage. The experimental results quantitatively highlight the disadvantage of using normal image files on local file systems to train deep neural networks and demonstrate reliable performance with key-value storage based storage systems. When training a model on the ImageNet dataset, the image file option was more than 17 times slower than the key-value storage option. Along with measurements on training time, this study provides in-depth analysis on the cause of performance advantages/disadvantages of each back-end to train deep neural networks. We envision the provided measurements and analysis will shed light on the optimal way to architect systems for training neural networks in a scalable manner.

Lim, Seung-Hwan↗
DOE OSTI2019

Using Real-Time Electricity Prices to Leverage Electrical Energy Storage and Flexible Loads in a Smart Grid Environment Utilizing Machine Learning Techniques

With exposure to real-time market pricing structures, consumers would be incentivized to invest in electrical energy storage systems and smart predictive automation of their home energy systems. Smart home automation through optimizing HVAC (heating, ventilation, and air conditioning) temperature set points, along with distributed energy storage, could be utilized in the process of optimizing the operation of the electric grid. Using electricity prices as decision variables to leverage electrical energy storage and flexible loads can be a valuable tool to optimize the performance of the power grid and reduce electricity costs both on the supply and demand sides. Energy demand prediction is important for proper allocation and utilization of the available resources. Manipulating energy prices to leverage storage and flexible loads through these demand prediction models is a novel idea that needs to be studied. In this paper, different models for proactive prediction of the energy demand for an entire city using different machine learning techniques are presented and compared. The results of the machine learning techniques show that the proposed nonlinear autoregressive with exogenous inputs neural network model resulted in the most accurate predictions. These prediction models pave the way for the demand side to become an important asset for grid regulation by responding to variable price signals through battery energy storage and passive thermal energy storage using HVAC temperature set points.

25 ENERGY STORAGE↗
DOE OSTI2025

SympGNNs: Symplectic Graph Neural Networks for identifying high-dimensional Hamiltonian systems and node classification

Existing neural network models to learn Hamiltonian systems, such as SympNets, although accurate in low-dimensions, struggle to learn the correct dynamics for high-dimensional many-body systems. Herein, we introduce Symplectic Graph Neural Networks (SympGNNs) that can effectively handle system identification in high-dimensional Hamiltonian systems, as well as node classification. SympGNNs combine symplectic maps with permutation equivariance, a property of graph neural networks. Specifically, we propose two variants of SympGNNs: (i) G-SympGNN and (ii) LA-SympGNN, arising from different parameterizations of the kinetic and potential energy. We demonstrate the capabilities of SympGNN on two physical examples: a 40-particle coupled Harmonic oscillator, and a 2000-particle molecular dynamics simulation in a two-dimensional Lennard-Jones potential. Furthermore, we demonstrate the performance of SympGNN in the node classification task, achieving accuracy comparable to the state-of-the-art. Finally, we also empirically show that SympGNN can overcome the oversmoothing and heterophily problems, two key challenges in the field of graph neural networks.

Deep learning↗
NASA NTRS2009

Method and Apparatus for Predicting Unsteady Pressure and Flow Rate Distribution in a Fluid Network

A method and apparatus for analyzing steady state and transient flow in a complex fluid network, modeling phase changes, compressibility, mixture thermodynamics, external body forces such as gravity and centrifugal force and conjugate heat transfer. In some embodiments, a graphical user interface provides for the interactive development of a fluid network simulation having nodes and branches. In some embodiments, mass, energy, and specific conservation equations are solved at the nodes, and momentum conservation equations are solved in the branches. In some embodiments, contained herein are data objects for computing thermodynamic and thermophysical properties for fluids. In some embodiments, the systems of equations describing the fluid network are solved by a hybrid numerical method that is a combination of the Newton-Raphson and successive substitution methods.

Majumdar, Alok K.↗
DOE OSTI2024

Open Call LDRD: Physically Informed Autoencoders for Galactic Redshift Regression

Physical constraints have been suggested to make neural network models more generalizable, act scientifically plausible, and be more data-efficient over unconstrained baselines. In this report, we present preliminary work on evaluating the effects of adding soft physical constraints to computer vision neural networks trained to estimate the conditional density of redshift on input galaxy images for the Sloan Digital Sky Survey. We introduce physically motivated soft constraint terms that are not implemented with differential or integral operators. We frame this work as a simple ablation study where the effect of including soft physical constraints is compared to an unconstrained baseline. We compare networks using standard point estimate metrics for photometric redshift estimation, as well as metrics to evaluate how faithful our conditional density estimate represents the probability over the ensemble of our test dataset. We find no evidence that the implemented soft physical constraints are more effective regularizers than augmentation.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2000

Theoretical Modeling and Computer Simulations for the Origins and Evolution of Reproducing Molecular Systems and Complex Systems with Many Interactive Parts

Our research effort has produced nine publications in peer-reviewed journals listed at the end of this report. The work reported here are in the following areas: (1) genetic network modeling; (2) autocatalytic model of pre-biotic evolution; (3) theoretical and computational studies of strongly correlated electron systems; (4) reducing thermal oscillations in atomic force microscope; (5) transcription termination mechanism in prokaryotic cells; and (6) the low glutamine usage in thennophiles obtained by studying completely sequenced genomes. We discuss the main accomplishments of these publications.

Liang, Shoudan↗
DOE OSTI2019

Decoding crystallography from high-resolution electron imaging and diffraction datasets with deep learning

While machine learning has been making enormous strides in many technical areas, it is still massively underused in transmission electron microscopy. To address this, a convolutional neural network model was developed for reliable classification of crystal structures from small numbers of electron images and diffraction patterns with no preferred orientation. Diffraction data containing 571,340 individual crystals divided among seven families, 32 genera, and 230 space groups were used to train the network. Despite the highly imbalanced dataset, the network narrows down the space groups to the top two with over 70% confidence in the worst case and up to 95% in the common cases. As examples, we benchmarked against alloys to two-dimensional materials to cross-validate our deep-learning model against high-resolution transmission electron images and diffraction patterns. We present this result both as a research tool and deep-learning application for diffraction analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Ab initio Modeling of the Electronic Structures and Physical Properties of a‐Si 1− x Ge x O 2 Glass ( x = 0 to 1)

The amorphous silica (a‐SiO 2 ) and germania (a‐GeO 2 ) have a wide range of applications in glass industry. Based on a previously constructed near‐perfect continuous random network model with 1296 atoms and periodic boundary conditions, we extend our study to amorphous Si 1− x G e x O 2 models of homogeneous random substitution of Si by Ge with x ranging from 0 to 1. We have calculated the structural, electronic, mechanical, and optical properties for the series by using the first‐principles density functional theory methods. The x ‐dependence of the variations in the properties is analyzed and critically compared with available experimental data. The mass density, volume, total bond order density, bulk mechanical properties, and refractive index are found to vary linearly as a function of x . For x = 0.5, we have also constructed six different kinds of particle immersion models to test the effect of inclusion of spherical particles of one glass of different sizes in the medium of the other glass on their physical properties. It is shown that particle sizes do affect the properties of particle immersion. Our calculations provide deep insight on the properties of mixture and nanocomposites of a‐SiO 2 and a‐GeO 2 glasses.

Baral, Khagendra↗
NASA NTRS1989

Parallel plan execution with self-processing networks

A critical issue for space operations is how to develop and apply advanced automation techniques to reduce the cost and complexity of working in space. In this context, it is important to examine how recent advances in self-processing networks can be applied for planning and scheduling tasks. For this reason, the feasibility of applying self-processing network models to a variety of planning and control problems relevant to spacecraft activities is being explored. Goals are to demonstrate that self-processing methods are applicable to these problems, and that MIRRORS/II, a general purpose software environment for implementing self-processing models, is sufficiently robust to support development of a wide range of application prototypes. Using MIRRORS/II and marker passing modelling techniques, a model of the execution of a Spaceworld plan was implemented. This is a simplified model of the Voyager spacecraft which photographed Jupiter, Saturn, and their satellites. It is shown that plan execution, a task usually solved using traditional artificial intelligence (AI) techniques, can be accomplished using a self-processing network. The fact that self-processing networks were applied to other space-related tasks, in addition to the one discussed here, demonstrates the general applicability of this approach to planning and control problems relevant to spacecraft activities. It is also demonstrated that MIRRORS/II is a powerful environment for the development and evaluation of self-processing systems.

Dautrechy, C. Lynne↗
NASA NTRS1989

Parallel plan execution with self-processing networks

A critical issue for space operations is how to develop and apply advanced automation techniques to reduce the cost and complexity of working in space. In this context, it is important to examine how recent advances in self-processing networks can be applied for planning and scheduling tasks. For this reason, the feasibility of applying self-processing network models to a variety of planning and control problems relevant to spacecraft activities is being explored. Goals are to demonstrate that self-processing methods are applicable to these problems, and that MIRRORS/II, a general purpose software environment for implementing self-processing models, is sufficiently robust to support development of a wide range of application prototypes. Using MIRRORS/II and marker passing modelling techniques, a model of the execution of a Spaceworld plan was implemented. This is a simplified model of the Voyager spacecraft which photographed Jupiter, Saturn, and their satellites. It is shown that plan execution, a task usually solved using traditional artificial intelligence (AI) techniques, can be accomplished using a self-processing network. The fact that self-processing networks were applied to other space-related tasks, in addition to the one discussed here, demonstrates the general applicability of this approach to planning and control problems relevant to spacecraft activities. It is also demonstrated that MIRRORS/II is a powerful environment for the development and evaluation of self-processing systems.

D'Autrechy, C. Lynne↗