Search NASA⌕ Search

SEARCH · Search NASA

Results for “Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

Brillouin Sensing with PCA, and PCA-Based Neural Networks for Efficient Temperature Monitoring

This work explores peak estimation techniques in Brillouin Optical Time Domain Analysis (BOTDA), emphasizing both accuracy and efficiency. Euclidean distance measurement method is applied to principal components derived from Brillouin Gain Spectrum data. It offers a major speed advantage being 180 170 times faster than traditional curve fitting methods such as Lorentzian curve fitting, while maintaining similar accuracy. Additionally, a PCA- based neural network model shows significant reduction of peak estimation time compared to Lorentzian fitting. Results show Brillouin frequency shift errors lie under 0.75 MHz in both Euclidean distance-based and neural network-based methods, both of which utilize PCA components. For large data sets and long length fibers, PCA- assisted neural network for peak estimation would be an efficient solution.

Distributed optical fiber sensing↗

Steam-air blown bubbling fluidized bed biomass gasification (BFBBG): Multi-scale models and experimental validation

During fluidized bed biomass gasification, complex gas-solid mixing patterns and numerous chemical and physical phenomena make identification of optimal operating conditions challenging. In this work, a parametric experimental campaign was carried out alongside the development of a coupled reactor network model which successfully integrates the individually validated sub-models to predict steady-state reactor performance metrics and outputs. The experiments utilized an integrated gasification system consisting of an externally-heated, bench-scale, 4-in., 5 kWth, fluidized bed steam/air blown gasifier fed with woody biomass equipped with a molecular beam mass spectrometer to directly measure tar species. The operating temperature (750-850°C) and air/fuel equivalence ratio (ER = 0-0.157) were independently varied to isolate their effects. Elevating temperature is shown to improve the char gasification rate and reduce tar concentrations. In conclusion, air strongly impacts the composition of tar, accelerating the conversion of lighter polycyclic-aromatic hydrocarbons into soot precursors, while also improving the overall carbon conversion.

09 BIOMASS FUELS↗

Inferring Instantaneous, Multivariate and Nonlinear Sensitivities for the Analysis of Feedback Processes in a Dynamical System: Lorenz Model Case Study

A new approach is presented for the analysis of feedback processes in a nonlinear dynamical system by observing its variations. The new methodology consists of statistical estimates of the sensitivities between all pairs of variables in the system based on a neural network modeling of the dynamical system. The model can then be used to estimate the instantaneous, multivariate and nonlinear sensitivities, which are shown to be essential for the analysis of the feedbacks processes involved in the dynamical system. The method is described and tested on synthetic data from the low-order Lorenz circulation model where the correct sensitivities can be evaluated analytically.

Aires, Filipe↗

PlantSegNet: 3D point cloud instance segmentation of nearby plant organs with identical semantics

In this study, we introduce PlantSegNet, a novel neural network model for instance segmentation of nearby objects with similar geometric structures. Our work addresses the challenges of instance segmentation of plant point clouds, including the difficulty of annotating and labeling point clouds, the loss of local structural information in neural network components, and the generation of large numbers of incorrect small clusters due to poor choices of the loss function. One of the key contributions of our approach is a digital twin of sorghum, i.e., a procedural sorghum model, which was used to generate point clouds of sorghum fields. This allowed us to create a large-scale, annotated, synthetic dataset of sorghum plants that we used to train our PlantSegNet model. We demonstrated the effectiveness of our method in segmenting instances of sorghum leaves grown in outdoor field settings. To the best of our knowledge, this is the first study to address this specific instance segmentation problem for plants grown in such a setting. We compared our proposed method with other state-of-the-art methods for indoor settings, including SGPN and TreePartNet, on both synthetic and real data. Furthermore, our results show that PlantSegNet outperforms these methods regarding accuracy, robustness, and efficiency.

97 MATHEMATICS AND COMPUTING↗

Nitrous oxide emission from denitrification in stream and river networks

Nitrous oxide (N{sub 2}O) is a potent greenhouse gas that contributes to climate change and stratospheric ozone destruction. Anthropogenic nitrogen (N) loading to river networks is a potentially important source of N{sub 2}O via microbial denitrification that converts N to N{sub 2}O and dinitrogen (N{sub 2}). The fraction of denitrified N that escapes as N{sub 2}O rather than N{sub 2} (i.e., the N{sub 2}O yield) is an important determinant of how much N{sub 2}O is produced by river networks, but little is known about the N{sub 2}O yield in flowing waters. Here, we present the results of whole-stream {sup 15}N-tracer additions conducted in 72 headwater streams draining multiple land-use types across the United States. We found that stream denitrification produces N{sub 2}O at rates that increase with stream water nitrate (NO{sub 3}{sup -}) concentrations, but that <1% of denitrified N is converted to N{sub 2}O. Unlike some previous studies, we found no relationship between the N{sub 2}O yield and stream water NO{sub 3}{sup -}. We suggest that increased stream NO{sub 3}{sup -} loading stimulates denitrification and concomitant N{sub 2}O production, but does not increase the N{sub 2}O yield. In our study, most streams were sources of N{sub 2}O to the atmosphere and the highest emission rates were observed in streams draining urban basins. Using a global river network model, we estimate that microbial N transformations (e.g., denitrification and nitrification) convert at least 0.68 Tg {center_dot} y{sup -1} of anthropogenic N inputs to N{sub 2}O in river networks, equivalent to 10% of the global anthropogenic N{sub 2}O emission rate. This estimate of stream and river N{sub 2}O emissions is three times greater than estimated by the Intergovernmental Panel on Climate Change.

54 ENVIRONMENTAL SCIENCES↗

FiberFlex: Real-time FPGA-based Intelligent and Distributed Fiber Sensor System for Pedestrian Recognition

In recent years, security monitoring of public places and critical infrastructure has heavily relied on the widespread use of cameras, raising concerns about personal privacy violations. To balance the need for effective security monitoring with the protection of personal privacy, we explore the potential of optical fiber sensors for this application. This article proposes FiberFlex, an intelligent and distributed fiber sensor system. Ultizing Field Programmable Gate Arrays (FPGA) high-level synthesis (HLS) acceleration, FiberFlex offers real-time pedestrian detection by co-designing the entire pipeline of optical signal acquisition, processing, and recognition networks based on the principles of optical fiber sensing. As a promising alternative to traditional camera-based monitoring systems, FiberFlex achieves pedestrian detection by analyzing the vibration patterns caused by pedestrian footsteps, enabling security monitoring while preserving individual privacy. FiberFlex comprises three modules: First , fiber-optic sensing system: A fiber-optic distributed acoustic sensing (DAS) system is built and used to measure the ground vibration waves generated by people walking. Second , algorithms: We first collect the training data by measuring the ground vibration waves, label the data, and use the data to train the neural network models to perform pedestrian recognition. Third , hardware accelerators: We use HLS tools to design hardware modules on FPGA for data collection and pre-processing and integrate them with the downstream neural network accelerators to perform in-line real-time pedestrian detection. The final detection results are sent back from FPGA to the host CPU. We implement our system FiberFlex with the in-house built DAS system and AMD/Xilinx Kintex7 FPGA KC705 board and verify the whole system using the real-world collected data. We conduct recognition tests on five test subjects of varying ages, heights, and weights in a fixed sensing area. Each subject experienced 20 real-time recognition tests using their daily walking habits, and the subjects were given adequate rest between tests. After 100 tests on five test subjects, the overall real-time recognition accuracy exceeded \(88.0\%\) . The whole system uses 55 W of power, 33 W in the optical DAS system and 22 W in the FPGA. Relying on its end-to-end interdisciplinary design, FiberFlex seamlessly combines fiber-optic sensors with FPGA accelerators to enable low-power real-time security monitoring without compromising privacy, making it a valuable addition to the existing security monitoring network. According to FiberFlex, more valuable research can be conducted in the future, such as fall monitoring for the elderly, migration of identification networks between different application scenarios, and improvement of anti-interference performance in more complex environments. In future perception networks, where the “eyes” are not feasible, let’s use fiber optic touch instead.

Distributed↗

Assessing Inhalation Exposures Associated with Contamination Events in Water Distribution Systems

When a water distribution system (WDS) is contaminated, short-term inhalation exposures to airborne contaminants could occur as the result of domestic water use. The most important domestic sources of such exposures are likely to be showering and the use of aerosol-producing humidifiers, i.e., ultrasonic and impeller (cool-mist) units. A framework is presented for assessing the potential effects of short-term, system-wide inhalation exposures that could result from such activities during a contamination event. This framework utilizes available statistical models for showering frequency and duration, available exposure models for showering and humidifier use, and experimental results on both aerosol generation and the volatilization of chemicals during showering. New models for the times when showering occurs are developed using time-use data for the United States. Given a lack of similar models for how humidifiers are used, or the information needed to develop them, an analysis of the sensitivity of results to assumptions concerning humidifier use is presented. The framework is applied using network models for three actual WDSs. Simple models are developed for estimating upper bounds on the potential effects of system-wide inhalation exposures associated with showering and humidifier use. From a system-wide, population perspective, showering could result in significant inhalation doses of volatile chemical contaminants, and humidifier use could result in significant inhalation doses of microbial contaminants during a contamination event. From a system-wide perspective, showering is unlikely to be associated with significant doses of microbial contaminants. In conclusion, given the potential importance of humidifiers as a source of airborne contaminants during a contamination event, an improved understanding of the nature of humidifier use is warranted.

54 ENVIRONMENTAL SCIENCES↗

Neural Scaling Laws of Deep ReLU and Deep Operator Network: A Theoretical Study

Neural scaling laws play a pivotal role in the performance of deep neural networks and have been observed in a wide range of tasks. However, a complete theoretical framework for understanding these scaling laws remains underdeveloped. In this paper, we explore the neural scaling laws for deep operator networks, which involve learning mappings between function spaces, with a focus on the Chen and Chen style architecture. These approaches, which include the popular Deep Operator Network (DeepONet), approximate the output functions using a linear combination of learnable basis functions and coefficients that depend on the input functions. We establish a theoretical framework to quantify the neural scaling laws by analyzing its approximation and generalization errors. We articulate the relationship between the approximation and generalization errors of deep operator networks and key factors such as network model size and training data size. Moreover, we address cases where input functions exhibit low-dimensional structures, allowing us to derive tighter error bounds. These results also hold for deep ReLU networks and other similar structures. Our results offer a partial explanation of the neural scaling laws in operator learning and provide a theoretical foundation for their applications.

97 MATHEMATICS AND COMPUTING↗

Geomechanics-Based Stochastic Analysis of Injection- Induced Seismicity

The production of geothermal energy from dry and low permeability reservoirs is achieved by water circulation in natural and/or man-made fractures, and is referred to as enhanced or engineered geothermal systems (EGS). Often, the permeable zones have to be created by stimulation, a process which involves fracture initiation and/or activation of discontinuities such as faults and joints due to pore pressure and the in-situ stress perturbations. The stimulation of a rock mass is often accompanied by multiple microseismic events. Micro-seismic events associated with rock failure in shear, and shear slip on new or pre-existing fracture planes and possibly their propagations. The microseismic signals contain information about the sources of energy that can be used for understanding the hydraulic fracturing process and the created reservoir properties. Detection and interpretation of microseismic events is useful for estimating the stimulated zone, created reservoir permeability and fracture growth, and geometry of the geological structures and the in-situ stress state. The process commonly is referred to as seismicity-based reservoir characterization (SBRC). Although, progress has been made by scientific & geothermal communities for quantitative and qualitative analysis of reservoir stimulation using SBRC several key questions remain unresolved in the analysis of micro-seismicity namely, variation of seismic activity with injection rate, delayed micro-seismicity, and the relation of stimulated zone to the injected volume and its rate, and the resulting reservoir permeability. In addition, the current approach to SBRC does not consider the full range of relevant poroelastic and thermoelastic phenomena and neglects the uncertainty in rock properties and in-situ stress in the data inversion process. The objective of this research and technology developments was to develop a 3D SBRC model that addresses these shortcomings by taking into account hydro-thermo-poro-mechanical mechanisms associated with injection and utilizing a state-of-the-art stochastic inversion procedure. The approach proposed herein is innovative and significantly improves the existing SBCR technology (e.g., Shapiro et al. 2003) for geothermal reservoirs in several ways. First, the current scope of the SBRC is limited with respect to the physical processes considered and the rock properties used. Usually, the geomechanics analyses within SBRC is limited to the pore pressure diffusion in the rock mass, which is modeled using a time-dependent parabolic equation and solved using a finite element algorithm with either a line or a point source. However, water injection induces both poroelastic and thermoelastic stresses in the rock mass which affect the stress state. In fact, it has been suggested that thermoelastic stresses can play a dominant role in reservoir seismicity (Ghassemi et al., 2007). We include these important effects by using a fully-coupled poro-thermoelastic constitutive equations for the rock mass which will be solved using a 3D finite element model with more realistic injection geometries such as multiple injection/extraction sources (and in fractures), uncertainty in the material parameters and the in-situ stress distribution to better reflect the pore pressure and stress distributions. In addition, we developed a 3D stochastic fracture network model to study MEQ generation in fracture rocks. The model was verified using laboratory experiments, and calibrated and applied to Newberry EGS stimulation. In previous SBRC approaches, the triggering of micro-seismicity is modeled base on the assumption that the prior stochastic criticality model of the rock mass is a valid and adequate description. However, this assumption often does not hold in the field. Thus, we improved upon the current SBRC approach by using the micro-seismic responses to estimate the hydraulic diffusivity as well as the criticality distribution itself within the field. In this way, instead of relying on our a priori knowledge of criticality distribution, we combine an initial probabilistic description of criticality with the information contained in microseismic measurements to arrive at criticality solutions that are conditioned on both field data and our prior knowledge. Previous SBRC have relied upon a deterministic inversion approach to estimate the permeability, and the extent of the stimulated zone, whereas a stochastic inversion algorithm that recognizes and quantifies the uncertainties in the prior model, the time evolution of pore pressure distributions (modeling errors), and the observed seismic events is developed and used herein to realistically assess the quality of the solution. Finally, we developed a technique for processing discrete MEQ data to estimate fracture network properties such as dip and dip directions. The approach was successfully applied to the Fenton Hill HRD experiment and the Newberry EGS with results in good agreement with field observations.

15 GEOTHERMAL ENERGY↗

Towards interpretable Cryo-EM: disentangling latent spaces of molecular conformations

Molecules are essential building blocks of life and their different conformations (i.e., shapes) crucially determine the functional role that they play in living organisms. Cryogenic Electron Microscopy (cryo-EM) allows for acquisition of large image datasets of individual molecules. Recent advances in computational cryo-EM have made it possible to learn latent variable models of conformation landscapes. However, interpreting these latent spaces remains a challenge as their individual dimensions are often arbitrary. The key message of our work is that this interpretation challenge can be viewed as an Independent Component Analysis (ICA) problem where we seek models that have the property of identifiability. That means, they have an essentially unique solution, representing a conformational latent space that separates the different degrees of freedom a molecule is equipped with in nature. Thus, we aim to advance the computational field of cryo-EM beyond visualizations as we connect it with the theoretical framework of (nonlinear) ICA and discuss the need for identifiable models, improved metrics, and benchmarks. Moving forward, we propose future directions for enhancing the disentanglement of latent spaces in cryo-EM, refining evaluation metrics and exploring techniques that leverage physics-based decoders of biomolecular systems. Moreover, we discuss how future technological developments in time-resolved single particle imaging may enable the application of nonlinear ICA models that can discover the true conformation changes of molecules in nature. The pursuit of interpretable conformational latent spaces will empower researchers to unravel complex biological processes and facilitate targeted interventions. This has significant implications for drug discovery and structural biology more broadly. More generally, latent variable models are deployed widely across many scientific disciplines. Thus, the argument we present in this work has much broader applications in AI for science if we want to move from impressive nonlinear neural network models to mathematically grounded methods that can help us learn something new about nature.

59 BASIC BIOLOGICAL SCIENCES↗

Steady-State Thermal-Analysis Program For Microcomputers

Nodal-network model of heat flow implemented by computer program. Steady State Thermal Analysis Program, STEADY, provides thermal designer with quick and convenient method for calculation of heat loads and temperatures. Used on small nodal networks for conceptual or preliminary thermal design and analysis. Accepts up to 20 nodes of fixed or variable temperatures, with constant or temperature-dependent thermal conductivities, and any set of consistent units. Written in FORTRAN 77.

Petrick, S. W.↗

An analysis of image storage systems for scalable training of deep neural networks

This study presents a principled empirical evaluation of image storage systems for training deep neural networks. We employ the Caffe deep learning framework to train neural network models for three different data sets, MNIST, CIFAR-10, and ImageNet. While training the models, we evaluate five different options to retrieve training image data: (1) PNG-formatted image files on local file system; (2) pushing pixel arrays from image files into a single HDF5 file on local file system; (3) in-memory arrays to hold the pixel arrays in Python and C++; (4) loading the training data into LevelDB, a log-structured merge tree based key-value storage; and (5) loading the training data into LMDB, a B+tree based key-value storage. The experimental results quantitatively highlight the disadvantage of using normal image files on local file systems to train deep neural networks and demonstrate reliable performance with key-value storage based storage systems. When training a model on the ImageNet dataset, the image file option was more than 17 times slower than the key-value storage option. Along with measurements on training time, this study provides in-depth analysis on the cause of performance advantages/disadvantages of each back-end to train deep neural networks. We envision the provided measurements and analysis will shed light on the optimal way to architect systems for training neural networks in a scalable manner.

Lim, Seung-Hwan↗

Using Real-Time Electricity Prices to Leverage Electrical Energy Storage and Flexible Loads in a Smart Grid Environment Utilizing Machine Learning Techniques

With exposure to real-time market pricing structures, consumers would be incentivized to invest in electrical energy storage systems and smart predictive automation of their home energy systems. Smart home automation through optimizing HVAC (heating, ventilation, and air conditioning) temperature set points, along with distributed energy storage, could be utilized in the process of optimizing the operation of the electric grid. Using electricity prices as decision variables to leverage electrical energy storage and flexible loads can be a valuable tool to optimize the performance of the power grid and reduce electricity costs both on the supply and demand sides. Energy demand prediction is important for proper allocation and utilization of the available resources. Manipulating energy prices to leverage storage and flexible loads through these demand prediction models is a novel idea that needs to be studied. In this paper, different models for proactive prediction of the energy demand for an entire city using different machine learning techniques are presented and compared. The results of the machine learning techniques show that the proposed nonlinear autoregressive with exogenous inputs neural network model resulted in the most accurate predictions. These prediction models pave the way for the demand side to become an important asset for grid regulation by responding to variable price signals through battery energy storage and passive thermal energy storage using HVAC temperature set points.

25 ENERGY STORAGE↗

SympGNNs: Symplectic Graph Neural Networks for identifying high-dimensional Hamiltonian systems and node classification

Existing neural network models to learn Hamiltonian systems, such as SympNets, although accurate in low-dimensions, struggle to learn the correct dynamics for high-dimensional many-body systems. Herein, we introduce Symplectic Graph Neural Networks (SympGNNs) that can effectively handle system identification in high-dimensional Hamiltonian systems, as well as node classification. SympGNNs combine symplectic maps with permutation equivariance, a property of graph neural networks. Specifically, we propose two variants of SympGNNs: (i) G-SympGNN and (ii) LA-SympGNN, arising from different parameterizations of the kinetic and potential energy. We demonstrate the capabilities of SympGNN on two physical examples: a 40-particle coupled Harmonic oscillator, and a 2000-particle molecular dynamics simulation in a two-dimensional Lennard-Jones potential. Furthermore, we demonstrate the performance of SympGNN in the node classification task, achieving accuracy comparable to the state-of-the-art. Finally, we also empirically show that SympGNN can overcome the oversmoothing and heterophily problems, two key challenges in the field of graph neural networks.

Deep learning↗

DESCRIPTION OF MODELING ANALYSES IN SUPPORT OF THE 200-ZP-1 REMEDIAL DESIGN/REMEDIAL ACTION

The Feasibility Study/or the 200-ZP-1 Groundwater Operable Unit (DOE/RL-2007-28) and the Proposed Plan/or Remediation of the 200-ZP-1 Groundwater Operable Unit (DOE/RL-2007-33) describe the use of groundwater pump-and-treat technology for the 200-ZP-1 Groundwater Operable Unit (OU) as part of an expanded groundwater remedy. During fiscal year 2008 (FY08), a groundwater flow and contaminant transport (flow and transport) model was developed to support remedy design decisions at the 200-ZP-1 OU. This model was developed because the size and influence of the proposed 200-ZP-1 groundwater pump-and-treat remedy will have a larger areal extent than the current interim remedy, and modeling is required to provide estimates of influent concentrations and contaminant mass removal rates to support the design of the aboveground treatment train. The 200 West Area Pre-Conceptual Design/or Final Extraction/Injection Well Network: Modeling Analyses (DOE/RL-2008-56) documents the development of the first version of the MODFLOW/MT3DMS model of the Hanford Site's Central Plateau, as well as the initial application of that model to simulate a potential well field for the 200-ZP-1 remedy (considering only the contaminants carbon tetrachloride and technetium-99). This document focuses on the use of the flow and transport model to identify suitable extraction and injection well locations as part of the 200 West Area 200-ZP-1 Pump-and-Treat Remedial Design/Remedial Action Work Plan (DOEIRL-2008-78). Currently, the model has been developed to the extent necessary to provide approximate results and to lay a foundation for the design basis concentrations that are required in support of the remedial design/remediation action (RD/RA) work plan. The discussion in this document includes the following: (1) Assignment of flow and transport parameters for the model; (2) Definition of initial conditions for the transport model for each simulated contaminant of concern (COC) (i.e., carbon tetrachloride, technetium-99, iodine-129, nitrate [as NO{sub 3}], trichloroethene [TCE], total chromium, tritium), plus uranium; (3) Assumptions underlying the predictive simulations, including the phased implementation of the final full remedy; (4) Approximate number, locations, and rates of extraction and injection wells; and (5) Predicted amounts of contaminant mass extracted and influent concentrations at individual extraction wells for each COC and for uranium. This document is a companion report to pre-conceptual design document (DOE/RL-2008-56). Together these documents describe the sequential, progressive development of the modeling analyses and design basis for the 200-ZP-1 OU remedy.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Method and Apparatus for Predicting Unsteady Pressure and Flow Rate Distribution in a Fluid Network

A method and apparatus for analyzing steady state and transient flow in a complex fluid network, modeling phase changes, compressibility, mixture thermodynamics, external body forces such as gravity and centrifugal force and conjugate heat transfer. In some embodiments, a graphical user interface provides for the interactive development of a fluid network simulation having nodes and branches. In some embodiments, mass, energy, and specific conservation equations are solved at the nodes, and momentum conservation equations are solved in the branches. In some embodiments, contained herein are data objects for computing thermodynamic and thermophysical properties for fluids. In some embodiments, the systems of equations describing the fluid network are solved by a hybrid numerical method that is a combination of the Newton-Raphson and successive substitution methods.

Majumdar, Alok K.↗

Open Call LDRD: Physically Informed Autoencoders for Galactic Redshift Regression

Physical constraints have been suggested to make neural network models more generalizable, act scientifically plausible, and be more data-efficient over unconstrained baselines. In this report, we present preliminary work on evaluating the effects of adding soft physical constraints to computer vision neural networks trained to estimate the conditional density of redshift on input galaxy images for the Sloan Digital Sky Survey. We introduce physically motivated soft constraint terms that are not implemented with differential or integral operators. We frame this work as a simple ablation study where the effect of including soft physical constraints is compared to an unconstrained baseline. We compare networks using standard point estimate metrics for photometric redshift estimation, as well as metrics to evaluate how faithful our conditional density estimate represents the probability over the ensemble of our test dataset. We find no evidence that the implemented soft physical constraints are more effective regularizers than augmentation.

97 MATHEMATICS AND COMPUTING↗