Search NASA⌕ Search

SEARCH · Search NASA

Results for “network architecture”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

DeepDist: real-value inter-residue distance prediction with deep residual convolutional network

Abstract Background Driven by deep learning, inter-residue contact/distance prediction has been significantly improved and substantially enhanced ab initio protein structure prediction. Currently, most of the distance prediction methods classify inter-residue distances into multiple distance intervals instead of directly predicting real-value distances. The output of the former has to be converted into real-value distances to be used in tertiary structure prediction. Results To explore the potentials of predicting real-value inter-residue distances, we develop a multi-task deep learning distance predictor (DeepDist) based on new residual convolutional network architectures to simultaneously predict real-value inter-residue distances and classify them into multiple distance intervals. Tested on 43 CASP13 hard domains, DeepDist achieves comparable performance in real-value distance prediction and multi-class distance prediction. The average mean square error (MSE) of DeepDist’s real-value distance prediction is 0.896 Å 2 when filtering out the predicted distance ≥ 16 Å, which is lower than 1.003 Å 2 of DeepDist’s multi-class distance prediction. When distance predictions are converted into contact predictions at 8 Å threshold (the standard threshold in the field), the precision of top L/5 and L/2 contact predictions of DeepDist’s multi-class distance prediction is 79.3% and 66.1%, respectively, higher than 78.6% and 64.5% of its real-value distance prediction and the best results in the CASP13 experiment. Conclusions DeepDist can predict inter-residue distances well and improve binary contact prediction over the existing state-of-the-art methods. Moreover, the predicted real-value distances can be directly used to reconstruct protein tertiary structures better than multi-class distance predictions due to the lower MSE. Finally, we demonstrate that predicting the real-value distance map and multi-class distance map at the same time performs better than predicting real-value distances alone.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Recovering the phase and amplitude of X-ray FEL pulses using neural networks and differentiable models

Dynamics experiments are an important use-case for X-ray free-electron lasers (XFELs), but time-domain measurements of the X-ray pulses themselves remain a challenge. Shot-by-shot X-ray diagnostics could enable a new class of simpler and potentially higher-resolution pump-probe experiments. Here, we report training neural networks to combine low-resolution measurements in both the time and frequency domains to recover X-ray pulses at high-resolution. Critically, we also recover the phase, opening the door to coherent-control experiments with XFELs. The model-based generative neural-network architecture can be trained directly on unlabeled experimental data and is fast enough for real-time analysis on the new generation of MHz XFELs.

42 ENGINEERING↗
DOE OSTI2020

The SONATA data format for efficient description of large-scale network models

Increasing availability of comprehensive experimental datasets and of high-performance computing resources are driving rapid growth in scale, complexity, and biological realism of computational models in neuroscience. To support construction and simulation, as well as sharing of such large-scale models, a broadly applicable, flexible, and high-performance data format is necessary. To address this need, we have developed the Scalable Open Network Architecture TemplAte (SONATA) data format. It is designed for memory and computational efficiency and works across multiple platforms. The format represents neuronal circuits and simulation inputs and outputs via standardized files and provides much flexibility for adding new conventions or extensions. SONATA is used in multiple modeling and visualization tools, and we also provide reference Application Programming Interfaces and model examples to catalyze further adoption. SONATA format is free and open for the community to use and build upon with the goal of enabling efficient model building, sharing, and reproducibility.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Conditional Pseudo-Reversible Normalizing Flow for Surrogate Modeling in Quantifying Uncertainty Propagation

We introduce a conditional pseudo-reversible normalizing flow (PR-NF) that directly learns conditional probability distributions from noisy physical models to efficiently quantify both forward and inverse uncertainty propagation. Traditional surrogate modeling approaches approximate only the deterministic component of physical models, requiring separate noise characterization and computationally expensive sampling methods for inverse problems. Here, in this work, we develop the conditional PR-NF model to directly learn and efficiently generate samples from the conditional probability density functions (PDFs). The training process utilizes dataset consisting of input-output pairs without requiring prior knowledge about the noise and the function. Once trained, our model efficiently generates samples from conditional PDFs for any input within the training domain. Moreover, the pseudo-reversibility feature allows for the use of fully connected neural network architectures, which simplifies the implementation and enables theoretical analysis. We provide a rigorous convergence analysis of the conditional PR-NF model, showing its ability to converge to the target conditional PDF using the Kullback−Leibler divergence. To demonstrate the effectiveness of our method, we apply it to several benchmark tests and a real-world geologic carbon storage problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Scaling Inference Using Triton to Accelerate Particle Physics at the LHC and DUNE

DUNE and the LHC experiments consist of unique and cutting-edge particle detectors that create massive, complex, and rich datasets with billions of events. They require sophisticated algorithms to reconstruct and interpret the data. Modern machine learning algorithms provide a powerful toolset to detect and classify particles, from familiar image processing convolutional neural networks to newer graph neural network architectures. A full reconstruction of these particle collisions requires novel approaches to handle the computing challenge of processing so much raw data. In a series of studies, physicists from Fermilab, CERN, and university groups explored how to accelerate their data processing using the Triton Inference Server.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

SD-WAN Evaluation Criteria for a Defense Information Systems Network Expeditionary Customer Edge

The Defense Information Systems Agency (DISA) has identified a service provision gap midway between the capacity and capability of a Defense Information Systems Network (DISN) transport Edge Points of Presence (POP) and U.S. Department of Defense (DoD) Enterprise Classified Travel Kit (DECTK). Some deployed force 100-user Tactical Operations Centers are in field locations far removed from the DISN transport core, in challenging environmental conditions with limitations on space, weight, power, and cooling for network equipment. As part of a multi-phase project, Pacific Northwest National Laboratory (PNNL) will gather and analyze requirements, design, develop, prototype, and test a miniaturized and ruggedized DISN Customer Edge POP scaled to support approximately 100 users in a field Tactical Operations Center. An Expeditionary Customer Edge (ECE) will be more suitable for field deployment than a DISN transport Edge POP, using ruggedized hardware and network function virtualization (NFV) to operate in challenging field environmental conditions, plus reduce weight, power, and cooling requirements. A key enabling technology for ECE is Software Defined Wide Area Networking (SD-WAN). This document provides: • A brief overview of SD-WAN use cases and how they apply to ECE • How SD-WAN technology compares to existing networks like DISN that use Optical Transport Networking (OTN) and Multiprotocol Label Switching (MPLS) • SD-WAN functional requirements relevant to ECE • A description of an ECE Virtual Prototype, including simulated wide area network paths and a DISN-representative implementation of MPLS, in Cisco Modeling Labs • Detailed network flow walkthroughs • Evaluation criteria based on ECE-relevant SD-WAN functional requirements Finally, an appendix provides an informal evaluation of Speedify—a commercial retail Virtual Private Network service—against the ECE SD-WAN evaluation criteria.

42 ENGINEERING↗
DOE OSTI2021

Verification of Triso Fuel Burnup Using Machine Learning Algorithms

Pebble Bed Reactors are fueled with fuel pebbles that are circulated multiple times through the reactor vessel before discharge. During the normal operation of a PBR, ejected pebbles are returned to the reactor or discharged depending on the fuel burnup and physical condition of the pebbles. The burnup measurement is usually based on detected radiation signatures of fission products accumulated in the pebble fuel over burnup. Previous research has shown that height of photopeaks of fission products, such as 134 Cs, 137 Cs, 154 Eu, etc., can be used independently or in combination to infer or predict the level of burnup in the fuel. However, it remains challenging to measure such complex sources due to self-shielding effects, strong radiation background and intervening materials. Another operational challenge is the required high throughput of burnup measurement, which necessitates limited measurement time and thus impacts quality of measured gamma-ray spectra. Hence, advanced spectral analysis methods are needed to analyze the noisy gamma spectra and predict the burnup values. We propose to use machine learning (ML) method to interpret gamma-ray spectra and predict the burnup values of the pebbles. ML has achieved widespread success and adoption across a few domains that require pattern recognition and analysis in varied data types. In this work, we apply three proven ML approaches - multilayer perceptrons, convolutional neural networks, and transformers - to the task of predicting fuel burnup from measured gamma spectra, and compile a dataset of simulated spectra for training and validation of the ML models. In this paper, we will discuss the network architecture of these three ML approaches and compare the performance of the simplest of these (MLP) to a standard linear regression.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Evaluating Scalograms for Seismic Event Denoising

Denoising contaminated seismic signals for later processing is a fundamental problem in seismic signals analysis. The most straightforward denoising approach, using spectral filtering, is not effective when noise and seismic signal occupy the same frequency range. Neural network approaches have shown success denoising local signal when trained on short-time Fourier transform spectrograms (Zhu et al 2018; Tibi et al 2021). Scalograms, a wavelet-based transform, achieved ~15% better reconstruction as measured by dynamic time warping on a seismic waveform test set than spectrograms, suggesting their use as an alternative for denoising. We train a deep neural network on a scalogram dataset derived from waveforms recorded by the University of Utah Seismograph Stations network. We find that initial results are no better than a spectrogram approach, with additional overhead imposed by the significantly larger size of scalograms. A robust exploration of neural network hyperparameters and network architecture was not performed, which could be done in follow on work.

58 GEOSCIENCES↗
DOE OSTI2022

Distributed Energy Resource Cybersecurity Standards Development [Final Report]

Currently, the solar industry is operating with little application-specific guidance on how to protect and defend their systems from cyberattacks. This 3-year Department of Energy (DOE) Solar Energy Technologies Office-funded project helped advance the distributed energy resource (DER) cybersecurity state-of-the-art by (a) bolstering industry awareness of cybersecurity concepts, risks, and solutions through a webinar series and (b) developing recommendations for DER cybersecurity standards to improve the security performance of DER products and networks. Drafting DER standards is a lengthy, consensus-based process requiring effective leadership and stakeholder participation. This project was designed to reduce standard and guide writing times by creating well-researched recommendations that could act as a starting place for national and international standards development organizations. Working within the SunSpec/Sandia DER Cybersecurity Workgroup, the team produced guidance for DER cybersecurity certification, communication protocol standards, network architecture s, access control, and patching. The team also led subgroups within the IEEE P 1547.3 Guide for Cybersecurity of Distributed Energy Resources Interconnected with Electric Power Systems committee and pushed a draft to ballot in October 2021.

14 SOLAR ENERGY↗
DOE OSTI2022

Integration of Wireless Sensor Networks and Battery-free RFID for Advanced Reactors

To address an important need for Nuclear Power Plants (NPPs) to significantly reduce the amount of the required cables for sensor data communications, this Phase I SBIR effort successfully developed and demonstrated a novel low-cost proof-of-concept prototype of a secure wireless sensor network backbone communications system. This system combines commercially available low power, low cost XBEE wireless communications network and passive (battery-free) Radio Frequency Identification (RFID) systems to report individual sensor data and their location through the containment wall for rapid response to anomalies in nuclear facilities. This WIreless Sensing and Locating (WISLO) system network architecture allows non-intrusive wireless collection of sensor data with the sensor’s accurate location information from inside of the instrumentation or containment area with minimal need for power sources. The multi-node sensor data in the containment area is wirelessly transmitted to outside through the metal reinforced concrete walls without the need for any batteries. The WISLO system could be readily used in current reactor fleet and future advanced reactors, as well as in small modular reactors (SMR). The WISLO system is the first dual frequency battery-free trough the wall communications backbone system developed specifically for use in nuclear power plants. It not only can modernize the sensor monitoring practices in the existing reactor fleet, but also offers a secure, low-cost solution to advanced reactors and SMRs by removing cables and issues related to them such as cable integrity, reporting delays, and installation and maintenance costs. The intent is to improve process safety, reliability, efficiency, and cost effectiveness to the monitoring and maintenance process in current and future plants. As we address the next productization and manufacturing capabilities in the next phase, this system will serve the needs of many commercial and government applications in remote monitoring of sensor data that demand battery-free transmission of sensor data such as Internet-of-Things (IOT).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Reduced diffusion and enhanced retention of multiple radionuclides from pore structure characterization of barrier materials for enhanced repository performance

Fluid flow and chemical transport in porous media are the macroscopic consequences of pore structure, which integrates geometry (e.g., pore size and surface area, pore-size distribution) and topology (e.g., pore connectivity). Low-permeability geological media whose pores are poorly interconnected will exhibit the characteristics of anomalous diffusion and sample size-dependent effective porosity, which will strongly impact long-term net diffusion and retention of radionuclides in geological repository settings involving different host rocks and barrier materials. A suite of innovative and complementary experimental approaches is utilized to study the microscopic pore structure and macroscopic fluid flow & chemical transport for a range of host rocks and barrier materials, in addition to standard clay minerals and reference rocks. With a particular focus on quantifying the presence and magnitude of “isolated” pores for a reduced effective porosity in low-permeability geomedia, the integrated methodologies for basic properties and pore structure characterization of these geomedia include X-ray diffraction, thin section petrography, grain size distribution, water immersion porosimetry after vacuum-pulling for full saturation, mercury intrusion porosimetry, nitrogen physisorption, scanning electron microscopy, X-ray computed tomography, and (ultra-)small angle neutron (X-ray) scattering. In addition, custom-designed gas diffusion, tracer recipe involving a range of anionic and cationic chemicals with subsequent analyses by laser ablation and inductively coupled plasma-mass spectrometry, along with batch sorption, column transport, and imbibition tests were conducted for coupled effects of pore structure and chemical retention/transport. From the perspectives of pore structure in conjunction with multiple and complementary approaches to examining a range of sample sizes under different observational scales, we find that the poor pore connectivity is prevalent in low-permeability media (mudstone and crystalline rock) that is related to geological processes (e.g., compaction, diagenesis and thermal maturation). For example, the deep and organic matter-rich mudstones have a much smaller effective porosity than the total porosity (as a result of poor pore connectivity) and associated diffusion coefficient, and the effective porosity & diffusion coefficients are also dependent upon the sample sizes used in the measurement. Similarly, most of the pore space in the shallow mudstone is also controlled by pore-throat diameters in the 5-50 nm range of intergranular pore types from its fine-grained nature, but with an overall good pore connectivity. However, the nm-sized pore space (physically pore-network architecture) and strong sorption capacities (chemical retention from clay minerals) of both shallow and deep mudstones lead to the synergistic retention of cationic radionuclides and their utilities as effective host rocks and barrier materials. Our unique approaches of studying how the micro-scale pore structure affect macro-scale fluid flow, diffusion & retention, and chemical transport produce improved mechanistic understanding, and realistic quantification, of diffusion and retention of typical radionuclides in a range of generic host rocks and barrier materials (clay/shale, salt, crystalline rock, and tuff), with the overall results leading to scientifically-based understanding of enhanced isolation (from both diffusion and retention) of radionuclides and improved confidence on the long-term performance of geological repository to store high-level radioactive wastes. In addition to the training of 25 undergraduates, graduates, and postdocs of UTA, the scientists (organizations) involved in performing this work (e.g., discussion, sample sharing, and operation of SANS and SAXS instruments) include Ed Matteo, Yifeng Wang, and Kristopher Kuhlman (Sandia National Laboratories), Jens Birkholzer, Liange Zheng, Tim Kneafsey, and Sharon Borglin (Lawrence Berkeley National Laboratory), Mavrik Zavarin (Lawrence Livermore National Laboratory), Yukio Tachi and Yuta Fukatsu (Japan Atomic Energy Agency), Mieke de Craen (Euridice, Belgium), Markus Bleuel (NIST), Wei-Ren Chen, Gergely Nagy, Changwoo Do, William Heller, Larry Anovitz, and Kenneth Littrell (ORNL), as well as Jan Illvsky, Ivan Kuzmenko, Ju-Sang Park and Jon Almers (ANL). Key deliverables include a total of 13 peer-reviewed journal articles (nine published and three under review), 23 presentations at scientific conferences (AAPG, AAPG Southwest Section, AGU, Asian Clay Conference, GSA, GSA South-Central Section, IHLRWM, InterPore, International Conference on Chemistry and Migration Behavior of Actinides and Fission Products in the Geosphere, International Conference on Coupled Processes in Fractured Geological Media: Observation, Modeling and Application), and academic institutions (UTA, New Mexico State University; University of Poitiers, France; University of Helsinki, Finland; Uppsala University, Sweden; Istanbul Technical University, Turkey) and other organizations (Andra, France; Posiva Oy, Finland).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Neural network denoising of HED x-ray images, with an introduction to neural networks [Slides]

We created and trained a new neural network denoiser model using estimates of noise in the data. We showed that our denoiser significantly reduces the combined blur and noise on the training and testing set. We demonstrated the efficacy of neural network denoisers for reducing noise on HED x-ray images. Changes to network architecture and improvements to the noise model in training could improve the model.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Validating Connected, Automated, and Electric Vehicle Models and Simulation - Research Performance Progress Report

The objective of this project is to test connected and automated vehicles with both electrified and internal combustion engine powertrains to support updates and validation of modeling and simulation tools. This includes the development of the components and network architecture to execute and collect empirical data for multiple scenarios and traffic interactions. Specific program objectives include: • Translate Lab algorithms into vehicle and infrastructure controls • Conduct physical testing at realistic scale • Evaluate system performance • Improve models using empirical data • Improve control algorithms from lessons learned • Identify system and algorithm assumptions which need refinement It is important to note that the objective of this project was not to demonstrate the efficacy of the selected algorithms to improve energy efficiency but rather to validate and improve modeling and simulation tools using empirical data. While it is a desirable outcome to concurrently demonstrate improved energy efficiency through use of these algorithms, and in most cases that was the outcome, the success of this project was not predicated on the performance of the algorithm towards improving energy efficiency across all scenarios and test matrices.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

How is statistical thinking useful for evaluating foundation models?

Good’s statement appears to be rather prescient – while humanity has marched on through to the 21st century, modern artificial intelligence (AI), driven by a menagerie of immense deep-neural-network architectures aided with parallel computation, seems positioned to change life as we know it. It would be an understatement to say that the world has been captivated by AI. Recent engineering feats, such as autonomous vehicles and generative AI, have gripped the public sphere, and AI is poised to disrupt a host of industries – including software, pharmaceuticals, healthcare, manufacturing, entertainment, and a slew of others; indeed, one is hard pressed to find any industry that does not claim to bear an impact from the so-called AI revolution.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Image Classification Using Convolutional Neural Networks to Automate Visual Inspection of CCO Containers (Rev. 1)

The Savannah River Site is automating the receipt and inspection of Criticality Control Overpack drums to aid in nuclear waste disposal. The Advanced Engineering group is automating this receipt and inspection process to assist the site’s goals. Part of this process includes visually inspecting CCO drums to ensure that no defects or security risks are present. This research focuses on developing a machine learning model to automatically classify drums as passing or failing inspection. The machine learning model was implemented using the open-source Tensorflow library and uses a Convolutional Neural Network architecture to extract features and differentiate between images. The model was able to achieve an average of 85% accuracy on a dataset of 288 drums. This project’s goal was to prove the validity of computer vision in an automation process and provide a starting place for continued research.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Experimental Evaluation of Interference in 2.4 GHz Wireless Network

To attain automation across different applications, nuclear power plants are beginning to leverage advancements in wireless communication technologies. A “one-size-fits-all” solution cannot be applied since wireless technologies are selected according to application needs, quality of service requirements, and economic restrictions. To balance the trade-off between technical and economic requirements, a multi-band heterogeneous wireless network architecture is needed. Numerous wireless technologies including Wi-Fi, Zigbee, and Bluetooth share the 2.4 GHz industrial, scientific, and medical band. However, due to different channel access mechanisms and transmit power levels, and very importantly, uncoordinated use, coexistence of these devices in the same vicinity can cause interference and degradation in performance. This report provides the technical basis for understanding the coexistence of these wireless technologies through an experimental evaluation of their performance. This report investigates interactions encompassing variables such as transmission power level, distance between the devices, data rates, and the utilization of co-channel or adjacent channels. The results show that the operation of both Zigbee and Bluetooth is severely compromised when coexisting with Wi-Fi within the same frequency spectrum. On the other hand, the performance of Bluetooth is not impaired by Zigbee and vice versa unless there exists any external interference from Wi-Fi.

2.4 GHz↗
DOE OSTI2024

Extraction of Drell-Yan Angular Parameters in $pp$ Collisions with a 120 GeV Beam Energy Using a Deep-Learning Unfolding Algorithm

Dilepton production in pp collisions through the Drell-Yan process provides a crucial tool for studying the internal quark-gluon structure of the nucleon. By precisely measuring the $\cos2\phi$ asymmetry, where $\phi$ represents the azimuthal angle of the $l^{+}l^{-}$ pair in the Collins-Soper frame, we can gain valuable insights into the proton’s structure and the transverse momentum ($q_{T}$) dependence of the $\cos2\phi$ asymmetry. SeaQuest, a fixed-target Drell-Yan experiment at Fermilab, involved an unpolarized proton beam colliding with unpolarized LH$_{2}$ and LD$_{2}$ targets. Measurements obtained from experiments typically require corrections for detector inefficiencies, smearing, and acceptance. Traditionally, these corrections involve “unfolding” the detector-level measurements through matrix operations. However, in higher-dimensional phase space, these conventional methods fail to scale effectively. To overcome these limitations, we employ an unbinned unfolding method that utilizes deep neural networks for unfolding higher-dimensional phase space. In this presentation, we will explain the design of the neural network architecture, our training strategies, and outline our plans to achieve conclusive results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Data-Driven Supervised Dimension Reduction for Scientific Discovery (LDRD QTI Report)

This report summarizes the findings of a four months FY24 Advanced Science & Technology (AS&T) LDRD Quick Targeted Investigation (QTI) project focused on the exploration of supervised dimension reduction approaches based on autoencoders. Autoencoders have been extensively employed in literature for unsupervised learning tasks, however, their use for supervised regression tasks, which are common within scientific applications, has been limited. Motivated by linear dimension reduction strategies like Active Subspaces and Adaptive Basis, we explored the possibility of employing autoencoders to discover a non-linear manifold able to represent the original function in fewer dimensions. In this report, we discuss a neural network architecture and we perform a numerical campaign on several problems ranging from simple two-dimensional functions to a model problem for magnetohydrodynamics in five dimensions. In our preliminary results, we show that the proposed approach is found to be superior to linear dimension reduction strategies in representing the target function even with a single latent variable.

97 MATHEMATICS AND COMPUTING↗