Search NASA⌕ Search

SEARCH · Search NASA

Results for “Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,639 records · Page 91

Correlated Trajectory Uncertainty for Adaptive Sequential Decision Making

One of the great challenges with decision making tasks on real world systems is the fact that data is sparse and acquiring additional data is expensive. In these cases, it is often crucial to make a model of the environment to assist in making decisions. At the same time, limited data means that learned models are erroneous, making it just as important to equip the model with good predictive uncertainties. In the context of learning sequential decision making policies, these uncertainties can prove useful for informing which data to collect for the greatest improvement in policy performance \citep{mehta2021experimental, mehta2022exploration} or informing the policy about unsure regions of state and action space to avoid during test time \citep{yu2020mopo}. Additionally, assuming that realistic samples of the environment can be drawn, an adaptable policy can be trained that attempts to make optimal decisions for any given possible instance of the environment \citep{ghosh2022offline, chen2021offline}. In this work, we examine the so-called ``probabilistic neural network'' (PNN) model that is ubiquitous in model-based reinforcement learning (MBRL) works. We argue that while PNN models may have good marginal uncertainties, they form a distribution of non-smooth transition functions. Not only are these samples unrealistic and may hamper adaptability, but we also assert that this leads to poor uncertainty estimates when predicting multiple step trajectory estimates. To address this issue, we propose a simple sampling method that can be implemented on top of pre-existing models.We evaluate our sampling technique on a number of environments, including a realistic nuclear fusion task, and find that, not only do smooth transition function samples produce more calibrated uncertainties, but they also lead to better downstream performance for an adaptive policy.

Offline Reinforcement Learning↗

Physics-Informed Machine Learning Model for Ceramic Matrix Composite Creep

A physics-informed recurrent neural network (RNN) based surrogate model is developed to emulate the nonlinear, time-dependent constitutive behavior of ceramic matrix composites (CMCs) driven by matrix damage and constituent creep at the microscale. Physics-informed constraints are introduced into the surrogate model through regularization to ground the prediction in physics and improve its predictive capabilities. Training data is generated using the high-fidelity generalized method of cells (HFGMC) approach which calls appropriate creep and damage models for each of the constituents. This coupling permits simulating the nonlinear behavior of CMCs based on constituent response at the microscale along with microstructural features such as fiber and porosity volume fraction and fiber radius. The microscale repeating unit cell is loaded under creep fatigue conditions to replicate the material loading experienced in a turbine engine. Therefore, the RNN-based surrogate model is tasked with predicting, as a function of variable input stress sequence, temperature, and microstructural features, the resulting strain history response while satisfying physical constraints related to creep rate, isochoric inelastic deformation, and strain energy density. The trained surrogate model is shown to effectively match the strain history over quantified distributions of microstructural features and relevant loading regimes and temperatures. Neural network based surrogate models can offer efficient alternatives to running computationally intensive multiscale material models to simulate the nonlinear response of large structural models. Therefore, the presented work provides evidence towards the feasibility of developing, training, and running such models for CMCs with complex microstructures, nonlinear time-dependent material response, and under non-monotonic loading conditions.

ceramic matrix composites↗

Accelerating discrete dislocation dynamics simulations with graph neural networks

Discrete dislocation dynamics (DDD) is a widely employed computational method to study plasticity at the mesoscale that connects the motion of dislocation lines to the macroscopic response of crystalline materials. However, the computational cost of DDD simulations remains a bottleneck that limits its range of applicability. Here, we introduce a new DDD-GNN framework in which the expensive time-integration of dislocation motion is entirely substituted by a graph neural network (GNN) model trained on DDD trajectories. As a first application, we demonstrate the feasibility and potential of our method on a simple yet relevant model of a dislocation line gliding through an array of obstacles. We show that the DDD-GNN model is stable and reproduces very well unseen ground-truth DDD simulation responses for a range of straining rates and obstacle densities, without the need to explicitly compute nodal forces or dislocation mobilities during time-integration. Our approach opens new promising avenues to accelerate DDD simulations and to incorporate more complex dislocation motion behaviors.

36 MATERIALS SCIENCE↗

Visual Data-Analytics of Large-Scale Parallel Discrete-Event Simulations

Parallel discrete-event simulation (PDES) is an important tool in the codesign of extreme-scale systems because PDES provides a cost-effective way to evaluate designs of highperformance computing systems. Optimistic synchronization algorithms for PDES, such as Time Warp, allow events to be processed without global synchronization among the processing elements. A rollback mechanism is provided when events are processed out of timestamp order. Although optimistic synchronization protocols enable the scalability of large-scale PDES, the performance of the simulations must be tuned to reduce the number of rollbacks and provide an improved simulation runtime. To enable efficient large-scale optimistic simulations, one has to gain insight into the factors that affect the rollback behavior and simulation performance. We developed a tool for ROSS model developers that gives them detailed metrics on the performance of their large-scale optimistic simulations at varying levels of simulation granularity. Model developers can use this information for parameter tuning of optimistic simulations in order to achieve better runtime and fewer rollbacks. In this work, we instrument the ROSS optimistic PDES framework to gather detailed statistics about the simulation engine. We have also developed an interactive visualization interface that uses the data collected by the ROSS instrumentation to understand the underlying behavior of the simulation engine. The interface connects real time to virtual time in the simulation and provides the ability to view simulation data at different granularities. We demonstrate the usefulness of our framework by performing a visual analysis of the dragonfly network topology model provided by the CODES simulation framework built on top of ROSS. The instrumentation needs to minimize overhead in order to accurately collect data about the simulation performance. To ensure that the instrumentation does not introduce unnecessary overhead, we perform a scaling study that compares instrumented ROSS simulations with their noninstrumented counterparts in order to determine the amount of perturbation when running at different simulation scales.

Ross, Caitlin↗

Report on THMC Modeling of the Near Field Evolution of a Generic Clay Repository: Model Validation and Demonstration

Shale and clay-rich rock formations have been considered as potential host rocks for geological disposal of high-level radioactive waste throughout the world. Coupled thermal, hydrological, mechanical, and chemical (THMC) processes have a significant impact on the long-term safety of a repository in this type of rocks. For example, the excavation damaged zone (EDZ) near repository tunnels can modify local permeability (resulting from induced fractures), potentially leading to less confinement capability. Maximum allowable temperature is one of the most important design variables for a geological repository, because it determines waste package spacing, distance between disposal galleries, and therefore the overall size (and cost) of the repository for a given amount of waste. This report documents results from four R&D activities to address the above concerns: (1) development and validation of constitutive relationships (Chapter 2); (2) development of a discrete fracture network (DFN) model for investigating coupled processes in the EDZ (Chapter 3); (3) development and validation of a THM model for the Full-Scale Emplacement Experiment (FE) tests at Mont Terri, Switzerland (Chapter 4); and (4) investigation of high-temperature impacts, including both laboratory and modeling studies (Chapter 5). The overall objectives of these activities are to provide an improved understanding of and advanced modeling capabilities for EDZ evolution in clay repositories and the associated coupled processes, and to develop a technical basis for the maximum allowable temperature for a clay repository.

54 ENVIRONMENTAL SCIENCES↗

FY24 Progress Report: Disposition of Cracks & Features Observed in the Inner Can Closure Weld Region (ICCWR) of the 3013 Package

The long-term integrity of the 3013 containers is of interest for the safe storage of Pu materials. Although the 3013 standard embodies multiple barrier concept, the integrity of the inner container is considered to be crucial since it protects the Safety Class outer container from its contents. The container is designed to withstand high pressures that could result from the complete radiolysis of the maximum water content permissible by the 3013 standard. Shelf-life studies and destructive examination have not found high gas pressures but have found that corrosive gases are generated. Pitting and stress corrosion cracking (SCC) are considered to be critical corrosion modes for the performance of the inner container and have been observed during destructive examinations. Considerable research has been conducted on the possibility of aqueous electrolytes condensing on the inner container that can promote SCC. These studies indicate the uncertainties surrounding the formation of corrosive environments and the corrosion behavior of container materials. In this initial report, a Bayesian network (BN) model is described that can consider the uncertainties and the causal connections between various factors influencing the corrosion modes of the inner container. The BN model is preliminary and provides an initial framework to identify the necessary information. The report also provides initial experimental results on the electrochemical behavior of stainless steels in anticipated condensed environments from gas phase migration of acidic gases. The experimental results are consistent with the corrosion model. Recommendation for further work on the BN model include assembling an expert group to provide input to the BN structure and quantification of the conditional probability matrix, experimental studies to characterize the microstructure of the container, electrochemical studies to identify critical potentials for localized corrosion and SCC, and crack growth rate studies

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Smart-PGSim: Using Neural Network to Accelerate AC-OPF Power Grid Simulation

In this work we address the problem of accelerating complex power-grid simulation through machine learning ( ML). Specifically, we develop a framework, Smart-PGSim,which generates multitask-learning (MTL) neural network (NN)models to predict the initial values of variables critical to the problem convergence. MTL models allow information sharing when predicting multiple dependent variables while including customized layers to predict individual variables. We show that,to achieve the required accuracy, it is paramount to embed domain-specific constraints derived from the specific power-grid components in the MTL model. Smart-PGSim then employs the predicted initial values as a high-quality initial condition for the power-grid numerical solver (warm start), resulting in both higher performance compared to state-of-the-art solutions while maintaining the required accuracy. Smart-PGSim brings 2.60×speedup on average (up to 3.28×) computed over 10,000 problems, without losing solution optimality.

machine learning, neural networks↗

Opinion Dynamics on Networks under Correlated Disordered External Perturbations

We study an influence network of voters subjected to correlated disordered external perturbations, and solve the dynamical equations exactly for fully connected networks. The model has a critical phase transition between disordered unimodal and ordered bimodal distribution states, characterized by an increase in the vote-share variability of the equilibrium distributions. The fluctuations (variance and correlations) in the external perturbations are shown to reduce the impact of the external influence by increasing the critical threshold needed for the bimodal distribution of opinions to appear. The external fluctuations also have the surprising effect of driving voters towards biased opinions. Furthermore, the first and second moments of the external perturbations are shown to affect the first and second moments of the vote-share distribution. This is shown analytically in the mean field limit, and confirmed numerically for fully connected networks and other network topologies. Studying the dynamic response of complex systems to disordered external perturbations could help us understand the dynamics of a wide variety of networked systems, from social networks and financial markets to amorphous magnetic spins and population genetics.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Effect of spatial sampling from European flux towers for estimating carbon and water fluxes with artificial neural networks

Abstract Empirical modeling approaches are frequently used to upscale local eddy covariance observations of carbon, water, and energy fluxes to regional and global scales. The predictive capacity of such models largely depends on the data used for parameterization and identification of input‐output relationships, while prediction for conditions outside the training domain is generally uncertain. In this work, artificial neural networks (ANNs) were used for the prediction of gross primary production (GPP) and latent heat flux (LE) on local and European scales with the aim to assess the portion of uncertainties in extrapolation due to sample selection. ANNs were found to be a useful tool for GPP and LE prediction, in particular for extrapolation in time (mean absolute error MAE for GPP between 0.53 and 1.56 gC m −2 d −1 ). Extrapolation in space in similar climatic and vegetation conditions also gave good results (GPP MAE 0.7–1.41 gC m −2 d −1 ), while extrapolation in areas with different seasonal cycles and controlling factors (e.g., the tropical regions) showed noticeably higher errors (GPP MAE 0.8–2.09 gC m −2 d −1 ). The distribution and the number of sites used for ANN training had a remarkable effect on prediction uncertainty in both, regional GPP and LE budgets and their interannual variability. Results obtained show that for ANN upscaling for continents with relatively small networks of sites, the error due to the sampling can be large and needs to be considered and quantified. The analysis of the spatial variability of the uncertainty helped to identify the meteorological drivers driving the uncertainty.

Papale, Dario↗

Silicon-on-glass pore network micromodels with oxygen-sensing fluorophore films for chemical imaging and defined spatial structure

Pore network microfluidic models were fabricated by a silicon-on-glass technique that provides the precision advantage of dry etched silicon while creating a structure that is transparent across all microfluidic channels and pores, and can be imaged from either side. A silicon layer is bonded to an underlying borosilicate glass substrate and thinned to the desired height of the microfluidic channels and pores. The silicon is then patterned and through-etched by deep reactive ion etching (DRIE), with the underlying glass serving as an etch stop. After bonding on a transparent glass cover plate, one obtains a micromodel in oxygen impermeable materials with water wet surfaces where the microfluidic channels are transparent and structural elements such as the pillars creating the pore network are opaque. The micromodel can be imaged from either side. The advantageous features of this approach in a chemical imaging application are demonstrated by incorporating a Pt porphyrin fluorophore in a PDMS film serving as the oxygen sensing layer and a bonding surface, or in a polystyrene film coated with a PDMS layer for bonding. The sensing of a dissolved oxygen gradient was demonstrated using fluorescence lifetime imaging, and it is shown that different matrix polymers lead to optimal use in different ranges dissolved oxygen concentration. Imaging with the opaque pillars in between the observation direction and the continuous fluorophore film yields images that retain spatial information in the sensor image.

chemical imaging↗

A new form of the Saint-Venant equations for variable topography

The solution stability of river models using the one-dimensional (1D) Saint-Venant equations can be easily undermined when source terms in the discrete equations do not satisfy the Lipschitz smoothness condition for partial differential equations. Although instability issues have been previously noted, they are typically treated as model implementation issues rather than as underlying problems associated with the form of the governing equations. This study proposes a new reference slope form of the Saint-Venant equations to ensure smooth slope source terms and eliminate one source of potential numerical oscillations. It is shown that a simple algebraic transformation of channel geometry provides a smooth reference slope while preserving the correct cross-section flow area and the total Piezometric pressure gradient that drives the flow. The reference slope method ensures the slope source term in the governing equations is Lipschitz continuous while maintaining all the underlying complexity of the real-world geometry. The validity of the mathematical concept is demonstrated with the open-source Simulation Program for River Networks (SPRNT) model in a series of artificial test cases and a simulation of a small urban creek. Validation comparisons are made with analytical solutions and the Hydrologic Engineering Center's River Analysis System (HEC-RAS) model. The new method reduces numerical oscillations and instabilities without requiring ad hoc smoothing algorithms.

54 ENVIRONMENTAL SCIENCES↗

Operation-adversarial scenario generation

This paper proposes a modified conditional generative adversarial network (cGAN) model to generate net load scenarios for power systems that are statistically credible, conditioned by given labels (e.g., seasons), and, at the same time, “stressful” to the system operations and dispatch decisions. The measure of stress used in this paper is based on the operating cost increases due to net load changes. The proposed operation-adversarial cGAN (OA-cGAN) internalizes a DC optimal power flow model and seeks to maximize the operating cost and achieve a worst-case data generation. The training and testing stages employed in the proposed OA-cGAN use historical day-ahead net load forecast errors and has been implemented for the realistic NYISO 11-zone system. In conclusion, our numerical experiments demonstrate that the generated operation-adversarial forecast errors lead to more cost-effective and reliable dispatch decisions.

42 ENGINEERING↗

A Data-Driven Method for Modeling Creep-Fatigue Stress- Strain Behavior Using Neural ODEs

In this paper, we introduce a data-driven machine learning approach for modeling one-dimensional stress–strain behavior under cyclic loading, utilizing experimental data from the nickel-based Alloy 617. The study employs uniaxial creep–fatigue test data acquired under various loading histories and compares two distinct neural network-based ODE models. The first model, known as the black-box model, comprehensively describes the strain–stress relationship using a Neural ODE equation. To interpret this black-box model, we apply the Sparse Identification of Nonlinear Dynamical Systems (SINDy) technique, transforming the black-box model into an equation-based model using symbolic regression. The second model, the Neural flow rule model, incorporates Hooke’s Law for the linear elastic component, with the nonlinear part characterized by a Neural ODE. Both models are trained with experimental data to accurately reflect the observed stress–strain behavior. We conduct a detailed comparison with the standard Chaboche model, which includes three back stresses. Our results demonstrate that the neural network-based ODE models precisely capture the experimental creep–fatigue mechanical behavior, exceeding the standard Chaboche model’s accuracy. Furthermore, an interpretable model derived from the black-box neural ODE model through symbolic regression achieves accuracy comparable to the Chaboche model, enhancing its interpretability. The results highlight the potential of neural network-based ODE models to depict complex creep–fatigue behavior, eliminating the necessity for experts to define a specific, material-focused model form.

creep-fatigue↗

Understanding Proton Movement in [Fe-Fe] Hydrogenases

Nature uses specialized metalloenzymes to carry out small molecule activation reactions, including CO 2 fixation, O 2 activation, and proton reduction, with unparalleled efficiency, rates, and selectivity. The latter reactions are performed by hydrogenases, protein metallo-complexes that interconverts H 2 to protons and electrons (H 2 oxidation) and the reverse reaction (H 2 production) with incredibly low energy input and amazingly fast kinetics. Reproducing both the activity and efficiency of metalloenzymes in sustainable anthropogenic systems remains one of the “holy grails” of inorganic chemistry. However, identifying the precise molecular components responsible for these desirable properties has been challenging in the natural metalloenzymes, hindering efforts to develop analogous processes in synthetic compounds. Considering the inherent complexity of a metalloenzyme and the many interactions, both strong and weak, that contribute to the function of an enzyme, we have elected to model natural metalloenzymes on a biochemical platform. Towards this end, we have a developed structural, functional, and mechanistic mimic of the [Ni-Fe] hydrogenases within a robust protein scaffold, rubredoxin, to understand the influence of the secondary coordination environment on the metal center. This involved preparing a series of three rubredoxin constructs containing a single point mutation at Val positions and making the NMR chemical shift assignments for the paramagnetic (nickel-substituted) and non-paramagnetic (zinc-substituted) form. These physical studies were complemented with in silico molecular dynamic studies on proteins with [Fe-S] clusters to engineer new proton channels to test in vitro . To assist our search for new natural metalloprotein scaffolds within the vast number of sequenced genomes, we created a neural network-based program to identify proteins with specific metal-binding sites. These computational and physical studies with metalloenzymes provide direct insight into the fundamental chemical principles driving the natural systems and offer design principles for developing catalysts that utilize analogous principles.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Experimental demonstration of a data-driven control system for subcritical nuclear facility

Here this paper presents an experimental demonstration of a data-driven control system (DCS) designed for the MIT Graphite Exponential Pile (MGEP). The DCS aims to regulate the neutron flux profile such that symmetry is preserved. Neutron flux perturbations are introduced into the MGEP to test the DCS's capabilities by the movement of an initiating control rod (ICR). To realize this functionality, a control system that relies on an artificial neural network (ANN) was developed, and then demonstrated on the MGEP. A Helium-3 ( 3 He) neutron detector and dual control rods, including their moving mechanisms, were fabricated. The perturbed flux profile was monitored by the moving neutron detector. The prediction accuracy of the neural network (NN) was examined and the DCS response was presented. Our results show that neural network regression model trained by experimental data can achieve a prediction error of less than 2.5 cm with a 95% confidence interval. The demonstration experiment also shows that a perturbation of the ICR can be captured by the control system and flux symmetry can be maintained within 1% after the response of the responding control rod (RCR).

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Nanoindentation mapping defects filtration for heterogeneous materials using generative adversarial networks

Advanced composite materials with multiple phases and heterogeneous microstructure necessitate spatial mapping characterization of elastic modulus to develop constitutive relations and overall mechanical response. Such modulus mapping can be obtained using the nanoindentation technique, where the indenter tip raster over the selected microstructure region. Typically, a surface preparation procedure is done in the specimens to ensure proper contact between the indenter tip and sample surface. However, a near-perfect surface finish is unachievable in heterogeneous materials, primarily with ceramic reinforcements, due to the differential material removal rate during polishing. Thus, the nanoindenter records localized erroneous measurements due to differences in surface roughness and corresponding force response. This study establishes a novel deep learning-based strategy to rectify incorrect experimental spatial measurements acquire during nanoindentation modulus mapping. Here, the integrated bicubic interpolation and generative adversarial networks (GANs) model was trained using 14 ceramic and 18 metallic data sets, each comprising 65,536 measurements. The developed algorithm was validated against experimental measurements on four unknown specimens. The standard deviation in measured elastic modulus reduces by ~50% in ceramics and ~72% in metallic samples. This computational framework proposes a novel approach to reducing uncertainty in materials’ properties using state-of-the-art computer vision techniques.

36 MATERIALS SCIENCE↗

Cross-scale sensing of field-level crop residue cover: Integrating field photos, airborne hyperspectral imaging, and satellite data

Conservation tillage practices can bring benefits to agricultural sustainability. Accurate spatial and temporal resolved information of field-scale crop residue cover, which reflects tillage intensity, is highly valuable for evaluating the outcomes of government conservation programs and voluntary ecosystem service markets, as well as facilitating agroecosystem modeling to quantify cropland biogeochemical processes. Remote sensing has the potential to cost-effectively detect crop residue cover, however, existing regional-scale studies were limited by insufficient ground truth data, scale mismatch between coarse satellite pixels and ground data, and the lack of key spectral data for detecting crop residues. Therefore, this study developed an innovative cross-sensing framework to integrate proximal sensing, airborne hyperspectral imaging, and satellite Earth Observation through deep learning to quantify field-level crop residue cover fractions at the regional scale. Specifically, we have collected intensive ground orthographic photos and conducted airborne hyperspectral surveys at corn and soybean fields of Champaign and nearby counties in Illinois, the heartland of the U.S. Corn Belt. Through semi-automatic labeling aided by ResNet-50 and superpixel image segmentation, we obtained 6719 records of ground residue fractions. With these ground data, we developed the 1-dimensional convolution neural network (CNN) model using airborne hyperspectral reflectance, which has 0.5m spatial resolution and 3–5 nm spectral resolution from 400 to 2400 nm, to predict residue fractions. By applying the CNN model to airborne pixels, we augmented “ground truth” data of crop residues and further combined them with Harmonized Landsat and Sentinel-2 (HLS) satellite data to quantify regional residue fractions at 30 m resolution. Results show that airborne hyperspectral imagery with CNN can accurately detect residue fractions (R 2 = 0.82, relative RMSE = 11.73%) to effectively generate quasi “ground truth” data to support satellite upscaling to all fields. With independent ground data for testing, we found that the ground-airborne-satellite integrative framework achieved better predictions in estimating crop residue cover (R 2 = 0.67, relative RMSE = 17.53%) than the conventional ground-satellite upscaling (R 2 = 0.22, relative RMSE = 32.09%). Here we also found that the shortwave infrared wavelengths, particularly 2100–2300 nm, are vital for predicting crop residue cover. Sentinel-2 and Landsat-8 data have a comparable capability to track residue fractions due to similar shortwave infrared wavelengths. This study highlights the high accuracy of hyperspectral imaging to detect agroecosystem tillage management practices and the advantages of cross-scale sensing to cost-effectively integrate multi-source data to quantify field-level agroecosystem variables across scales.

60 APPLIED LIFE SCIENCES↗