Search NASASearch

SEARCH · Search NASA

Results for “deep reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

170 records · Page 2

Explainable machine learning reveals that local structural motifs encode the thermodynamic state across the CuZr metallic glass-forming range

Metallic glasses derive their properties from the statistics of local atomic motifs rather than from long-range order, yet a quantitative, chemistry-specific link between motif populations and the underlying glassy state has remained elusive. In this work we combine large-scale molecular dynamics, Voronoi tessellation, deep neural networks, and SHapley Additive exPlanations (SHAP) to identify which local structural motifs define the glassy state of Cu—Zr metallic glasses. A dataset of 17,180 atomistic configurations spanning ten compositions (Cu 20 Zr 80 –Cu 80 Zr 20 ) and four quench rates (10 9 –10 12 K/s) is used to train a feed-forward neural network that regresses temperature across the 50–2000 K liquid–supercooled–glass range, achieving a mean absolute error of 19.89 K and R 2 = 0.9974, confirming that the local structural state is faithfully encoded in motif-level structure. SHAP analysis then reveals that a tightly coupled near-icosahedral family of motifs (coordination numbers (CN) 11–13, including the full icosahedron 001200 and its single-atom-perturbation sibling 10930) collectively encodes the thermodynamic state of the system across the full glass-forming range. The CN = 11–13 ordered members carry negative SHAP values at high populations, tracking the most deeply-quenched configurations, while 10930 shows the reversed signature consistent with its role as a soft-spot host whose population shrinks as the icosahedral network deepens. The analysis demonstrates that explainable machine learning can isolate the minimal motif vocabulary defining the glassy state and recovers the near-icosahedral building blocks previously identified by data-driven analyses of Cu—Zr. The approach provides a general, chemistry-specific route for characterizing the structural state of disordered materials.

36 MATERIALS SCIENCE

Design Trade-Offs in Composite Fuel Cell Membranes: Effects of Reinforcement and Chemical Additives

Perfluorosulfonic acid (PFSA) membranes are critical components in proton exchange membrane fuel cells, where performance depends on balancing ionic conductivity, mechanical durability, and chemical stability. This study characterizes a composite membrane (NC700) featuring PFSA-impregnated expanded polytetrafluoroethylene (ePTFE) reinforcement and cerium-based radical scavengers, benchmarked against unreinforced NR211. Complementary techniques, including electron microscopy, X-ray scattering, infrared spectroscopy, thermogravimetric analysis, and dynamic mechanical analysis, identify the structural and compositional strategies employed in NC700. Water sorption isotherms reveal lower water uptake for NC700 across all conditions, attributed to reinforcement and cerium incorporation. Reinforcement reduces in-plane swelling from 11% to 2.1% at 90% RH, confirming strong swelling anisotropy, while maintaining mechanical properties at elevated temperatures. While the ionic conductivity of NC700 is approximately 10% lower than that of NR211, the reduced thickness yields a 40% decrease in calculated area-specific resistance, suggesting the composite architecture can favorably shift the conductivity-stability trade-off. The composite structure also reduces gas permeability, indicating potential for improved separator function alongside favorable transport properties. Systematic deconvolution of reinforcement and additive contributions shows that conductivity losses from cerium incorporation are largely offset by gains from the lower equivalent-weight polymer, providing quantitative relationships that may guide composite membrane design for fuel cells and other electrochemical applications.

25 ENERGY STORAGE

Polymer grafted aramid nanofiber reinforces immiscible waste polypropylene/poly(ethylene terephthalate)

Polypropylene (PP) and poly(ethylene terephthalate) (PET) are plastics commonly used for packaging because of their excellent barrier and mechanical properties. The properties of these plastics are often diminished after mechanical recycling, inevitably causing down-cycling. Furthermore, this problem is exacerbated when different kinds of polymers mix. Aramid nanofibers have the potential to improve the mechanical properties of polymers due to their excellent mechanical properties but their poor dispersion in polymers is a challenge. Grafting polymers onto nanofibers can help address this challenge. In this work, different loading levels (1%, 2%, and 5%) of polymer grafted aramid nanofibers (ANFs) are blended with waste PP/PET (90/10), simulating a PP waste stream containing traces of PET contaminants. Scanning electronic microscopy, rheology, and differential scanning calorimetry results show the affinity of PP functionalized aramid nanofibers (PP_ANF) towards the PP matrix. At 1 wt% of the nanofiber, the size of the PET droplets in the PP matrix of the PP_ANF blend range from 0.2 to 2.0 μm while that of unmodified ANF and PET_ANF blends are in the range of 0.1–6.2 and 0.5–7.4 μm, respectively. In summary, polymer grafted ANFs have the tendency of improving properties of its like polymers due to similarity in the grafting polymer and the polymer matrix.

36 MATERIALS SCIENCE

Enhancement of the Physical and Mechanical Properties of Cellulose Nanofibril-Reinforced Lignocellulosic Foams for Packaging and Building Applications

Biobased foams have the potential to serve as eco-friendly alternatives to petroleum-based foams, provided they achieve comparable thermomechanical and physical properties. We propose a facile approach to fabricate eco-friendly cellulose nanofibril (CNF)-reinforced thermomechanical pulp (TMP) fiber-based foams via an oven-drying process with thermal conductivity as low as 0.036 W/(m·K) at a 34.4 kg/m3 density. Acrodur®, iron chloride (FeCl3), and cationic polyacrylamide (CPAM) were used to improve the foam properties. Acrodur® did not have any significant effect on the foamability and density of the foams. Mechanical, thermal, cushioning, and water absorption properties of the foams were dependent on the density and interactions of the additives with the fibers. Due to their high density, foams with CPAM and FeCl3 at a 1% additive dosage had significantly higher compressive properties at the expense of slightly higher thermal conductivity. There was slight increase in compressive properties with the addition of Acrodur®. All additives improved the water stability of the foams, rendering them stable even after 24 h of water absorption.

Chemistry

Uncertainty quantification for competing failure mechanisms in unidirectionally reinforced carbon–carbon composites

Microstructure-informed finite element models play a key role in the carbon–carbon composite design process. Variability in manufacturing process parameters and experimental limitations introduce model parameter uncertainty. This study quantifies the effect of model parameter uncertainty on transverse tensile fracture behavior and proposes a methodology to predict the failure mode based on competing microscale damage mechanisms. Finite element simulations incorporate fiber–matrix interface debonding with cohesive zones and matrix damage with a smeared crack band approach in a unidirectional carbon–carbon composite. Results from a variance-based global sensitivity analysis identifies interfacial and matrix damage parameters as the primary source of variability in fracture behavior. Sobol’ indices indicate that matrix and cohesive zone strengths contribute 94% of the variance in the effective ultimate stress. A local analysis elucidates the relationship between these constituent strength parameters and failure mode by estimating the probability of cohesive, matrix, and mixed-mode dominated failure. Based on the results for 4000 simulations, 93% exhibit mixed-mode or interfacial dominated failure, which underscores the crucial role of fiber–matrix interface debonding in the transverse tensile failure of carbon–carbon composites. These uncertainty quantification results facilitate more efficient model calibration and provide a framework for microstructure-informed failure predictions in the face of manufacturing-induced uncertainty.

36 MATERIALS SCIENCE

Effects of high-dose neutron irradiation at light-water reactor relevant temperature on the mechanical properties of SiC/SiC composites

For this study, the neutron dose-dependent evolutions and the underlying mechanisms of properties of SiC fiber-reinforced SiC matrix (SiC/SiC) composites at a temperature relevant to light-water reactors (∼600 K) were investigated and analyzed. Chemical vapor infiltrated (CVI) SiC/SiC composites reinforced with Hi-Nicalon Type S or Tyranno SA3 fiber were neutron-irradiated to doses up to 30 dpa. The irradiated composites retained their flexural strengths. The thermal diffusivity and dimensional changes were mostly retained from 2.0 to 30.2 dpa. Discrepancies in irradiation responses among CVI SiC/SiC composites from different sources were found. Additional microstructural analysis using Raman spectroscopy and numerical analysis on irradiation effect on residual stress were used to explain how the microstructural variables, especially of carbon interphases, affect the mechanical properties in the 30–40 dpa dose range.

Continuous fiber-reinforced ceramic matrix composi

Structure–Property Linkage in Alloys Using Graph Neural Network and Explainable Artificial Intelligence

Deep learning tools have recently shown significant potential for accelerating the prediction of microstructure–property linkage in materials. While deep neural networks like convolution neural networks (CNNs) can extract physics information from 3D microstructure images, they often require a large network architecture and substantial training time. In this research, we trained a graph neural network (GNN) using phase field generated microstructures of Ni-Al alloys to predict the evolution of mechanical properties. We found that a single GNN is capable of accurately predicting the strengthening of Ni-Al alloys with microstructures of varying sizes and dimensions, which cannot otherwise be done with a CNN. Additionally, GNN requires significantly less GPU utilization than CNN and offers more interpretable explanation of predictions using saliency analysis as features are manually defined in the graph. We also utilize explainable artificial intelligence tool Bayesian Inference to determine the coefficients in the power law equation that governs coarsening of precipitates. Overall, our work demonstrates the ability of the GNN to accurately and efficiently extract relevant information from material microstructures without having restrictions on microstructure size or dimension and offers an interpretable explanation.

Chemistry

Socio-Techno-Economic Feasibility of Deep Geothermal with EGS for Residential District Heating in the Northeastern United States

In this paper, we present socio-techno-economic simulation results for enhanced geothermal system (EGS) district heating systems in the northeastern United States. We applied the geospatial Distributed Geothermal Market Demand (dGeo) tool coupled with GEOPHIRES to evaluate the feasibility of geothermal deep direct-use, utilizing EGS reservoirs for providing residential heating with district heating systems. The results were combined with JEDI results to assess social impacts. Simulation results assuming doublet EGS reservoirs with target production temperature of 80 degrees C and newly constructed district heating systems indicate a wide range in system levelized cost of heat (LCOH) values ranging from ~$15/MMBtu to over $1,000/MMBtu, with most the attractive regions urban areas with high total thermal demand and high thermal demand density. We estimate about 60 GWth in potential installed capacity with LCOH values under $50/MMBtu and 100 GWth in potential capacity with LCOH values under $100/MMBtu, respectively.

15 GEOTHERMAL ENERGY

Tensorized Interior Radiative Heat Transfer for a Scalable and Calibrated Building Energy Simulator

Building energy simulation is a critical tool for developing and testing advanced control strategies, such as Reinforcement Learning (RL), to provide demand flexibility and affordable energy costs. The recently introduced Smart Buildings Control Suite (sbsim) provides a lightweight, scalable, and data-calibrated simulation environment based on a 2D finite-difference model. However, the initial model primarily focused on conductive and convective heat transfer, neglecting the significant impact of long-wave radiative heat exchange between interior surfaces. This paper presents a significant extension to the sbsim framework by incorporating a physically-grounded model for interior radiative heat transfer. Our primary contribution is the development and integration of a fully tensorized radiative heat transfer module, which preserves the computational efficiency and scalability of the original simulator. This was achieved by developing a pipeline for view factor calculation, including an algorithm to identify directly seeing surfaces within complex floor plans, and formulating the net radiation equations for efficient execution on modern hardware accelerators. We validate the numerical accuracy of our tensorized implementation by comparing its results against a traditional iterative approach, demonstrating identical outcomes. This enhancement increases the physical fidelity of sbsim, enabling more accurate training of RL agents for building energy optimization.

Ham, Sang woo

PET waste- and bio-derived imine vitrimers for shape-memory, intrinsic flame-retardant, and recyclable carbon fiber composites

Developing circular multifunctional vitrimers and carbon fiber–reinforced polymers (CFRPs) that are simultaneously recyclable, mechanically robust, and intrinsically flame retardant remains a major challenge. Here, in this study, we report multifunctional vitrimers and their carbon fiber–reinforced vitrimer (CFRV) composites, where the vitrimer design integrates closed-loop recyclability, enhanced interfacial adhesion, and intrinsic flame retardancy within a single materials platform. The vitrimer matrix is synthesized from post-consumer polyethylene terephthalate (PET) waste and a vanillin-derived phosphorus-containing crosslinker, forming an imine-based network. The resulting vitrimer resin exhibits high tensile strength, thermal healability, repeated reprocessability, programmable shape memory, and rapid chemical depolymerization under mild conditions. Amine-functionalized carbon fibers significantly improve fiber–matrix interfacial bonding, yielding CFRVs with tensile strengths up to 789 MPa and complete recovery of structurally intact fibers after chemical recycling. The phosphorus-rich aromatic network further imparts intrinsic flame retardancy, enabling self-extinguishing behavior without external additives. This work advances a materials design paradigm for next-generation multifunctional, sustainable vitrimers and CFRVs, while simultaneously addressing the recycling challenges associated with both plastic and CFRP waste.

Bio-derived crosslinker

Aragonite saturation horizon variability along North Pacific seamounts and implications for deep-sea coral reefs

The 2014 discovery of living deep-sea coral reefs along the Northwest Hawaiian Islands (NWHI) and lower Emperor Seamount Chain (ESC), despite the North Pacific’s shallow aragonite saturation horizon (ASH) and high CaCO3 dissolution rates, underscores the need to understand the local seawater chemistry that allows these reefs to persist. We investigated seawater carbonate chemistry using discrete samples along the NWHI and ESC from two cruises ~1 year apart (08/26/21 – 09/26/21, 09/09/22 – 10/24/22). Across the two cruises, ASH depth difference ranged from 15 to 77 m. Since the Pacific ASH shoals by 1–2 m yr?¹, this long-term trend cannot explain the magnitude of ASH change observed between cruises. Temperature-salinity plots similarly indicate no major shifts in intermediate water masses that could account for these changes. Instead, ASH depth variability was primarily governed by localized biogeochemical processes, namely changes in intermediate water respiration and CaCO3 dissolution. Indicators for dissolution (TA*) and respiration (AOU) suggest changes in ASH depth were driven by changes in dissolution at the northern- and southern-most sites, whereas respiration exerted stronger control at central sites. Combining 2021 and 2022 data with data from 2014 – 2019 (excluding 2018) revealed high interannual ASH variability, by as much as >200 m at one site. Deep-sea coral reefs across the NWHI and ESC currently reside close to the ASH depth and likely experience seasonal and interannual shifts between under- and supersaturation. As ocean acidification progresses however, persistent exposure to undersaturated seawater could further threaten these critical deep-sea ecosystems.

coral reefs

Hamiltonian switching control of noisy bipartite qubit systems

Abstract We develop a Hamiltonian switching ansatz for bipartite control that is inspired by the quantum approximate optimization algorithm, to mitigate environmental noise on qubits. We demonstrate the control for a central spin coupled to bath spins via isotropic Heisenberg interactions, and then make physical applications to the protection of quantum gates performed on superconducting transmon qubits coupling to environmental two-level-systems (TLSs) through dipole-dipole interactions, as well as on such qubits coupled to both TLSs and a Lindblad bath. The control field is classical and acts only on the system qubits. We use reinforcement learning with policy gradient to optimize the Hamiltonian switching control protocols, using a fidelity objective for specific target quantum gates. We use this approach to demonstrate effective suppression of both coherent and dissipative noise, with numerical studies achieving target gate implementations with fidelities over 0.9999 (four nines) in the majority of our test cases and showing improvement beyond this to values of 0.999 999 999 (nine nines) upon a subsequent optimization by GRadient Ascent Pulse Engineering (GRAPE). We analyze how the control depth, total evolution time, number of environmental TLS, and choice of optimization method affect the fidelity achieved by the optimal protocols and reveal some critical behaviors of bipartite control of quantum gates.

Physics

An Overview of Electric Vehicle Load Modeling Strategies for Grid Integration Studies

The adoption of electric vehicles (EVs) has emerged as a solution to reduce greenhouse gas emissions in the transportation sector, which has motivated the implementation of public policies to promote their use in several countries. However, the high adoption of EVs poses challenges for the electricity sector, as it would imply an increase in energy demand and possible impacts on the power quality (PQ) of the power grid. Therefore, it is important to conduct EV integration studies in the power grid to determine the amount that can be incorporated without causing problems and identify the areas of the power sector that will require reinforcements. Accurate EV load patterns are required for this type of study that, through mathematical modeling, reflect both the dynamic behavior and the factors that influence the decision to recharge EVs. This article aims to present an overview of EVs, examine the different factors considered in the literature for modeling EV load patterns, and review modeling methods. EV load modeling methods are classified into deterministic, statistical, and machine learning. The article shows that each modeling method has its advantages, disadvantages, and data requirements, ranging from simple load modeling to more accurate models requiring large datasets.

Computer Science

Are Deep Energy Retrofits in Commercial Buildings Including Window Upgrades?

U.S. Commercial buildings account for about 20% of total U.S. energy consumption. Because the thermal performance of windows significantly affects building energy efficiency and HVAC system performance, best practice guidance often includes window and envelope improvements in conjunction with HVAC upgrades to optimize energy use and improve occupant comfort. It is an open question, however, regarding how often these best practices are implemented in the field. This paper aims to address that gap by conducting a literature review and a series of interviews with commercial building auditing and management professionals to explore the factors that drive window retrofits in commercial buildings. The paper explores a range of case studies from deep energy retrofits across the globe, comparing projects with and without window retrofits. The primary goals of this review are to: (1) provide data from real-world case studies illustrating the role of windows in deep energy renovations and HVAC upgrades, (2) conduct retrofit cost analyses for windows and high-performance HVAC systems and (3) offer insights into how window upgrade decisions are made and when they are implemented as part of deep energy retrofits. Most of the retrofit studies focused exclusively on high performance HVAC upgrades without considering how window upgrades might further enhance the overall energy efficiency of commercial buildings. Interviews with building industry experts shed light on the key factors influencing deep energy retrofit decisions and what factors tip the scales in favor of including window measures with more comprehensive retrofit projects.

Cort, Katherine

Radiolytically reworked Archean organic matter in a habitable deep ancient high-temperature brine

Abstract Investigations of abiotic and biotic contributions to dissolved organic carbon (DOC) are required to constrain microbial habitability in continental subsurface fluids. Here we investigate a large (101–283 mg C/L) DOC pool in an ancient (>1Ga), high temperature (45–55 °C), low biomass (10 2 −10 4 cells/mL), and deep (3.2 km) brine from an uranium-enriched South African gold mine. Excitation-emission matrices (EEMs), negative electrospray ionization (–ESI) 21 tesla Fourier-transform ion cyclotron resonance mass spectrometry (FT-ICR MS), and amino acid analyses suggest the brine DOC is primarily radiolytically oxidized kerogen-rich shales or reefs, methane and ethane, with trace amounts of C 3 –C 6 hydrocarbons and organic sulfides. δ 2 H and δ 13 C of C 1 –C 3 hydrocarbons are consistent with abiotic origins. These findings suggest water-rock processes control redox and C cycling, helping support a meagre, slow biosphere over geologic time. A radiolytic-driven, habitable brine may signal similar settings are good targets in the search for life beyond Earth.

Science & Technology - Other Topics

Investigating permafrost carbon dynamics in Alaska with artificial intelligence

Abstract Positive feedbacks between permafrost degradation and the release of soil carbon into the atmosphere impact land–atmosphere interactions, disrupt the global carbon cycle, and accelerate climate change. The widespread distribution of thawing permafrost is causing a cascade of geophysical and biochemical disturbances with global impacts. Currently, few earth system models account for permafrost carbon feedback (PCF) mechanisms. This research study integrates artificial intelligence (AI) tools and information derived from field-scale surveys across the tundra and boreal landscapes in Alaska. We identify and interpret the permafrost carbon cycling links and feedback sensitivities with GeoCryoAI, a hybridized multimodal deep learning (DL) architecture of stacked convolutionally layered, memory-encoded recurrent neural networks (NN). This framework integratesin-situmeasurements and flux tower observations for teacher forcing and model training. Preliminary experiments to quantify, validate, and forecast permafrost degradation and carbon efflux across Alaska demonstrate the fidelity of this data-driven architecture. More specifically, GeoCryoAI logs the ecological memory and effectively learns covariate dynamics while demonstrating an aptitude to simulate and forecast PCF dynamics—active layer thickness (ALT), carbon dioxide flux (CO 2 ), and methane flux (CH 4 )—with high precision and minimal loss (i.e. ALT RMSE : 1.327 cm [1969–2022]; CO 2 RMSE : 0.697µmolCO 2 m −2 s −1 [2003–2021]; CH 4 RMSE : 0.715 nmolCH 4 m −2 s −1 [2011–2022]). ALT variability is a sensitive harbinger of change, a unique signal characterizing the PCF, and our model is the first characterization of these dynamics across space and time.

Environmental Sciences & Ecology

Optimizing Deep Geothermal Drilling for Energy Sustainability in the Appalachian Basin

This study investigates the geological and geomechanical characteristics of the MIP 1S geothermal well in the Appalachian Basin to optimize drilling and address the wellbore stability issues encountered. Data from well logs, sidewall core analysis, and injection tests were used to derive elastic and rock strength properties, as well as stress and pore pressure profiles. A robust 1D-geomechanical model was developed and validated, correlating strongly with wellbore instability observations. This revealed significant wellbore breakout, widening the diameter from 12 ¼ inches to over 16 inches. Advanced technologies like Cerebro Force™ In-Bit Sensing were used to monitor drilling performance with high accuracy. This technology tracks critical metrics such as bit acceleration, vibration in the x, y, and z directions, Gyro RPM, stick-slip indicators, and bending on the bit. Cerebro Force™ readings identified hole drag caused by poor hole conditions, including friction between the drill string and wellbore walls and the presence of cuttings or debris. This led to higher torque and weight on bit (WOB) readings at the surface compared to downhole measurements, affecting drilling efficiency and wellbore stability. Optimal drilling parameters for future deep geothermal wells were determined based on these findings.

Environmental Sciences & Ecology