Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

170 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Multi-contrast machine learning improves schistosomiasis diagnostic performance

Schistosomiasis currently affects over 250 million people and remains a public health burden despite ongoing global control efforts. Conventional microscopy is a practical tool for diagnosis and screening ofSchistosoma haematobium, but identification of eggs requires a skilled microscopist. Here we present a machine learning (ML)-based strategy for automated detection ofS. haematobiumthat combines two imaging contrasts, brightfield (BF) and darkfield (DF), to improve diagnostic performance. We collected BF and DF images of urine samples, many of them containingS. haematobiumeggs, during two different field studies in Côte d’Ivoire using a mobile phone-based microscope, the SchistoScope. We then trained separate egg-detection ML models and compared the patient-level performance of BF and DF models alone to combinations of BF and DF models, using annotations from trained microscopists as the gold standard. We found that models trained on DF images, and almost all BF and DF combinations, performed significantly better than models trained on BF images only. When models were trained on images from the first field study (n = 349 patients, 748 images of each contrast), patient-level classification performance on patient images from the second study (n = 375 patients, 752 images of each contrast) met the WHO Diagnostic Target Product Profile (TPP) sensitivity and specificity for the monitoring and evaluation use case (sensitivity for all models and combinations was >75% when evaluated at a confidence score threshold that resulted in specificity >96.5%). When we used images from both field studies for the training set, performance of the models was improved. Overall, this work shows that the use of DF and BF increases the performance of ML models on images from devices with low-cost optics, while retaining the portability, power, and time-to-results of the WHO’s diagnostic TPP. DF requires no additional sample preparation and does not increase the complexity of the imaging system. It thus offers a practical means to improve performance of automated diagnostics forS. haematobiumas well as other microscopy-based diagnostics.

Infectious Diseases↗
DOE OSTI2026

Effects of Composition and Oxidation States on the Structures of Chromium-Containing Sodium Silicate Glasses: Molecular Dynamics Simulations using Machine Learning Interatomic Potentials

Chromium represents a significant challenge for the vitrification of high-level nuclear waste into silicate and borosilicate glasses due to its low solubility and variable oxidation states, which can limit the waste loading due to promotion of crystallization or phase separation during processing. In this study, we modeled chromium containing silicate glasses using molecular dynamics simulations with three machine learning interatomic potentials (MLIPs), MACE, CHGNet, and PFP were employed, to gain insights on glass composition and oxidation states on the structures of these glasses. One of the goals is to evaluate their ability of these MLIPs to accurately represent the general structure of silicate glasses and chromium local environments as a function of chromium oxidation states. Density Functional Theory (DFT) based calculations and experimental data such as neutron structure factors were used to validate the structural models. It was found that the foundation models of all three MLIPs are able to reproduce general structural features of the sodium silicate glass structure consistent with experimental and DFT data, but only CHGNet and PFP can accurately capture the oxidation states and local environment of chromium: tetrahedral for Cr6+ and octahedral for Cr3+. Furthermore, we studied the effect of varying Cr3+/ Cr6+ (Cr3+/Crtotal) ratio and total chromium content using PFP. Our results show that Cr6+ enhances network polymerization by reducing non-bridging oxygens through Na? charge compensation required due to the formation of chromate (CrO42-) species, while Cr³? acts as a network modifier that disrupts connectivity. System size effects on the structural characteristics and chromium environments were also tested using the PFP potential. This work highlights the importance of careful validation on the precision, transferability, and potential of MLIPs for modeling glasses containing transition metal elements that can exist in multiple oxidation states. It is also encouraging to see the foundational models are all three MLFFs are able to reproduce the basic sodium silicate glass structures, while suggesting additional training or refining is needed to improve the description of more complex systems containing transition metals.

Puga, Christina L.↗
DOE OSTI2026

The SPT-deep Cluster Catalog: Sunyaev–Zel’dovich Selected Clusters from Combined SPT-3G and SPTpol Measurements over 100 Square Degrees

We present a catalog of 500 galaxy cluster candidates in the SPT-Deep field: a 100 deg$^{2}$ field that combines data from the SPT-3G and SPTpol surveys to reach noise levels of 3.0, 2.2, and 9.0 μK-arcmin at 95, 150, and 220 GHz, respectively. Candidates are selected via the thermal Sunyaev–Zel’dovich (SZ) effect with a minimum significance of ξ = 4.0, resulting in a catalog of purity ∼89%. Optical data from the Dark Energy Survey and infrared data from the Spitzer Space Telescope are used to confirm 442 cluster candidates. The clusters span 0.12 < z ≲ 1.8 and 1.0 × 10$^{14}$M$_{⊙}$/h$_{70}$ < M$_{500c}$ < 8.7 × 10$^{14}$M$_{⊙}$/h$_{70}$. The sample’s median redshift is 0.74, and the median mass is 1.7 × 10$^{14}$M$_{⊙}$/h$_{70}$; these are the lowest median mass and highest median redshift of any SZ-selected sample to date. We assess the effect of infrared emission from cluster member galaxies on cluster selection by performing a joint fit to the infrared dust and tSZ signals by combining measurements from SPT and overlapping submillimeter data from Herschel/SPIRE. We find that at high redshift (z > 1), the tSZ signal is reduced by $17.9_{−3.2}^{+3.8}$%$(3.8_{−0.7}^{+0.9}$%$)$ at 150 GHz (95 GHz) due to dust contamination. We repeat our cluster finding method on dust-nulled SPT maps and find the resulting catalog is consistent with the nominal SPT-Deep catalog, suggesting dust contamination does not significantly impact the SPT-Deep selection function; we attribute this lack of bias to the inclusion of the SPT 220 GHz band.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

NanoPSD: A software for automatic detection of Nano-Particle Shape Distribution in electron microscopy images

Accurate quantification of the size and morphology of nanoparticles from electron microscopy (EM) images is essential to understand growth mechanisms, surface reactivity, and functional behavior in nanoscale materials. Manual analysis remains slow, subjective, and difficult to reproduce in large datasets. We introduce NanoPSD (Nano-Particle Shape Distribution), an open-source and fully automated framework for quantitative particle detection and morphology analysis from EM images. NanoPSD integrates adaptive contrast enhancement, polarity-agnostic scale-bar detection, Optical Character Recognition (OCR)-based calibration, and classical segmentation via Otsu thresholding with morphological refinement. Particle contours are used to extract geometric descriptors, including equivalent circular diameter, aspect ratio, circularity, and solidity, enabling automated classification into spherical, rod-like, and aggregate morphologies. The framework supports both single-image and batch processing, generating publication-quality visualizations, LaTeX-ready tables, and structured comma-separated values (CSV) datasets. As a demonstration, we applied NanoPSD to plasma-synthesized nanoparticle samples diagnosed via transmission electron microscopy (TEM). The code produced statistically robust size and morphology distributions spanning a few to tens of nanometers with minimal user supervision. The pipeline demonstrates high reproducibility and scalability, processing large image collections with consistent calibration and output formatting. Its modular design enables seamless integration of future deep-learning-based segmentation models, providing a pathway toward intelligent, data-driven electron microscopy analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Smart building HVAC control challenge: experience and solutions from the ADRENALIN project

A smart building HVAC control competition crowdsourced and compared algorithms on fair and equal ground using the standardized BOPTEST framework. The competition attracted 138 participants, but only 9% submitted valid solutions for the final stage, highlighting the complexity of advanced HVAC control design. The winning solutions showed significant potential to reduce energy use and cost by shifting demand, without compromising occupant comfort. Across scenarios, thermal energy cost reductions of 36–76% relative to a baseline, were achieved. In peak heat periods, the cost reduction leveraged limited energy use reduction (0–15%), but more significant energy price reduction (34–62%). This shows smart controls' ability to avoid as much as possible consumption during the morning peak hours, when spot prices are tendentially the highest. Hosting the competition has highlighted challenges in creating competitions that both are fair and promotes solutions that are transferable to real life implementation.

BOPTEST↗
DOE OSTI2026

Surrogate modeling of Monte Carlo radiation transport with convolutional neural networks for shielding optimization

Here, we present a machine learning (ML)-based surrogate model using convolutional neural networks (CNN) designed to emulate the attenuation of neutron fields as they pass through various shielding materials. This model can compute the outgoing neutron flux almost instantaneously and achieves reasonable accuracy compared to traditional Monte Carlo (MC)-based codes, which are computationally intensive. This emulator alleviates the complexity of neutron radiation transport through shielding materials by reducing the dimensionality and enables shielding optimization for a known radiation environment. This optimization process, which would have taken an unrealistic timeline due to several complex radiation transport simulations, can now be achieved in minutes, thus increasing computational capabilities in radiation shielding assessment. We demonstrate the applications of this emulator in computing effective dose rates and optimizing shielding solutions for a heavy-ion accelerator facility, such as the Facility for Rare Isotope Beams, where secondary neutrons produced via beam interactions dominate the radiation environment.

accelerator shielding↗
DOE OSTI2026

Visualizing Millisecond Atomic Dynamics of Nanocrystals in Liquid

Atomic structures of nanomaterials are inherently dynamic and continuously reshaped through interactions with chemical species and external stimuli. Such dynamics are further amplified as the size and dimensionality of nanomaterials decrease. Despite advances in analytical methods, it remains challenging to capture the structural dynamics of nanomaterials in reactive environments with both atomic spatial resolution and commensurate temporal resolution. Here, in this study, we directly visualize atomic-scale dynamics of gold (Au) nanocrystals in reactive liquid environments with millisecond-speed liquid-cell electron microscopy (EM) and deep-learning denoising. We uncover reversible fluctuations in the local crystallinity of Au nanocrystals dependent on the surrounding chemical environment. These transient fluctuations, driven by interactions at nanocrystal–liquid interfaces, critically influence the dissolution kinetics and grain boundary relaxation. By overcoming the spatiotemporal limitations in conventional liquid-cell EM, our findings provide insights into how transient nanoscale structures dictate the stability and reactivity of nanomaterials.

Kang, Sungsu [University of Chicago, IL (United St↗
DOE OSTI2026

Atomistic Simulation of Glasses and Amorphous Materials: Challenges and Opportunities for the Next Decade

Atomistic simulations have become indispensable tools for understanding glass structure, dynamics, and properties, yet persistent challenges limit their predictive power. This perspective examines three interconnected issues, namely glass formation procedures, interatomic potential development, and machine learning applications, which emerged from the 5th International Workshop on Challenges of Atomistic Simulations of Glasses and Amorphous Materials. We identify convergent community priorities for (i) standardized validation protocols, (ii) curated benchmark datasets with complete metadata, and (iii) open repositories for glasses. A systematic was forward is provided by a hierarchical validation framework for assessing the structural fidelity, property prediction, and behavioral realism of simulation techniques. Looking ahead, transformative advances are promised by the fusion of classical techniques with machine learning based approaches, for instance, by integrating swap Monte Carlo with machine-learning (ML) potentials, leveraging foundation models through transfer learning, and finetuning ML potentials with experimental data. Progress depends on the community committing to validated models, reproducible protocols, and sustained data sharing.

Krishnan, N. M. Anoop↗
DOE OSTI2024

Real-space visualization of a defect-mediated charge density wave transition

Here, we study the coupled charge density wave (CDW) and insulator-to-metal transitions in the 2D quantum material 1T-TaS 2 . By applying in situ cryogenic 4D scanning transmission electron microscopy with in situ electrical resistance measurements, we directly visualize the CDW transition and establish that the transition is mediated by basal dislocations (stacking solitons). We find that dislocations can both nucleate and pin the transition and locally alter the transition temperature T c by nearly ~75 K. This finding was enabled by the application of unsupervised machine learning to cluster five-dimensional, terabyte scale datasets, which demonstrate a one-to-one correlation between resistance—a global property—and local CDW domain-dislocation dynamics, thereby linking the material microstructure to device properties. This work represents a major step toward defect-engineering of quantum materials, which will become increasingly important as we aim to utilize such materials in real devices.

4D-STEM↗
DOE OSTI2026

The Role of Nuclear Data Sensitivities in Prompt α-Eigenvalue Predictions of Delayed Critical Benchmarks

Alpha (α) eigenvalues, which describe the logarithmic time derivative of the neutron population in a multiplying system, are integral to time-dependent behavior and diagnostic applications. However, uncertainties in the evaluated nuclear data can significantly impact the accuracy of transport simulations for such quantities. This work explores the use of machine learning models to predict two key outputs, α-eigenvalues and keff bias, using input features derived from α-eigenvalue sensitivities to nuclear data. The criticality safety benchmark models used in this study come from the International Handbook of Evaluated Criticality Safety Benchmark Experiments. Three models, random forest, XGBoost, and NGBoost, are trained on both energy-resolved and energy-summed α sensitivities. For the α-eigenvalue bias prediction, NGBoost achieved the highest R 2 (0.9476) using energy-resolved features, while XGBoost performed best using summed sensitivities. In contrast, when predicting the keff bias, all the models showed moderate predictive capability (best R 2 ≈ 0.72), as the mapping from the static α-sensitivities to the static keff bias was less direct. SHAP (SHapley Additive exPlanations) analysis was used to interpret the model predictions. Across both prediction tasks, the features associated with neutron capture [H-1 (n, γ)], uranium scattering reactions (such as 235 U elastic/inelastic), and actinide capture/fission reactions (such as 239 Pu and 234 U) were consistently identified as the most impactful. This highlights the key role of specific nuclear reactions and energy ranges in shaping both time-dependent and steady-state criticality behavior. These results demonstrated that α-sensitivities, despite being computed for time-dependent metrics, can provide valuable insights for predicting both α-eigenvalues and the keff bias. Moreover, machine learning models offer a promising pathway for uncovering important nuclear data dependencies and guiding future data evaluation efforts.

Nuclear data↗
DOE OSTI2023

Hybrid Data‐Driven Discovery of High‐Performance Silver Selenide‐Based Thermoelectric Composites

Optimizing material compositions often enhances thermoelectric performances. However, the large selection of possible base elements and dopants results in a vast composition design space that is too large to systematically search using solely domain knowledge. To address this challenge, a hybrid data-driven strategy that integrates Bayesian optimization (BO) and Gaussian process regression (GPR) is proposed to optimize the composition of five elements (Ag, Se, S, Cu, and Te) in AgSe-based thermoelectric materials. Data is collected from the literature to provide prior knowledge for the initial GPR model, which is updated by actively collected experimental data during the iteration between BO and experiments. Within seven iterations, the optimized AgSe-based materials prepared using a simple high-throughput ink mixing and blade coating method deliver a high power factor of 2100 µW m −1 K −2 , which is a 75% improvement from the baseline composite (nominal composition of Ag 2 Se 1 ). In conclusion, the success of this study provides opportunities to generalize the demonstrated active machine learning technique to accelerate the development and optimization of a wide range of material systems with reduced experimental trials.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Durability of ABC Team Wall Assemblies

This study evaluates the long-term hygrothermal durability of four advanced retrofit wall systems using a field test facility located in Hollywood, South Carolina, representative of a mixed-humid coastal climate (Zone 3). The research focuses on assessing the thermal and moisture performance of a baseline wall assembly retrofitted with (1) Tremco/Dryvit prefabricated panel systems (Revitalite and Fedderlite), (2) Reinforced Fiberglass Plastic (RFP) panels developed by Oak Ridge National Laboratory (ORNL), and (3) Vacuum Insulated Panels (VIP) integrated with EPS by Home Innovation Research Labs (HIRL) and ORNL. A baseline wall representing a typical uninsulated wood-frame construction was used for comparison.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Mechanisms of Alkali Ionic Transport in Amorphous Oxyhalides Solid State Conductors

Amorphous oxyhalides have attracted significant attention due to their relatively high ionic conductivity (1 mS cm –1 ), excellent chemical stability, mechanical softness, and facile synthesis routes via standard solid‐state reactions. These materials exhibit an ionic conductivity that is almost independent of the underlying chemistry, in stark contrast to what occurs in crystalline conductors. In this work, we employ machine learning interatomic potentials to construct large‐scale molecular dynamics trajectories encompassing hundreds of nanoseconds to obtain statistically converged transport properties. We find that the amorphous state consists of chain fragments of metal‐anion tetrahedra of various lengths. By analyzing the residence time of alkali cations migrating around tetrahedrally‐coordinated metals, we find that oxygen anions limit alkali diffusion. By computing the full Einstein expression of the ionic conductivity, we demonstrate that the alkali transference number of these materials is strongly influenced by distinct‐particles correlations, while alkali transport is dictated by uncorrelated self‐diffusion. By extending this analysis to chemical compositions AMX 2.5 O 0.75 , spanning different alkaline (A = Li, Na, K), metallic (M = Al, Ga, In), and halogen (X = Cl, Br, I) species, we clarify why the diffusion properties of these materials remain largely insensitive to variations in atomic isovalent chemistry.

amorphous materials↗
DOE OSTI2024

The occurrence rate of galaxies with polar structures may be significantly underestimated

Polar-ring galaxies are photometrically and kinematically decoupled systems that are highly inclined to the major axis of the host. These galaxies have been explored since the 1970s, but the rarity of these systems has made such systematic studies difficult. However, over 250 good candidates have been identified. In this work, we examine a sample of over 18 000 galaxies from the Sloan Digital Sky Survey (SDSS) Stripe 82 for the presence of galaxies with polar structures. Using deep SDSS Stripe 82, DESI Legacy Imaging Surveys, and Hyper Suprime-Cam Subaru Strategic Program, we selected 53 good candidate galaxies with photometrically decoupled polar rings, 9 galaxies with polar halos, 6 galaxies with polar bulges, and 34 possibly forming polar-ring galaxies, versus 13 polar-ring candidates previously selected in Stripe 82. Our results suggest that the occurrence rate of galaxies with polar structures may be significantly underestimated, as revealed by the deep observations, and may amount to 1–3% of non-dwarf galaxies.

Astronomy & Astrophysics↗
DOE OSTI2026

Resources for E-Mobility Program Implementation [Slides]

The Energy to Communities (E2C) peer-learning cohort program provides technical assistance to groups of 15 community entities around a common energy topic over the course of 6 months. Every month, participants join a virtual meeting where they hear from experts and exchange strategies and best practices with their peers. This cohort, "Successful Energy Project Implementation" will explore common challenges in implementing energy projects and learn strategies to turn project plans into reality. Each participant will focus on a local energy project or priority as a cornerstone for their learning throughout the series.This presentation overviews the basics of developing electric mobility projects with emphasis on leveraging the right tools to advance technical scoping and program design.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Revealing the Hidden Third Dimension of Point Defects in Two-Dimensional MXenes

Point defects govern many important functional properties of two-dimensional (2D) materials. However, resolving the three-dimensional (3D) arrangement of these defects in multi-layer 2D materials remains a fundamental challenge, hindering rational defect engineering. Here, we overcome this limitation using an artificial intelligence-guided electron microscopy workflow to map the 3D topology and clustering of atomic vacancies in Ti3C2TX MXene. Our approach reconstructs the 3D coordinates of vacancies across hundreds of thousands of lattice sites, generating robust statistical insight into their distribution that can be correlated with specific synthesis pathways. This large-scale data enables us to classify a hierarchy of defect structures-from isolated vacancies to nanopores-revealing their preferred formation and interaction mechanisms, as corroborated by molecular dynamics simulations. This work provides a generalizable framework for understanding and ultimately controlling point defects across large volumes, paving the way for the rational design of defect-engineered functional 2D materials.

2D materials↗
DOE OSTI2025

Revealing the evolution of order in materials microstructures using multi-modal computer vision

The development of high-performance materials for microelectronics, energy storage, and extreme environments depends on our ability to describe and direct property-defining microstructural order. Our present understanding is typically derived from laborious manual analysis of imaging and spectroscopy data, which is difficult to scale, challenging to reproduce, and lacks the ability to reveal latent associations needed for mechanistic models. Here, we demonstrate a multi-modal machine learning (ML) approach to describe order from electron microscopy analysis of the complex oxide La 1−x Sr x FeO 3 . We construct a hybrid pipeline based on fully and semi-supervised classification, allowing us to evaluate both the characteristics of each data modality and the value each modality adds to the ensemble. We observe distinct differences in the performance of uni- and multi-modal models, from which we draw general lessons in describing crystal order using computer vision.

36 MATERIALS SCIENCE↗
DOE OSTI2026

SODAs: sparse optimization for the discovery of differential and algebraic equations

Differential-algebraic equations (DAEs) integrate ordinary differential equations (ODEs) with algebraic constraints, providing a fundamental framework for developing models of dynamical systems characterized by time-scale separation, conservation laws and physical constraints. While sparse optimization has revolutionized model development by allowing data-driven discovery of parsimonious models from a library of possible equations, existing approaches for dynamical systems assume DAEs can be reduced to ODEs by eliminating variables before model discovery. This assumption limits the applicability of such methods for DAE systems with unknown constraints and time scales. We introduce sparse optimization for differential-algebraic systems (SODAs), a data-driven method for the identification of DAEs in their explicit form. By discovering the algebraic and dynamic components sequentially without prior identification of the algebraic variables, this approach leads to a sequence of convex optimization problems. It has the advantage of discovering interpretable models that preserve the structure of the underlying physical system. To this end, SODAs improves since SODAs is singular numerical stability when handling high correlations between library terms, caused by near-perfect algebraic relationships, by iteratively refining the conditioning of the candidate library. We demonstrate the performance of our method on biological, mechanical and electrical systems, showcasing its robustness to noise in both simulated time series and real-time experimental data.

DAE↗