Search NASA⌕ Search

SEARCH · Search NASA

Results for “deep reinforcement learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

316 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1983

The Deep Space Network: A Radio Communications Instrument for Deep Space Exploration

The primary purpose of the Deep Space Network (DSN) is to serve as a communications instrument for deep space exploration, providing communications between the spacecraft and the ground facilities. The uplink communications channel provides instructions or commands to the spacecraft. The downlink communications channel provides command verification and spacecraft engineering and science instrument payload data.

N A Renzetti↗
NASA NTRSDate not supplied

Advancing Wildfire Monitoring with TEMPO and ML tools: Hourly Smoke and Fire‑Front Mapping and Near‑Surface NO₂ Predictions

Wildfires impose substantial impacts on communities and regions downwind of wildfire smoke. We present a TEMPO‑enabled workflow that generates value‑added Level‑3 smoke‑plume masks and fire‑front maps for large wildfires, such as 2024 Park Fire, using the self‑supervised deep learning system SIT‑FUSE, along with near‑surface NO₂ predictions produced by a foundation model (Microsoft Aurora). We conclude by outlining a roadmap for expanding these capabilities to additional Western U.S. wildfire events and for delivering actionable tools to stakeholders. This open-source, reproducible workflow provides a scalable framework for cross-agency wildfire monitoring to overcome traditional limitations in smoke-cloud discrimination and air-quality forecasting by incorporating TEMPO data and beyond.

Xiaohua Pan↗
NASA NTRS1976

The Deep Space Network Progress Report 42-33, March and April 1976

This report describes work performed for the JPL/NASA Deep Space Network (DSN). Progress is presented on DSN supporting research and technology, advanced development and engineering, and implementation, and DSN operations which pertain to mission-independent or multiple-mission development as well as to support of flight projects. Each issue contains a description of the functions and facilities of the DSN.

JPL Staff↗
NASA NTRS1993

Preliminary Design and Implementation of the Baseline Digital Baseband Architecture for Advanced Deep Space Transponders

The baseline design and implementation of the digital baseband architecture for advanced deep space transponders is investigated and identified. Trade studies on the selection of the number of bits for the analog-to-digital converter (ADC) and optimum sampling schemes are presented. In addition, the proposed optimum sampling scheme is analyzed in detail. Descriptions of possible implementations for the digital baseband (or digital front end) and digital phase-locked loop (DPLL) for carrier tracking are also described.

T M Nguyen↗
NASA NTRS1977

Deep Electromagnetic Sounding of the Moon With Lunokhod 2 Data

Results of electromagnetic sounding distinguished an outer high resistance shell about 200 km thick in the moon's structure. A preliminary petrological interpretation of the moon's layers indicated their origin as a consequence of differentiation of the initial peridotite material. Upon melting, 20% to 40% of the material melts and is removed to form a high resistance basaltic shell underlain by a layer of spinal peridotites enriched in divalent iron oxides and having a reduced resistance.

L L Van'yan↗
DOE OSTI2025

Socio-Techno-Economic Feasibility of Deep Geothermal with EGS for Residential District Heating in the Northeastern United States

In this paper, we present socio-techno-economic simulation results for enhanced geothermal system (EGS) district heating systems in the northeastern United States. We applied the geospatial Distributed Geothermal Market Demand (dGeo) tool coupled with GEOPHIRES to evaluate the feasibility of geothermal deep direct-use, utilizing EGS reservoirs for providing residential heating with district heating systems. The results were combined with JEDI results to assess social impacts. Simulation results assuming doublet EGS reservoirs with target production temperature of 80 degrees C and newly constructed district heating systems indicate a wide range in system levelized cost of heat (LCOH) values ranging from ~$15/MMBtu to over $1,000/MMBtu, with most the attractive regions urban areas with high total thermal demand and high thermal demand density. We estimate about 60 GWth in potential installed capacity with LCOH values under $50/MMBtu and 100 GWth in potential capacity with LCOH values under $100/MMBtu, respectively.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Tensorized Interior Radiative Heat Transfer for a Scalable and Calibrated Building Energy Simulator

Building energy simulation is a critical tool for developing and testing advanced control strategies, such as Reinforcement Learning (RL), to provide demand flexibility and affordable energy costs. The recently introduced Smart Buildings Control Suite (sbsim) provides a lightweight, scalable, and data-calibrated simulation environment based on a 2D finite-difference model. However, the initial model primarily focused on conductive and convective heat transfer, neglecting the significant impact of long-wave radiative heat exchange between interior surfaces. This paper presents a significant extension to the sbsim framework by incorporating a physically-grounded model for interior radiative heat transfer. Our primary contribution is the development and integration of a fully tensorized radiative heat transfer module, which preserves the computational efficiency and scalability of the original simulator. This was achieved by developing a pipeline for view factor calculation, including an algorithm to identify directly seeing surfaces within complex floor plans, and formulating the net radiation equations for efficient execution on modern hardware accelerators. We validate the numerical accuracy of our tensorized implementation by comparing its results against a traditional iterative approach, demonstrating identical outcomes. This enhancement increases the physical fidelity of sbsim, enabling more accurate training of RL agents for building energy optimization.

Ham, Sang woo↗
DOE OSTI2026

PET waste- and bio-derived imine vitrimers for shape-memory, intrinsic flame-retardant, and recyclable carbon fiber composites

Developing circular multifunctional vitrimers and carbon fiber–reinforced polymers (CFRPs) that are simultaneously recyclable, mechanically robust, and intrinsically flame retardant remains a major challenge. Here, in this study, we report multifunctional vitrimers and their carbon fiber–reinforced vitrimer (CFRV) composites, where the vitrimer design integrates closed-loop recyclability, enhanced interfacial adhesion, and intrinsic flame retardancy within a single materials platform. The vitrimer matrix is synthesized from post-consumer polyethylene terephthalate (PET) waste and a vanillin-derived phosphorus-containing crosslinker, forming an imine-based network. The resulting vitrimer resin exhibits high tensile strength, thermal healability, repeated reprocessability, programmable shape memory, and rapid chemical depolymerization under mild conditions. Amine-functionalized carbon fibers significantly improve fiber–matrix interfacial bonding, yielding CFRVs with tensile strengths up to 789 MPa and complete recovery of structurally intact fibers after chemical recycling. The phosphorus-rich aromatic network further imparts intrinsic flame retardancy, enabling self-extinguishing behavior without external additives. This work advances a materials design paradigm for next-generation multifunctional, sustainable vitrimers and CFRVs, while simultaneously addressing the recycling challenges associated with both plastic and CFRP waste.

Bio-derived crosslinker↗
DOE OSTI2026

Aragonite saturation horizon variability along North Pacific seamounts and implications for deep-sea coral reefs

The 2014 discovery of living deep-sea coral reefs along the Northwest Hawaiian Islands (NWHI) and lower Emperor Seamount Chain (ESC), despite the North Pacific’s shallow aragonite saturation horizon (ASH) and high CaCO3 dissolution rates, underscores the need to understand the local seawater chemistry that allows these reefs to persist. We investigated seawater carbonate chemistry using discrete samples along the NWHI and ESC from two cruises ~1 year apart (08/26/21 – 09/26/21, 09/09/22 – 10/24/22). Across the two cruises, ASH depth difference ranged from 15 to 77 m. Since the Pacific ASH shoals by 1–2 m yr?¹, this long-term trend cannot explain the magnitude of ASH change observed between cruises. Temperature-salinity plots similarly indicate no major shifts in intermediate water masses that could account for these changes. Instead, ASH depth variability was primarily governed by localized biogeochemical processes, namely changes in intermediate water respiration and CaCO3 dissolution. Indicators for dissolution (TA*) and respiration (AOU) suggest changes in ASH depth were driven by changes in dissolution at the northern- and southern-most sites, whereas respiration exerted stronger control at central sites. Combining 2021 and 2022 data with data from 2014 – 2019 (excluding 2018) revealed high interannual ASH variability, by as much as >200 m at one site. Deep-sea coral reefs across the NWHI and ESC currently reside close to the ASH depth and likely experience seasonal and interannual shifts between under- and supersaturation. As ocean acidification progresses however, persistent exposure to undersaturated seawater could further threaten these critical deep-sea ecosystems.

coral reefs↗
DOE OSTI2024

Hamiltonian switching control of noisy bipartite qubit systems

Abstract We develop a Hamiltonian switching ansatz for bipartite control that is inspired by the quantum approximate optimization algorithm, to mitigate environmental noise on qubits. We demonstrate the control for a central spin coupled to bath spins via isotropic Heisenberg interactions, and then make physical applications to the protection of quantum gates performed on superconducting transmon qubits coupling to environmental two-level-systems (TLSs) through dipole-dipole interactions, as well as on such qubits coupled to both TLSs and a Lindblad bath. The control field is classical and acts only on the system qubits. We use reinforcement learning with policy gradient to optimize the Hamiltonian switching control protocols, using a fidelity objective for specific target quantum gates. We use this approach to demonstrate effective suppression of both coherent and dissipative noise, with numerical studies achieving target gate implementations with fidelities over 0.9999 (four nines) in the majority of our test cases and showing improvement beyond this to values of 0.999 999 999 (nine nines) upon a subsequent optimization by GRadient Ascent Pulse Engineering (GRAPE). We analyze how the control depth, total evolution time, number of environmental TLS, and choice of optimization method affect the fidelity achieved by the optimal protocols and reveal some critical behaviors of bipartite control of quantum gates.

Physics↗
DOE OSTI2024

An Overview of Electric Vehicle Load Modeling Strategies for Grid Integration Studies

The adoption of electric vehicles (EVs) has emerged as a solution to reduce greenhouse gas emissions in the transportation sector, which has motivated the implementation of public policies to promote their use in several countries. However, the high adoption of EVs poses challenges for the electricity sector, as it would imply an increase in energy demand and possible impacts on the power quality (PQ) of the power grid. Therefore, it is important to conduct EV integration studies in the power grid to determine the amount that can be incorporated without causing problems and identify the areas of the power sector that will require reinforcements. Accurate EV load patterns are required for this type of study that, through mathematical modeling, reflect both the dynamic behavior and the factors that influence the decision to recharge EVs. This article aims to present an overview of EVs, examine the different factors considered in the literature for modeling EV load patterns, and review modeling methods. EV load modeling methods are classified into deterministic, statistical, and machine learning. The article shows that each modeling method has its advantages, disadvantages, and data requirements, ranging from simple load modeling to more accurate models requiring large datasets.

Computer Science↗
DOE OSTI2026

Are Deep Energy Retrofits in Commercial Buildings Including Window Upgrades?

U.S. Commercial buildings account for about 20% of total U.S. energy consumption. Because the thermal performance of windows significantly affects building energy efficiency and HVAC system performance, best practice guidance often includes window and envelope improvements in conjunction with HVAC upgrades to optimize energy use and improve occupant comfort. It is an open question, however, regarding how often these best practices are implemented in the field. This paper aims to address that gap by conducting a literature review and a series of interviews with commercial building auditing and management professionals to explore the factors that drive window retrofits in commercial buildings. The paper explores a range of case studies from deep energy retrofits across the globe, comparing projects with and without window retrofits. The primary goals of this review are to: (1) provide data from real-world case studies illustrating the role of windows in deep energy renovations and HVAC upgrades, (2) conduct retrofit cost analyses for windows and high-performance HVAC systems and (3) offer insights into how window upgrade decisions are made and when they are implemented as part of deep energy retrofits. Most of the retrofit studies focused exclusively on high performance HVAC upgrades without considering how window upgrades might further enhance the overall energy efficiency of commercial buildings. Interviews with building industry experts shed light on the key factors influencing deep energy retrofit decisions and what factors tip the scales in favor of including window measures with more comprehensive retrofit projects.

Cort, Katherine↗
NASA NTRSDate not supplied

First N 2 Profile for Venus’ Deep Lower Atmosphere

We present the first N 2 profile for Venus’ deep lower atmosphere (<15 km) and a constrained isotopic composition for cloud N 2 [1]. This work directly addresses unresolved questions for Venus using legacy observations. Prior to this work, there were no reported measurements for N 2 abundances at <15 km and the isotopic composition remained unconstrained [2]. The N 2 parameters are critical to understanding the evolution and thermal properties of the atmosphere [3-7]. Our N 2 results were obtained by re-analysis of data acquired in 1978 by the Pioneer Venus Large Probe Neutral Mass Spectrometer (LNMS) [8]. The archived mass spectra from 64.2 to 0.2 km were treated using the analytical procedures specifically developed for the LNMS [9-11]. Judicious peak fitting permitted disambiguation of (A) N 2 + and CO + at 28 u and (B) 14 N 15 N+, 13 CO + , and C 2 H 5 + at 29 u. Quality controls included comparing the (A) LNMS CO + /CO 2 + ratios to the NIST database and literature and (B) fitted counts for CO + to the expected counts of CO + calculated from C 18 O + and 13 CO + using the LNMS 16 O/ 18 O and 12 C/ 13 C ratios (obtained from CO 2 ). Our results show that N 2 is uniformly mixed across the deep lower atmosphere between ~0.2 and 15 km (2.49 ± 0.10 v%). In contrast, N 2 is non-uniformly mixed across the sub-cloud atmosphere and clouds (~15–59 km), where N 2 abundances increase by ~ 2-fold between ~15 km (2.45 ± 0.32 v%) and ~59-51 km (5.21 ± 0.18 v%). Using the cloud data, we also obtained a constrained 15 N/ 14 N ratio (2.93×10 -3 ± 0.13×10 -3 ) and δ 15 N value (-204 ± 35‰). Thus, the LNMS results [1] suggest that (A) the atmosphere is unstable at <15 km, (B) N 2 is not well-mixed >15 km, and (C) the cloud δ 15 N falls between Earth and the solar wind [12, 13]. Comparisons of the N 2 abundances and isotopic compositions for nitrogen, carbon, and oxygen to other Venus measurements will be discussed.

deep lower atmosphere↗
DOE OSTI2023

Radiolytically reworked Archean organic matter in a habitable deep ancient high-temperature brine

Abstract Investigations of abiotic and biotic contributions to dissolved organic carbon (DOC) are required to constrain microbial habitability in continental subsurface fluids. Here we investigate a large (101–283 mg C/L) DOC pool in an ancient (>1Ga), high temperature (45–55 °C), low biomass (10 2 −10 4 cells/mL), and deep (3.2 km) brine from an uranium-enriched South African gold mine. Excitation-emission matrices (EEMs), negative electrospray ionization (–ESI) 21 tesla Fourier-transform ion cyclotron resonance mass spectrometry (FT-ICR MS), and amino acid analyses suggest the brine DOC is primarily radiolytically oxidized kerogen-rich shales or reefs, methane and ethane, with trace amounts of C 3 –C 6 hydrocarbons and organic sulfides. δ 2 H and δ 13 C of C 1 –C 3 hydrocarbons are consistent with abiotic origins. These findings suggest water-rock processes control redox and C cycling, helping support a meagre, slow biosphere over geologic time. A radiolytic-driven, habitable brine may signal similar settings are good targets in the search for life beyond Earth.

Science & Technology - Other Topics↗
NASA NTRS1996

Planetary and Deep Space Requirements for Photovoltaic Solar Arrays

In the past 25 years, the majority of interplanetary spacecraft have been powered by nuclear sources. However, as the emphasis on smaller, low cost missions gains momentum, more deep space missions now being planned have baselined photovoltaic solar arrays due to the low power requirements (usually significantly less than 100 W) needed for engineering and science payloads. This will present challenges to the solar array builders, inasmuch as planetary requirements usually differ from earth orbital requirements. In addition, these requirements often differ greatly, depending on the specific mission; for example, inner planets vs. outer planets, orbiters vs. flybys, spacecraft vs. landers, and so on. Also, the likelihood of electric propulsion missions will influence the requirements placed on solar array developers. This paper will discuss representative requirements for a range of planetary and deep space science missions now in the planning stages. We have divided the requirements into three categories: Inner planets and the sun; outer planets (greater than 3 AU); and Mars, cometary, and asteroid landers and probes. Requirements for Mercury and Ganymede landers will be covered in the Inner and Outer Planets sections with their respective orbiters. We will also discuss special requirements associated with solar electric propulsion (SEP). New technology developments will be needed to meet the demanding environments presented by these future applications as many of the technologies envisioned have not yet been demonstrated. In addition, new technologies that will be needed reside not only in the photovoltaic solar array, but also in other spacecraft systems that are key to operating the spacecraft reliably with the photovoltaics.

C P Bankston↗