Search NASA⌕ Search

SEARCH · Search NASA

Results for “Q learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Model-based, in-situ, non-destructive qualification and certification of parts made by autonomous additive manufacturing

To address the significant productivity challenges associated with the qualification and certification (Q&C) tasks of additively manufactured (AM) parts, which have traditionally relied on rigorous post‐build inspection and testing, we propose an integrated framework that combines model‐based qualification and certification (MBQ&C) with autonomous additive manufacturing (AAM). MBQ&C employs high‐fidelity predictive models, developed within the Integrated Computational Materials Engineering (ICME) paradigm, to simulate process–structure–property–performance relationships for assessing a part’s fitness for use. Since predictive models are commonly machine learning (ML)-based or reduced-order surrogates of validated physics models, they run efficiently, enabling timely inference. In parallel, the self-driving AAM utilises ML-based adaptive, closed‐loop control strategies to avoid, mitigate, or repair defects and anomalies during fabrication, thereby increasing the likelihood of producing acceptable parts. A key feature of the combined AAM-MBQ&C framework is that predictive models explicitly incorporate defects or anomalies that persist after the build, using instance-specific data captured via in-situ sensing. This customisation enables a build‐specific assessment of fitness for use, rather than relying on nominal or generic parameters. Such individualised evaluation provides a robust basis for Q&C-related acceptance decisions relating to each build. Additionally, the rapid solution capabilities of ML or reduced-order models enable the determination of a part’s suitability for service shortly after build completion. As the framework matures, it has the potential to substantially reduce reliance on conventional point‐design approaches—such as time‐consuming post‐build computed tomography scanning and costly destructive testing. Thus, the AAM-MBQ&C framework represents a transformative, scalable strategy for quality assurance of AM components, as parts produced within a stable, validated, and certified envelope can be certified with reduced testing. Key benefits include: (1) significant gains in Q&C productivity through efficient, model-centric assessment; (2) performance-based classification of defects into critical and non-critical categories; (3) the ability to predict potential deviations in the performance of parts affected by real-time, adaptive process control interventions relative to those produced under a certified process, and (4) the enabling of virtual Q&C for service environments that are difficult, hazardous, or impractical to access or reproduce experimentally. Collectively, these capabilities strengthen the business case for AM, particularly for high‐consequence and mission‐critical applications. Finally, although this work focuses on powder-based AM, the proposed techniques could be extended to AM processes employing alternative feedstock forms.

Gunasegaram, Dayalan↗

Microservice Architecture for Cognitive Networks

This develops the concept of a cognitive network and describes a microservice based architecture which could be used to implement such a system. Delay tolerant networking (DTN) influences the design of the architecture as well as the networking scenarios that the system attempts to address. A cognitive storage and fragmentation service is developed based on existing artificial intelligence techniques such as Advantage Actor Critic (A2C) and Deep Q-Networks. The system is simulated using OpenAI Gym in a custom developed DTN environment.

cognitive networks↗

Extraction of Drell-Yan Angular Parameters in $pp$ Collisions with a 120 GeV Beam Energy Using a Deep-Learning Unfolding Algorithm

Dilepton production in pp collisions through the Drell-Yan process provides a crucial tool for studying the internal quark-gluon structure of the nucleon. By precisely measuring the $\cos2\phi$ asymmetry, where $\phi$ represents the azimuthal angle of the $l^{+}l^{-}$ pair in the Collins-Soper frame, we can gain valuable insights into the proton’s structure and the transverse momentum ($q_{T}$) dependence of the $\cos2\phi$ asymmetry. SeaQuest, a fixed-target Drell-Yan experiment at Fermilab, involved an unpolarized proton beam colliding with unpolarized LH$_{2}$ and LD$_{2}$ targets. Measurements obtained from experiments typically require corrections for detector inefficiencies, smearing, and acceptance. Traditionally, these corrections involve “unfolding” the detector-level measurements through matrix operations. However, in higher-dimensional phase space, these conventional methods fail to scale effectively. To overcome these limitations, we employ an unbinned unfolding method that utilizes deep neural networks for unfolding higher-dimensional phase space. In this presentation, we will explain the design of the neural network architecture, our training strategies, and outline our plans to achieve conclusive results.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

The Right Amount of Glue: Technologies and Standards Relevant to a Future Solar-Terrestrial Data Environment

In order to meet the challenge of developing a new system science, we will need to employ technology that enables researchers to access data from fields with which they are at least initially unfamiliar as well as from sources they use more regularly. At the same time, the quantity of data to be obtained by missions such as the Solar Dynamics Observatory demands ease and simplicity of data access. These competing demands must in turn fit within severely constrained funding for data analysis in such projects. Based on experience in only a single discipline but with a diversity of data types and sources, we will give examples of technology that have made a significant difference in the way people do science. Similarly, we will show how adoption of a well-documented data format has made it easier for one community to search, reduce, and analyze data. We will also describe a community-supported data reduction and analysis software tree with useful features. We will attempt to generalize the lessons learned in these instances to features the broader, solar-terrestrial community might find compelling, while avoiding overdesign of a common data environment.

Gurman, J. B.↗

INSPIRED: Inelastic neutron scattering prediction for instantaneous results and experimental design

Inelastic neutron scattering (INS) has unique advantages in probing how atoms vibrate and how the vibrations propagate and interact. Such dynamic information is crucial in understanding various material properties, from heat capacity, thermal conductivity, phase transitions, and chemical reactions to more exotic quantum behavior. The analysis and interpretation of the INS spectra often start from a model structure of the sample, followed by a series of calculations to obtain the simulated spectra to compare with experiments. The conventional way to perform such calculations usually requires significant time, computing resources, and specialized expertise. Here, we present a new program named INSPIRED (Inelastic Neutron Scattering Prediction for Instantaneous Results and Experimental Design), which enables users to perform rapid INS simulations in several different ways on their personal computers in just a few clicks, with the crystal structure as the only input file. Specifically, the users can choose a pre-trained symmetry-aware neural network (coupled with an autoencoder) to predict the phonon density of states (DOS), 1D S(E) and 2D S(|Q|,E) spectra for any given structure. One can also choose an existing density functional theory (DFT) calculation from a database (containing over 12,000 crystals), and quickly obtain the simulated INS spectra for single crystals and powders. It is also possible to use pre-trained universal machine learning force fields to relax a given crystal structure, calculate the phonon dispersion and DOS, and, subsequently, the INS spectra. All these functions are implemented with a PyQt graphic user interface. Finally, we expect these new tools will benefit broad user communities and significantly improve the efficiency of experiment design, execution, and data analysis for INS.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Designing reinforcement learning algorithms for building HVAC control: From experimental observation to simulation comparisons

Advanced supervisory-level control with reinforcement learning (RL) is regarded as a promising solution for HVAC systems to minimize energy consumption while maintaining thermal comfort and indoor air quality. However, most RL applications were conducted in the simulation environment rather than real-world HVAC systems. This paper developed a value-based RL controller termed Deep Q-Network (DQN) for a typical central HVAC system and evaluated its performance in a building test facility. By comparing DQN with a rule-based controller, the study not only demonstrated the cases where DQN could properly maintain indoor comfort but also discussed possible reasons why DQN failed in some other situations. Recognizing the limitations of value-based RL algorithms from the experimental tests, a simulation study was conducted to compare DQN with an alternative RL approach, an actor–critic algorithm termed Deep Deterministic Policy Gradient (DDPG). In scenarios with a relatively large action space, DDPG outperformed DQN by requiring fewer computational resources and achieving better thermal comfort, lower energy consumption, and more stable control actions. The findings suggest that the ability of DDPG to handle continuous control variables more effectively allows for faster convergence in training and more precise control in practice, which enhances the overall efficiency and reliability of the HVAC system.

Guo, Fangzhou↗

Time-Accurate Computations of Isolated Circular Synthetic Jets in Crossflow

Results from unsteady Reynolds-averaged Navier-Stokes computations are described for two different synthetic jet flows issuing into a turbulent boundary layer crossflow through a circular orifice. In one case the jet effect is mostly contained within the boundary layer, while in the other case the jet effect extends beyond the boundary layer edge. Both cases have momentum flux ratios less than 2. Several numerical parameters are investigated, and some lessons learned regarding the CFD methods for computing these types of flow fields are outlined. Results in both cases are compared to experiment.

Rumsey, Christoper L.↗

Time-Accurate Computations of Isolated Circular Synthetic Jets in Crossflow

Results from unsteady Reynolds-averaged Navier-Stokes computations are described for two different synthetic jet flows issuing into a turbulent boundary layer crossflow through a circular orifice. In one case the jet effect is mostly contained within the boundary layer, while in the other case the jet effect extends beyond the boundary layer edge. Both cases have momentum flux ratios less than 2. Several numerical parameters are investigated, and some lessons learned regarding the CFD methods for computing these types of flow fields are summarized. Results in both cases are compared to experiment.

Rumsey, C. L.↗

How To Train Your Dragon (and Vice Versa) – Human Spaceflight Research and The First Commercial Crews

The International Space Station has been an orbiting laboratory for human spaceflight research for over 20 years. NASA’s human research implementation teams have worked to develop, refine, and execute pre-, in-, and post-flight sessions to collect critical research data that will enable future spaceflight missions. The teams have worked closely with the spaceflight vehicle teams, including those for Soyuz and the now retired Space Shuttle vehicles, to successfully conduct this research. As NASA has transitioned to commercial vehicles for transport of crews to the ISS, the implementation teams have expanded their scope to include the SpaceX and upcoming Boeing vehicles. This session will focus on the unique implementation needs for the first available commercial platform, SpaceX. We will identify implementation adjustments made to accommodate the SpaceX Dragon system, including crew training and preflight baseline data collection, inflight operations tied to landing, and postflight planning and crew testing, as well as offer lessons learned from the past three SpaceX long-duration crew missions. Representatives from the Flight Operations Directorate, including the Astronaut Office and the vehicle recovery team, will also provide their perspectives on this new system, and how it affects their work with the human research community. A panel discussion with dedicated time for Q&A will follow.

Pasha Morshedi↗

Electron-phonon interaction on optical spectra of nanoelectronic devices

Information obtained on the solid-state lattice dynamics by electron-phonon interaction between lattice phonons and electrons could open up to learn more about lattice dynamics and to apply it in nanoelectronic devices including software reliability, nano-size capacitors, master clock sources, as well as non-contact temperature probes on nano-electronic and photonicdevices.

electron-phonon interactions lattice dynamics SrTi↗

An Evening with NASA Scientists and Engineers: A Senior Living Community Outreach Program

Introduction: An Evening with NASA Scientists and Engineers is an outreach program for senior living communities, where participants learn from and interact with a scientist or engineer in a virtual setting. Participants learn about NASA science and engineering through a behind-the-scenes look from the people who work at NASA. The program focuses on both the stories behind the discoveries and the stories behind the people. The audience tunes in to the events via the NASA Zoom Webinar platform, where they have the opportunity to ask questions throughout the approximately 30-minute program. By bringing the audience into the conversation, we build rapport and thus improve their connection with NASA. Overview: An Evening with NASA Scientists and Engineers began in September 2020 when we identified a need for outreach to this particular demographic, as senior living communities had been hit especially hard by the COVID-19 pandemic. The program covers a wide range of topics, including heliophysics, astrophysics, planetary science, Earth science, planetary defense, and more, depending on what is topically appropriate at the time, and occurs on a roughly monthly basis. Each interactive presentation is between 20-25 minutes with 5-10 minutes of dedicated Q&A. Future dates and topics may change depending on new developments to NASA missions and stories. Audience: As of December 2021, we have four regularly attending senior living communities, spanning the East Coast from New Hampshire to Florida, with each joining the overall program at various stages of its development. The ability to reach many different senior living communities is crucial so that a diversity of people may benefit from this program. The audience consists of seniors with varying experience and comprehension levels – some are very familiar with the sciences while others are simply curious to learn more. Residents tune in to each event from their individual rooms or from their larger community rooms. RiverWoods Exeter. The RiverWoods Exeter community was our initial audience who acted as our “guinea pig” to see how this program might be implemented and to work out any major issues. They are located in Exeter, NH but also have two additional campuses in Durham, NH and Manchester, NH, that joined us a few months into the program. Culpepper Garden. Our second community to join the program was Culpepper Garden, a senior living community in Arlington, VA that provides both independent and assisted living housing to low-income seniors. Edinburgh Square. Our third community, Edinburgh Square, connected with us after hearing about the program through Culpepper Garden. Edinburgh Square is an HUD-subsidized retirement community in Roanoke, VA that houses both seniors and those living with disabilities. Moonstruck Astronomy Club. The Moonstruck Astronomy Club consists of residents from the On Top of the World retirement community in Ocala, FL and was the latest senior living community to join us. NASA Zoom Webinar: An Evening with NASA Scientists and Engineers reaches numerous senior living communities through live presentations that we host using the NASA Zoom Webinar virtual platform. Participants are typically already familiar with the Zoom platform which enables a lower barrier to entry. A recording of each talk is added to a designated video playlist on the NASA STEM YouTube channel so that audiences worldwide may view them [1]. These recordings began with our April 1, 2021 presentation, as this was when NASA Zoom Webinar was implemented, thus enabling us to record each talk. Metrics: We record attendance numbers from the senior living communities for each event as well as those from YouTube views after the presentation recording is posted online. Depending on which communities tune in, typical attendance numbers are between 60-100 people. RiverWoods Exeter has the most regularly attending residents, with an average of 55 attendees per event. As of December 2021, we have hosted fourteen events, nine of which were recorded and posted to our designated NASA STEM YouTube Channel playlist. The nine recordings combined have roughly 4,000 YouTube views thus far, with specific videos seeing higher view counts around launch dates (e.g. NASA’s DART mission) and trending topics (e.g. JWST). A list of speakers, topics, and links to presentation recordings is shown in Table 1. Future Program Expansion: Thus far, we have been adding communities on an individual basis. To make this process more streamlined, we are looking into working with senior living community networks and organizations such as LeadingAge [2]. In this manner, we will be able to reach more communities while also making it easier to send and receive relevant information.

S L Tiedeken↗

The Nature of C Asteroid Regolith from Meteorite Observations

Regolith from C (and related) asteroid bodies are a focus of the current missions Dawn at Ceres, Hayabusa 2 and OSIRIS REx. An asteroid as large as Ceres is expected to be covered by a mature regolith, and as Hayabusa demonstrated, flat and therefore engineeringly-safe ponded deposits will probably be the sampling sites for both Hayabusa 2 and OSIRIS REx. Here we examine what we have learned about the mineralogy of fine-grained asteroid regolith from recent meteorite studies and the examination of the samples harvested from asteroid Itokawa by Hayabusa.

Zolensky, M.↗

Downscaling Satellite Precipitation with Emphasis on Extremes: A Variational 1-Norm Regularization in the Derivative Domain

The increasing availability of precipitation observations from space, e.g., from the Tropical Rainfall Measuring Mission (TRMM) and the forthcoming Global Precipitation Measuring (GPM) Mission, has fueled renewed interest in developing frameworks for downscaling and multi-sensor data fusion that can handle large data sets in computationally efficient ways while optimally reproducing desired properties of the underlying rainfall fields. Of special interest is the reproduction of extreme precipitation intensities and gradients, as these are directly relevant to hazard prediction. In this paper, we present a new formalism for downscaling satellite precipitation observations, which explicitly allows for the preservation of some key geometrical and statistical properties of spatial precipitation. These include sharp intensity gradients (due to high-intensity regions embedded within lower-intensity areas), coherent spatial structures (due to regions of slowly varying rainfall),and thicker-than-Gaussian tails of precipitation gradients and intensities. Specifically, we pose the downscaling problem as a discrete inverse problem and solve it via a regularized variational approach (variational downscaling) where the regularization term is selected to impose the desired smoothness in the solution while allowing for some steep gradients(called 1-norm or total variation regularization). We demonstrate the duality between this geometrically inspired solution and its Bayesian statistical interpretation, which is equivalent to assuming a Laplace prior distribution for the precipitation intensities in the derivative (wavelet) space. When the observation operator is not known, we discuss the effect of its misspecification and explore a previously proposed dictionary-based sparse inverse downscaling methodology to indirectly learn the observation operator from a database of coincidental high- and low-resolution observations. The proposed method and ideas are illustrated in case studies featuring the downscaling of a hurricane precipitation field.

Hurricanes↗

Deconvoluting thermomechanical effects in X-ray diffraction data using machine learning

X-ray diffraction is ideal for probing the sub-surface state during complex or rapid thermomechanical loading of crystalline materials. However, challenges arise as the size of diffraction volumes increases due to spatial broadening and because of the inability to deconvolute the effects of different lattice deformation mechanisms. Here, we present a novel approach that uses combinations of physics-based modeling and machine learning to deconvolve thermal and mechanical elastic strains for diffraction data analysis. The method builds on a previous effort to extract thermal strain distribution information from diffraction data. The new approach is applied to extract the evolution of the thermomechanical state during laser melting of an Inconel 625 wall specimen which produces significant residual stress upon cooling. A combination of heat transfer and fluid flow, elasto-plasticity and X-ray diffraction simulations is used to generate training data for machine-learning (Gaussian process regression, GPR) models that map diffracted intensity distributions to underlying thermomechanical strain fields. First-principles density functional theory is used to determine accurate temperature-dependent thermal expansion and elastic stiffness used for elasto-plasticity modeling. The trained GPR models are found to be capable of deconvoluting the effects of thermal and mechanical strains, in addition to providing information about underlying strain distributions, even from complex diffraction patterns with irregularly shaped peaks.

36 MATERIALS SCIENCE↗

OSIRIS-REx Earth Return & Entry: Navigation Operations & Lessons Learned

The Origins, Spectral Interpretation, Resource Identification, and Security–Regolith Explorer (OSIRIS-REx) spacecraft successfully returned to Earth on September24, 2024, safely delivering its Sample Return Capsule (SRC) to the Utah Test and Training Range (UTTR). This paper describes the navigation operations that occurred between the departure from Bennu and the return of the SRC. An overview is given of the Flight Dynamics System (FDS) that includes tracking, orbit determination (OD), maneuver planning, and interfaces with entry, descent, and landing. Operational details on the SRC release criteria and conjunction assessment considerations are also provided. Lessons learned are presented that may help future sample return or interplanetary entry missions.

Kenneth M. Getzandanner↗

Highest fusion performance without harmful edge energy bursts in tokamak

The path of tokamak fusion and International thermonuclear experimental reactor (ITER) is maintaining high-performance plasma to produce sufficient fusion power. This effort is hindered by the transient energy burst arising from the instabilities at the boundary of plasmas. Conventional 3D magnetic perturbations used to suppress these instabilities often degrade fusion performance and increase the risk of other instabilities. This study presents an innovative 3D field optimization approach that leverages machine learning and real-time adaptability to overcome these challenges. Implemented in the DIII-D and KSTAR tokamaks, this method has consistently achieved reactor-relevant core confinement and the highest fusion performance without triggering damaging bursts. This is enabled by advances in the physics understanding of self-organized transport in the plasma edge and machine learning techniques to optimize the 3D field spectrum. The success of automated, real-time adaptive control of such complex systems paves the way for maximizing fusion efficiency in ITER and beyond while minimizing damage to device components.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Observation of the singly Cabibbo-suppressed decay Λ c + → p π 0

Utilizing 4.5 fb − 1 of e + e − annihilation data collected with the BESIII detector at the BEPCII collider at center-of-mass energies between 4.600 and 4.699 GeV, the first observation of the singly Cabibbo-suppressed decay Λ c + → p π 0 is presented, with a statistical significance of 5.4 σ . The ratio of the branching fractions of Λ c + → p π 0 and Λ c + → p η is measured as B ( Λ c + → p π 0 ) / B ( Λ c + → p η ) = ( 0.120 ± 0.02 6 stat ± 0.00 7 syst ) . This result resolves the longstanding discrepancy between earlier experimental searches, providing both a decisive conclusion and valuable input for QCD-inspired theoretical models. A sophisticated deep learning approach using a Transformer-based architecture is employed to distinguish the signal from the prevalent hadronic backgrounds, complemented by thorough validation and systematic uncertainty quantification. Published by the American Physical Society 2025

Ablikim, M.↗

DIP for Service Providers

The second DIP workshop’s topic is DIP for Service Providers. The workshop presentation covers topics such as DIP onboarding process, service authentication, catalog service capabilities, API requirements, NASA services and their access points, and data requirements for service providers. The Onboarding Process describes the required documentation that enables to collaborate with NASA as well as other industry partners through DIP. Also, step by step approach for the partner to take to register services or consme services through the DIP platform. The Catalog Service describes the different ways for the users to search for services that are of interest as well as registering services to the platform, so other users can search and discover. The API Requirements and Service Specifications describes the benefits of DIP's API management approach via API Gateway where services are managed centrally but ownership is decentralized and partners completely own the administration of their own services. NASA Services and Data Access Points topic describes the services, both data access service and machine learning prediction service, that NASA provides via the DIP platform in near time and post operations via REST API endpoints defined on the API Gateway. Also, NASA's approach for data storage process is explained. The Data Requirements for service providers describes the requirements for storing and exposing to support the performance of services that are provided by the service providers. Lastly, NASA's technology development plan with preliminary scheduler will be presented. There will be a Q&A session at the end of each segment of the presentation to solicit feedback from the participants.

ATM-X↗