Reinforcement learning framework for the mechanical design of microelectronic components under multiphysics constraints

Nair, Siddharth [Purdue University]; Walsh, Timothy [Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)] (ORCID:0000000295274025); Pickrell, Gregory William [Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)] (ORCID:0000000303377236); Semperlotti, Fabio [Purdue University]

doi:10.1007/s00158-026-04416-5

DOE OSTI · 3683812

Reinforcement learning framework for the mechanical design of microelectronic components under multiphysics constraints

Nair, Siddharth [Purdue University]·Walsh, Timothy [Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)] (ORCID:0000000295274025)·Pickrell, Gregory William [Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)] (ORCID:0000000303377236)·Semperlotti, Fabio [Purdue University]

View original source ↗Read source document ↗Export metadata ↓

Abstract

The source did not provide an abstract. Follow the original record for more information.

Keep this discovery

BibTeX RIS

Nair, Siddharth [Purdue University], Walsh, Timothy [Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)] (ORCID:0000000295274025), Pickrell, Gregory William [Sandia National Laboratories (SNL-NM), Albuquerque, NM (United States)] (ORCID:0000000303377236), Semperlotti, Fabio [Purdue University]. 2026-08-01. Reinforcement learning framework for the mechanical design of microelectronic components under multiphysics constraints. https://doi.org/10.1007/s00158-026-04416-5

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related discoveries

NASA NTRS2026

Deep RL for Fast Long-Horizon Operations Scheduling on NASA's Carruthers Geocorona Observatory Mission

Spacecraft operations scheduling is a highly constrained, long-horizon combinatorial optimization problem that traditionally relies on heuristics, constraint programming, or manual planning. We present a scalable deep reinforcement learning framework developed and deployed for NASA’s Carruthers Geocorona Observatory mission. Our framework introduces a macro-action abstraction known as activity blocks coupled with dynamic action-masking to navigate the intractably large search space and strictly enforce complex power, thermal, and instrument constraints. The resulting architecture generates globally feasible schedules with overwhelming probability, establishes operational trust, and executes a full training cycle in under six hours, circumventing the need for policy robustness by enabling rapid, on-demand retraining. Further, resulting schedules outperform baseline heuristics in scheduled science quality. The deep reinforcement learning framework was deployed as the default operational scheduler for the Carruthers Geocorona Observatory mission from the outset of the mission, demonstrating that deep reinforcement learning can be trusted for real spacecraft operations under complex, evolving constraints.

Geocorona↗

DOE OSTI2026

Optimization of the FRIB beam dump: a hybrid genetic algorithm and reinforcement learning approach

The operational envelope of high-power-density systems, such as particle accelerators and advanced nuclear energy systems, is critically constrained by the need to manage extreme thermal loads. To address this, we present a novel hybrid optimization framework combining a genetic algorithm (GA) with a soft actor-critic (SAC) deep reinforcement learning agent. This framework was applied to a practical high-heat-flux problem: redesigning the beam dump at the Facility for Rare Isotope Beams (FRIB) for a power upgrade from 20 kW to 50 kW. The resulting design, validated by three-dimensional conjugate heat transfer simulations, suppresses hazardous hot spots and yields a markedly more uniform temperature distribution. This provides a robust operating margin, increasing the average power-handling capability by 72% relative to the current design, demonstrating the framework’s potential to solve complex thermal management challenges in both accelerator technology and advanced nuclear systems.

Accelerator↗

DOE OSTI2024

User-Centric Communication With Aerial Network for 6G: A Reinforcement Learning Approach

Meeting the diverse needs of user verticals requires innovative cellular architectures that can offer additional degrees of freedom to provide on-demand services. The terrestrial user-centric radio access network (UC-RAN) stands out as an excellent choice for this purpose. However, a drawback of UC-RAN is its tendency to prioritize high-priority verticals, often resulting in a subpar quality of experience for low-priority verticals. This issue is particularly exacerbated in hotspot areas. Here, to address this problem, we introduce an aerial network integrated with terrestrial UC-RAN to provide coverage to users which are not served by the terrestrial network. Furthermore, we analyze the impact of key configuration and optimization parameters (COPs), such as location, transmit power, altitude, and beamwidth of aerial base stations (ABSs) on system key performance indicators (KPIs), such as coverage, latency satisfaction, average spectral efficiency, and energy efficiency. We formulate a robust multiobjective function to maximize these KPIs without biasing toward any specific KPI(s). Finally, we propose a deep reinforcement learning optimization framework based on the state-of-the-art soft actor-critic algorithm to control ABS COPs and optimize system KPIs. Experimental evaluations demonstrate that the proposed optimization framework can converge to near-optimal solutions derived from the pseudo brute force in a few thousand epochs.

6G↗