Search NASA⌕ Search

SEARCH · Search NASA

Results for “Remote Operation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

S-QGPU: Shared quantum gate processing unit for distributed quantum computing

We propose a distributed quantum computing (DQC) architecture in which individual small-sized quantum computers are connected to a shared quantum gate processing unit (S-QGPU). The S-QGPU comprises a collection of hybrid two-qubit gate modules for remote gate operations. In contrast to conventional DQC systems, where each quantum computer is equipped with dedicated communication qubits, S-QGPU effectively pools the resources (e.g., the communication qubits) together for remote gate operations, and, thus, significantly reduces the cost of not only the local quantum computers but also the overall distributed system. Our preliminary analysis and simulation show that S-QGPU's shared resources for remote gate operations enable efficient resource utilization. When not all computing qubits (also called data qubits) in the system require simultaneous remote gate operations, S-QGPU-based DQC architecture demands fewer communication qubits, further decreasing the overall cost. Alternatively, with the same number of communication qubits, it can support a larger number of simultaneous remote gate operations more efficiently, especially when these operations occur in a burst mode.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Adaptive Control for Load-Following of Boiling Water Reactors Part I: Linear Systems and Fully-Observable Dynamics

Automation control is a key strategy to improve the economic competitiveness of nuclear power plants. Not only does it help reduce operational costs, but it also extends the value proposition of these plants to nontraditional markets, including unattended operations in remote villages and space. However, the dynamics of the operating environments of nuclear reactors are subject to changes over time, and there are no widely adopted methods to ensure that the automation strategy will remain effective over the extended durations required for these applications. Adaptive control is a discipline that offers the possibility to accommodate such changes online. However, it relies on mathematical assumptions that must be respected to ensure robustness and reliability. In this work, we derive an adaptive control formulation for linear systems in which all states are observable and apply it to an instance of load-follow operation for Boiling Water Reactors. We assumed uncertainty in two factors: the temperature coefficient and the control rod worth, both of which are affected over time by the evolution of the nuclear reactor core environment. With an arbitrary penalty factor of 5, we found that the mean absolute and integral time absolute errors can be reduced by more than 90%, underscoring the strength of adaptive control. To extend the application to more challenges, different uncertainties and load-follow trajectories, as well as new formulations that include non-linearity and partial observability, are currently being developed.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Practical Insights on Applying Simulation-Based Control Methods in Experimental Studies

Advanced nuclear reactors are crucial to the future of energy both in the United States and around the globe. In contrast to the current operating fleet, they are characterized as being deployable in remote locations and able to operate in semi-autonomous or autonomous fashion. This leap forward necessitates a new reactor control paradigm. Because advanced nuclear reactors are still under development in the United States, the creation of new control methods to achieve autonomous operations has been based on systems modeling and simulation. However, an important factor in successfully deploying these new control methods is the ability to seamlessly transition from simulation environments to real-world settings. Control methods tested in both simulation and experimental settings need to be investigated in the context of advanced reactor applications. This work developed a series of simple controllers for Idaho National Laboratory (INL)’s Microreactor Applications Research Validation and Evaluation (MARVEL) microreactor operating in load-following scenarios. These controllers were tested in both simulation and experimental settings, and a comparative performance analysis was performed. The simulation tests leveraged the Control and Optimization Modular Modeling Application for Nuclear Deployment (COMMAND) software developed in a previous stage of the current effort, along with the MARVEL Reactor Excursion and Leak Analysis Program (RELAP5-3D) and Monte Carlo N-Particle (MCNP) models. The experimental tests leveraged the COMMAND software, MARVEL models, and the U.S. Department of Energy Microreactor Program’s Microreactor Automated Control System (MACS). MACS was developed to serve as a control method testbed. It was customized to mirror the MARVEL microreactor, and COMMAND enabled MACS to emulate the physics of MARVEL. The load-following controller was developed using the simulation platform, with efforts to emulate real systems by introducing actuator saturation and noise. These factors were incrementally accounted for in the controller design. After finalizing the controller design, it was implemented with the experimental setup. The experimental conditions tested included an initial test under conditions similar to the final simulation test, and two additional scenarios. The first scenario introduced additional actuator saturation to account for equipment aging over time, which was unknown to the controller. The second scenario introduced sensor delay, a phenomenon anticipated with the use of remote operations or wireless communication in advanced reactors. These tests revealed several notable differences. While the controller performed well in simulation, it exhibited several limitations when transitioning to hardware. The main challenges involved maintaining the steady-state target power, as evidenced by larger error values between the true reactor power and setpoint power, as well as persistent oscillations in controlled reactor power. These issues could lead to unacceptable transient conditions in real reactor testing. Introducing actuator aging and stochastic delays in the experimental setup significantly impacted controller performance, resulting in increased overshoot and undershoot, and exacerbated error and oscillations previously mentioned. These findings underscore the importance of experimental testbeds for testing and validating control methods, as controllers developed using only theory and/or simulation may perform unexpectedly when applied to actual hardware. This research emphasizes the need for an experimental testbed for achieving such validation.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Innovative Advanced Hydrogen Mobile Fueler (Final Technical Report)

The US Department of Energy (DOE) funded a project to design, develop, deploy and analyze the economic viability of an innovative Advanced Hydrogen Mobile Fueler (AHMF). As part of the design activity the project team defined specifications based upon vehicle requirements and compliance with specific fueling performance criteria. The AHMF was originally designed to fuel 10-20 fuel cell vehicles (FCV) per day, consistent with the requirements of the H70 fueling category. The AHMF is able to operate without remote power connections, is modular for easy transport and deployment, and can provide expanded daily capacity and multi-day operations using delivered gaseous hydrogen. Toward the end of the project, due to request from the hydrogen industry and some necessary modifications of the AHMF, the system is now modified to fuel heavy duty vehicles. The project was conducted over two primary phases, each including several key tasks, subtasks, and project milestones. Phase 1 involved the design, development, and construction of the AHMF, moving from a conceptual design through to completion of assembly and testing. In addition to reviewing several different approaches, the team chose to take a conventional station design and modify it for mobile fueling. There were several innovative components included in the design. The high pressure storage was the first to achieve a US Department of Energy (DOE) Special Permit (SP 20391) to transport high pressure hydrogen (95 MPa) in a composite cylinder. The second novel system was a liquid nitrogen (LIN) cooling system with a compact heat exchanger. Without this change, the cooling system would not be able to fit into the AHMF. Phase 2 demonstrated the AHMF by fueling fuel cell buses at a fleet in Pomona, CA. The site was chosen because a temporary fueling solution was required while a fixed station was being installed. The existing permits for the fixed station and non-public access also was a determining factor. Over two months, the buses were fueled 320 times with over 5000 kg of hydrogen from tube trailers. Existing shore power was used, and the average electrical efficiency was 0.13 kWh/kg. The average liquid nitrogen (LIN) consumption was 90.68 scf/kg. The fueling and consumption data was provided to the National Renewable Energy Laboratory (NREL) for analysis. An economic analysis was performed and will be provided in a separate report. The project was successful, but not without challenges and lessons learned. The DOT special permit led the way for the use of high pressure, composite cylinders and is being by multiple other systems and applications. The pandemic along with time for the DOT special permit approval delayed the project for years. The team also believes that hydrogen mobile fueling has a use for the industry, especially during this upcoming phase of expansion. However, it does have its limitations due to high cost to build and operate, and the same permitting challenges as a fixed station. A fully capable system at the speeds and pressures of the AHMF may not be necessary for most applications and would help reduce the cost and increase storage capacity. The on-board generator can be easily replaced with shore power or the wide range of power generation solutions in the marketplace. One of the major results of the project was the development of new code language in National Fire Protection Agency (NFPA) 2 and the International Fire Code (IFC) for on-demand mobile fueling. This will provide guidance for Authorities Having Jurisdiction (AHJ) and user on how to permit temporary fueling sites across the nation.

08 HYDROGEN↗

Bridging Cloud and Edge Computing at NREL Using CONNECT: Cloud Optimized Networking for Next-Gen Edge Computing Technologies [Slides]

CONNECT is an innovative on-premise hardware and software solution that integrates edge and cloud computing infrastructure at NREL. Built on the AWS Greengrass middleware and leveraging the MQTT protocol, CONNECT enables real-time data streaming from IoT devices and gateways to both cloud and local services, empowering researchers to rapidly capture, analyze, and act upon edge-generated data while leveraging cloud capabilities. The platform addresses research infrastructure challenges by providing a pre-approved platform which is already configured with the correct networking and cybersecurity baselines thus eliminating procurement delays and enabling on-demand availability. CONNECT's hybrid architecture efficiently manages burstable workloads, allowing research teams to dynamically scale computational capacity, handle peak data loads, and reduce operational bottlenecks. Advanced capabilities include built-in GPU support for executing machine learning models which enables low-latency inference at the edge from models trained in the cloud. This architecture supports real-time analytics and filtering, providing a mechanism to allow only transmitting and processing high-value data. Cloud-based configuration management permits engineers to manage on-premise systems remotely, optimizing operational efficiency. By bridging edge and cloud computing, CONNECT provides NREL researchers with a flexible, scalable platform that accelerates scientific discovery while maintaining robust security and performance standards.

97 MATHEMATICS AND COMPUTING↗

Enhancement of microwave to optical spin-based quantum transduction via a magnon mode

We propose a method for converting single microwave photons to single optical sideband photons based on spinful impurities in magnetic materials. This hybrid system is advantageous over previous proposals because (i) the implementation allows much higher transduction rates (10 3 times faster at the same optical pump Rabi frequency) than state-of-the-art devices, (ii) high-efficiency transduction is found to happen in a significantly larger space of device parameters (in particular, over 1 GHz microwave detuning), and (iii) it does not require mode volume matching between optical and microwave resonators. We identify the needed magnetic interactions as well as potential materials systems to enable this speed up using erbium dopants for telecom compatibility. This is an important step towards realizing high-fidelity entangling operations between remote qubits and will provide additional control of the transduction through perturbation of the magnet.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

2024 Atmospheric Radiation Measurement (ARM) Annual Report

This report provides an overview of the Atmospheric Radiation Measurement (ARM) user facility and a sample of achievements for fiscal year 2024 (FY2024). Strong collaborations between nine DOE national laboratories enable ARM to successfully operate in remote locations around the world. This unique partnership supports the DOE mission to provide for the energy security of the nation. Without the support of the following laboratories, ARM would not be the state-of-the-art facility that it is today. ARM is a multi-laboratory, U.S. Department of Energy (DOE) Office of Science user facility and a key contributor to national and international atmospheric and climate research efforts. ARM offers scientists cutting-edge, ground-based observatories, aerial observation capabilities, and high-performance computing. ARM’s capabilities have enabled more than 30 years of continuous measurements of cloud and aerosol properties and their effects on Earth’s energy balance.

54 ENVIRONMENTAL SCIENCES↗

Mauka Energy FEVER Tool DOE SBIR Phase 1 Final Scientific/Technical Report

This report is on the Forestry Electric Vehicle Energy Routing (FEVER) Tool, a novel software system developed to support heavy-duty electric vehicle (EV) operations in remote, forested, and mountainous regions. The Phase I project aimed to demonstrate the feasibility of modeling EV energy consumption using terrain elevation, road conditions, and route features specific to forestry logistics. The tool combines geographic information systems (GIS), electric motor physics, and vehicle-specific data to calculate feasible, energy-efficient routes. Collaborations with Oregon State University’s Research Forests and Titan Freight Systems enabled collection and validation of GPS and elevation-based trip data. The FEVER Tool offers substantial opportunities for the efficient management of medium- and heavy-duty electric vehicles in sectors like forestry, agriculture, mining, defense and waste management—areas which are beginning to adopt HDEVs. The project demonstrated technical feasibility and lays the groundwork for commercial development and deployment in other industries and environmental conditions in Phase II.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Neutronics Evaluation of the Preliminary Design of the Service Cell Door for the Second Target Station

The service cell door needs to provide sufficient shielding to achieve 0.25 mrem/h dose rates in the adjacent room while remote handling operations of waste materials are going on within the service cell for the Second Target Station (STS). This analysis provides a neutronics evaluation of the preliminary design of the service cell door to evaluate the required thickness and the effect of streaming gaps around the door. As radiation source, we use the decay gamma source of the moderator reflector assembly (MRA) of the STS with a decay time of either two days or six months. As the MRA contains a significant amount of beryllium, photonuclear reactions induce a neutron source, which dictates the required door thickness in certain situations. Four scenarios with different MRA positions and decay times have been analyzed. The required thickness differs drastically depending on the chosen scenario and on the material of the door. The streaming through the gaps around the door is relatively small with high dose rates limited to small sections of the geometry.

43 PARTICLE ACCELERATORS↗

Testing, Calibration, and UxS Integration of the Kromek GR1 Plus CZT Gamma Spectrometer

Collecting radiation measurements can be a hazardous task, especially in the presence of highly active sources. Various scenarios necessitate source search, classification, and quantification, often with limited or no a priori information. Activities such as disaster mitigation, emergency response, environmental monitoring, and site remediation may involve dangerous radioactive sources. In these situations, there is a pressing need for remote monitoring capabilities that protect human operators from potential harm and enhance adherence to the principle of “As Low as Reasonably Achievable” (ALARA) for radiation doses. The first step toward achieving remote radiation measurement capabilities is the remote operation of a radiation sensor. Once this milestone is reached, the next challenge is to integrate this remote sensing capability into suitable actuation agents, collectively referred to as uncrewed systems (UxS). These systems include familiar platforms such as robotic quadrupeds, aerial multirotor vehicles, and ground vehicles, any of which may be teleoperated, act autonomously, or utilize a combination of both. A critical factor in achieving remote radiation sensing is the availability of data from the appropriate sensor. Many commercially available radiation sensors have closed-source documentation for their communication protocols. Typical end-user products are often self-contained, handheld devices designed for manual measurement scenarios. While there are commercial off-the-shelf (COTS) integrations of radiation sensors with UxS available for purchase, these solutions are typically tailored for specific use cases and may not meet the requirements of different applications. This paper discusses efforts to remotely acquire radiation measurements from a small form-factor CZT gamma spectrometer. Sandia National Laboratories has successfully demonstrated the initial capability to integrate low size, weight, and power (SWaP) gamma spectroscopy into various UxS, alongside co-located GPS data logging and sensor calibration and qualification. With remote gamma spectroscopy achieved, the stage is set for UxS integration of this capability.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Techno-economic assessment of distributed wellhead RO water treatment for nitrate removal and salinity reduction: A field study in small disadvantaged communities

Techno-economic analysis of distributed wellhead water treatment and desalination (DWTD) systems was carried out based on a three-year field study in three small, disadvantaged communities (DACs) to evaluate the reliability and affordability of upgrading their impaired well water. The local water supplies of the three study DACs, located in Salinas Valley, California, were contaminated with nitrate at levels (~ 12–87 mg/L NO$^{-}_{3}$ - N) ) above the California maximum contaminant level (MCL) of 10 mg/L NO$^{-}_{3}$ - N , and had elevated water salinity (~600–1,600 mg/L total dissolved solids(TDS)) above its secondary MCL (SMCL) of 500 mg/L TDS. Well water nitrate removal and salinity reduction were accomplished via reverse osmosis (RO) based DWTD systems that operated autonomously, supported by remote monitoring and supervisory cyberinfrastructure. Reliable DWTD operation provided treated water quality, with respect to nitrate and salinity, in the range of 0.5–6.3 mg/L NO$^{-}_{3}$ - N and 57–161 mg/L TDS, respectively, which were well below the respective MCL and SMCL. The levelized cost of water treatment was in the range of ~$$2/m 3 - $$2.9/m 3 which aligns with typical residential water costs in California and in the study region, and monthly residential water costs (39 dollars-74 dollars/residential unit/month) were also within the range in California. The study showcased the DWTD approach as a viable and potentially scalable solution for upgrading impaired local potable water supply of communities lacking centralized water delivery infrastructure. However, streamlined permitting processes and standardized regulatory frameworks are critical to promoting wider adoption and maximizing the socio-economic benefits of the DWT approach. Moreover, DACs are likely to require government subsidies in order to cover the CapEx of DWTD systems in addition to upgrade of site infrastructure.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Platform for Remote Deployment and Training for Enhanced Building Operation Practices (Building Re-Tuning and On-going Commissioning)

While a building’s energy usage is driven largely by its design and use, building operator behavior has a strong influence on its energy consumption. This project developed and piloted a specific, data-driven coaching methodology to help operators understand how they can adjust operations and/or affect no/low-cost repairs or upgrades to their specific building HVAC systems to reduce energy consumption. Named BuildingCoach, the operational optimization method used is based on the Building Re-tuning approach developed by the Pacific Northwest National Laboratory. A building operations analytics market has matured over the past decade, though its potential to affect energy-saving changes has not been fully realized. Training operators to understand the methods for operational optimization with the explicit approach of using building-system performance data is hypothesized to create a more effective, longer lasting result in building energy efficiency, and this strategy is the fundamental premise of this project. With the support of an Industry Advisory Board, the project succeeded in developing materials and recruiting for and delivering three pilot cohorts. Deliverables included twenty-two self-paced training modules (accessed via a Learning Management System) and a web-based platform that includes access to real-time building system data and a repository for building system documentation. The project set out to have 100 participants from 50 buildings in three pilot cohorts. In the end, there were 28 participants from 17 buildings, i.e., a significant shortfall. The first two pilot cohorts had only two buildings in each, and this was partially due to difficulties in deploying the Building Operator Coaching Solution (“the BOCS”), which is technology that extracts the data from the controls network and presents it as prescribed for coaching. In the third cohort, the project team deployed the BOCS successfully to 13 buildings, the methodology was piloted as intended, and numerous opportunities for optimization were identified. The BuildingCoach business plan charts a path to an economically sustainable effort. However, even with a licensing model captured in the final version of the business plan, the scalability is still limited to keeping less than 1,000 buildings affected by 2033. Even so, there are unexplored paths to greater scalability that are being considered. CUNY BPL is working to perpetuate and grow the use of BuildingCoach. As of this writing, about twenty buildings have either been connected or will be connected with operators coached / to be coached in the NYC municipal portfolio, twelve buildings across four campuses in NY State will use BuildingCoach, a NY upstate county wishes for six or seven buildings to participate with the support of funding from NYSERDA, and others have also expressed interest. In the decades to come, there will be an increasing percentage of large and mid-sized buildings that incorporate automated system optimization (ASO), and the building operators’ role will shift to spend more time on maintenance and monitoring. Meanwhile, programs such as BuildingCoach will play a critical role in optimizing operations. And, regardless of the emergence of ASO, operators will still need to understand how their systems operate so that they can monitor them properly. Within that context, BuildingCoach is an important step towards operators’ understanding of efficient building system operations.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Remote Sensing of Live Fuel Moisture for Wildfires Using SMAP Satellite Observations

Live Fuel Moisture (LFM) is a critical parameter for wildfire risk assessment, traditionally measured by labor-intensive field sampling. However, sampled LFM data are influenced by site-specific factors, such as local vegetation types and plant traits, and are often collected retrospectively after wildfire events, making it difficult to obtain pre-fire data for predictive applications. Here, we evaluate the relationship between LFM and Vegetation Water Content (VWC) and Soil Moisture (SM) retrieved from SMAP L-band brightness temperature using the Maximum Entropy Production (MEP) approach. The MEP-retrieved VWC exhibited strong correlation with in situ measurements of LFM ( r > 0.6) in the Western U.S. The integration of high-resolution vegetation coverage data enhances the detection of sub-grid vegetation heterogeneity. This study demonstrates the operational potential of remote sensing derived VWC as a scalable proxy of LFM, supporting its application in regional assessment of wildfire risk.

Cho, Kyeungwoo [Georgia Institute of Technology, A↗

Advancing Conduction-Cooled 650 MHz SRF Technology for Industrial Accelerators at Fermilab's IARC

The National Nuclear Security Administration (NNSA) funds the Illinois Accelerator Research Center (IARC) at Fermilab in developing a high-power, conduction-cooled Superconducting Radio Frequency (SRF) accelerator tailored for industrial applications requiring robust and efficient operation. A 650 MHz, 1.6 MeV, 20 kW SRF accelerator is currently under development, employing a conduction cooling approach to simplify cryogenic requirements and enhance accessibility for industrial use. The accelerator’s control system is implemented on the Blinky Lite platform, selected for its open-source architecture, secure remote access capabilities, and operational flexibility—attributes advantageous for industrial deployment and sustained operation. A dedicated beamline is designed to measure essential beam parameters and test the integrated performance of the accelerator and control systems, thereby validating their operational readiness for intended applications

Ji, Y. [Fermilab] (ORCID:0000000233981752)↗

Advancing Conduction-Cooled 650 MHZ SRF Technology for Industrial Accelerators at Fermilab S IARC

The National Nuclear Security Administration (NNSA) funds the Illinois Accelerator Research Center (IARC) at Fermilab in developing a high-power, conduction-cooled Superconducting Radio Frequency (SRF) accelerator tailored for industrial applications requiring robust and efficient operation. A 650 MHz, 1.6 MeV, 20 kW SRF accelerator is currently under development, employing a conduction cooling approach to simplify cryogenic requirements and enhance accessibility for industrial use. The accelerator's control system is implemented on the Blinky Lite platform, selected for its open-source architecture, secure remote access capabilities, and operational flexibility attributes advantageous for industrial deployment and sustained operation. A dedicated beamline is designed to measure essential beam parameters and test the integrated performance of the accelerator and control systems, thereby validating their operational readiness for intended applications.

Ji, Yichen [Fermilab]↗

Enhanced Laser-Induced Graphene Microfluidic Integrated Sensors (LIGMIS) for On-Site Biomedical and Environmental Monitoring

The convergence of microfluidic and electrochemical biosensor technologies offers significant potential for rapid, in-field diagnostics in biomedical and environmental applications. Traditional systems face challenges in cost, scalability, and operational complexity, especially in remote settings. Addressing these issues, laser-induced graphene microfluidic integrated sensors (LIGMIS) are presented as an innovative platform that integrates microfluidics and electrochemical sensors both comprised of laser-induced graphene. This study advances the LIGMIS concept by resolving issues of uneven fluid transport, increased hydrophobicity during storage, and sensor biofunctionalization challenges. Key innovations include Y-shaped reservoirs for consistent fluid flow, hydrophilic polyethyleneimine coatings to maintain wettability, and separable microfluidic and electrochemical components enabling isolated electrode nanoparticle metallization and biofunctionalization. Multiplexed electrochemical detection of the neonicotinoid imidacloprid and nitrate ions in environmental water samples yields detection limits of 707 nm and 10 -5.4 m with wide sensing ranges of 5–100 µm and 10 -5 –10 -1 m, respectively. Similarly, uric acid and calcium ions are detected in saliva, demonstrating detection limits of 217 nm and 10 -5.3 m with sensing ranges of 10–50 µm, and 10 -5 –10 -2.5 m, respectively. Overall, this biosensing demonstrates the capability of the LIGMIS platform for multiplexed detection in biologically complex solutions, with applications in environmental water quality monitoring and oral cancer screening.

environmental monitoring↗

Distributed water desalination and purification systems: perspective and future directions

Distributed water treatment and desalination (DWTD) systems are critical for the development of a diverse water portfolio of the desired quality and intended use at the target location. Widespread adoption of DWTD has been hampered given the need for round-the-clock monitoring and the lack of local technical expertise for system management. However, self-adaptive operation, real-time remote monitoring, supervisory control, and asset management of DWTD systems are now feasible with the implementation of advanced local system control, cyberinfrastructure that facilitates real-time cloud-based analytics, data management, and artificial intelligence–powered decision support. Such an approach will introduce transformative virtual networks of DWTD systems to provide needed water to locations that are not served by centralized and satellite water treatment and desalination systems.

Cohen, Yoram [University of California, Los Angele↗

OPER: Optimality-Guided Embedding Table Parallelization for Large-scale Recommendation Model

With the sharp increasing volume of user data, Deep Learning Recommendation Model (DLRM) becomes an indispensable infrastructure in large technology companies. However, large-scale DLRM on the multi-GPU platform is still inefficient due to unbalanced workload partitioning and intensive inter-GPU communication. To this end, we propose OPER, an OPtimality guided Embedding table placement for large-scale Recommendation model training and inference. OPER explores the potential of mitigating remote memory access latency in DLRM through fine-grained embedding table placement. Specifically, OPER proposes a theoretical modeling that builds up the relationship between EMT placement and the embedding communication latency in both training and inference. OPER proves the NP hardness of finding the optimal embedding table placement and proposes a heuristic algorithm that yields near optimal placement. OPER implements a SHMEM-based embedding table training system and a unified embedding index mapping to support fine-grained embedding table sharding and placement. Comprehensive experiments reveal that OPER achieves on average 3.4× and 5.1× speedup on training and inference respectively over state-of-the-art DLRM frameworks.

Wang, Zheng↗