Search NASA⌕ Search

SEARCH · Search NASA

Results for “large load modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Optimizing Power Line Undergrounding Decisions under Varying Wildfire Risk and Weather Scenarios

Abstract—The threat of wildfire ignitions from electric power equipment has led utilities to increasingly turn to preemptive power shutoffs, which, while effective in reducing grid-induced wildfire risk, can cause significant load loss. Undergrounding power lines is an alternative strategy for preventing grid-induced wildfires. However, undergrounding lines is costly, so an efficient undergrounding plan must balance reductions in wildfire risk and load loss with the cost of undergrounding lines. We propose a robust optimization model to identify which power lines to underground to maximize load served while limiting wildfire risk across a range of wildfire risk and weather scenarios. Since solving this problem may be computationally heavy for large power grids and many operating scenarios, we present a delayed constraint generation algorithm to iteratively add scenarios until an optimal solution is found. We evaluate the performance of this framework on the RTS-GMLC with scenarios representing a year of operating conditions and compare it with a stochastic programming formulation. Our results indicate that our undergrounding model is successful in reducing load shed and risk compared to baseline cases in which no mitigation action is taken and only power shutoffs are implemented (no undergrounding). The robust formulation also reduces more load shed than the stochastic formulation in the most extreme scenarios. Index Terms—grid resilience, optimization, transmission systems, underground power lines, wildfire risk.

Taylor, S. [Department of Electrical and Computer ↗
DOE OSTI2026

Roadmap and Benchmarking: Privacy in Federated Load Forecasting

Data-driven techniques for energy demand forecasting continue to emerge with promising impacts on distribution grid planning. However, the development of robust and generalizable machine learning models requires that representative high quality training data are available. Distributed energy resources have begun to embed intelligence, gathering large amounts of data on customer demand, behavior, and household devices that are connected to the grid. Though utilities aggregate meter-level demand data for load shaping, demand response, outage management, reliability planning, and billing applications, there lies an inherent privacy concern in sharing consumption data that may identify individual consumer behavioral patterns. Hence, while sharing the data is crucial, the private sensitive customer data must be safeguarded from being exposed or manipulated. In this study, we propose a roadmap for implementing a based privacy preserving framework to support the advancement of data-driven analytics in data-sensitive distributed energy resources environments. The roadmap incorporates federated learning–a distributed training framework, differential privacy–a statistical framework that provides guarantees to safeguard the leakage of sensitive data, secure multiparty computation and homomorphic encryption– techniques for encrypting model gradients and applying secure aggregation on the server. Moreover, we perform baseline experiments on the federated short-term load forecasting (STLF) task using open-source residential load profile datasets, offering insights into the challenges of integrating differential privacy into federated learning.

Abebe, Waqwoya [Oak Ridge National Laboratory (ORN↗
DOE OSTI2024

Wind Loading on CSP Collectors

The project significantly enhanced the community's understanding of the fundamental physics drivers underlying the wind-loading experienced by concentrating solar power (CSP) collector structures (i.e., parabolic troughs and heliostats) as well as their support structures. This project had two overarching objectives: (1) detailed measurements to characterize the prevailing wind conditions and resulting operational loads on collector structures, and (2) development and validation of a computationally efficient, high-fidelity modeling tool capable of predicting wind-loading in deep-array installations. Over three years, we conducted comprehensive at-scale field measurements of the atmospheric turbulent wind conditions, and the resulting wind loads on parabolic troughs and heliostats. Two at-scale measurement campaigns yielded first-of-its-kind, high-resolution, long-term datasets that are used to characterize the complex flow field and wind loading on parabolic-troughs and heliostats in operational power plants. The high-resolution measurements collected during these campaigns were used to validate the high-fidelity computational models developed at NREL. These open-source computationally efficient models were shown to be accurate in predicting wind-driven loads on collectors without the need for a large supercomputer.

14 SOLAR ENERGY↗
DOE OSTI2025

The influence of wind veer and drivetrain flexibility on fatigue loading for large floating wind turbines

To reduce costs, offshore wind turbines are expected to be designed with significantly increased rotor diameters. Larger turbines become more flexible and span a larger portion of the atmospheric boundary layer. With these changes, the validity of traditional modeling assumptions should be investigated. This work challenges two common assumptions: (1) that the drivetrain can be considered rigid (except in torsion) and does not couple with the rotor and tower and 2) that wind directional change with height (veer) does not greatly influence the fatigue damage in the tower, blades and drivetrain. Two large semi-submersible floating wind turbines are considered: a 15 and a 22 MW reference turbine. Both use direct-drive generators. Aero-hydro-servo-elastic simulations are performed using OpenFAST, with drivetrain bending flexibility and main bearing response implemented in the coupled analysis. The turbines are subjected to a set of load cases at below-, near- and above-rated mean wind speeds, assembled based on the 3 km Norwegian reanalysis (NORA3) hourly wind and wave hindcast data for Utsira Nord, off the coast of Norway. In each load case, conditions with and without veer are simulated to evaluate the influence of veer on damage equivalent loads (DELs) of the turbine tower, blades and main bearings. Further, these load cases are applied to evaluate the influence of drivetrain flexibility on aero-elastic turbine response. The results indicate that, depending on the veer gradient, mean wind speed, operating regime and turbine size, veer can be very important for tower-top DELs and the fluctuations of main bearing radial loads, while main bearing and blade-root flapwise DELs are less affected. Considering these specific load cases and turbine models, drivetrain flexibility is found to significantly influence tower-top DELs of the largest turbine: the tower-top fore-aft and torsional damage equivalent moments of the 22 MW turbine are reduced by more than 20 % at near-rated wind speeds when the drivetrain is modeled as flexible.

17 WIND ENERGY↗
DOE OSTI2025

Coupled Aerodynamic and Hydrodynamic Hybrid Simulation of Floating Offshore Wind Turbines

The development and innovation of floating offshore wind energy in the U.S. requires detailed high-fidelity observations and measurements of turbine and platform loading due to wind, waves, and currents. However, full-scale and quasi-full-scale experiments require significant financial and temporal investments for construction, experimental testing, and long-term field campaigns. To support the commercial advancement of the offshore wind energy industry, specialized wind tunnel and wave basin experimental facilities are critical to be able to test FOWT designs at small scale under controlled conditions prior to full-scale deployment. Oregon State University (OSU) is internationally known as a leader in water and energy research, development, and testing. The O.H. Hinsdale Wave Research Laboratory (HWRL) and the Wallace Energy Systems and Renewables Facility (WESRF) at OSU have extensive experience building, modeling, monitoring, controlling, and actuating scaled systems. Experiments on wave-structure interaction have been performed at the HWRL since its establishment in 1972. Studies have included the interaction of waves with coastal structures (breakwaters, seawalls, buildings, cylinders, bridges, fixed foundations of offshore wind turbines, etc.) and with floating structures (e.g., wave energy converters, maneuvering of vessels, etc.). Hinsdale is actively used by marine energy technology developers, both for private testing and OSU-collaborative research projects. However, despite the availability of several large-scale facilities for hydrodynamic testing (at OSU and elsewhere in the U.S.), existing experimental laboratories are generally limited in their ability to accurately generate combined wind and wave conditions. The simulation of both wind and waves in experimental testing is complicated due to a number of constraints, including: [i] incompatible similitude laws governing the wind and waves for scaled experiments, [ii] producing accurate wind over a large enough control volume via fans, and [iii] generating wind that reasonably represents the atmospheric boundary layer in existing wave basins/flumes. Hence, physical test data providing insight into the simultaneous wave- and wind-structure response of floating offshore wind components can be difficult to generate. Given the aforementioned challenges in classic hydrodynamic experiments, the motivation of this project is to establish a real-time hybrid simulation (RTHS) approach that can apply aero- and hydro-dynamic loading by augmenting wave-only experimental facilities with virtual aerodynamic forces through numerical models representing the remaining dynamic forces. RTHS is a physical-numerical approach that partitions a prototype system into physical and numerical sub-assemblies that interact with each other through actuators and sensors in real time. In coupling physical and numerical models, the hybrid simulation approach applied herein is ideal for problems with: (1) structures subjected to different scaling laws, such as floating offshore wind turbines subjected to combined aero/hydro-dynamic loading, (2) structures that are too large or complex to be tested entirely in a laboratory setting, such as deep-water mooring applications, and (3) component testing, where the behavior of a portion of the assembly is uncertain but still interacts with other portions of the structure, such as testing the fatigue life of turbine blades. Few U.S. experimental facilities are able to test simultaneous aero- and hydro-dynamic loading and none can accurately produce aero/hydro-dynamic response on scaled FOWT models due to conflicting similitude laws between the wind (commonly Reynolds) and the waves (commonly Froude). To aid in accelerating the development of the U.S. floating offshore industry, there is a significant need to develop a flexible, modular framework that can expand the capacities of existing wave-only laboratories. The project goal is to demonstrate a hydrodynamic real-time hybrid simulation (hydro-RTHS) framework that couples numerical wind and physical waves acting on a FOWT, thus representing simultaneous aero/hydro-dynamic loading. The FOWT is partitioned into a full-scale numerical sub-assembly associated with the aerodynamics and a model-scale physical sub-assembly associated with the hydrodynamics. The numerical-physical partition associated with hydro-RTHS mitigates scaling constraints by supplying different scaling laws to the physical and numerical sub-assemblies. Herein, length, force, and time are scaled and exchanged between the sub-assemblies using Froude scaling to represent the open-channel flow in the physical sub-assembly. Other similitude laws could also be utilized depending on the problem definition. It is envisioned that the ability to model FOWTs under waves and wind, with mitigation of similitude distortions, would result in reduced development costs (currently, FOWT concept development is performed with full-size pro- totypes at enormous expense and risk) and increase the reliability of the FOWT industry (since extreme wave and wind conditions and contingency events can be tested safely in a controlled environment).

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

Commercialization of Distribution System Load Modeling Tool for Improved DER Interconnection Studies

Residential and commercial buildings have huge potential to contribute value to improve grid resilience by participating grid services. To reveal the significant value, it is critical to estimate the grid service capability from these buildings. Unlike the large-scale distributed energy resources such as wind and solar farms, those buildings need to participate grid services in aggregation, not by individual. Therefore, it is important to appropriately group buildings for aggregation. The load profiles in the same group will have similar characteristics at the same time step, so grid operators can send the grid service signal to the customer group with a higher chance to respond at that time step. In this paper, we develop a load profile clustering method to classify the building-level load profiles for grid service capability estimation. In our two-step clustering approach, we first calculate the total load consumption for each building, clustering the load profiles based on energy consumption level. Then, we further cluster the load profiles in each energy cluster based on the load shape. The parameter selection for each clustering step is discussed. The proposed method is applied on actual building-level load profiles, and the results have proved the effectiveness of this method.

14 SOLAR ENERGY↗
DOE OSTI2024

Direct Geologic Constraints on the Timing of Late Holocene Ice Thickening in the Amundsen Sea Embayment, Antarctica

Abstract Constraining past West Antarctic Ice Sheet (WAIS) change helps validate numerical models simulating future ice sheet dynamics. Following rapid deglaciation during the mid‐Holocene, ice near Thwaites Glacier was ∼35 m thinner than present; however, the timing of ice regrowth to its present configuration remains unknown. To fill this knowledge gap, we present cosmogenic nuclide exposure ages of cobbles from the surface of a moraine situated between Thwaites and Pope glaciers. We infer that the moraine formed and stabilized in the Late Holocene (∼1.4 ka) when a small glacier thickened. We also present a novel reconstruction of WAIS volume constrained by sea‐level data, which demonstrates that moraine formation coincided with a large‐scale WAIS readvance. Our new geologic constraints will help inform models of the solid Earth response to surface mass loading, improving our understanding of ice sheet dynamics in a vulnerable part of WAIS.

Nichols, Keir A. [Imperial College London London U↗
DOE OSTI2026

Electromagnetic Analysis of ITER Electron Cyclotron Emission Model

The ITER electron cyclotron emission (ECE) diagnostic system is located at diagnostics shielding module 2 (DSM2), equatorial port 9 (EP9), to measure electron temperature profile and electron temperature fluctuations, and also assess nonthermal electron distributions via the oblique view. Therefore, ECE has both radial and oblique views with two hot sources for calibration and two couples of mirrors for two different optical views. It shall receive that the large electromagnetic (EM) loads up to 100-MN/m3 force density due to the eddy currents on the copper mirrors generated by the short transient plasma disruption. The simplified EM analysis model using magnetic field ( B ) data and flux variations (dB/dt) method based on the worst case of plasma disruption, MD_DW_EXP16MS_CATIII, has been developed to calculate the force and moments for each ECE component and support structure for EP9 DSM2 Bay2 and Bay3. The B and dB/dt methods use the constant B and dB/dt assumed for each local bay space, but the real B and dB/dt are basically varied along the radial direction of each bay. The complex global model with the local ECE components and support structure using Maxwell transient has been developed to do EM analysis to compare the results of the B and dB/dt models. The volumetric EM force density of the whole ECE components and support structure can be used for the subsequent structural analysis. In conclusion, combined with the thermal and nuclear loads and seismic and initial loads, the ECE integration analysis can be finalized for the operation case.

Fang, J. [Princeton Plasma Physics Laboratory (PPP↗
DOE OSTI2025

Unsteady aerodynamic loads on pitching aerofoils represented by Gaussian body force distributions

The actuator line model (ALM) is an approach commonly used to represent lifting and dragging devices like wings and blades in large-eddy simulations (LES). The crux of the ALM is the projection of the actuator point forces onto the LES grid by means of a Gaussian regularisation kernel. The minimum width of the kernel is constrained by the grid size; however, for most practical applications like LES of wind turbines, this value is an order of magnitude larger than the optimal value that maximises accuracy. This discrepancy motivated the development of corrections for the actuator line, which, however, neglect the effect of unsteady spanwise shed vorticity. In this work we develop a model for the impact of spanwise shed vorticity on the unsteady loading of an aerofoil modelled as a Gaussian body force distribution, where the model is applicable within the regime of unsteady attached flow. The model solution is derived both in the time and frequency domain and features an explicit dependence on the Gaussian kernel width. We verify the model with ALM-LES for both pitch steps and periodic pitching. The model solution is compared with Theodorsen theory and validated with both computational fluid dynamics using body fitted grids and experiment. It is concluded that the optimal kernel width for unsteady aerodynamics is approximately 40 % of the chord. The ALM is able to predict the magnitude of the unsteady loading up to a reduced frequency of 𝑘 ≈ 0.2.

17 WIND ENERGY↗
DOE OSTI2024

Study on Conversion from an Existing Alternating Current Medium-Voltage Line to a Direct Current Line: A Case of Load or Source Expansion

Simultaneous increase of power generation through renewable systems and load due owing to the rapid growth in electrified road transportation systems, leads to new challenges in the design, operation, and protection of distribution-level electrical power systems. This paper addresses challenges related to the integration of new sources or loads to a distribution grid through long alternating current lines. The International Council on Large Electric Systems medium-voltage benchmark model developed for North America was used for simulation studies. Use cases were developed to illuminate the issues related to long alternating current lines and the usefulness of medium-voltage direct current lines in a distribution network.

Jaldanki, Sreenivasa↗
DOE OSTI2024

Role of dislocations on martensitic transformation temperatures and microstructure: A molecular dynamics study

Microstructure and defects strongly affect martensitic transformations in metallic alloys. Significant progress has been made in understanding the atomic-level processes that control the role of grain boundaries and precipitates in these solid-to-solid phase transformations. Yet, the role of dislocations and their structures on martensitic transformation temperature and the resulting microstructure remains unclear. Therefore, we used large-scale molecular dynamics simulations to study the forward and reverse transformation of a martensitic material modeled after Ni63Al37 under cyclic thermal loading. The simulations reveal that dislocations in the austenite phase act as one-dimensional seeds for the martensite phase, which is present at temperatures significantly above the martensite start value. We find a reduction in the dislocation density during cyclic thermal loading, which results in the increase in martensite and austenite transition temperatures, in agreement with experiments. Importantly, we extracted a critical martensitic nuclei size for developing stable domains and found that relatively low dislocation densities are needed to grow independent martensitic variants resulting in a multi-domain structure.

Physics↗
DOE OSTI2024

Validation of new and existing methods for time-domain simulations of turbulence and loads

We seek to obtain a second-by-second match between the simulated and measured structural loads of a utility-scale wind turbine. To obtain the one-to-one load simulations, we start with the furthest upstream component of the modeling chain: the turbulent inflow. We consider new and existing methods to generate constrained-turbulence flow fields. The new method is based on large-eddy simulations (LES) and machine learning (ML). The existing methods include Kaimal-based TurbSim and the superstatistical wind field model. The inflow measurements used to constrain these simulations are obtained with a nacelle-mounted scanning lidar. We compare the flow fields for the different inflow simulation approaches and validate their associated load predictions against measurements collected in the Rotor Aero-dynamics, Aeroelastics, and Wake (RAAW) field campaign. We find that the rotor-position control developed for this study is key in enabling the time match between measurements and simulations. When this control approach is used, the load simulation performance tracks with the inflow simulation fidelity, with LES+ML yielding errors ≤ 4% for the damage-equivalent loads of flapwise bending moment, and tower fore-aft bending moments.

17 WIND ENERGY↗
DOE OSTI2025

Micrometer: Micromechanics transformer for predicting full field mechanical responses of heterogeneous materials

Predicting mechanical responses of heterogeneous materials across scales remains a significant challenge. Traditional computational methods often struggle with complex and multiscale nature of these materials, limiting their effectiveness in real-world applications. Here, in this paper, we introduce Micrometer, a vision transformer based deep learning model designed to predict full field mechanical responses of heterogeneous materials, bridging the gap between computer vision and solid mechanics problems. We show that Micrometer, trained on a large-scale high-resolution dataset of 2D fiber-reinforced composites, can achieve state-of-the-art performance in predicting microscale strain fields across a wide range of material properties and loading conditions. Our model demonstrates accuracy and computational efficiency in applications such as computational homogenization and multiscale modeling, reducing computational time by up to two orders of magnitude compared to conventional numerical solvers while maintaining less than 1 % errors in predicting macroscale stress fields. Furthermore, we showcase Micrometer’s adaptability through transfer learning experiments on new materials with limited data, highlighting its potential to tackle diverse scenarios in computational solid mechanics. These results represent a significant step towards AI-driven innovation in materials science, addressing the limitations of traditional numerical methods and paving the way for more efficient simulations of heterogeneous materials across various industrial applications.

Composite materials↗
DOE OSTI2024

A bioactive supramolecular and covalent polymer scaffold for cartilage repair in a sheep model

Regeneration of hyaline cartilage in human-sized joints remains a clinical challenge, and it is a critical unmet need that would contribute to longer healthspans. Injectable scaffolds for cartilage repair that integrate both bioactivity and sufficiently robust physical properties to withstand joint stresses offer a promising strategy. We report here on a hybrid biomaterial that combines a bioactive peptide amphiphile supramolecular polymer that specifically binds the chondrogenic cytokine transforming growth factor β-1 (TGFβ-1) and crosslinked hyaluronic acid microgels that drive formation of filament bundles, a hierarchical motif common in natural musculoskeletal tissues. The scaffold is an injectable slurry that generates a porous rubbery material when exposed to calcium ions once placed in cartilage defects. The hybrid material was found to support in vitro chondrogenic differentiation of encapsulated stem cells in response to sustained delivery of TGFβ-1. Using a sheep model, we implanted the scaffold in shallow osteochondral defects and found it can remain localized in mechanically active joints. Evaluation of resected joints showed significantly improved repair of hyaline cartilage in osteochondral defects injected with the scaffold relative to defects injected with the growth factor alone, including implantation in the load-bearing femoral condyle. These results demonstrate the potential of the hybrid biomimetic scaffold as a niche to favor cartilage repair in mechanically active joints using a clinically relevant large-animal model.

Science & Technology - Other Topics↗
DOE OSTI2025

Modeling of Microgrid for Critical Data Center Applications

As part of continuing efforts to develop support, understanding, and infrastructure of data center integration onto the electric grid, our work aims to model and analyze the behavior of data center loads in a microgrid power system. Our model consists of renewable energy sources, batteries, and a nuclear reactor-steam Rankine cycle to power data center loads. The simulation studies investigate the electrical behavior of the microgrid system to assess its ability in supporting large data center electrical demands.

14 - SOLAR ENERGY↗
DOE OSTI2026

Progressing Analysis of Variable Electric Rates (PAVER) Study

The Progressing Analysis of Variable Electric Rates (PAVER) study analyzed the impact of a range of time-varying electric rates on the performance of a regional electric grid and the resulting costs for participating and non-participating customers. This analysis leveraged and extended the work of PNNL’s Distribution System Operator with Transactive (DSO+T) study. Five different rate designs were included: a flat volumetric energy charge, a typical Time of Use (TOU) rate, a dynamic energy (DE) rate (based on wholesale locational marginal prices), a dynamic energy and capacity (DE+C) rate, and, finally, a Block and Swing (B&S) rate that billed customers based on their average load profile at constant pricing, but used the DE+C dynamic price for load deviations from their average profile. These rates were analyzed in a large-scale co-simulation of an entire regional grid with a customer population representative of the current state. A large fraction (80%) of residential and commercial customers were assumed to participate in these time-varying rates with automatically controlled HVAC, water heaters, electric vehicles, and batteries. This study assumed no industrial sector participation. The DE and DE+C rates saw system peak loads reduced by 6-7%, while the large participation in the TOU rate case saw a significant rebound effect and a resulting peak load increase of >5%. The impacts to the annual and peak system demand impacted system wholesale prices and the overall grid operating costs. This cost structure determined the revenue needed to be collected from customers by each rate design. Participating customers on the DE and DE+C rates (located in one of the modeled DSOs) saw reductions in average annual electricity bills of 11-17% with average increases in monthly bill variation of no more than 13%. At such high participation levels, TOU customers saw 10% higher average annual bills (due to system-wide rebound effects) and average increased monthly bill variation of 16%. Residential owners of large flexible loads (such as electric vehicles) saw larger bill savings (17-20%) when on a fully dynamic rate. The presence of on-site generation (such as rooftop solar) did not appear to appreciably change customer outcomes. Customers on the Block and Swing rate did see 6% lower monthly bill variation (as intended) than the flat rate case, but at the expense of appreciable bill savings, which were only 3%, comparable to the savings seen by non-participants. Given this finding we recommend that additional research be conducted into how best various bill protection mechanisms can balance minimizing customer bill variation with providing financial incentives commensurate with the flexibility customers provide. We also recommend that customer outcomes be explored across a range of regions using current actual customer and system cost data.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Application of a Physics-Informed Convolutional Neural Network for Monitoring the Temperature Fields in High-Temperature Gas Reactors

Here, this work presents current advances in applying a physics-informed convolutional neural network (CNN) to evaluate temperature distributions in advanced reactors. Our goal is to demonstrate that the CNN can reconstruct temperature fields within the solid region of a prismatic fuel assembly in a high-temperature gas reactor (HTGR) with sensor data available in only a few cooling channels. Before that, we showcase the superior performance of the physics-informed CNN in comparison to a purely data-driven multilayer perceptron (MLP), considering a canonical heated channel setup. This analysis shows the advantages of our approach and justifies its choice. The datasets employed here are obtained upon numerical simulations performed with codes under the Nuclear Energy Advanced Modeling and Simulation program. This work is important, as industry experience indicates that the assembly material in HTGR concepts is prone to large thermal-mechanical loads nearing operational limits. This makes it crucial to characterize peak temperatures and their distributions near hot spots. Modern thermocouples are unreliable in these types of harsh environments because of the high neutron fluxes and elevated temperatures involved. The CNN-based field reconstruction represents an attractive solution, enabling sensor arrays in less aggressive locations and augmenting indirect predictions for less accessible regions. The results show that the CNN reduces prediction errors by orders of magnitude in comparison to the MLP, considering the simple yet well-representative heated channel case. In the case of the HTGR fuel assembly, the CNN can successfully reconstruct temperature fields over various cooling regimes. Furthermore, we also explore the algorithm’s ability to detect abnormalities. Interestingly, the CNN proves it has the capacity to detect blockage in one of the noninstrumented cooling channels.

Machine learning↗
DOE OSTI2025

MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several inference-time challenges, including load imbalance across experts and the additional routing computational overhead. To address these challenges and fully harness the benefits of MoE, a systematic evaluation of hardware acceleration techniques is essential. We present MoE-Inference-Bench, a comprehensive study to evaluate MoE performance across diverse scenarios. We analyze the impact of batch size, sequence length, and critical MoE hyperparameters such as FFN dimensions and number of experts on throughput. We evaluate several optimization techniques on Nvidia H100 GPUs, including pruning, Fused MoE operations, speculative decoding, quantization, and various parallelization strategies. Our evaluation includes MoEs from the Mixtral, DeepSeek, OLMoE and Qwen families. The results reveal performance differences across configurations and provide insights for the efficient deployment of MoEs.

Chitty-Venkata, Krishna Teja↗