Search NASA⌕ Search

SEARCH · Search NASA

Results for “model performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Meso-scale modeling of UO2 nuclear fuel to high burnup

To improve the economics of light water reactors for commercial nuclear energy generation, utility operators are seeking to obtain regulatory approval to run UO2 fuel to higher levels of burnup. One potential impediment to obtaining this approval is the phenomenon of fuel fragmentation, relocation, and dispersal (FFRD). FFRD can result when fuel experiences a rapid temperature transient, such as that occurring during a Loss Of Coolant Accident (LOCA). FFRD has historically been most associated with the rim region in UO2 fuel pellets, where the phenomenon of fragmentation is also referred to as pulverization due to the small size of the fragments. More recent evidence suggests that the so-called “dark zone” (due to its appearance in micrographs) that can be observed in the mid-radial regions of high burnup fuel is also susceptible to FFRD. Although empirical fuel performance models have been developed that can adequately predict pulverization in the rim region under typical LWR conditions, a scientific understanding of what underlies fuel restructuring and subsequent FFRD is lacking even in the rim region, and no models are currently available for the behavior the dark zone. To address these challenges, the U.S. Department of Energy’s Nuclear Energy Advanced Modeling and Simulation (NEAMS) program has employed a multi-scale modeling approach to improve scientific understanding and develop new fuel performance models. In this talk, I will focus on meso-scale efforts, which form a crucial link between atomic-scale and engineering-scale models. Phase-field modeling combined with cluster dynamics is used to predict the restructuring process in the rim region. Phase-field fracture modeling, informed by atomistic simulations, is used to predict the onset of pulverization in the rim region. Combining these techniques together allows the extent of rim pulverization to be predicted. The formation and evolution of the dark zone has also been simulated with the phase-field method, using an improved approach to vacancy source term parameterization. The work shows the important impact of microstructure on fuel performance.

fracture↗
DOE OSTI2021

New methods to improve the vertical extrapolation of near-surface offshore wind speeds

Accurate characterization of the offshore wind resource has been hindered by a sparsity of wind speed observations that span offshore wind turbine rotor-swept heights. Although public availability of floating lidar data is increasing, most offshore wind speed observations continue to come from buoy-based and satellite-based near-surface measurements. The aim of this study is to develop and validate novel vertical extrapolation methods that can accurately estimate wind speed time series across rotor-swept heights using these near-surface measurements. We contrast the conventional logarithmic profile against three novel approaches: a logarithmic profile with a long-term stability correction, a single-column model, and a machine-learning model. These models are developed and validated using 1 year of observations from two floating lidars deployed in US Atlantic offshore wind energy areas. We find that the machine-learning model significantly outperforms all other models across all stability regimes, seasons, and times of day. Machine-learning model performance is considerably improved by including the air–sea temperature difference, which provides some accounting for offshore atmospheric stability. Finally, we find no degradation in machine-learning model performance when tested 83 km from its training location, suggesting promising future applications in extrapolating 10 m wind speeds from spatially resolved satellite-based wind atlases.

17 WIND ENERGY↗
DOE OSTI2025

A Comprehensive Machine Learning Model for Metal–Ligand Binding Prediction: Applications in Chemistry and Biology

A machine-learning (ML) model that predicts metal–ligand binding constants was developed using the open-source Chemprop software. The model was trained on over 30,000 experimental log K 1 values, which include both protonation and metal–ligand stability constants, comprising over 3500 ligands and 10 2 metal ions from 73 total elements, thus generalizing beyond existing limited approaches, which focus only on specific metals or ligand families. The best-performing model included a combination of SMILES-based molecular representations along with descriptors for the metal ion and experimental conditions. It had an external test R 2 value of 0.942, and MAE value of 0.834. A “SMILES-only” simpler version also produced accurate predictions and preserved the binding trends, serving as a quick and easily accessible alternative for users without computational expertise. The SMILES-only model performed comparably to density functional theory (DFT) calculations but utilized a fraction of the computational resources. The model was successfully applied across diverse domains, including bioinorganic chemistry, heavy metal remediation, and sensor development and demonstrated its effectiveness as a rapid and reliable screening tool for both academic and industrial uses.

Ligands↗
DOE OSTI2023

Machine Learning for Daily Forecasts of Arctic Sea Ice Motion: An Attribution Assessment of Model Predictive Skill

Physics-based simulations of Arctic sea ice are highly complex, involving transport between different phases, length scales, and time scales. Resultantly, numerical simulations of sea ice dynamics have a high computational cost and model uncertainty. We employ data-driven machine learning (ML) to make predictions of sea ice motion. The ML models are built to predict present-day sea ice velocity given present-day wind velocity and previous-day sea ice concentration and velocity. Models are trained using reanalysis winds and satellite-derived sea ice properties. We compare the predictions of three different models: persistence (PS), linear regression (LR), and a convolutional neural network (CNN). We quantify the spatiotemporal variability of the correlation between observations and the statistical model predictions. Additionally, we analyze model performance in comparison to variability in properties related to ice motion (wind velocity, ice velocity, ice concentration, distance from coast, bathymetric depth) to understand the processes related to decreases in model performance. Results indicate that a CNN makes skillful predictions of daily sea ice velocity with a correlation up to 0.81 between predicted and observed sea ice velocity, while the LR and PS implementations exhibit correlations of 0.78 and 0.69, respectively. The correlation varies spatially and seasonally: lower values occur in shallow coastal regions and during times of minimum sea ice extent. LR parameter analysis indicates that wind velocity plays the largest role in predicting sea ice velocity on 1-day time scales, particularly in the central Arctic. Regions where wind velocity has the largest LR parameter are regions where the CNN has higher predictive skill than the LR.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

North Atlantic Oscillation response in GeoMIP experiments G6solar and G6sulfur: why detailed modelling is needed for understanding regional implications of solar radiation management

The realization of the difficulty of limiting global-mean temperatures to within 1.5 or 2.0°C above pre-industrial levels stipulated by the 21st Conference of Parties in Paris has led to increased interest in solar radiation management (SRM) techniques. Proposed SRM schemes aim to increase planetary albedo to reflect more sunlight back to space and induce a cooling that acts to partially offset global warming. Under the auspices of the Geoengineering Model Intercomparison Project, we have performed model experiments whereby global temperature under the high-forcing SSP5-8.5 scenario is reduced to follow that of the medium-forcing SSP2-4.5 scenario. Two different mechanisms to achieve this are employed: the first via a reduction in the solar constant (experiment G6solar) and the second via modelling injections of sulfur dioxide (experiment G6sulfur) which forms sulfate aerosol in the stratosphere. Results from two state-of-the-art coupled Earth system models (UKESM1 and CESM2-WACCM6) both show an impact on the North Atlantic Oscillation (NAO) in G6sulfur but not in G6solar. Both models show a persistent positive anomaly in the NAO during the Northern Hemisphere winter season in G6sulfur, suggesting an increase in zonal flow and an increase in North Atlantic storm track activity impacting the Eurasian continent and leading to high-latitude warming over Europe and Asia. These results are broadly consistent with previous findings which show similar impacts from stratospheric volcanic aerosol on the NAO and emphasize that detailed modelling of geoengineering processes is required if accurate impacts of SRM effects are to be simulated. Differences remain between the two models in predicting regional changes over the continental USA and Africa, suggesting that more models need to perform such simulations before attempting to draw any conclusions regarding potential continental-scale climate change under SRM.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Development of Accelerated Steady-state Test Capsule Experiments to Replicate EBR-II Fuel Behavior Using BISON Fuel Performance Analysis

Here in this work, BISON fuel performance calculations were performed to predict the fuel behavior of accelerated burnup U-Pu-Zr fuel, with temperature operation conditions of the fuel and the cladding mirroring conditions within EBR-II fuel pins. The temperature operating conditions within the FAST accelerated burnup rods were aimed at replicating EBR-II X447/X447A fuel surface and inner cladding surface temperatures. Due to the FAST capsule design, these temperatures can be replicated with fission rate densities being significantly increased. fuel performance modeling has not been assessed for novel experiments such as accelerated burnup utilizing the FAST capsule within ATR. This is an important step in understanding accelerated irradiation methods as many performance models are empirical models conforming to the results of PIE but do not always include physical models that would represent the changes in irradiation tests.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

GraphAlign: Graph-Enabled Machine Learning for Seismic Event Filtering

This report summarizes results from a 2 year effort to improve the current automated seismic event processing system by leveraging machine learning models that can operated over the inherent graph data structure of a seismic sensor network. Specifically, the GraphAlign project seeks to utilize prior information on which stations are more likely to detect signals originating from particular geographic regions to inform event filtering. To date, the GraphAlign team has developed a Graphical Neural Network (GNN) model to filter out false events generated by the Global Associator (GA) algorithm. The algorithm operates directly on waveform data that has been associated to an event by building a variable sized graph of station waveforms nodes with edge relations to an event location node. This builds off of previous work where random forest models were used to do the same task using hand crafted features. The GNN model performance was analyzed using an 8 week IMS/IDC dataset, and it was demonstrated that the GNN outperforms the random forest baseline. We provide additional error analysis of which events the GNN model performs well and poorly against concluded by future directions for improvements.

58 GEOSCIENCES↗
DOE OSTI2025

Best estimate of the planetary boundary layer height from multiple remote sensing measurements

Remote sensing measurements have been widely used to estimate the planetary boundary layer height (PBLHT). Each remote sensing approach offers unique strengths and faces different limitations. In this study, we use machine learning (ML) methods to produce a best-estimate PBLHT (PBLHT-BE-ML) by integrating four PBLHT estimates derived from remote sensing measurements at the Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) observatory. Three ML models – random forest (RF) classifier, RF regressor, and light gradient-boosting machine (LightGBM) – were trained on a dataset from 2017 to 2023 that included radiosonde, various remote sensing PBLHT estimates, and atmospheric meteorological conditions. Evaluations indicated that PBLHT-BE-ML from all three models improved alignment with the PBLHT derived from radiosonde data (PBLHT-SONDE), with LightGBM demonstrating the highest accuracy under both stable and unstable boundary layer conditions. Feature analysis revealed that the most influential input features at the SGP site were the PBLHT estimates derived from (a) potential temperature profiles retrieved using Raman lidar (RL) and atmospheric emitted radiance interferometer (AERI) measurements (PBLHT-THERMO), (b) vertical velocity variance profiles from Doppler lidar (PBLHT-DL), and (c) aerosol backscatter profiles from micropulse lidar (PBLHT-MPL). The trained models were then used to predict PBLHT-BE-ML at a temporal resolution of 10 min, effectively capturing the diurnal evolution of PBLHT and its significant seasonal variations, with the largest diurnal variation observed over summer at the SGP site. We applied these trained models to data from the ARM Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE) field campaign (EPC), where the PBLHT-BE-ML, particularly with the LightGBM model, demonstrated improved accuracy against PBLHT-SONDE. Analyses of model performance at both the SGP and EPC sites suggest that expanding the training dataset to include various surface types, such as ocean and ice-covered areas, could further enhance ML model performance for PBLHT estimation across varied geographic regions.

Zhang, Damao [Pacific Northwest National Laborator↗
DOE OSTI2024

Fuel Performance Evaluation of THOR-C Experiments

The Temperature Heatsink Overpower Response Commissioning (THOR-C) and THOR-Metal (THOR-M) experiments will be performed as part of an ongoing project for testing sodium fast reactor fuels with the Japan Atomic Energy Agency (JAEA). The THOR-C experiments consist of fresh metallic fuel pins and have been analyzed using the ABAQUS, Ansys codes and the BISON fuel performance code. THOR-M-Loss of Flow-1 (THOR-M-LOF-1) is designed to test an EBR-II irradiated fuel pin under LOF conditions. Simulation of the THOR-MLOF-1 experiment required first simulating the base irradiation of the fuel pin in EBR-II. MFUEL module of SAS4A/SASSYS-1 [1] is a physics-based metallic fuel performance model applicable to the normal operation, transient scenarios and fuel failure modeling including scenarios with bulk fuel melting. The model has been validated using EBR-II normal operation, separate effect transient tests as well as TREAT M-Series transient tests [2]. In this study, MFUEL models has been utilized together with a new capsule heat transfer model developed in this project. The new heat transfer model was necessary due to (1) significant amount of heat losses that required 2D heat transfer, (2) the presence of a titanium heat sink, rejecting a significant amount of heat, and (3) stagnant coolant conditions, which are inconsistent with SAS4A/SASSYS-1 (SAS) heat transfer model. Updates to SAS4A/SASSYS-1 and MFUEL has been described below, followed by a preliminary validation effort using the results from THOR-C-2 fresh fuel capsule experiment. A previous study for THOR-C-2 analysis using BISON code is also utilized in this study to model this test [3]. [1] D. O’Grady, A. J. Brunett, L. Ibarra, A. Karahan, T. Kim, T. S. Sumner, R. Thomas, T. H. Fanning, “The SAS4A/SASSYS-2 Version 5.7 Safety Analysis Code System,” Argonne National Laboratory,ANL/NSE-SAS/5.7, (2023). [2] A. Karahan, T. Kim, T. Fanning, D. O’Grady, “Validation of MFUEL Metal Fuel Performance Models of SAS4A/SASSYS-1,” Argonne National Laboratory, ANL/NSE-23/11, (2023). [3] M. Mihelish, A. Zabriskie, K. Paaren, P. Medvedev, C. Jensen, “Fuel Performance Predictions for the TREAT THOR-C Experiments,” Idaho National Laboratory, INL/RPT-23-73397, Revision 0, (2023)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Challenges in predicting protein-protein interactions of understudied viruses: Arenavirus-human interactions

Understanding protein-protein interactions (PPIs) between viruses and host organisms is crucial for uncovering infection mechanisms and identifying potential therapeutic targets. The ability to generalize PPI predictive models across understudied viruses presents a significant challenge. In this work, we use arenavirus-human PPIs to illustrate the difficulties associated with model generalization, which are compounded by a lack of both positive and negative data. We employ a Transfer Learning approach to investigate arenavirus-human PPIs by utilizing models trained on better-studied virus-human and human-human PPIs. Additionally, we curate and assess four types of negative sampling datasets to evaluate their impact on model performance. Despite the overall high accuracies (93–99 %) and AUPRC scores (0.8–0.9) appearing promising, further analysis indicates that these performance metrics can be misleading due to data leakage, data bias, and overfitting, especially concerning under-represented viral proteins. We reveal these gaps and assess the impact of data imbalance using standard k-fold cross-validation and Independent Blind Testing with a Balanced Dataset, resulting in a drop in accuracy below 50 %. We propose a viral protein-specific evaluation framework that categorizes viral proteins into majority and minority classes based on their representation in the dataset, enabling comparison of model performance across these groups using balanced accuracies. This framework offers a more robust evaluation of model generalizability, addressing biases inherent in standard evaluation techniques and paving the way for more reliable PPI prediction models for understudied viruses.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

The Virtual Blast Furnace - An Integrated High Performance Computing Modeling, Simulation, and Visualization Capability for Steel Manufacturing (Final Report)

Many manufacturing industries require substantial capital and utilize energy intensive processes that involve complex phenomena. One example of such an industry is the steel industry, which is the fourth largest energy consuming industry in the U.S. By harnessing the power of High-Performance Computing (HPC) to enhance current simulation and visualization methods in the steel industry, it should be possible to increase resolution and/or decrease time of these methods by a factor of 1000. In this way, information can be obtained in a time frame that is useful for making business and engineering decisions, optimizing manufacturing processes and, ultimately, improving the completeness of U.S. industries. For example, if coke usage in blast furnaces were optimized such that the average coke rate was reduced from 797 lb/net tonne of hot metal (NTHM) to 604 lb/NTHM, costs could be reduced by $894 million/year. Additionally, members of the steel industry need the flexibility to efficiently operate blast furnaces at a range of production rates in order to meet fluctuating market demands. Large scale parameter studies can be utilized to discover workable operating parameters at a range of production rates.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

A critical examination of compound stability predictions from machine-learned formation energies

Machine learning has emerged as a novel tool for the efficient prediction of material properties, and claims have been made that machine-learned models for the formation energy of compounds can approach the accuracy of Density Functional Theory (DFT). The models tested in this work include five recently published compositional models, a baseline model using stoichiometry alone, and a structural model. By testing seven machine learning models for formation energy on stability predictions using the Materials Project database of DFT calculations for 85,014 unique chemical compositions, we show that while formation energies can indeed be predicted well, all compositional models perform poorly on predicting the stability of compounds, making them considerably less useful than DFT for the discovery and design of new solids. Most critically, in sparse chemical spaces where few stoichiometries have stable compounds, only the structural model is capable of efficiently detecting which materials are stable. The nonincremental improvement of structural models compared with compositional models is noteworthy and encourages the use of structural models for materials discovery, with the constraint that for any new composition, the ground-state structure is not known a priori. This work demonstrates that accurate predictions of formation energy do not imply accurate predictions of stability, emphasizing the importance of assessing model performance on stability predictions, for which we provide a set of publicly available tests.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Nonlinear modeling and performance analysis of cracked beam microgyroscopes

Cracks constitute a common structural defect in microelectromechanical systems that may arise during manufacturing, mechanical fatigue, or shock loading. Areas weakened by cracks increase the flexibility of the microstructure. Furthermore, depending on the crack severity, the increased flexibility can cause dramatic changes in the static and dynamic behaviors of electrically actuated MEMS. In this study, a numerical investigation of the depth and location of multiple edge cracks on the performance of beam microgyroscopes is conducted. Applying the Griffith strain energy release theorem for an edge crack, the vibrational characteristics of microgyroscopes with multiple cracks including the static deflection, natural frequencies, and mode shapes are studied analytically. Then, the differential quadrature method is employed to model the nonlinear dynamic behaviors of the cracked gyroscope system. Cracks initiated along the driving or sensing directions of the microgyroscope are found to have differing effects on its nonlinear dynamic response. This numerical study reveals that the onset of severe single cracks or a series of multiple cracks can significantly affect the sensitivity of the microgyroscope to base rotations and therefore leads to a degradation in the performance of the damaged MEMS sensor. This study also shows that a potential design approach for broadband microgyroscope systems manufactured with cracks can be proposed.

42 ENGINEERING↗
DOE OSTI2023

A Surface Radiation Balance Dataset from Siple Dome in West Antarctica for Atmospheric and Climate Model Evaluation

Abstract A field campaign at Siple Dome in West Antarctica during the austral summer 2019/20 offers an opportunity to evaluate climate model performance, particularly cloud microphysical simulation. Over Antarctic ice sheets and ice shelves, clouds are a major regulator of the surface energy balance, and in the warm season their presence occasionally induces surface melt that can gradually weaken an ice shelf structure. This dataset from Siple Dome, obtained using transportable and solar-powered equipment, includes surface energy balance measurements, meteorology, and cloud remote sensing. To demonstrate how these data can be used to evaluate model performance, comparisons are made with meteorological reanalysis known to give generally good performance over Antarctica (ERA5). Surface albedo measurements show expected variability with observed cloud amount, and can be used to evaluate a model’s snowpack parameterization. One case study discussed involves a squall with northerly winds, during which ERA5 fails to produce cloud cover throughout one of the days. A second case study illustrates how shortwave spectroradiometer measurements that encompass the 1.6- μ m atmospheric window reveal cloud phase transitions associated with cloud life cycle. Here, continuously precipitating mixed-phase clouds become mainly liquid water clouds from local morning through the afternoon, not reproduced by ERA5. We challenge researchers to run their various regional or global models in a manner that has the large-scale meteorology follow the conditions of this field campaign, compare cloud and radiation simulations with this Siple Dome dataset, and potentially investigate why cloud microphysical simulations or other model components might produce discrepancies with these observations. significance statement Antarctica is a critical region for understanding climate change and sea level rise, as the great ice sheets and the ice shelves are subject to increasing risk as global climate warms. Climate models have difficulties over Antarctica, particularly with simulation of cloud properties that regulate snow surface melting or refreezing. Atmospheric and climate-related field work has significant challenges in the Antarctic, due to the small number of research stations that can support state-of-the-art equipment. Here we present new data from a suite of transportable and solar-powered instruments that can be deployed to remote Antarctic sites, including regions where ice shelves are most at risk, and we demonstrate how key components of climate model simulations can be evaluated against these data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Impact of Color Space and Color Resolution on Vehicle Recognition Models

In this study, we analyze both linear and nonlinear color mappings by training on versions of a curated dataset collected in a controlled campus environment. We experiment with color space and color resolution to assess model performance in vehicle recognition tasks. Color encodings can be designed in principle to highlight certain vehicle characteristics or compensate for lighting differences when assessing potential matches to previously encountered objects. The dataset used in this work includes imagery gathered under diverse environmental conditions, including daytime and nighttime lighting. Experimental results inform expectations for possible improvements with automatic color space selection through feature learning. Moreover, we find there is only a gradual decrease in model performance with degraded color resolution, which suggests the need for simplified data collection and processing. By focusing on the most critical features, we could see improved model generalization and robustness, as the model becomes less prone to overfitting to noise or irrelevant details in the data. Such a reduction in resolution will lower computational complexity, leading to quicker training and inference times.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Automated prediction of lattice parameters from X-ray powder diffraction patterns

A key step in the analysis of powder X-ray diffraction (PXRD) data is the accurate determination of unit-cell lattice parameters. This step often requires significant human intervention and is a bottleneck that hinders efforts towards automated analysis. This work develops a series of one-dimensional convolutional neural networks (1D-CNNs) trained to provide lattice parameter estimates for each crystal system. A mean absolute percentage error of approximately 10% is achieved for each crystal system, which corresponds to a 100- to 1000-fold reduction in lattice parameter search space volume. The models learn from nearly one million crystal structures contained within the Inorganic Crystal Structure Database and the Cambridge Structural Database and, due to the nature of these two complimentary databases, the models generalize well across chemistries. A key component of this work is a systematic analysis of the effect of different realistic experimental non-idealities on model performance. It is found that the addition of impurity phases, baseline noise and peak broadening present the greatest challenges to learning, while zero-offset error and random intensity modulations have little effect. However, appropriate data modification schemes can be used to bolster model performance and yield reasonable predictions, even for data which simulate realistic experimental non-idealities. In order to obtain accurate results, a new approach is introduced which uses the initial machine learning estimates with existing iterative whole-pattern refinement schemes to tackle automated unit-cell solution.

42 ENGINEERING↗
DOE OSTI2026

Search for HH → bbτ⁺τ⁻ Using Run 3 Scouting Data Analyze b-tagging and tau-tagging Performance with Unified Particle Transformer

B-tagging and tau-tagging performances play an important role in the search for the rare event HH → bbτ⁺τ⁻. A transformer-based neural network, Unified Particle Transformer, is applied for both tagging tasks, and Run 3 proton–proton collision scouting data at center-of-mass energy of 13.6 TeV is used. The scouting data stream accepts events at a much higher rate compared to traditional triggers, but stores only the objects reconstructed in the trigger, no low-level detector information. Therefore, existing taggers trained for the offline event reconstruction cannot be used. Analysis of the SoftMax plots, ROC/AUC curves, confusion matrix, accuracy and losses are used to evaluate model performance. Specifically, the tagging efficiency of the signal and misidentification probability across multiple background processes are compared for varying working points. Different training samples with distinct distributions of jet flavors are utilized and related model performances are analyzed. Interpretability methods, such as Integrated Gradients, may further be applied to study the input features’ influence on the model’s decisions, providing insights into potential improvements.

Chen, Blair [Purdue U., West Lafayette; Fermilab]↗
DOE OSTI2020

Multimodel validation of single wakes in neutral and stratified atmospheric conditions

Previous research has revealed the need for a validation study that considers several wake quantities and code types so that decisions on the trade-off between accuracy and computational cost can be well informed and appropriate to the intended application. In addition to guiding code choice and setup, rigorous model validation exercises are needed to identify weaknesses and strengths of specific models and guide future improvements. Here, we consider 13 approaches to simulating wakes observed with a nacelle-mounted lidar at the Scaled Wind Technology Facility (SWiFT) under varying atmospheric conditions. We find that some of the main challenges in wind turbine wake modeling are related to simulating the inflow. In the neutral benchmark, model performance tracked as expected with model fidelity, with large-eddy simulations performing the best. In the more challenging stable case, steady-state Reynolds-averaged Navier–Stokes simulations were found to outperform other model alternatives because they provide the ability to more easily prescribe noncanonical inflows and their low cost allows for simulations to be repeated as needed. Dynamic measurements were only available for the unstable benchmark at a single downstream distance. These dynamic analyses revealed that differences in the performance of time-stepping models come largely from differences in wake meandering. This highlights the need for more validation exercises that take into account wake dynamics and are able to identify where these differences come from: mesh setup, inflow, turbulence models, or wake-meandering parameterizations. In addition to model validation findings, we summarize lessons learned and provide recommendations for future benchmark exercises.

17 WIND ENERGY↗