Search NASA⌕ Search

SEARCH · Search NASA

Results for “simulation fidelity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

EVALUATION OF HOT CHANNEL FACTOR FOR SODIUM-COOLED FAST REACTORS WITH MULTI-PHYSICS TOOLKIT

The evaluation of hot channel factor (HCF) is of great significance to the quantification of safety margins for reactor designs. In this paper, HCFs for a sodium-cooled fast reactor (SFR) are evaluated with the Simulation-based High-efficiency Advanced Reactor Prototyping (SHARP) toolkit, which is developed under the Nuclear Energy Advanced Modeling and Simulation (NEAMS) Campaign of DOE for multi-physics reactor performance and safety simulations. The high-fidelity neutronics and thermal hydraulics solvers PROTEUS and Nek5000 in the SHARP toolkit are coupled to perform the multi-physics simulations for HCF evaluation. The HCFs induced by cladding manufacturing tolerance, fissile content mal-distribution, wire orientation and uncertainties on the cladding, coolant, and fuel properties are evaluated for a reference core SFR design (AFR-100). The HCFs calculated with the SHARP toolkit are compared to legacy HCFs for similar reactor types. The comparison demonstrates the reduction or elimination of modeling uncertainties in the calculation of HCFs using high fidelity advanced modeling and simulation tools without the need of expensive experiments. Moreover, the reduction of the uncertainties on HCFs evaluation allows an increase in nominal parameters and safety margin, which in turn improves the economic competitiveness of the SFR.

Hot channel factor (HCF)↗

Electromagnetic Transient Simulation of Photovoltaic Inverter Using Implicit-Explicit Solver

This paper introduces the implementation of electromagnetic transient (EMT) simulations of a photovoltaic (PV) inverter module using the Implicit-Explicit (ImEx) solver in the Suite of Nonlinear and Differential/Algebraic Equation Solvers (SUNDIALS). This study demonstrates the effectiveness of the ImEx solver in overcoming the challenges inherent in simulating the complex dynamics of PV inverter modules. Furthermore, using SUNDIALS’ ImEx solver module ARKODE for EMT simulation automates key aspects of the process, such as numerical integration, providing substantial benefits including enhanced consistency, faster implementation, reduced human error, and the capability to handle the complexities of advanced numerical integration. By conducting comparative simulations with an implicit method used in commercial software, the research showcases the ImEx solver’s capability in achieving high accuracy and reliability. Results indicate that leveraging the ImEx approach significantly enhances modeling fidelity and reduces simulation setup times, offering a promising tool for the EMT analysis of PV inverter systems in power electronics-dominated power grids.

Choi, Jongchan [ORNL] (ORCID:000000025952455X)↗

Progress in Simulating the Quasi–Biennial Oscillation in CMIP Models

The quasi–biennial oscillation (QBO) of the zonal mean zonal wind is the primary mode of variability in the tropical lower stratosphere. The QBO is characterized by alternating easterly westerly shear layers that descend down from ~10 to 100 hPa. The QBO is also seen in lower stratospheric tropical temperature, water vapor, and ozone and affects tropospheric variability through various teleconnections. We examine here the progress in simulating the QBO in the Coupled Model Intercomparison Project (CMIP) models, more specifically in CMIP3, CMIP5, and CMIP6 models. We show that the number of models that are able to simulate the QBO has increased from 0 in CMIP3, to 5 in CMIP5, to 15 in CMIP6. While the number of models with an internally generated QBO has tripled from CMIP5 to CMIP6, the fidelity of the simulation averaged over the CMIP models has not improved. We show that CMIP5 and CMIP6 models represent the QBO period and latitudinal extent quite well; however the QBO amplitude is shifted upwards relative to observations resulting in large underestimation of QBO amplitude at all levels below 20 hPa. As a result, the underestimation of QBO amplitude in the lowermost stratosphere and lack of variations downward to the tropopause and below will likely impact the quality of teleconnections seen in the current generation Earth system models.

54 ENVIRONMENTAL SCIENCES↗

Simulations of Laser Experiments to Study the Origin of Cosmic Magnetic Fields

Magnetic fields are ubiquitous in the universe; however, their origin is not fully understood. Cosmologists and astrophysicists have proposed a variety of ways in which small seed magnetic fields could be created. It is widely thought that the much larger values of the cosmic magnetic fields that we observe are a result of the amplification of these seed fields by the nonlinear turbulent dynamo mechanism. Such a mechanism had not yet been demonstrated in a controlled laboratory environment. We conceived experiments designed to demonstrate and study the nonlinear turbulent dynamo mechanism in the laboratory. These experiments characterize the distribution of turbulent energy among the velocity, magnetic field, and density fluctuations, providing a comprehensive picture of the energy cascade in a magnetized, turbulent plasma. The experiments build on the pathfinder experiments we have conducted on the Vulcan laser at the Rutherford-Appleton Laboratory in the UK and the OMEGA laser at Laboratory for Laser Energetics at Rochester. They utilize the high-intensity lasers at the Omega Laser Facility, the National Ignition Facility (NIF) at LLNL and the Laser Megajoule (LMJ) Facility in France – the largest laser facilities in the world. The goal of this project was to design and model the highly demanding experiments through simulation campaigns using FLASH, a highly capable radiation-MHD code we have developed, and large-scale 3D simulations on the Mira supercomputer at ANL. The simulations were vital to ensuring the experiments achieve the strong turbulence and large magnetic Reynolds numbers required for the nonlinear turbulent dynamo mechanism to operate. The simulations were also critical to determining when to fire the diagnostics, since the experiments last tens of nanoseconds but the signals of the strongly amplified magnetic fields last only a few nanoseconds. Finally, high-fidelity, validated FLASH simulations were crucial to interpreting the results of the experiments. By combining theory, experiments, and simulations, we were able to succeed in demonstrating and characterizing the nonlinear turbulent dynamo mechanism. The effort leveraged (1) the emergence of the Flash Center for Computational Science as a leader in numerical modeling of academic High Energy Density Physics (HEDP) experiments; (2) the FLASH code, which has been developed by the Flash Center and is a leadership-class, multi- physics, publicly available community code that has been applied successfully in many laser-driven experiments; (3) the expertise acquired through pathfinder experiments we performed on the Vulcan laser at the Rutherford-Appleton Laboratory in the UK and on the Omega laser facility; (4) the experience we have gained in designing and interpreting these experiments using validated simulations done with FLASH; and (5) the close collaborations we have established with outstanding experimental groups in the US and abroad. The broader impacts of the project are two-fold: (1) the work furthered the transformation of the academic community’s ability to design and analyze HEDP experiments at large laser facilities that is happening through the availability of FLASH and its widespread adoption by the academic community – a community that previously had had limited access to open and validated hydro/MHD simulation tools for HEDP experiments; and (2) the work trained young scientists to design and interpret HEDP experiments using validated simulations – a critical national need.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Multi-scale gyrokinetic simulations of an Alcator C-Mod, ELM-y H-mode plasma

High fidelity, multi-scale gyrokinetic simulations capable of capturing both ion (${k}_{\theta }{\rho }_{s}\sim { \mathcal O }(1.0)$) and electron-scale (${k}_{\theta }{\rho }_{e}\sim { \mathcal O }(1.0)$) turbulence were performed in the core of an Alcator C-Mod ELM-y H-mode discharge which exhibits reactor-relevant characteristics. These simulations, performed with all experimental inputs and realistic ion to electron mass ratio (${({m}_{i}/{m}_{e})}^{1/2}=60.0$) provide insight into the physics fidelity that may be needed for accurate simulation of the core of fusion reactor discharges. Three multi-scale simulations and series of separate ion and electron-scale simulations performed using the GYRO code are presented. As with earlier multi-scale results in L-mode conditions, both ion and multi-scale simulations results are compared with experimentally inferred ion and electron heat fluxes, as well as the measured values of electron incremental thermal diffusivities—indicative of the experimental electron temperature profile stiffness. Consistent with the L-mode results, cross-scale coupling is found to play an important role in the simulation of these H-mode conditions. Extremely stiff ion-scale transport is observed in these high-performance conditions which is shown to likely play and important role in the reproduction of measurements of perturbative transport. In conclusion, these results provide important insight into the role of multi-scale plasma turbulence in the core of reactor-relevant plasmas and establish important constraints on the fidelity of models needed for predictive simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Aerodynamic Simulation of Ice Accretion on Airfoils

This report describes recent improvements in aerodynamic scaling and simulation of ice accretion on airfoils. Ice accretions were classified into four types on the basis of aerodynamic effects: roughness, horn, streamwise, and spanwise ridge. The NASA Icing Research Tunnel (IRT) was used to generate ice accretions within these four types using both subscale and full-scale models. Large-scale, pressurized windtunnel testing was performed using a 72-in.- (1.83-m-) chord, NACA 23012 airfoil model with high-fidelity, three-dimensional castings of the IRT ice accretions. Performance data were recorded over Reynolds numbers from 4.5 x 10(exp 6) to 15.9 x 10(exp 6) and Mach numbers from 0.10 to 0.28. Lower fidelity ice-accretion simulation methods were developed and tested on an 18-in.- (0.46-m-) chord NACA 23012 airfoil model in a small-scale wind tunnel at a lower Reynolds number. The aerodynamic accuracy of the lower fidelity, subscale ice simulations was validated against the full-scale results for a factor of 4 reduction in model scale and a factor of 8 reduction in Reynolds number. This research has defined the level of geometric fidelity required for artificial ice shapes to yield aerodynamic performance results to within a known level of uncertainty and has culminated in a proposed methodology for subscale iced-airfoil aerodynamic simulation.

Broeren, Andy P.↗

Data-driven surrogate modeling of hPIC ion energy-angle distributions for high-dimensional sensitivity analysis of plasma parameters' uncertainty

In this work, we present a data-driven strategy for effective construction of a surrogate model in high-dimensional parameter space for the ion energy-angle distribution (IEAD) output of hPIC simulations of plasma-surface interactions. The methodology is based on a bin-by-bin least-squares fitting of the IEAD in the parameter space. The fitting is performed in a transformed coordinate system to normalize the IEAD, and it employs sparse grids for sampling the parameter space to overcome sampling challenges in high dimensions. The surrogate model is significantly cheaper computationally than direct hPIC simulations yet maintains high fidelity to them, providing a fast emulator for hPIC simulations. Sensitivity analysis based on the surrogate model is utilized to characterize the dependence of the ion impact angle and energy moments on the physical parameters.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Plasma shape and position control development for NSTX-U using the GSEvolve plasma simulator

NSTX-U discharges have been reproduced using the GSEvolve plasma simulator in order to improve their control and reduce oscillations during the plasma current (Ip) ramp-up phase, and with the ultimate goal of enabling reliable H-mode access with a double-null shape at high elongation, low internal inductance, and high plasma performance. The control objective is to eliminate undesired oscillations in the plasma shape and vertical position that start when the plasma diverts during the Ip ramp-up phase, and that happened recurrently during the first NSTX-U experimental campaign. Model-based control solutions have been developed, including alternative H-mode access recipes and a Multi-Input Multi-Output (MIMO) decoupling controller. These solutions have demonstrated their capability to reduce or eliminate the aforementioned oscillations in GSEvolve simulations, enabling reproducible H-mode access. The results of this work aim to inform NSTX-U experimental operations on potential control developments to maximize its scientific output, and highlight the powerful capabilities of high-fidelity control-simulation frameworks like GSEvolve.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Quantifying the Effect of Pore‐Size Dependent Wettability on Relative Permeabilities Using Lattice Boltzmann Simulation

Relative permeability is a crucial two-phase property in porous media that can be significantly impacted by wettability conditions. While traditional research has predominantly examined homogeneous wettability, this work explores the less studied pore-size dependent (PSD) wettability, featured by a pore-size dependent wettability distribution. Leveraging high-fidelity Lattice Boltzmann simulations on CT-scanned porous samples, we demonstrate how PSD wettability would impact relative permeability at the pore scale. Our findings reveal that the deviation of relative permeability from the homogeneous wettabilitity induced by PSD wettability can be 5%–20%. The deviation of relative permeability curves increases as the spanning range of the contact angle increases. We also find that this impact is less pronounced as the capillary number increases. By adopting a pore-size-dependent contact angle relationship, our approach provides a more accurate and nuanced understanding of how PSD wettability would impact two-phase flow. These findings discovered at the pore scale may also provide valuable insights on relative permeability at the core to reservoir scales.

25 ENERGY STORAGE↗

High-resolution simulations of a turbulent boundary layer impacting two obstacles in tandem

High-fidelity large-eddy simulations of the flow around two rectangular obstacles are carried out at a Reynolds number of 10 000 based on the freestream velocity and the obstacle height. The incoming flow is a developed turbulent boundary layer. Mean-velocity components, turbulence fluctuations, and the terms of the turbulent-kinetic-energy budget are analyzed for three flow regimes: skimming flow, wake interference, and isolated roughness. Three regions are identified where the flow undergoes the most significant changes: the first obstacle’s wake, the region in front of the second obstacle, and the region around the second obstacle. In the skimming-flow case, turbulence activity in the cavity between the obstacles is limited and mainly occurs in a small region in front of the second obstacle. In the wake-interference case, there is a strong interaction between the freestream flow that penetrates the cavity and the wake of the first obstacle. Furthermore, this interaction results in more intense turbulent fluctuations between the obstacles. In the isolated-roughness case, the wake of the first obstacle is in good agreement with that of an isolated obstacle. Separation bubbles with strong turbulent fluctuations appear around the second obstacle.

97 MATHEMATICS AND COMPUTING↗

Direct numerical simulation and Reynolds-averaged Navier-Stokes modeling of the sudden viscous dissipation for multicomponent turbulence

Simulations of a turbulent multicomponent fluid mixture undergoing isotropic deformations are carried out to investigate the sudden viscous dissipation. This dissipative mechanism was originally demonstrated using simulations of an incompressible single-component fluid [S. Davidovits and N. J. Fisch, Phys. Rev. Lett. 116, 105004 (2016)]. By accounting for the convective and diffusive transfer of various species, the current work aims to increase the physical fidelity of previous simulations and their relevance to inertial confinement fusion applications. Direct numerical simulations of the compressed fluid show that the sudden viscous dissipation of turbulent kinetic energy is unchanged from the single-component scenario. More importantly, the simulations demonstrate that the mass fraction variance and covariance for the various species also exhibit a sudden viscous decay. Reynolds-averaged Navier-Stokes simulations were carried out using the $k - l$ model to assess its ability to reproduce the sudden viscous dissipation. Results show that the standard $k - l$ formulation does not capture the sudden decay of turbulent kinetic energy, mass-fraction variance, and mass-fraction covariance for simulations with various compression and expansion rates, or different exponents for the power-law model of viscosity. A new formulation of the $k - l$ model that is based on previous improvements to the $k - ε$ family of models is proposed, which leads to consistently good agreement with the direct numerical simulations for all the isotropic deformations under consideration.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Combining regional mesh refinement with vertically enhanced physics to target marine stratocumulus biases as demonstrated in the Energy Exascale Earth System Model version 1

Abstract. In this paper we develop a novel framework aimed to significantly reduce biases related to marine stratocumulus clouds in general circulation models (GCMs) while circumventing excessive computational cost requirements. Our strategy is to increase the horizontal resolution using a regionally refined mesh (RRM) over our region of interest in addition to using the Framework for Improvement by Vertical Enhancement (FIVE) to increase the vertical resolution only for specific physical processes that are important for stratocumulus. We apply the RRM off the coast of Peru in the southeastern Pacific, a region that climatologically contains the most marine stratocumulus in the subtropics. We find that our new modeling framework is able to replicate the results of our high-resolution benchmark simulation with much fidelity, while reducing the computational cost by several orders of magnitude. In addition, this framework is able to greatly reduce the long-standing biases associated with marine stratocumulus in GCMs when compared to the standard-resolution control simulation.

54 ENVIRONMENTAL SCIENCES↗

Simulations of Transient Phenomena in Liquid Rocket Feed Systems

Valve systems in rocket propulsion systems and testing facilities are constantly subject to dynamic events resulting from the timing of valve motion leading to unsteady fluctuations in pressure and mass flow. Such events can also be accompanied by cavitation, resonance, system vibration leading to catastrophic failure. High-fidelity dynamic computational simulations of valve operation can yield important information of valve response to varying flow conditions. Prediction of transient behavior related to valve motion can serve as guidelines for valve scheduling, which is of crucial importance in engine operation and testing. Feed components operating in cryogenic regimes can also experience cavitation based instabilities leading to large scale shedding of vapor clouds and pressure oscillations. In this paper, we present simulations of the diverse unsteady phenomena related to valve and feed systems that include valve stall, valve timing studies as well as two different forms of cavitation instabilities in components utilized in the test loop.

Ahuja, V.↗

Inertial Effects During the Process of Supercritical CO 2 Displacing Brine in a Sandstone: Lattice Boltzmann Simulations Based on the Continuum-Surface-Force and Geometrical Wetting Models

Inertial effects during the process of supercritical CO 2 displacing brine in porous media may not be negligible according to recent studies. Capturing the inertial effects of the physical CO 2 -brine system imposes a requirement on the grid resolution and viscosity to surface tension ratio for pore-scale simulations, which some commonly used simulators may not be able to meet. To fulfill the parameter requirement, we combine the continuum-surface-force based color-gradient lattice Boltzmann (LB) multiphase model and the geometrical wetting model and extend the model to 3D under the multiple-relaxation-time framework. We validate the model via simple benchmarks which show significant improvement over the traditional models. Furthermore, we perform 3D drainage simulations in a heterogeneous micromodel where the simulation result agrees well with experimental data, while our previous work fails to reproduce certain displacement patterns in the experiment due to the use of a traditional LB model that cannot fulfill the parameter requirement. Finally, we perform high-fidelity 3D drainage simulations to study the inertial effects in a Bentheimer sandstone sample. These findings show that stronger inertial effects generally help develop more CO 2 flow pathways for the same capillary number which results in higher CO 2 saturation, consistent with the micromodel results. The phenomena can be found in both low and high capillary number cases, indicating that the inertial effects are not dependent on the mean velocity. In addition, the change of the invasion patterns is not proportional to the change of inertial effects, thus exhibiting threshold behavior.

58 GEOSCIENCES↗

Implementation of disruptive designs for gas turbine components using direct energy deposition additive manufacturing

This research aims to develop a framework for establishing the correlation between in-situ monitoring data, process parameters, and microstructure evolution in blown-powder laser-directed energy deposition (DED) additive manufacturing (AM). To achieve this, a comprehensive manufacturing framework has been developed, spanning from in-situ data acquisition, melt-pool simulation, microstructure modeling, and statistical microstructure quantification. A machine learning-based surrogate model is constructed to predict melt pool geometry directly from in-situ coaxial camera data. The surrogate model is trained using outputs from a high-fidelity melt pool simulation, which provides accurate melt pool dimension data under varying process conditions. The predicted melt pool geometry is then used as input to a microstructure model to predict microstructural features. To rigorously compare and analyze microstructures, the project introduces statistical metrics that quantify differences based on key features such as morphology and texture. Microstructures are represented using advanced statistical descriptors including angular chord length distribution, two-point spatial statistics, orientation distribution function, and global spherical harmonic. These representations are used to compute four distinct “dissimilarity scores” that quantitatively capture differences in texture and morphology. This framework is demonstrated to enable automated calibration of simulation parameters by minimizing discrepancies between simulated and target microstructures. The technology developed in this project enables direct correlation between in-situ monitoring data and resulting microstructure, paving the way for adaptive microstructure control in metal AM. This capability strengthens the connection between process parameters and final material properties, facilitating more precise and reliable material design.

36 MATERIALS SCIENCE↗

Neutronics/Thermal-hydraulics coupling with RMC and CTF for BEAVRS benchmark calculation

As the computational accuracy required for design and safety analysis of current and future nuclear reactors is continuously increasing, high fidelity numerical reactor simulations including different physics raise wide concern of researchers. The interplay between neutronic and thermal-hydraulic (N-TH) effects of a nuclear reactor core plays an important role in reactor design, safety analysis and core performance. Monte Carlo method can provide high fidelity neutronics analysis of different nuclear reactors, owing to its advantages of the flexible geometry modeling and the use of continuous-energy nuclear cross sections. Armed with the massively parallel algorithms, the computational cost of Monte Carlo codes can be greatly reduced. Compared to single channel thermal process, sub-channel codes have enormous advantages of detailed modeling of full-core reactor or single assembly and high accuracy of calculation results. Detailed sub-channel modeling of a full-core also needs running in parallel, otherwise the computational cost will be relatively high. In this paper, a new hybrid coupling with continuous-energy Monte Carlo code RMC and the sub-channel code CTF has been developed. The coupling codes are applied to steady-state simulations of BEAVRS benchmark in hot full power condition. In order to deal with the temperature dependence of cross sections for Monte Carlo code, the on-the-fly cross sections treatment has been developed in RMC. The on-the-fly method was applied to the N-TH coupling in this work. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Thermal-Hydraulic Simulations of Single Pin and Assembly Sector for IVG- 1M Reactor

Thermal-hydraulic simulations have been performed using computational fluid dynamics (CFD) for the highly-enriched uranium (HEU) design of the IVG.1M reactor at the Institute of Atomic Energy (IAE) at the National Nuclear Center (NNC) in the Republic of Kazakhstan. Steady-state simulations were performed for both types of fuel assembly (FA), i.e. the FA in rows 1 & 2 and the FA in row 3, as well as for single pins in those FA (600 mm and 800 mm pins). Both single pin calculations and bundle sectors have been simulated for the most conservative operating conditions corresponding to the 10 MW output power, which corresponds to a pin unit cell Reynolds number of only about 7500. Simulations were performed using the commercial code STAR-CCM+ for the actual twisted pin geometry as well as a straight-pin approximation. Various Reynolds-Averaged Navier-Stokes (RANS) turbulence models gave different results, and so some validation runs with a higher-fidelity Large Eddy Simulation (LES) code were performed given the lack of experimental data. These singled out the Realizable Two-Layer k-ε as the most accurate turbulence model for estimating surface temperature. Single-pin results for the twisted case, based on the average flow rate per pin and peak pin power, were conservative for peak clad surface temperature compared to the bundle results. Also the straight-pin calculations were conservative as compared to the twisted pin simulations, as expected, but the single-pin straight case was not always conservative with regard to the straight-pin bundle. This was due to the straight-pin temperature distribution being strongly influenced by the pin orientation, particularly near the outer boundary. The straight-pin case also predicted the peak temperature to be in a different location than the twisted-pin case. This is a limitation of the straight-pin approach. The peak temperature pin was in a different location from the peak power pin in every case simulated, and occurred at an inner pin just before the enrichment change. The 600 mm case demonstrated a peak clad surface temperature of 370.4 K, while the 800 mm case had a temperature of 391.6 K. These temperatures are well below the necessary temperatures for boiling to occur at the rated pressure. Fuel temperatures are also well below the melting point. Future bundle work will include simulations of the proposed low-enriched uranium (LEU) design. Two transient scenarios were also investigated for the single-pin geometries. Both were “model” problems that were focused on pure thermal-hydraulic behavior, and as such were simple power changes that did not incorporate neutron kinetics modeling. The first scenario was a high-power, ramp increase, while the second scenario was a low-power, step increase. A cylindrical RELAP model was also constructed to investigate its accuracy as compared to the higher-fidelity CFD. Comparisons between the two codes showed good agreement for peak temperatures in the fuel and at the cladding surface for both cases. In the step transient, temperatures at four axial levels were also computed. These showed greater but reasonable discrepancy, with RELAP outputting higher temperatures. These results provide some evidence that RELAP can be used with confidence in modeling transients for IVG.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Characterizing the Relative Importance Assigned to Physical Variables by Climate Scientists when Assessing Atmospheric Climate Model Fidelity

Evaluating a climate model’s fidelity (ability to simulate observed climate) is a critical step in establishing confidence in the model’s suitability for future climate projections, and in tuning climate model parameters. Model developers use their judgement in determining which trade-offs between different aspects of model fidelity are acceptable. However, little is known about the degree of consensus in these evaluations, and whether experts use the same criteria when different scientific objectives are defined. Here, we report on results from a broad community survey studying expert assessments of the relative importance of different output variables when evaluating a global atmospheric model’s mean climate. We find that experts adjust their ratings of variable importance in response to the scientific objective, for instance, scientists rate surface wind stress as significantly more important for Southern Ocean climate than for the water cycle in the Asian watershed. There is greater consensus on the importance of certain variables (e.g., shortwave cloud forcing) than others (e.g., aerosol optical depth). We find few differences in expert consensus between respondents with greater or less climate modeling experience, and no statistically significant differences between the responses of climate model developers and users. In conclusion, the concise variable lists and community ratings reported here provide baseline descriptive data on current expert understanding of certain aspects of model evaluation, and can serve as a starting point for further investigation, as well as developing more sophisticated evaluation and scoring criteria with respect to specific scientific objectives.

54 ENVIRONMENTAL SCIENCES↗