Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation/performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

4 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2021

An Evaluation of Size-Resolved Cloud Microphysics Scheme Numerics for use with Radar Observations Part II: Condensation and Evaporation

Accurate numerical modeling of clouds and precipitation is essential for weather forecasting and climate change research. While size-resolved (bin) cloud microphysics models predict particle size distributions without imposing shapes, results are subject to artificial size distribution broadening owing to numerical diffusion associated with various processes. Whereas Part 1 addressed collision-coalescence, here we investigate numerical diffusion that occurs in solving condensation and evaporation. In a parcel model framework, all of the numerical schemes examined converge to one solution of condensation and evaporation as the mass grid is refined, and the advection-based schemes are recommended over the reassigning schemes. Including Eulerian vertical advection in a column limits the convergence to some extent, but that limitation occurs at a sufficiently fine mass grid, and the number of iterations in solving vertical advection should be minimized to reduce numerical diffusion. Insubstantial numerical diffusion in solving condensation can be amplified if collision-coalescence is also active, which in turn can be substantially diminished if turbulence effects on collision are incorporated. Large-eddy simulations of a drizzling stratocumulus field reveal that changes in moments of Doppler spectra obtained using different mass grids are consistent with those obtained from the simplified framework, and that spectral moments obtained using a mass grid designed to effectively reduce numerical diffusion are generally closer to observations. Notable differences between the simulations and observations still exist, and our results suggest a need to consider whether factors other than numerical diffusion in the fundamental process schemes employed can cause such differences.

Cloud microphysics↗
NASA NTRS2014

Assessment of NASA GISS CMIP5 and Post-CMIP5 Simulated Clouds and TOA Radiation Budgets Using Satellite Observations: TOA Radiation Budget and CREs - Part 2

In Part I of this study, the NASA GISS Coupled Model Intercomparison Project (CMIP5) and post-CMIP5 (herein called C5 and P5, respectively) simulated cloud properties were assessed utilizing multiple satellite observations, with a particular focus on the southern midlatitudes (SMLs). This study applies the knowledge gained from Part I of this series to evaluate the modeled TOA radiation budgets and cloud radiative effects (CREs) globally using CERES EBAF (CE) satellite observations and the impact of regional cloud properties and water vapor on the TOA radiation budgets. Comparisons revealed that the P5- and C5-simulated global means of clear-sky and all-sky outgoing longwave radiation (OLR) match well with CE observations, while biases are observed regionally. Negative biases are found in both P5- and C5-simulated clear-sky OLR. P5-simulated all-sky albedo slightly increased over the SMLs due to the increase in low-level cloud fraction from the new planetary boundary layer (PBL) scheme. Shortwave, longwave, and net CRE are quantitatively analyzed as well. Regions of strong large-scale atmospheric upwelling/downwelling motion are also defined to compare regional differences across multiple cloud and radiative variables. In general, the P5 and C5 simulations agree with the observations better over the downwelling regime than over the upwelling regime. Comparing the results herein with the cloud property comparisons presented in Part I, the modeled TOA radiation budgets and CREs agree well with the CE observations. These results, combined with results in Part I, have quantitatively estimated how much improvement is found in the P5-simulated cloud and radiative properties, particularly over the SMLs and tropics, due to the implementation of the new PBL and convection schemes.

Model comparison↗
NASA NTRS2014

Assessment of NASA GISS CMIP5 and Post-CMIP5 Simulated Clouds and TOA Radiation Budgets Using Satellite Observations. Part I: Cloud Fraction and Properties

Although many improvements have been made in phase 5 of the Coupled Model Intercomparison Project (CMIP5), clouds remain a significant source of uncertainty in general circulation models (GCMs) because their structural and optical properties are strongly dependent upon interactions between aerosol/cloud microphysics and dynamics that are unresolved in such models. Recent changes to the planetary boundary layer (PBL) turbulence and moist convection parameterizations in the NASA GISS Model E2 atmospheric GCM(post-CMIP5, hereafter P5) have improved cloud simulations significantly compared to its CMIP5 (hereafter C5) predecessor. A study has been performed to evaluate these changes between the P5 and C5 versions of the GCM, both of which used prescribed sea surface temperatures. P5 and C5 simulated cloud fraction (CF), liquid water path (LWP), ice water path (IWP), cloud water path (CWP), precipitable water vapor (PWV), and relative humidity (RH) have been compared to multiple satellite observations including the Clouds and the Earth's Radiant Energy System-Moderate Resolution Imaging Spectroradiometer (CERES-MODIS, hereafter CM), CloudSat- Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO; hereafter CC), Atmospheric Infrared Sounder (AIRS), and Advanced Microwave Scanning Radiometer for Earth Observing System (AMSR-E). Although some improvements are observed in the P5 simulation on a global scale, large improvements have been found over the southern midlatitudes (SMLs), where correlations increased and both bias and root-mean-square error (RMSE) significantly decreased, in relation to the previous C5 simulation, when compared to observations. Changes to the PBL scheme have resulted in improved total column CFs, particularly over the SMLs where marine boundary layer (MBL) CFs have increased by nearly 20% relative to the previous C5 simulation. Globally, the P5 simulated CWPs are 25 gm22 lower than the previous C5 results. The P5 version of the GCM simulates PWV and RH higher than its C5 counterpart and agrees well with the AMSR-E and AIRS observations. The moister atmospheric conditions simulated by P5 are consistent with the CF comparison and provide a strong support for the increase in MBL clouds over the SMLs. Over the tropics, the P5 version of the GCM simulated total column CFs and CWPs are slightly lower than the previous C5 results, primarily as a result of the shallower tropical boundary layer in P5 relative to C5 in regions outside the marine stratocumulus decks.

General circulation models↗
NASA NTRS2022

Advances in the prediction of MJO-Teleconnections in the S2S forecast systems

This study evaluates the ability of state-of-the-art subseasonal to seasonal (S2S) forecasting systems to represent and predict the teleconnections of the Madden Julian Oscillations and their effects on weather in terms of midlatitude weather patterns and North Atlantic tropical cyclones. This evaluation of forecast systems applies novel diagnostics developed to track teleconnections along their preferred pathways in the troposphere and stratosphere, and to measure the global and regional responses induced by teleconnections across both the Northern and Southern Hemispheres. Results of this study will help the modeling community understand to what extent the potential to predict the weather on S2S time scales is achieved by the current generation of forecasting systems, while informing where to focus further development efforts. The findings of this study will also provide impact modelers and decision makers with a better understanding of the potential of S2S predictions related to MJO teleconnections.

Forecasting↗