SEARCH · Search NASA
Results for “model skill”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Investigation of the role of thermal boundary layer processes in initiating convection under the NASA SPACE Field Program
The current NWS ground based network is not sufficient to capture the dynamic or thermodynamic structure leading to the initiation and organization of air mass moist convective events. Under this investigation we intend to use boundary layer mesoscale models (McNider and Pielke, 1981) to examine the dynamic triggering of convection due to topography and surface thermal contrasts. VAS and MAN's estimates of moisture will be coupled with the dynamic solution to provide an estimate of the total convective potential. Visible GOES images will be used to specify incoming insolation which may lead to surface thermal contrasts and JR skin temperatures will be used to estimate surface moisture (via the surface thermal inertia) (Weizel and Chang, 1988) which can also induce surface thermal contrasts. We will use the SPACE-COHMEX data base to evaluate the ability of the joint mesoscale model satellite products to show skill in predicting the development of air mass convection. We will develop images of model vertical velocity and satellite thermodynamic measures to derive images of predicted convective potential. We will then after suitable geographic registration carry out a pixel by pixel correlation between the model/satellite convective potential and the 'truth' which are the visible images. During the first half of the first year of this investigation we have concentrated on two aspects of the project. The first has been in generating vertical velocity fields from the model for COHMEX case days. We have taken June 19 as the first case and have run the mesoscale model at several different grid resolutions. We are currently developing the composite model/satellite convective image. The second aspect has been the attempted calibration of the surface energy budget to provide the proper horizontal thermal contrasts for convective initiation. We have made extensive progress on this aspect using the FIFE data as a test data set. The calibration technique looks very promising.
Validation of Community Models: 2. Development of a Baseline, Using the Wang-Sheeley-Arge Model
This paper is the second in a series providing independent validation of community models of the outer corona and inner heliosphere. Here I present a comprehensive validation of the Wang-Sheeley-Arge (WSA) model. These results will serve as a baseline against which to compare the next generation of comparable forecasting models. The WSA model is used by a number of agencies to predict Solar wind conditions at Earth up to 4 days into the future. Given its importance to both the research and forecasting communities, it is essential that its performance be measured systematically and independently. I offer just such an independent and systematic validation. I report skill scores for the model's predictions of wind speed and interplanetary magnetic field (IMF) polarity for a large set of Carrington rotations. The model was run in all its routinely used configurations. It ingests synoptic line of sight magnetograms. For this study I generated model results for monthly magnetograms from multiple observatories, spanning the Carrington rotation range from 1650 to 2074. I compare the influence of the different magnetogram sources and performance at quiet and active times. I also consider the ability of the WSA model to forecast both sharp transitions in wind speed from slow to fast wind and reversals in the polarity of the radial component of the IMF. These results will serve as a baseline against which to compare future versions of the model as well as the current and future generation of magnetohydrodynamic models under development for forecasting use.
Predictability of Seasonal Means in the NSIPP-1 AGCM
The predictability of seasonal means during 1980-99 is examined from 720 seasonal integrations with version 1 of NASA's Seasonal to Interanual Prediction Project (NSIPP-1) atmospheric general circulation model (AGCM). The AGCM is the atmospheric (and land) component of the NSIPP fully-coupled atmosphere-land-ocean model. For these runs, the initial atmospheric conditions are taken from the National Centers for Environmental Prediction/National Center for Atmospheric Research (NCEP/NCAR) reanalyses, and sea surface temperatures and sea ice are specified from observations. Results from the northern winter integrations show that the model has a very realistic El Nino/Southern Oscillation (ENSO) response in both the tropics and extratropics. Early results from the northern summer runs show a robust extratropical ENSO response in the Southern Hemisphere Pacific, as well as, a pronounced zonally-symmetric component to the ENSO response in both hemispheres. Results will be presented at the meeting highlighting the seasonal evolution in predictability and skill of the NSIPP model on both global and regional scales. A further analysis of the zonally-symmetric response will be discussed in terms of its potential impact on the predictability of middle-latitude climate variability on seasonal to interannual time scales.
Systematic Independent Validation of Inner Heliospheric Models
This presentation is the first in a series which will provide independent validation of community models of the outer corona and inner heliosphere. In this work we establish a set of measures to be used in validating this group of models. We use these procedures to generate a comprehensive set of results from the Wang- Sheeley-Arge (WSA) model which will be used as a baseline, or reference, against which to compare all other models. We also run a test of the validation procedures by applying them to a small set of results produced by the ENLIL Magnetohydrodynamic (MHD) model. In future presentations we will validate other models currently hosted by the Community Coordinated Modeling Center(CCMC), including a comprehensive validation of the ENLIL model. The Wang-Sheeley-Arge (WSA) model is widely used to model the Solar wind, and is used by a number of agencies to predict Solar wind conditions at Earth as much as four days into the future. Because it is so important to both the research and space weather forecasting communities, it is essential that its performance be measured systematically, and independently. In this paper we offer just such an independent and systematic validation. We report skill scores for the model's predictions of wind speed and IMF polarity for a large set of Carrington rotations. The model was run in all its routinely used configurations. It ingests line of sight magnetograms. For this study we generated model results for monthly magnetograms from the National Solar Observatory (SOLIS), Mount Wilson Observatory and the GONG network, spanning the Carrington rotation range from 1650 to 2068. We compare the influence of the different magnetogram sources, performance at quiet and active times, and estimate the effect of different empirical wind speed tunings. We also consider the ability of the WSA model to identify sharp transitions in wind speed from slow to fast wind. These results will serve as a baseline against which to compare future versions of the model
A Global Assessment of Added Value in the SMAP Level-4 Soil Moisture Product Relative to Its Baseline Land Surface Model
The Soil Moisture Active Passive (SMAP) Level-4 product provides enhanced soil moisture estimates by assimilating SMAP brightness temperature observations into a land surface model. Here, an unbiased qualitative estimate of the relative skill of SMAP Level-4 and model-only surface soil moisture (versus true soil moisture) is derived using only one additional noisy (but independent) soil moisture product. The method is applied globally and verified using high-quality, ground-based measurements where available. Results demonstrate that assimilating SMAP brightness temperature has relatively little impact in data-rich areas like the United States and Europe. In contrast, much larger improvement is observed in data-sparse regions, including much of Africa and central Australia, where model-only simulations are disproportionately impacted by low-quality model forcing. Therefore, ground validation conducted in data-rich areas does not adequately sample the added value of SMAP data assimilation for data-sparse regions and substantially underestimates the added skill provided by the SMAP Level-4 system.
The Role of Lightning in Controlling Interannual Variability of Tropical Tropospheric Ozone and OH and its Implications for Climate
Nitrogen oxides (NO(x) = NO + NO2) produced by lightning make a major contribution to the production of the dominant tropospheric oxidants (OH and ozone). These oxidants control the lifetime of many trace gases including long-lived greenhouse gases, and control the source-receptor relationship of inter-hemispheric pollutant transport. Lightning is affected by meteorological variability, and therefore represents a potentially important tropospheric chemistry-climate feedback. Understanding how interannual variability (IAV) in lightning affects IAV in ozone and OH in the recent past is important if we are to predict how oxidant levels may change in a future warmer climate. However, lightning parameterizations for chemical transport models (CTMs) show low skill in reproducing even climatological distributions of flash rates from the Lightning Imaging Sensor (LIS) and the Optical Transient Detector (OTD) satellite instruments. We present an optimized regional scaling algorithm for CTMs that enables sufficient sampling of spatiotemporally sparse satellite lightning data from LIS to constrain the spatial, seasonal, and interannual variability of tropical lightning. We construct a monthly time series of lightning flash rates for 1998-2010 and 35degS-35degN, and find a correlation of IAV in total tropical lightning with El Nino. We use the IAV-constraint to drive a 9-year hindcast (1998-2006) of the GEOS-Chem 3D chemical transport model, and find the increased IAV in LNO(x) drives increased IAV in ozone and OH, improving the model fs ability to simulate both. Although lightning contributes more than any other emission source to IAV in ozone, we find ozone more sensitive to meteorology, particularly convective transport. However, we find IAV in OH to be highly sensitive to lightning NO(x), and the constraint improves the ability of the model to capture the temporal behavior of OH anomalies inferred from observations of methyl chloroform and other gases. The sensitivity of OH is explained using photochemical reaction rates which show a "magnification" effect of the initial lightning NO perturbation on OH primary production, HO(x) recycling, and OH loss frequencies. This influence on OH may represent a negative feedback, if lightning increases in a warming world..
Analysis and forecast intercomparisons using the FGGE SOP-1 data base
The First GARP Global Experiment (FGGE) data base has provided the research community with the most complete global coverage of meteorological informaiton since measurements were first taken. It is important to understand the characteristics of the FGGE data base in terms of its accuracy and representativeness compared to the true state of the atmosphere. The uncertainty associated with the initial conditions used in a numerical model plays a significant role in subsequent error growth as shown by predictability theory. The ultimate limit of forecast skill is directly related to the initial uncertainty. The accuracy of analyses using FGGE data base coupled with the errors due to modeling imperfections determines the present skill of numerical models. An estimte of initial uncertainty is determined by examining differences in several FGGE analyses. The estimate is then used to determine an ultimate limit of forecast skill from derived predictability error growth rates. Several different calculations of predictability error growth are also compared. Finally, present-day forecast skill using FGGE analyses is contrasted to the estimates of ultimate skill, and the partition of model error versus initial uncertainty is discussed.
Bridging the Gap Between the iLEAPS and GEWEX Land-Surface Modeling Communities
Models of Earth's weather and climate require fluxes of momentum, energy, and moisture across the land-atmosphere interface to solve the equations of atmospheric physics and dynamics. Just as atmospheric models can, and do, differ between weather and climate applications, mostly related to issues of scale, resolved or parameterised physics,and computational requirements, so too can the land models that provide the required surface fluxes differ between weather and climate models. Here, however, the issue is less one of scale-dependent parameterisations.Computational demands can influence other minor land model differences, especially with respect to initialisation, data assimilation, and forecast skill. However, the distinction among land models (and their development and application) is largely driven by the different science and research needs of the weather and climate communities.
Bulk cloud microphysical properties as seen from numerical simulation and remote sensing products: case study of a hailstorm event over the La Plata Basin
Hailstorms develop over the La Plata Basin, in south-eastern South America, more often during later winter and early austral spring, between September and October. These systems have significant socioeconomic impacts over the region. Thus, a better understanding of how atmospheric drivers modulate the formation of hailstorms is important to improve the forecast of such phenomena. In this study, we selected a hailstorm event observed over the eastern La Plata Basin during 14–15 July 2016 to evaluate the performance of the Brazilian developments on the Regional Atmospheric Modelling System (BRAMS) model. The ability of the model in simulating cloud microphysical properties was evaluated by comparing simulations driven by different global forcings against in situ and remote sensing observations. The model results showed good skill in capturing the basic characteristics of the thunderstorm, particularly in terms of the spatial distribution of hydrometeors. The simulated spatial distribution of hail covers locations where hail fall was reported. The BRAMS simulations suggest that, despite relatively low values of the convective available potential energy (CAPE) (700–1000 J kg -1 ), environments with strong 0–8-km bulk shear (60–70 kt, ~30.9–36.0 m s –1 ) can promote the formation of ice clouds and hail fall over the eastern La Plata Basin. To be more conclusive, however, further research is needed to understand how different combinations of CAPE and shear affect hail formation over the region.
Predictability of the Minimum Sea Ice Extent from Winter Fram Strait Ice Area Export: Model vs Observations
Observations show predictive skill of the minimum sea ice extent (Min SIE) from late winter anomalous off-shore ice drift along the Eurasian coastline – leading to local ice thickness anomalies at the onset of the melt season – a signal then amplified by the ice-albedo feedback. We assess whether the observed seasonal predictability of September sea ice extent (Sept SIE) from Fram Strait Ice Area Export (FSIAE, a proxy for Eurasian coastal divergence) is present in Global Climate Model (GCM) large ensembles, namely the CESM2-LE, GISS-E2.1-G, FLOR-LE, CNRM-CM6-1, and CanESM5. All models show distinct periods where winter FSIAE anomalies are negatively correlated with the May sea ice thickness (May SIT) anomalies along the Eurasian coastline, and the following Sept Arctic SIE, as in observations. Counter-intuitively, several models show occasional periods where winter FSIAE anomalies are positively correlated with the following Sept SIE anomalies when the mean ice thickness is large or late in the simulation when the sea ice is thin, and/or when internal variability increases. More importantly, periods with weak correlation between FSIAE and the Sept SIE dominate, suggesting that summer melt processes dominate over late winter preconditioning and May SIT anomalies. In general, we find that the coupling between the FSIAE and ice thickness anomalies along the Eurasian coastline is an ubiquitous feature of GCMs and that the relationship with the following Sept SIE is dependent on the mean Arctic sea ice thickness.
Quantifying Uncertainties in Earth's Energy Budget by Cloud Feedback and Ocean Heat Uptake Using E3SM-Slab Ocean Configurations
In order to improve predictive skills of Earth System Model, we need to better understand processes that control Earth's energy budget via ocean, atmosphere, and cryosphere interactions. Simulated energy budget in comprehensive Earth System Models shows a wide range, leading to large uncertainties in predicting Earth system dynamic and thermodynamic variations and associated social-economic impacts. Uncertainties in cloud feedbacks have been identified as the main cause of the large inter-model spread, but oceanic adjustments, especially those associated with ocean heat uptake (OHU) and the Atlantic Meridional Overturning Circulation (AMOC), also play an important role. In this proposed work, we focus on understanding the individual and combined roles of cloud feedbacks and ocean adjustments on modulating Earth's energy balance. This research is motivated by our overarching hypothesis that oceanic adjustment is a key source of uncertainty, in addition to those associated with the cloud feedbacks; further, the ocean adjustment and associated OHU work through the cloud feedbacks to modulate Earth's energy budget and temperature variations. We test this hypothesis using numerical experiments where we systematically enable and disable cloud feedbacks in conjunction with perturbations to OHU.
Forecast skill of a high-resolution real-time mesoscale model designed for weather support of operations at Kennedy Space Center and Cape Canaveral Air Station
NASA funded Mesoscale Environmental Simulations and Operations (MESO), Inc. to develop a version of the Mesoscale Atmospheric Simulation System (MASS). The model has been modified specifically for short-range forecasting in the vicinity of KSC/CCAS. To accomplish this, the model domain has been limited to increase the number of horizontal grid points (and therefore grid resolution) and the model' s treatment of precipitation, radiation, and surface hydrology physics has been enhanced to predict convection forced by local variations in surface heat, moisture fluxes, and cloud shading. The objective of this paper is to (1) provide an overview of MASS including the real-time initialization and configuration for running the data pre-processor and model, and (2) to summarize the preliminary evaluation of the model's forecasts of temperature, moisture, and wind at selected rawinsonde station locations during February 1994 and July 1994. MASS is a hydrostatic, three-dimensional modeling system which includes schemes to represent planetary boundary layer processes, surface energy and moisture budgets, free atmospheric long and short wave radiation, cloud microphysics, and sub-grid scale moist convection.
Constructing an Educational Mars Simulation
Working in the Educational Programs Office, my task this summer is to model a 3D habitat that will be part of a future Mars base. With the President's charge to further explore mars by way of robotic-led and human-led missions, there has been a surge in the activity regarding the "red planet". Since all present designs are merely conjecture, I have some creative freedom in deciding what the habitat will look like. To get ideas for what a Mars habitat might be like, I looked at several references including websites and NASA documents. One of these was a NASA Technical Memorandum about Space Transportation Systems that I looked at to get insight on spaceship design. Information about the planet's environment, such as the gravity and the weather, is useful as well when designing the structure. The main software that I am using is Lightwave 3D and Modeler 7.5 that comes along with it. Lightwave is very complex in that it lets you model, surface, and animate so there was a lot to learn. To learn the software I watched a series of instructional videos, looked at online tutorials, and referenced several books. Modeling is like shaping clay with a computer. Every item modeled is made of smaller shapes called polygons. For example, each side of a box would be a different polygon. Modelers must be careful to design with users' systems in mind. Having a model made with too many polygons can slow down a walk-through, but it usually improves the small details on a model. Getting speed and quality proved tricky. An important thing for me to remember when modeling the habitat was to save space. Also, I must consider that technology in the future will be much different than now, so I must be especially creative. My project will be used in an educational walkthough simulation in which users can interact with the environment. I worked closely with intern Stephen Henke who built a Mars Rover, terrain and programmed code for the simulation. This summer's project will help me with future aspirations in computer graphics. Modeling is a valuable skill that I appreciate having the chance to learn and practice.