Search NASA⌕ Search

SEARCH · Search NASA

Results for “model skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Impact Assessment of All-Sky TROPICS Microwave Observations on the NASA GEOS Analyses and Forecasts and Progress to Use the Data in the JEDI-GEOS Analysis System

The NASA Time-Resolved Observations of Precipitation structure and storm Intensity with a Constellation of Smallsats (TROPICS) mission is a constellation of small satellites carrying state-of-art microwave temperature and humidity sounders with 12 channels between 91 GHz and 205 GHz frequency. Including TROPICS-pathfinder, launched on 30 June 2021, five TROPICS CubeSats operate and provide temperature and humidity data to NWP and atmospheric retrieval communities. This study is dedicated to evaluating the impact of the TROPICS satellite constellation microwave observations in numerical weather prediction (NWP) using the NASA Goddard Earth Observing System (GEOS). The TROPICS-01 (TROPICS-Pathfinder), TROPICS-03, TROPICS-05, and TROPICS-06 data in all-sky conditions over the ocean during the period of 25 July 2023 and 6 September 2023 are used for assessing forecast impacts on global NWP analysis and five-day forecasts. A series of experiments are carried out to measure the benefits of assimilating observations from only temperature sounders, water vapor sounders, and both sounders. Statistical analysis of the Observing System Experiments (OSEs) results has shown incremental improvements in global model forecast skills for critical geophysical parameters, including temperature, winds, and geopotential heights. The results demonstrate the potential of the TROPICS-like data to positively impact NWP by adding new information to the current observation and forecast system. In another set of experiments, the TROPICS-03, TROPICS-05, and TROPICS-06 data sets are added to the TROPICS-01 one by one to evaluate the impacts of increasing the revisit rate of TROPICS satellite measurements on NWP analysis for a tropical cyclone’s dynamical and microphysical structures. This study offers important insights into the capabilities of a new generation of small satellite microwave radiometers based on emerging technologies, including their unique measurements at 118 GHz and 205 GHz that are not available in traditional operational microwave sounders. Finally, the efforts to implement these new developments for TROPICS in the JEDI-GEOS atmospheric data assimilation system are in progress, and preliminary results from cycled JEDI-GEOS data assimilation experiments are presented.

Min-Jeong Kim↗
NASA NTRS1974

Short-range forecasts with the GISS model of the global atmosphere

Results of tests carried out during the period from December 1972 through January 1973 to determine the short-term forecasting accuracy of a multilevel numerical primitive-equation (PE) model of the global atmosphere developed at the Goddard Institute for Space Studies (GISS). Six 48-hr forecasts were carried out with the aid of this model, using nine vertical levels and a horizontal grid spacing of 4 deg in latitude and 5 deg in longitude for an effective grid point separation averaging slightly more than 400 km. Verification of forecast sea-level pressures, 1000-mb heights, and 500-mb heights, as well as 1000-mb and 500-mb vector geostrophic winds, shows that the model has forecast skill comparable to that of operational PE models. Based on the 36-hr evolution of 18 extratropical cyclones, the model forecasts exhibit a tendency toward underestimating their propagation speeds and overestimating their central pressures. Both deficiencies are attributed to inadequate horizontal grid resolution. Quantitative verification of forecast surface temperatures over the eastern United States shows a forecast skill equal to that achieved by combined dynamical-statistical procedures.

Druyan, L. M.↗
NASA NTRS1998

Precipitation Structure in the Sierra Nevada of California During Winter

The influences of upper air characteristics along the coast of California upon the winter time precipitation in the Sierra Nevada region were investigated. Most precipitation episodes in the Sierra are associated with moist southwesterly winds and also tend to occur when the 700-mb temperature is close to -2 C. This favored wind direction and temperature signifies the equal importance of moisture transport and orographic lifting for maximum precipitation frequency. Making use of this observation, simple linear models were formulated to quantify the precipitation totals observed at different sites as a function of moisture transport. The skill of the model is least for daily precipitation and increases with time scale of aggregation. In terms of incremental gain, the skill of the model is optimal for an aggregation period of 5-7 days, which is also the duration of the most frequent precipitation events in the Sierra. This indicates that upper air moisture transport at can be used to make reasonable estimates of the precipitation totals for most frequent events in the Sierra region.

Pandey, Ganesh R.↗
NASA NTRS2018

Using Board Games as Subject Matter for Developing Expertise in Model-Based Systems Engineering

As more organizations transition from traditional document-centric systems engineering to a model-based approach, many are challenged to train their staff in new languages, tools, and methodologies, and manage the expectations of stakeholders and their expected model outcomes. In particular, challenges associated with learning a new modeling language and developing skills in the 'art' of modeling present organizations with formidable obstacles to realizing this transition. This paper hypothesizes that systems engineers may more readily learn how to correctly model with SysML, and develop intuition about the art of modeling and using patterns, if their learning references a commonly and thoroughly-understood subject matter, such as a board game. This paper presents a case for the use of board games as subject matter for new modelers, demonstrates the concept with a sample model of Hasbro's popular board game, Monopoly, and discusses the limitations of this approach and potential adaptations that may broaden the applicability of the learned skills to projects.

Systems Engineering↗
NASA NTRS2018

Using Board Games as Subject Matter for Developing Expertise in Model-Based Systems Engineering

As more organizations transition from traditional document-centric systems engineering to a model-based approach, many are challenged to train their staff in new languages, tools, and methodologies, while managing the expectations of stakeholders and their expected model outcomes. In particular, challenges associated with learning a new modeling language and developing skills in the 'art' of modeling present organizations with formidable obstacles to realizing this transition. This paper hypothesizes that systems engineers may more readily learn how to correctly model with SysML, and develop intuition about the art of modeling and using patterns, if their learning references a commonly and thoroughly-understood subject, such as a board game. This paper presents a case for the use of board games as subject matter for new modelers. It demonstrates the concept with a sample model of Hasbro's popular board game, Monopoly, and discusses the limitations of this approach and potential adaptations that may broaden the applicability of the learned skills to projects. Finally, results from a small feasibility assessment and concepts for more formal study to evaluate the hypothesis are presented.

Model-Based Systems Engineering↗
NASA NTRS2017

The SMAP Level-4 ECO Project: Linking the Terrestrial Water and Carbon Cycles

The SMAP (Soil Moisture Active Passive) Level-4 projects aims to develop a fully coupled hydrology-vegetation data assimilation algorithm to generate improved estimates of modeled hydrological fields and carbon fluxes. This includes using the new NASA Catchment-CN (Catchment-Carbon-Nitrogen) model, which combines the Catchment land surface hydrology model with dynamic vegetation components from the Community Land Model version 4 (CLM4). As such, Catchment-CN allows a more realistic, fully coupled feedback between the land hydrology and the biosphere. The L4 ECO project further aims to inform the model through the assimilation of Soil Moisture Active Passive (SMAP) brightness temperature observations as well as observations of Moderate Resolution Imaging Spectroradiometer (MODIS) fraction of absorbed photosynthetically active radiation (FPAR). Preliminary results show that the assimilation of SMAP observations leads to consistent improvements in the model soil moisture skill. An evaluation of the Catchment-CN modeled vegetation characteristics showed that a calibration of the model's vegetation parameters is required before an assimilation of MODIS FPAR observations is feasible.

MODIS↗
DOE OSTI2026

Improving thermodynamic nudging in the E3SM Atmosphere Model version 2 (EAMv2): strategy and hindcast skills on weather systems

Nudging techniques are commonly employed to constrain atmospheric simulations toward observed states, facilitating model evaluation and sensitivity studies. However, if applied improperly – particularly to thermodynamic variables such as temperature and humidity – nudging can distort physical processes and introduce spurious biases, undermining the credibility of the simulations. This study presents an improved nudging implementation that applies vertically modulated tendencies to reduce adverse impacts on model physics. The framework is tested in version 2 of the Energy Exascale Earth System Model (EAMv2) using a suite of hindcast simulations nudged toward ERA5 reanalysis. We systematically evaluate the individual and combined effects of nudging wind, temperature, and humidity fields on the model's ability to represent large-scale atmospheric states and high-impact weather systems. Results show that the revised strategy – particularly when nudging temperature and humidity at selected levels – enhances hindcast skill by improving agreement with ERA5 without degrading the hydrological cycle or precipitation processes. Additional improvements in surface temperature, outgoing longwave radiation, and precipitation biases are achieved through targeted nudging of land-surface variables. The proposed approach strengthens the representation of large-scale conditions relevant to tropical cyclones, atmospheric rivers, and extratropical cyclones in the low-resolution EAMv2. These findings demonstrate that carefully designed thermodynamic nudging, especially of temperature and humidity, improves the realism of constrained simulations and broadens the utility of nudged EAMv2 for atmospheric modeling, machine learning, and high-impact weather research.

Atmospheric river↗
DOE OSTI2025

Mesoscale Convective Systems Tracking Method Intercomparison (MCSMIP): Application to DYAMOND Global km‐Scale Simulations

Abstract Global kilometer‐scale models represent the future of Earth system modeling, enabling explicit simulation of organized convective storms and their associated extreme weather. Here, we comprehensively evaluate tropical mesoscale convective system (MCS) characteristics in the DYAMOND (DYnamics of the atmospheric general circulation modeled on non‐hydrostatic domains) simulations for both summer and winter phases. Using 10 different feature trackers applied to simulations and satellite observations, we assess MCS frequency, precipitation, and other key characteristics. Substantial differences (a factor of 2–3) arise among trackers in observed MCS frequency and their precipitation contribution, but model‐observation differences in MCS statistics are more consistent across trackers. DYAMOND models are generally skillful in simulating tropical mean MCS frequency, with multi‐model mean biases ranging from −2%–8% over land and −8%–8% over ocean (summer vs. winter). However, most DYAMOND models underestimate MCS precipitation amount (23%) and their contribution to total precipitation (17%). Biases in precipitation contributions are generally smaller over land (13%) than over ocean (21%), with moderate inter‐model variability. While models better simulate MCS diurnal cycles and cloud shield characteristics, they overestimate MCS precipitation intensity and underestimate stratiform rain contributions (up to a factor of 2), particularly over land, albeit observational uncertainties exist. Additionally, models exhibit a wide range of precipitable water in the tropics compared to reanalysis and satellite observations, with many models showing exaggerated sensitivity of MCS precipitation intensity to precipitable water. The MCS metrics developed here provide process‐oriented diagnostics to guide future model development.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2021

Description of the NASA GEOS Composition Forecast Modeling System GEOS-CF v1.0

The Goddard Earth Observing System composition forecast (GEOS-CF) system is a high-resolution (0.25 degree) global constituent prediction system from NASA’s Global Modeling and Assimilation Office (GMAO). GEOS-CF offers a new tool for atmospheric chemistry research, with the goal to supplement NASA’s broad range of space-based and in-situ observation sand to support flight campaign planning, support of satellite observations, and air quality research. GEOS-CF expands on the GEOS weather and aerosol modeling system by introducing the GEOS-Chem chemistry module to provide analyses and 5-day forecasts of atmospheric constituents including ozone (O3), carbon monoxide (CO), nitrogen dioxide (NO2), and fine particulate matter (PM2.5). The chemistry module integrated in GEOS-CF is identical to the offline GEOS-Chem model and readily benefits from the innovations provided by the GEOS-Chem community.Evaluation of GEOS-CF against satellite, ozone sonde and surface observations show realistic simulated concentrations of O3, NO2, and CO, with normalized mean biases of -0.1 to -0.3, normalized root mean square errors (NRMSE) between 0.1-0.4, and correlations between 0.3-0.8. Comparisons against surface observations highlight the successful representation of air pollutants under a variety of meteorological conditions, yet also highlight current limitations, such as an over prediction of summertime ozone over the Southeast United States. GEOS-CFv1.0 generally overestimates aerosols by 20-50% due to known issues in GEOS-Chem v12.0.1 that have been addressed in later versions.The 5-day hourly forecasts have skill scores comparable to the analysis. Model skills can be improved significantly by applying a bias-correction to the surface model output using a machine-learning approach.

GEOS-CF↗
NASA NTRSDate not supplied

Developing Soft Skill in the Geosciences: NASA DEVELOP’s Approach to Strengthening Soft Skills in the Future Geospatial Workforce

Part of NASA’s Applied Sciences, the DEVELOP Program bridges the gap between NASA Earth Science and potential users through rapid feasibility studies that apply Earth observations to environmental decision making needs. The program conducts 50-60 studies a year that engage participants – students, recent graduates, early career individuals, and transitioning career professionals – in autonomous teamwork with an emphasis on professional development and communication. The experience offers participants a robust opportunity to build their teaming skills (facilitated through programmatic personality assessments and discussions), interpersonal communication, and critical thinking skills which are central to project work in the DEVELOP model. The program also offers leadership opportunities where participants lead their peers within a supportive environment. This presentation will introduce the DEVELOP model for soft skill development, lessons learned, and highlight testimonials of past participants.

Amanda Clayton↗
NASA NTRS2012

Decadal Prediction Skill in the GEOS-5 Forecast System

A suite of decadal predictions has been conducted with the NASA Global Modeling and Assimilation Office?s GEOS-5 Atmosphere-Ocean General Circulation Model (AOGCM). The hindcasts are initialized every December from 1959 to 2010 following the CMIP5 experimental protocol for decadal predictions. The initial conditions are from a multi-variate ensemble optimal interpolation ocean and sea-ice reanalysis, and from the atmospheric reanalysis (MERRA, the Modern-Era Retrospective Analysis for Research and Applications) generated using the GEOS-5 atmospheric model. The forecast skill of a three-member-ensemble mean is compared to that of an experiment without initialization but forced with observed CO2. The results show that initialization acts to increase the forecast skill of Northern Atlantic SST compared to the uninitialized runs, with the increase in skill maintained for almost a decade over the subtropical and mid-latitude Atlantic. The annual-mean Atlantic Meridional Overturning Circulation (AMOC) index is predictable up to a 5-year lead time, consistent with the predictable signal in upper ocean heat content over the Northern Atlantic. While the skill measured by Mean Squared Skill Score (MSSS) shows 50% improvement up to 10-year lead forecast over the subtropical and mid-latitude Atlantic, however, prediction skill is relatively low in the subpolar gyre, due in part to the fact that the spatial pattern of the dominant simulated decadal mode in upper ocean heat content over this region appears to be unrealistic. An analysis of the large-scale temperature budget shows that this is the result of a model bias, implying that realistic simulation of the climatological fields is crucial for skillful decadal forecasts.

Ham, Yoo-Geun↗
NASA NTRS2021

Development and Validation of an Empirical Ocean Color Algorithm with Uncertainties: A Case Study with the Particulate Backscattering Coefficient

We explored how algorithm (model) and in situ measurement (observation) uncertainties can effectively be incorporated into empirical ocean color model development and assessment. In this study we focused on methods for deriving the particulate backscattering coefficient at 555 nm, b(bp)(555)/(m). We developed a simple empirical algorithm for deriving b(bp)(555) as a function of a remote sensing reflectance line height (LH) metric. Model training was performed using a high-quality bio-optical dataset that contains coincident in situ measurements of the spectral remote sensing reflectances, R(rs)(λ)/(sr), and the spectral particulate backscattering coefficients, b(bp)(λ). The LH metric used is defined as the magnitude of Rrs(555) relative to a linear baseline drawn between R(rs)(490) and R(rs)(670). Using an independent validation dataset, we compared the skill of the LH-based model with two other models. We used contemporary validation metrics, including bias and mean absolute error (MAE), that were corrected for model and observation uncertainties. The results demonstrated that measurement uncertainties do indeed impact contemporary validation metrics such as mean bias and MAE. Zeta-scores and z-tests for overlapping confidence intervals were also explored as potential methods for assessing model skill.

ocean color↗
NASA NTRSDate not supplied

Extreme Precipitation in the Southern US Great Plains in the Spring of 2015: Mechanisms and Prediction

During May of 2015, the southern US Great Plains and adjacent Gulf Coast region experienced more than twice the long-term mean precipitation, making it the wettest May since 1895. We investigate the physical mechanisms associated with this event using a suite of large-ensemble regional replay AGCM simulations from the NASA-GEOS model. In these simulations, certain regions of the globe are constrained to closely follow observations while the remainder of the domain is free running, allowing for the isolation of the remote regions that were important for the event. Preliminary analysis provides evidence that the extreme southern US precipitation was linked in part to positive precipitation anomalies in the central and eastern tropical Pacific via a wave train, which ultimately caused anomalous moisture flux from the Gulf of Mexico. An analysis of Subseasonal Experiment (SubX) model output was conducted to explore the subseasonal prediction skill of the event. Several models are able the predict the presence of positive precipitation anomalies in or near the southern US at lead times exceeding 10 days, albeit with errors in the locations and magnitude of the heaviest precipitation anomalies. A more thorough investigation with version 2 of NASA’s GEOS-S2S model shows that the prediction skill stems from the model’s ability to reasonably predict the positive tropical Pacific precipitation anomalies and the initiation of the Rossby wave train that is believed to be linked to the event. The potential causes for limitations in the prediction skill of this event will be explored.

Great Plains↗
NASA NTRS1988

Assessment of recent resolution and parameterization changes in the GLA fourth order GCM

The Goddard Laboratory for Atmospheres' fourth-order GCM is under evaluation for the impact on model integrations of enhanced horizontal and vertical resolution, as well as the effects of such novel parameterization schemes as that of gravity-wave-drag, the Arakawa-Schubert (1974) cumulus parameterization, and an explicitly-resolved planetary boundary layer. While the doubling of the GMC's horizontal resolution to 2 deg in latitude and 2.5 deg in longitude has improved the model's predictive skill for 6-7 day forecasts, systematic errors associated with the model's climate drift lead to a deterioration in predictions for longer forecasts.

Helfand, H. M.↗
NASA NTRS2021

Understanding the Impacts of Land Surface and PBL Observations on the Terrestrial and Atmospheric Legs of Land-Atmosphere Coupling

Accurately representing land-atmosphere (L-A) interactions and coupling in NWP systems remains a challenge. New observations, incorporated into models via assimilation or calibration, hold the promise of improved forecast skill, but erroneous model coupling can hinder the benefits of such activities. To better understand model representation of coupled interactions and feedbacks, this study demonstrates a novel framework for coupled calibration of the Single Column Model (SCM) capability of the NASA Unified Weather Research and Forecasting (NU-WRF) system coupled to NASA’s Land Information System (LIS). The local land-atmosphere coupling (LoCo) process chain paradigm is used to assess the processes and connections revealed by calibration experiments. Two summer case studies in the U. S. Southern Great Plains are simulated in which LSM parameters are calibrated to diurnal observations of LoCo process chain components including 2-meter temperature, 2-meter humidity, surface fluxes (Bowen ratio), and PBL height. Results show a wide range of soil moisture and hydraulic parameter solutions depending on which L-A variable (i.e. observation) is used for calibration, highlighting that improvement in either SHP or ISM when not in tandem with the other can provide undesirable results. Overall, this work demonstrates that a process chain calibration approach can be used to assess L-A connections, feedbacks, strengths, and deficiencies in coupled models, as well as quantify the potential impact of new sources of observations of land-PBL variables on coupled prediction.

Patricia Lawston-Parker↗
NASA NTRS2000

Enhancement of Directional Ambiguity Removal Skill in Scatterometer Data Processing Using Planetary Boundary Layer Models

Planetary boundary layer (PBL) models are utilized to enhance directional ambiguity removal skill in scatterometer data processing. The ambiguity in wind direction retrieved from scatterometer measurements is removed with the aid of physical directional information obtained from PBL models. This technique is based on the observation that sea level pressure is scalar and its field is more coherent than the corresponding wind. An initial wind field obtained from the scatterometer measurements is used to derive a pressure field with a PBL model. After filtering small-scale noise in the derived pressure field, a wind field is generated with an inverted PBL model. This derived wind information is then used to remove wind vector ambiguities in the scatterometer data. It is found that the ambiguity removal skill can be improved when the new technique is used properly in conjunction with the median filter being used for scatterometer wind dealiasing at JPL. The new technique is applied to regions of cyclone systems which are important for accurate weather prediction but where the errors of ambiguity removal are often large.

Kim, Young-Joon↗
NASA NTRS2013

The North American Multi-Model Ensemble (NMME): Phase-1 Seasonal to Interannual Prediction, Phase-2 Toward Developing Intra-Seasonal Prediction

The recent US National Academies report "Assessment of Intraseasonal to Interannual Climate Prediction and Predictability" was unequivocal in recommending the need for the development of a North American Multi-Model Ensemble (NMME) operational predictive capability. Indeed, this effort is required to meet the specific tailored regional prediction and decision support needs of a large community of climate information users. The multi-model ensemble approach has proven extremely effective at quantifying prediction uncertainty due to uncertainty in model formulation, and has proven to produce better prediction quality (on average) then any single model ensemble. This multi-model approach is the basis for several international collaborative prediction research efforts, an operational European system and there are numerous examples of how this multi-model ensemble approach yields superior forecasts compared to any single model. Based on two NOAA Climate Test Bed (CTB) NMME workshops (February 18, and April 8, 2011) a collaborative and coordinated implementation strategy for a NMME prediction system has been developed and is currently delivering real-time seasonal-to-interannual predictions on the NOAA Climate Prediction Center (CPC) operational schedule. The hindcast and real-time prediction data is readily available (e.g., http://iridl.ldeo.columbia.edu/SOURCES/.Models/.NMME/) and in graphical format from CPC (http://origin.cpc.ncep.noaa.gov/products/people/wd51yf/NMME/index.html). Moreover, the NMME forecast are already currently being used as guidance for operational forecasters. This paper describes the new NMME effort, presents an overview of the multi-model forecast quality, and the complementary skill associated with individual models.

NOAA CPC↗
NASA NTRS2021

Precipitable water vapor over oceans from the Maritime Aerosol Network: Evaluation of global models and satellite products under clear sky conditions

We present results from an evaluation of precipitable water vapor (W) over remote oceanic areas as derived from global reanalysis models and from satellites against observations from the Maritime Aerosol Network (MAN) for cloudless skies during the period of 2004–2017. They cover polar, mid latitude and tropical oceanic regions and represent a first effort to use MAN observations for such evaluation. The global reanalysis model products evaluated in this study are from the Modern-Era Retrospective analysis for Research and Applications Version 2 (MERRA-2), the European Centre for Medium-Range Weather Forecasts (ECMWF) Interim Reanalysis (ERA I), and the Climate Forecast System Reanalysis (CFSR) model. The satellite products evaluated are from the Moderate Resolution Imaging Spectroradiometer (MODIS), the Polarization and Directionality of the Earth's Reflectances (POLDER), the Global Ozone Monitoring Experiment (GOME-2), the Scanning Imaging Absorption Spectrometer for Atmospheric Chartography (SCIAMACHY), and the Atmospheric Infra-red Sounder (AIRS). Satellite retrievals of W are based on the attenuation of solar reflected light by water vapor absorption bands, except those from AIRS that rely on brightness temperature measurements. A very good agreement is observed between the model estimates and MAN, with mean differences of ~5% and standard deviations of ~15%. These results are within the uncertainties associated with the models and the measurements, indicating the skill of the reanalysis models to estimate W over oceans under clear sky conditions. Mean differences of W between the satellite and MAN products are ~11, 6.7, 12, −7, and 3% for MODIS, POLDER, GOME-2, SCIAMACHY and AIRS respectively, while their standard deviations are 31, 29, 28, 20 and 17%. These differences reveal the need to address inconsistencies among different satellite sensors and ground-based measurements to reduce the uncertainties associated with the retrievals.

Daniel Pérez-Ramírez↗