SEARCH · Search NASA

Results for “model skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS2013

Technical Report Series on Global Modeling and Data Assimilation: Global Surface Ocean Carbon Estimates in a Model Forced by MERRA - Volume 31

MERRA products were used to force an established ocean biogeochemical model to estimate surface carbon inventories and fluxes in the global oceans. The results were compared to public archives of in situ carbon data and estimates. The model exhibited skill for ocean dissolved inorganic carbon (DIC), partial pressure of ocean CO2 (pCO2) and air-sea fluxes (FCO2). The MERRA-forced model produced global mean differences of 0.02% (approximately 0.3 microns) for DIC, -0.3% (about -1.2 (micro) atm; model lower) for pCO2, and -2.3% (-0.003 mol C/sq m/y) for FCO2 compared to in situ estimates. Basin-scale distributions were significantly correlated with observations for all three variables (r=0.97, 0.76, and 0.73, P<0.05, respectively for DIC, pCO2, and FCO2). All major oceanographic basins were represented as sources to the atmosphere or sinks in agreement with in situ estimates. However, there were substantial basin-scale and local departures.

Gregg, Watson W.↗

DOE OSTI2025

Developing a digital twin framework for remotely monitoring nuclear reactor facilities

A digital twin must seek to represent all applicable functional components of the system of interest. Different expertise is required for understanding the physical system being modeled than the skills needed for transforming those models into a functional digital twin through physics modeling, machine learning analysis, and visualization. The diversity of knowledge requires a multi-disciplinary team to ensure all system details are captured. Team members also need a method to verify that the data they generate within their domain can be effectively communicated to professionals in other fields. To address this challenge, this work provides an approach for developing a digital twin framework to remotely monitoring nuclear facilities. Through this, general knowledge of the framework is presented along with two examples to solidify the process. The AGN-201 digital twin and microreactor digital twins provide varying levels of complexity in a potential nuclear facility, where common threads are identified and lessons learned are provided. The goal of this research is to aid future researchers by providing a formula for a successful digital twin and in turn reducing the development time of nuclear system digital twins, specifically for remote monitoring.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS2016

Forecasting the Northern African Dust Outbreak Towards Europe in April 2011: A Model Intercomparison

In the framework of the World Meteorological Organisation's Sand and Dust Storm Warning Advisory and Assessment System, we evaluated the predictions of five state-of-the-art dust forecast models during an intense Saharan dust outbreak affecting western and northern Europe in April 2011. We assessed the capacity of the models to predict the evolution of the dust cloud with lead times of up to 72 hours using observations of aerosol optical depth (AOD) from the AErosol RObotic NETwork (AERONET) and the Moderate Resolution Imaging Spectroradiometer (MODIS) and dust surface concentrations from a ground-based measurement network. In addition, the predicted vertical dust distribution was evaluated with vertical extinction profiles from the Cloud and Aerosol Lidar with Orthogonal Polarization (CALIOP). To assess the diversity in forecast capability among the models, the analysis was extended to wind field (both surface and profile), synoptic conditions, emissions and deposition fluxes. Models predict the onset and evolution of the AOD for all analysed lead times. On average, differences among the models are larger than differences among lead times for each individual model. In spite of large differences in emission and deposition, the models present comparable skill for AOD. In general, models are better in predicting AOD than near-surface dust concentration over the Iberian Peninsula. Models tend to underestimate the long-range transport towards northern Europe. Our analysis suggests that this is partly due to difficulties in simulating the vertical distribution dust and horizontal wind. Differences in the size distribution and wet scavenging efficiency may also account for model diversity in long-range transport.

dust storms↗

NASA NTRS2019

Global Assimilation of L-Band Brightness Temperature Observations from SMAP and SMOS into the Catchment Land Surface Model and Contribution to the Skill of Soil Moisture Estimates

The Soil Moisture Active Passive (SMAP) and Soil Moisture Ocean Salinity (SMOS) missions provide global observations of L-band (1.4 GHz) passive microwave brightness temperature (Tb) observations at a resolution of ~40 km every 2-3 days. These observations have been available since 2015 from SMAP and since 2010 from SMOS.Soil moisture estimates from the separate assimilation of SMAP and SMOS Tb observations into land surface models were previously shown to improve over model-only estimates, thereby demonstrating the value of assimilating L-band Tb observations for soil moisture estimation. The assimilation experiments documented in the literature do not, however, establish whether the joint assimilation of SMAP and SMOS Tbs improves the skill of the resulting soil moisture estimates beyond what can be achieved with either set of observations alone. Moreover, because the published SMAP and SMOS results used different assimilation systems and configurations and applied different evaluation data and procedures, it is unclear whether the assimilation of SMAP-only or SMOS-only Tbs results in better soil moisture skill. In this presentation, we compare the results of three separate assimilation experiments for the period from April 2015 to present. The experiments utilize the SMAP Level-4 Soil Moisture (L4_SM) algorithm, which assimilates L-band Tb observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter. Specifically, the three experiments presented here assimilate (i) SMAP Tbs only, as in the L4_SM product, (ii) SMOS Tbs only, after interpolation of 40° incidence angle, and (iii) both SMAP and SMOS Tbs. In all other respects, the configuration of three experiments is identical, as is the validation of the output. Preliminary results suggest that the joint assimilation of SMAP and SMOS Tbs yields the most skillful soil moisture estimates when compared to independent in situ measurements. Moreover, the skill of the SMAP-only assimilation exceeds that of the SMOS-only assimilation. The presentation provides an in-depth evaluation of the skill of the assimilation estimates vs. independent in situ and satellite measurements and in terms of statistics of the observation-minus-forecast residuals and analysis increments.

Reichle, Rolf↗

NASA NTRS1981

A model for the control mode man-computer interface dialogue

A four stage model is presented for the control mode man-computer interface dialogue. It consists of context development, semantic development syntactic development, and command execution. Each stage is discussed in terms of the operator skill levels (naive, novice, competent, and expert) and pertinent human factors issues. These issues are human problem solving, human memory, and schemata. The execution stage is discussed in terms of the operators typing skills. This model provides an understanding of the human process in command mode activity for computer systems and a foundation for relating system characteristics to operator characteristics.

Chafin, R. L.↗

NASA NTRS2000

The Instrument Synthesis for Analysis Laboratory at the Goddard Space Flight Center

The objectives of the Instrument Synthesis and Analysis laboratory (ISAL) are to: 1) Provide a rapid and sustainable instrument development environment with clear efficient processes and tools, re-usable models and skilled engineers. 2) Provide a capability for quick and efficient trade studies of instrument architectures and concepts. 3) Streamline and optimize instrument systems design for the entire life cycle, including cost and technology assessment. 4) Provide detailed multi-disciplinary modeling and analysis for phase C/D design validation and for operational investigations.

Wood, H. John↗

NASA NTRS1999

Potential Predictability of the Monsoon Subclimate Systems

While El Nino/Southern Oscillation (ENSO) phenomenon can be predicted with some success using coupled oceanic-atmospheric models, the skill of predicting the tropical monsoons is low regardless of the methods applied. The low skill of monsoon prediction may be either because the monsoons are not defined appropriately or because they are not influenced significantly by boundary forcing. The latter characterizes the importance of internal dynamics in monsoon variability and leads to many eminent chaotic features of the monsoons. In this study, we analyze results from nine AMIP-type ensemble experiments with the NASA/GEOS-2 general circulation model to assess the potential predictability of the tropical climate system. We will focus on the variability and predictability of tropical monsoon rainfall on seasonal-to-interannual time scales. It is known that the tropical climate is more predictable than its extratropical counterpart. However, predictability is different from one climate subsystem to another within the tropics. It is important to understand the differences among these subsystems in order to increase our skill of seasonal-to-interannual prediction. We assess potential predictability by comparing the magnitude of internal and forced variances as defined by Harzallah and Sadourny (1995). The internal variance measures the spread among the various ensemble members. The forced part of rainfall variance is determined by the magnitude of the ensemble mean rainfall anomaly and by the degree of consistency of the results from the various experiments.

Yang, Song↗

DOE OSTI2026

Subseasonal Forecasting and MJO Teleconnections in Machine Learning Weather Prediction Models

Abstract In recent years, machine‐learning (ML) models trained on reanalysis data have rivaled physics‐based forecast models in terms of performance skill for global weather forecasting. With increased rollout stability, the question of how these models perform for subseasonal to seasonal (S2S, week 3–8) forecasting has emerged. In this study we run a large set of subseasonal hindcasts over 2004–2023 to evaluate two ML weather forecast models at the S2S time scale, SFNO‐HENS (Nvidia, fully ML) and NeuralGCM (Google Research, hybrid). Corresponding hindcasts from the European Centre for Medium‐Range Weather Forecasts (ECMWF) are used as a baseline for comparison to a physics‐based model. Because our focus is on predicting moisture transport over the Western United States between October and March, we evaluate the models' prediction skill for the Madden‐Julian Oscillation (MJO) and its associated teleconnections in the North Pacific. We find that both ML models are competitive with the ECWMF model, with comparable skill in predicting the North Pacific large‐scale circulation and the MJO at week 3 and beyond. Even though overall the mid‐latitude subseasonal prediction skill remains low, the ML models exhibit interesting behavior such as a realistic propagation of the MJO across the Maritime Continent and realistic teleconnections. A SFNO‐HENS sensitivity experiment with altered initial conditions in the tropics demonstrates the stability of the model, and it illustrates the capability of ML models to represent important physical processes of the atmosphere at the S2S time scale. Plain Language Summary Predicting weather patterns and precipitation a few weeks in advance (subseasonal time scale) is of great interest for stakeholders such as water managers in the Southwest United States (US), where arid conditions prevail. Subseasonal forecasts from traditional weather forecast models exhibit low skill in the region, limiting their applicability. Here we examine whether the recent breakthrough in weather forecasting made with machine learning/artificial intelligence models can translate to improved subseasonal forecasts. Recently‐developed machine learning models exhibit comparable skill to a state‐of‐the‐art physics‐based model for predicting weather patterns in the North Pacific/North America region, and associated moisture transport. The same applies to their skill in predicting the tropical pattern, the Madden‐Julian Oscillation, and its important remote perturbations over the midlatitude East Pacific and Southwest US. Additionally, a perturbation experiment carried out with one of the machine learning models illustrates their ability to not only predict the evolution of atmospheric fields, but also to learn and represent physical processes such as tropics‐extratropics Rossby wave propagation. Key Points Two machine learning weather forecast models exhibit state‐of‐the‐art prediction skill at the subseasonal time scale in the Pacific sector The models equal ECWMF in terms of Madden‐Julian oscillation (MJO) prediction skill, and they accurately predict the MJO propagation and associated teleconnections The two machine‐learning models represent key physical processes for subseasonal prediction, despite being trained for weather forecasting

Peings, Yannick↗

NASA NTRS2010

Improving Forecast Skill by Assimilation of AIRS Temperature Soundings

Susskind, Joel↗

NASA NTRS2021

Australian tidal currents – assessment of a barotropic model (COMPAS v1.3.0 rev6631) with an unstructured grid

While the variations of tidal range are large and fairly well known across Australia (less than 1 m near Perth but more than 14 m in King Sound), the properties of the tidal currents are not. We describe a new regional model of Australian tides and assess it against a validation dataset comprising tidal height and velocity constituents at 615 tide gauge sites and 95 current meter sites. The model is a barotropic implementation of COMPAS, an unstructured-grid primitive-equation model that is forced at the open boundaries by TPXO9v1. The mean absolute error (MAE) of the modelled M2 height amplitude is 8.8 cm, or 12 % of the 73 cm mean observed amplitude. The MAE of phase (10°), however, is significant, so the M2 mean magnitude of vector error (MMVE, 18.2 cm) is significantly greater. The root sum square over the eight major constituents is 26 % of the observed amplitude. We conclude that while the model has skill at height in all regions, there is definitely room for improvement (especially at some specific locations). For the M2 major axis velocity amplitude, the MAE across the 95 current meter sites, where the observed amplitude ranges from 0.1 to 156 cm s −1 , is 6.9 cm s −1 , or 22 % of the 31.7 cm s −1 observed mean. This nationwide average result is encouraging, but it conceals a very large regional variation. Relative errors of the tidal current amplitudes on the narrow shelves of New South Wales (NSW) and Western Australia exceed 100 %, but tidal currents are weak and negligible there compared to non-tidal currents, so the tidal errors are of little practical significance. Looking nationwide, we show that the model has predictive value for much of the 79 % of Australia's shelf seas where tides are a major component of the total velocity variability. In descending order this includes the Bass Strait, the Kimberley to Arnhem Land, and southern Great Barrier Reef regions. There is limited observational evidence to confirm that the model is also valuable for currents in other regions across northern Australia. We plan to commence publishing “unofficial” tidal current predictions for chosen regions in the near future based on both our COMPAS model and the validation dataset we have assembled.

Tidal currents↗

NASA NTRS1989

Global models: Robot sensing, control, and sensory-motor skills

Robotics research has begun to address the modeling and implementation of a wide variety of unstructured tasks. Examples include automated navigation, platform servicing, custom fabrication and repair, deployment and recovery, and science exploration. Such tasks are poorly described at onset; the workspace layout is partially unfamiliar, and the task control sequence is only qualitatively characterized. The robot must model the workspace, plan detailed physical actions from qualitative goals, and adapt its instantaneous control regimes to unpredicted events. Developing robust representations and computational approaches for these sensing, planning, and control functions is a major challenge. The underlying domain constraints are very general, and seem to offer little guidance for well-bounded approximation of object shape and motion, manipulation postures and trajectories, and the like. This generalized modeling problem is discussed, with an emphasis on the role of sensing. It is also discussed that unstructured tasks often have, in fact, a high degree of underlying physical symmetry, and such implicit knowledge should be drawn on to model task performance strategies in a methodological fashion. A group-theoretic decomposition of the workspace organization, task goals, and their admissible interactions are proposed. This group-mechanical approach to task representation helps to clarify the functional interplay of perception and control, in essence, describing what perception is specifically for, versus how it is generically modeled. One also gains insight how perception might logically evolve in response to needs of more complex motor skills. It is discussed why, of the many solutions that are often mathematically admissible to a given sensory motor-coordination problem, one may be preferred over others.

Schenker, Paul S.↗

DOE OSTI2025

Stable Machine‐Learning Parameterization of Subgrid Processes in a Comprehensive Atmospheric Model Learned From Embedded Convection‐Permitting Simulations

Modern climate projections often suffer from inadequate spatial and temporal resolution due to computational limitations, resulting in inaccurate representations of sub-grid processes. A promising technique to address this is the multiscale modeling framework (MMF), which embeds a kilometer-resolution cloud-resolving model (CRM) within each atmospheric column of a host climate model to replace traditional convection and cloud parameterizations. Machine learning offers a unique opportunity to make MMF more accessible by emulating the embedded CRM and reducing its substantial computational cost. Although many studies have demonstrated proof-of-concept success of achieving stable hybrid simulations, it remains a challenge to achieve near operational-level success with real geography and comprehensive variable emulation that includes, for example, explicit cloud condensate coupling. In this study, we present a stable hybrid model capable of integrating for at least 5 years with near operational-level complexity, including coarse-grid geography, seasonality, explicit cloud condensate and wind predictions, and land coupling. Our model demonstrates skillful online performance, achieving a 5-year zonal mean tropospheric temperature bias within 2 K, water vapor bias within 1 g/kg, and a precipitation root mean square error of 0.96 mm/day. Key factors contributing to our online performance include an expressive U-Net architecture and physical thermodynamic constraints for microphysics. With microphysical constraints mitigating unrealistic cloud formation, our work is the first to demonstrate realistic multi-year cloud condensate climatology under the MMF framework. Despite these advances, online diagnostics reveal persistent biases in certain regions, highlighting the need for innovative strategies to further optimize online performance.

Hu, Zeyuan [NVIDIA Corporation, Santa Clara, CA (U↗

NASA NTRS1986

Prediction of monthly 700 mb heights using simulated medium-range numerical forecasts

Standardized 700 mb heights at 126 grid points over the Northern Hemisphere during 1948-80 were used to quantify the persistence of the heights from one month to the next (using various antecedent period lengths) and to determine predictive skill for calendar-month 700 mb heights using antecedent and simulated prognostic height information. The calculations showed that optimum period length and its corresponding average pattern correlation vary widely over the course of the year, being largest in summer and winter. The skill of models using simulated prog heights was found to be much superior to those using antecedent heights.

Harnack, R.↗

NASA NTRS1990

Systematic errors in the annual and intraseasonal variations of the planetary-scale divergent circulation in NMC medium-range forecasts

The systematic error in the National Meteorological Center's (NMC) medium-range operational forecasts of the global divergence during 1987 and 1988 is examined in this study. As in other operational NWP models the NMC model has too weak an annual mean, annual cycle, and 30-60 day oscillation. This weakness shows up after only a few days, especially over the monsoon region and tropical areas. When the intraseasonal oscillation amplitude is large the model predictive skill is improved. The eastward propagation of the low-frequency mode is well predicted throughout the 10-day forecast period. The north-south migration of the tropical Hadley circulation, depicted primarily by the annual-cycle mode, is also weaker although the phase pattern predicted by the MRF is consistent with analyses.

Chen, Tsing-Chang↗

NASA NTRS2000

The Tropical Rainfall Measuring (TRMM) - What Have We Learned and What Does the Future Hold?

Rainfall is important in the hydrological cycle and to the lives and welfare of humans. In addition to being a life-giving resource, rainfall processes also plays a crucial role in the dynamics of the global atmospheric circulation. Three-fourths of the energy that drives the atmospheric wind circulation comes from the latent heat released by tropical precipitation. It varies greatly in space and time. The rain-producing cloud systems may last several hours or days. Their dimensions range from 10 km to several hundred km. This makes it difficult to incorporate rainfall directly large-scale weather and climate models. Until the end of 1997, precipitation in the global tropics was not known to within a factor of two. Regarding "global warming", the various large-scale models differed among themselves in the predicted magnitude of the warming and in the expected regional effects of these temperature and moisture changes. The Tropical Rainfall Measuring Mission (TRMM) satellite has yielded important interim results related to rainfall observations, data assimilation and model forecast skills when rainfall data is assimilated. This talk will summarize where the TRMM science team is with regards to answering some of these important scientific challenges, as well as discuss the future Global Precipitation Mission which will provide 3 hourly rainfall coverage and offers some unique collaborative potential for NOAA and NASA.

Kummerow, C.↗

NASA NTRS2010

Use of Quality Controlled AIRS Temperature Soundings to Improve Forecast Skill

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU-A are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. Also included are the clear column radiances used to derive these products which are representative of the radiances AIRS would have seen if there were no clouds in the field of view. All products also have error estimates. The sounding goals of AIRS are to produce 1 km tropospheric layer mean temperatures with an rms error of 1K, and layer precipitable water with an rms error of 20 percent, in cases with up to 90 percent effective cloud cover. The products are designed for data assimilation purposes for the improvement of numerical weather prediction, as well as for the study of climate and meteorological processes. With regard to data assimilation, one can use either the products themselves or the clear column radiances from which the products were derived. The AIRS Version 5 retrieval algorithm is now being used operationally at the Goddard DISC in the routine generation of geophysical parameters derived from AIRS/AMSU data. A major innovation in Version 5 is the ability to generate case-by-case level-by-level error estimates for retrieved quantities and clear column radiances, and the use of these error estimates for Quality Control. The temperature profile error estimates are used to determine a case-by-case characteristic pressure pbest, down to which the profile is considered acceptable for data assimilation purposes. The characteristic pressure p(sub best) is determined by comparing the case dependent error estimate (delta)T(p) to the threshold values (Delta)T(p). The AIRS Version 5 data set provides error estimates of T(p) at all levels, and also profile dependent values of pbest based on use of a Standard profile dependent threshold (Delta)T(p). These Standard thresholds were designed as a compromise between optimal use for data assimilation purposes, which requires highest accuracy (tighter Quality Control), and climate purposes, which requires more spatial coverage (looser Quality Control). Subsequent research using Version 5 sounding and error estimates showed that tighter Quality Control performs better for data assimilation proposes, while looser Quality Control better spatial coverage) performs better for climate purposes. We conducted a number of data assimilation experiments using the NASA GEOS-5 Data Assimilation System as a step toward finding an optimum balance of spatial coverage and sounding accuracy with regard to improving forecast skill. The model was run at a horizontal resolution of 0.5 degree latitude x 0.67 degree longitude with 72 vertical levels. These experiments were run during four different seasons, each using a different year. The AIRS temperature profiles were presented to the GEOS-5 analysis as rawinsonde profiles, and the profile error estimates (delta)T(p) were used as the uncertainty for each measurement in the data assimilation process.

Susskind, Joel↗

NASA NTRS2012

Snow Cover and Precipitation Impacts on Dry Season Streamflow in the Lower Mekong Basin

Climate change impacts on dry season streamflow in the Mekong River are relatively understudied, despite the fact that water availability during this time is critically important for agricultural and ecological systems. Analyses of two gauging stations (Vientiane and Kratie) in the Lower Mekong Basin (LMB) show significant positive correlations between dry season (March through May, MAM) discharge and upper basin snow cover and local precipitation. Using snow cover, precipitation, and upstream discharge as predictors, we develop skillful regression models for MAM streamflow at Vientiane and Kratie, and force these models with output from a suite of general circulation model (GCM) experiments for the twentieth and twenty-first centuries. The GCM simulations predict divergent trends in snow cover (decreasing) and precipitation (increasing) over the twenty-first century, driving overall negligible long-term trends in dry season streamflow. Our study demonstrates how future changes in dry season streamflow in the LMB will depend on changes in snow cover and precipitation, factors that will need to be considered when assessing the full basin response to other climatic and non-climatic drivers.

Cook, Benjamin I.↗

NASA NTRSDate not supplied

A Regional Perspective on Global NWP from North America and Recent Developments in the NASA GEOS System

Satellite data have played an important role in improving model forecast skills. This presentation will give a perspective of data usages of vital satellites on global NWP and show some examples of using existing satellite observations in the GEOS data assimilation system at NASA GMAO. The efforts to utilize emerging satellite data and to prepare for the upcoming new instruments NASA supports will be presented as well.

Yanqiu Zhu↗