Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Sport Transition of JPSS VIIRS Imagery for Night-time Applications

The NASA/Short‐term Prediction, Research, and Transition (SPoRT) Program and NOAA/Cooperative Institute for Research in the Atmosphere (CIRA) work within the NOAA/Joint Polar Satellite System (JPSS) Proving Ground to demonstrate the unique capabilities of the VIIRS instrument. Very similar to MODIS, the VIIRS instrument provides many high‐resolution visible and infrared channels in a broad spectrum. In addition, VIIRS is equipped with a low‐light sensor that is able to detect light emissions from the land and atmosphere as well as reflected sunlight by the lunar surface. This band is referred to as the Day‐Night Band due to the sunlight being used at night to see cloud and topographic features just as one would typically see in day‐time visible imagery. NWS forecast offices that collaborate with SPoRT and CIRA have utilized MODIS imagery in operations, but have longed for more frequent passes of polar‐orbiting data. The VIIRS instrument enhances SPoRT collaborations with WFOs by providing another day and night‐time pass, and at times two additional passes due to its large swath width. This means that multi‐spectral, RGB imagery composites are more readily available to prepare users for their use in GOES‐R era and high‐resolution imagery for use in high‐latitudes is more frequently able to supplement standard GOES imagery within the SPoRT Hybrid GEO‐LEO product. The transition of VIIRS also introduces the new Day‐Night Band capability to forecast operations. An Intensive Evaluation Period (IEP) was conducted in Summer 2013 with a group of "Front Range" NWS offices related to VIIRS night‐time imagery. VIIRS single‐channel imagery is able to better analyze the specific location of fire hotspots and other land features, as well as provide a more true measurement of various cloud and aerosol properties than geostationary measurements, especially at night. Viewed within the SPoRT Hybrid imagery, the VIIRS data allows forecasters to better interpret the more frequent, but coarse GOES Imagery. Night‐time Microphysics and Dust RGB Imagery provides cloud analysis of cloud height, thickness, and composition in order for operational applications such as separating fog from low clouds, dust plume detection, and determining precipitating clouds in radar-void/ blocked regions. The Day‐Night Band has a particular benefit to seeing light from cities, fires, or other emissions as well as the reflection of moonlight off of clouds and smoke plumes, given the right lunar phase and angle. Examples from the VIIRS transition and IEP will be presented.

Fuell, Kevin↗
NASA NTRS1990

Atmospheric energetics and earth radiation budget

Processed ERBE data are used in several studies in which NMC global analyses and forecasts are examined and evaluated. In the first study, ERBE net radiation values for four months are averaged and integrated to provide global net energy transport. Energy transport by atmospheric circulations is obtained using NMC analyses and results provide a measure of reasonableness of the analyses. In the second and third experiments, ERBE values of outgoing longwave radiation are used as 'top-side truth' to examine both the spin-up problem and the radiation algorithms of the global forecasts.

Kann, Deirdre M.↗
NASA NTRS2019

Assessing the Impact of Observations in a Multi-Year Reanalysis (MERRA-2)

Operational and quasi-operational weather prediction centers have been routinely assessing the contribution from various observing systems to reducing errors in short-range forecasts for a number of years now. The original technique, Forecast Sensitivity-based Observation Impact (FSOI), involves definition of a forecast error measure and evaluation of sensitivities with respect to changes in the observations that require adjoint operators of both the underlying tangent linear model and corresponding analysis technique. The present work applies FSOI to reanalysis and aims at providing an expanded view of the contribution of various observing systems over nearly 40 years of assimilation. Specifically, this study uses MERRA-2 given that its supporting software includes all ingredients necessary to calculate FSOI. Part of this work shows how the quality of forecasts improves over the course of the reanalysis, and examines forecast sensitivities relevant to FSOI. The assessment here finds, for example, that: conventional observations are a major player in reducing forecast error throughout the 40 years of reanalysis, even when their volume reduces from 45\% in the earlier periods to about 5% in the modern era; satellite radiances, especially microwave instruments are major contributors to error reduction from the early single platform TIROS-N days to the current multi-platform scenario, though their fractional contribution reduces slightly from the early 2000's onward after the increased availability of wind observation from aircraft and atmospheric motion vectors, and the introduction of GPSRO; infrared instruments play a secondary role to microwave but are significant still, with the peculiar result of fractional impacts contribution from modern hyperspectral instruments being roughly similar to those from early infrared instruments. The dependence of results on the chosen error measure is emphasized throughout.

Todling, Ricardo↗
NASA NTRS2019

Assessing the Impact of Observations in a Multi-Year Reanalysis

Operational and quasi-operational weather prediction centers have been routinely assessing the contribution from various observing systems to reducing errors in short-range forecasts for a number of years now. The original technique, Forecast Sensitivity Observation Impact (FSOI), involves definition of a forecast error measure and evaluation of sensitivities with respect to changes in the observing system that require adjoint operators of both the underlying tangent linear model and corresponding analysis technique. The present work applies FSOI to Reanalysis and aims at providing an expanded view of the contribution of various observing systems over nearly 40 years of assimilation. Specifically, this study uses MERRA-2 given that its supporting software includes all ingredients necessary to calculate FSOI. Part of this work shows how the quality of forecasts improves over the course of the reanalysis, and examines forecast sensitivities relevant to FSOI. The assessment here finds, for example, that: conventional observations are a major player in reducing forecast error throughout the 40 years of reanalysis, even when their volume reduces from 45% in the earlier periods to about 5% in the modern era; satellite radiances, especially microwave instruments are major contributors to error reduction from the early single platform TIROS-N days to the current multi-platform scenario; infrared instruments play a secondary role to microwave but are significant still, with the peculiar result of fractional impacts contribution from modern hyperspectral instruments being roughly similar to those from early infrared instruments. The dependence of results on the chosen error measure is emphasized throughout.

Fabio L R Diniz↗
DOE OSTI2020

PyDDA: A Pythonic Direct Data Assimilation Framework for Wind Retrievals

This software assimilates data from an arbitrary number of weather radars together with other spatial wind fields (eg numerical weather forecasting model data) in order to retrieve high resolution three dimensional wind fields. PyDDA uses NumPy and SciPy’s optimization techniques combined with the Python Atmospheric Radiation Measurement (ARM) Radar Toolkit (Py-ART) in order to create wind fields using the 3D variational technique (3DVAR). PyDDA is hosted and distributed on GitHub at https://github.com/openradar/PyDDA. PyDDA has the potential to be used by the atmospheric science community to develop high resolution wind retrievals from radar networks. These retrievals can be used for the evaluation of numerical weather forecasting models and plume modelling. This paper shows how wind fields from 2 NEXt generation RADar (NEXRAD) WSR-88D radars and the High Resolution Rapid Refresh can be assimilated together using PyDDA to create a high resolution wind field inside Hurricane Florence.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Flow Forecasting on New England’s Great River Hydro (Abstract)

Great River Hydro (GRH) operates 13 generating stations and 3 storage-only reservoirs along the Upper Connecticut River, draining 6,266 square miles. Managing the reservoirs requires coordination over a couple days. So far seasonal flow-forecast and medium range probabilistic flow forecast during high flow conditions are leading to satisfactory management. Great River Hydro is seeking technical assistance to evaluate potential improvements in inflow forecasting and scheduling accuracy, particularly during short- to medium- duration periods (1-10 days). Improved accuracy is anticipated to enhance the efficiency with which GRH utilizes water, improving GRH’s ability to hit the best priced hours throughout the system and enhancing revenues as a result.

13 HYDRO ENERGY↗
NASA NTRS2012

Estimation of Eddy Dissipation Rates from Mesoscale Model Simulations

The Eddy Dissipation Rate is an important metric for representing the intensity of atmospheric turbulence and is used as an input parameter for predicting the decay of aircraft wake vortices. In this study, the forecasts of eddy dissipation rates obtained from the current state-of-the-art mesoscale model are evaluated for terminal area applications. The Weather Research and Forecast mesoscale model is used to simulate the planetary boundary layer at high horizontal and vertical mesh resolutions. The Bougeault-Lacarrer and the Mellor-Yamada-Janji schemes implemented in the Weather Research and Forecast model are evaluated against data collected during the National Aeronautics and Space Administration s Memphis Wake Vortex Field Experiment. Comparisons with other observations are included as well.

Ahmad, Nashat N.↗
DOE OSTI2021

Daily grass reference evapotranspiration with Meteosat Second Generation shortwave radiation and reference ET products

Here we assess the accuracy of estimating daily grass reference evapotranspiration (PM-ET o ) using daily shortwave radiation (R s ) and reference evapotranspiration (ET REF ) products provided by the Meteosat Second Generation (MSG) geostationary satellite delivered by the Satellite Applications Facility on Land Surface Analysis (LSA-SAF) framework. The accuracy of using reanalysis ERA5 shortwave radiation data (R s ERA5 ) provided by the European Center for Medium-Range Weather Forecasts (ECMWF) is also evaluated. The assessments were performed using observed weather variables at 37 weather stations distributed across continental Portugal, where climate conditions range from semi-arid to humid, and 12 weather stations located in Azores islands, characterized by humid, windy and often cloudy conditions. This study&#x27;s use of data from a variety of climate conditions contributed to a unique and innovative assessment of the usability of LSA-SAF and ERA5 products for ET o estimation. The first assessment focused on comparing LSA-SAF estimates of R s (R s LSA-SAF ) against ground stations (R s ground ). The results showed a good matching between the two R s data sets for continental Portugal but a tendency for R s LSA-SAF to under-estimate R s ground in the cloudy islands of Azores. ET o values computed using R s LSA-SAF data and observed temperature, humidity and wind speed (ET o LSA-SAF ) were then compared with PM-ET o estimates with ground-based data, which were used as benchmark; input data of temperature and humidity needed for PM-ET o were quality checked for surface aridity effects. It was observed that ET o LSA-SAF is strongly correlated with PM-ET o (R 2 > 0.97) for most locations in continental Portugal, with regression coefficient of a linear regression forced to the origin ranging between 0.95 and 1.05, mean root mean square error (RMSE) of 0.13 mm d –1 , and Nash and Sutcliff efficiency of modeling (EF) above 0.95. For most Azores locations, ET o LSA-SAF over-estimated PM-ET o . This is likely a consequence of the high spatio-temporal heterogeneity of weather conditions that occur in these oceanic islands together with the different footprints of satellite (averaged over the pixel) and station observations. Reanalysis ERA5 shortwave radiation data presented similar behavior to the LSA-SAF products, however with slightly lower accuracy. The daily LSA-SAF ET REF product (ET REF LSA-SAF ) was assessed and results have shown a good accuracy of this product, with acceptable RMSE and high EF values, for continental Portugal but a low accuracy for the Azores islands. A simplified bias correction approach was shown to improve both ET o derived from the LSA-SAF products, namely for Azores stations, which seem to be representative of smaller areas. The use of the FAO-PM temperature approach (PMT) was also assessed using the R s LSA-SAF and R s ERA5 data, which showed a superiority of the LSA-SAF product for ET o estimations (ET o PMT LSA-SAF ). No significant differences (p < 0.05) were observed in terms of the median value of the RMSE when adopting ET o PMT and ET REF LSA-SAF . Differently, results showed that using the R s LSA-SAF in the PMT approach (ET o PMT LSA-SAF ) produces significantly better RMSE results than ET o PMT and ET REF LSA-SAF . Overall, the performed assessment allows concluding that the use of R s LSA-SAF, and to a lesser extent the use of the R s ERA5 , highly improves the accuracy of computation of ET o when R s observations are not available, including when only temperature data are accessible. The use of the ET REF LSA-SAF product is a good alternative when observed weather data are not available.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Agora : Multicomponent simulation for cross-survey science

ABSTRACT Next-generation cosmological surveys will observe large portions of the sky, with significant overlap between them. Multi-wavelength observations will enable us to analyse the same large-scale structure from different angles using a variety of tracers and astrophysical effects. The complex interplay between these observables calls for a model that can accurately and coherently describe their collective behaviour, posing a challenge that can only be met through the use of simulations. In this work, a suite of simulated extragalactic skies is presented, including maps and/or catalogues of cosmic microwave background (CMB) lensing, thermal and kinetic Sunyaev–Zel’dovich (tSZ/kSZ) effects, cosmic infrared background (CIB), radio sources, galaxy overdensity and galaxy weak lensing. Each of these probes is implemented in the lightcone using halo catalogues and/or particles from the Multidark-Planck2 ($\small {MDPL2}$) N-body simulation, and the modelling is calibrated using hydrodynamic simulations and publicly available data. The auto and cross-spectra of the individual probes, as well as the cross-spectra between the observables, are shown to be consistent with theoretical models and measurements from data. The simulation is shown to have a wide range of applications, including forecasting, pipeline testing, and evaluating astrophysical biases in cross-correlation measurements. It is further demonstrated that the simulation products produced in this work have sufficient accuracy to recover the input cosmology when subjected to a full cosmological analysis and are ready for application in real-world analyses for ongoing and future surveys. The simulation products presented in this work can be accessed at: https://yomori.github.io/agora/index.html.

Astronomy & Astrophysics↗
DOE OSTI2020

An Updated Visual Orbit of the Directly Imaged Exoplanet 51 Eridani b and Prospects for a Dynamical Mass Measurement with Gaia

We present a revision to the visual orbit of the young, directly imaged exoplanet 51 Eridani b using four years of observations with the Gemini Planet Imager. The relative astrometry is consistent with an eccentric (e=0.53{sub -0.13}{sup +0.09}) orbit at an intermediate inclination (i=136{sub -11}{sup +10} °), although circular orbits cannot be excluded due to the complex shape of the multidimensional posterior distribution. We find a semimajor axis of 11.1{sub -1.3}{sup +4.2} au and a period of 28.1{sub -4.9}{sup +17.2} yr, assuming a mass of 1.75 M{sub ⊙} for the host star. We find consistent values with a recent analysis of VLT/SPHERE data covering a similar baseline. We investigate the potential of using the absolute astrometry of the host star to obtain a dynamical mass constraint for the planet. The astrometric acceleration of 51 Eri derived from a comparison of the Hipparcos and Gaia catalogs was found to be inconsistent at the 2σ–3σ level with the predicted reflex motion induced by the orbiting planet. Potential sources of this inconsistency include a combination of random and systematic errors between the two astrometric catalogs and the signature of an additional companion within the system interior to current detection limits. We also explored the potential of using Gaia astrometry alone for a dynamical mass measurement of the planet by simulating Gaia measurements of the motion of the photocenter of the system over the course of the extended 8 yr mission. We find that such a measurement is only possible (>98% probability) given the most optimistic predictions for the Gaia scan astrometric uncertainties for bright stars and a high mass for the planet (≳3.6 M {sub Jup}).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Effects of spatial resolution on WRF v3.8.1 simulated meteorology over the central Himalaya

The sensitive ecosystem of the central Himalayan (CH) region, which is experiencing enhanced stress from anthropogenic forcing, requires adequate atmospheric observations and an improved representation of the Himalaya in the models. However, the accuracy of atmospheric models remains limited in this region due to highly complex mountainous topography. This article delineates the effects of spatial resolution on the modeled meteorology and dynamics over the CH by utilizing the Weather Research and Forecasting (WRF) model extensively evaluated against the Ganges Valley Aerosol Experiment (GVAX) observations during the summer monsoon. The WRF simulation is performed over a domain (d01) encompassing northern India at 15 km x 15 km resolution and two nests (d02 at 5 km x 5 km and d03 at 1 km x 1 km) centered over the CH, with boundary conditions from the respective parent domains. WRF simulations reveal higher variability in meteorology, e.g., relative humidity (RH = 70.3%-96.1%) and wind speed (WS = 1.1-4.2m s(-1)), compared to the ERA-Interim reanalysis (RH D 80.0%-85.0%, WS D 1.2-2.3m s(-1)) over northern India owing to the higher resolution. WRF-simulated temporal evolution of meteorological variables is found to agree with balloon-borne measurements, with stronger correlations aloft (r = 0.44-0.92) than those in the lower troposphere (r = 0.18-0.48). The model overestimates temperature (warm bias by 2.8 degrees C) and underestimates RH (dry bias by 6.4 %) at the surface in d01. Model results show a significant improvement in d03 (P = 827.6 hPa, T = 19.8 degrees C, RH = 92.3 %), closer to the GVAX observations (P = 801.4 hPa, T = 19.5 degrees C, RH = 94.7 %). Interpolating the output from the coarser domains (d01, d02) to the altitude of the station reduces the biases in pressure and temperature; however, it suppresses the diurnal variations, highlighting the importance of well-resolved terrain (d03). Temporal variations in near-surface P, T, and RH are also reproduced by WRF in d03 to an extent (r>0:5). A sensitivity simulation incorporating the feedback from the nested domain demonstrates the improvement in simulated P, T, and RH over the CH. Our study shows that the WRF model setup at finer spatial resolution can significantly reduce the biases in simulated meteorology, and such an improved representation of the CH can be adopted through domain feedback into regional-scale simulations. Interestingly, WRF simulates a dominant easterly wind component at 1 km x 1 km resolution (d03), which is missing in the coarse simulations; however, the frequency of southeasterlies remains underestimated. The model simulation implementing a highresolution (3 s) topography input (SRTM) improved the prediction of wind directions; nevertheless, further improvements are required to better reproduce the observed local-scale dynamics over the CH.

Singh, Jaydeep↗
DOE OSTI2025

A process-based evaluation of biases in extratropical stratosphere–troposphere coupling in subseasonal forecast systems

Abstract. Two-way coupling between the stratosphere and troposphere is recognized as an important source of subseasonal-to-seasonal (S2S) predictability and can open windows of opportunity for improved forecasts. Model biases can, however, lead to a poor representation of such coupling processes; drifts in a model's circulation related to model biases, resolution, and parameterizations have the potential to feed back on the circulation and affect stratosphere–troposphere coupling. We introduce a set of diagnostics using readily available data that can be used to reveal these biases and then apply these diagnostics to 22 S2S forecast systems. In the Northern Hemisphere, nearly all S2S forecast systems underestimate the strength of the observed upward coupling from the troposphere to the stratosphere, downward coupling within the stratosphere, and the persistence of lower-stratospheric temperature anomalies. While downward coupling from the lower stratosphere to the near surface is well represented in the multi-model ensemble mean, there is substantial intermodel spread likely related to how well each model represents tropospheric stationary waves. In the Southern Hemisphere, the stratospheric vortex is oversensitive to upward-propagating wave flux in the forecast systems. Forecast systems generally overestimate the strength of downward coupling from the lower stratosphere to the troposphere, even as most underestimate the radiative persistence in the lower stratosphere. In both hemispheres, models with higher lids and a better representation of tropospheric quasi-stationary waves generally perform better at simulating these coupling processes.

Garfinkel, Chaim I. (ORCID:000000017258666X)↗
NASA NTRS1975

Further studies of methods for reducing community noise around airports

A simplified method of analysis was used in which all flights at a 'simulated' airport were assumed to operate from one runway in a single direction. For this simulated airport, contours of noise exposure forecast were obtained and evaluated. A flight schedule of the simulated airport which is representative of the 23 major U. S. airports was used. The effect of banning night-time operations by four-engine, narrow-body aircraft in combination with other noise reduction options was studied. The reductions in noise which would occur of two- and three-engine, narrow-body aircraft equipped with a refanned engine was examined. A detailed comparison of the effects of engine cutback on takeoff versus the effects of retrofitting quiet nacelles for narrow-body aircraft was also examined. A method of presenting the effects of various noise reduction options was treated.

Petersen, R. H.↗
NASA NTRS1976

Study of short-haul aircraft operating economics. Phase 2: An analysis of the impact of jet modernization on local service airline operating costs

The objectives of this phase of the study were (1) to assess the 10 year operating cost trends of the local service airlines operating in the 1965 through 1974 period, (2) to glean from these trends the technological and operational parameters which were impacted most significantly by the transition to newer pure jet, short haul transports, and effected by changing fuel prices and cost of living indices, and (3) to develop, construct, and evaluate an operating cost forecasting model which would incorporate those factors which best predicted airline total operating cost behavior over that 10-year period.

Andrastek, D. A.↗
NASA NTRS1984

The importance of altimeter and scatterometer data for ocean prediction

The prediction of ocean circulation using satellite altimeter data is discussed. Three classes of oceanic response to atmospheric forcing are outlined and examined. Storms, surface waves, eddies, and ocean currents were evaluated in terms of forecasting time requirements. Scatterometer and radiometer applications to ocean prediction are briefly reviewed.

Hurlburt, H. E.↗
NASA NTRS1985

Comparison of Two Orographical Data Sets for the GLAS Fourth Order GCM

The development of a 2 deg latitude by 2.5 deg longitude version of the GLAS Fourth Order General Circulation Model has necessitated the specification of a correspondingly fine horizontal resolution orographic data set to act as a lower boundary condition for the GCM. The S1 topography attempts to relate the mean areally averaged height of such terrain while the Q3 topography emphasizes the effect of the flow of the tallest peaks in such regions by specifying an exaggerated significant height. In order to assess the relative merits of these two orographic data sets. A series of tests was initiated to evaluate the comparative weather forecasting and climate simulation skills of the GLAS Fourth Order GCM when the S1 and Q3 topographies are applied to the lower boundary. Three sets of Northern Hemispheric winter forecasts at the 2 deg x 2.5 deg resolution indicate that the Q3 topography gives slightly better results over the Northern Hemisphere than does the S1 topography. It is apparent that more forecasts will be necessary at both horizontal resolutions before any definitive conclusions are made regarding the choice of an optimal orographic data set.

Helfand, H. M.↗
NASA NTRS1994

Implementation of a state of the art automated system for the production of cloud/water vapor motion winds from geostationary satellites

The thrust of the proposed effort under this contract is aimed at improving techniques to track water vapor data in sequences of imagery from geostationary satellites. In regards to this task, significant testing, evaluation, and progress was accomplished during this period. Sets of winds derived from Meteosat data were routinely produced during Atlantic hurricane events in the 1993 season. These wind sets were delivered via Internet in real time to the Hurricane Research Division in Miami for their evaluation in a track forecast model. For eighteen cases in which 72-hour forecasts were produced, thirteen resulted in track forecast improvements (some quite significant). In addition, quality-controlled Meteosat water vapor winds produced by NESDIS were validated against rawinsondes, yielding an 8 m/s RMS. This figure is comparable to upper-level cloud drift wind accuracies. Given the complementary horizontal coverage in cloud-free areas, we believe that water vapor vectors can supplement cloud-drift wind information to provide good full-disk coverage of the upper tropospheric flow. The impact of these winds on numerical analysis and forecasts will be tested in the next reporting period.

Velden, Christopher S.↗
NASA NTRSDate not supplied

Model Evaluation and Intercomparison Using Data Collected by the Langley Mobile Ozone Lidar in Hampton, Virginia

Throughout the year 2022, the Langley Mobile Ozone Lidar (LMOL) has been frequently collecting ozone and aerosol measurements in the lower troposphere. The lidar is located in the parking lot behind the Atmospheric Sciences building at NASA Langley in Hampton, Virginia, approximately 37.095 N, -76.389 W. The data was collected during a range of several distinct atmospheric conditions, including stratospheric intrusions, surface frontal passages, and long-range transported wildfire smoke plumes. We use this data to evaluate and intercompare the forecast accuracy of two atmospheric chemistry models: the GEOS Composition Forecasting model (GEOS-CF) and the Weather Research and Forecasting model with Chemistry (WRF-Chem). Both models make daily three-dimensional forecasts of many trace gases and species for the contiguous United States. Over a range of ten distinct collection events, each spanning 36 hours to nearly seven days, the forecast models predict tropospheric ozone at NASA Langley with reasonable accuracy. The models best predict the timing and shape of the observed stratospheric intrusions in the middle troposphere but often vary in the magnitude of the ozone mixing ratios. For other atmospheric conditions, there is more variability in the model accuracy. Here, we summarize the accuracy of the models for all events and investigate reasons for differences between the models and the lidar.

Daniel B. Phoenix↗