SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

All sources NASA NTRS DOE OSTI

NASA NTRS1975

Further studies of methods for reducing community noise around airports

A simplified method of analysis was used in which all flights at a 'simulated' airport were assumed to operate from one runway in a single direction. For this simulated airport, contours of noise exposure forecast were obtained and evaluated. A flight schedule of the simulated airport which is representative of the 23 major U. S. airports was used. The effect of banning night-time operations by four-engine, narrow-body aircraft in combination with other noise reduction options was studied. The reductions in noise which would occur of two- and three-engine, narrow-body aircraft equipped with a refanned engine was examined. A detailed comparison of the effects of engine cutback on takeoff versus the effects of retrofitting quiet nacelles for narrow-body aircraft was also examined. A method of presenting the effects of various noise reduction options was treated.

Petersen, R. H.↗

NASA NTRS1976

Study of short-haul aircraft operating economics. Phase 2: An analysis of the impact of jet modernization on local service airline operating costs

The objectives of this phase of the study were (1) to assess the 10 year operating cost trends of the local service airlines operating in the 1965 through 1974 period, (2) to glean from these trends the technological and operational parameters which were impacted most significantly by the transition to newer pure jet, short haul transports, and effected by changing fuel prices and cost of living indices, and (3) to develop, construct, and evaluate an operating cost forecasting model which would incorporate those factors which best predicted airline total operating cost behavior over that 10-year period.

Andrastek, D. A.↗

NASA NTRS1984

The importance of altimeter and scatterometer data for ocean prediction

The prediction of ocean circulation using satellite altimeter data is discussed. Three classes of oceanic response to atmospheric forcing are outlined and examined. Storms, surface waves, eddies, and ocean currents were evaluated in terms of forecasting time requirements. Scatterometer and radiometer applications to ocean prediction are briefly reviewed.

Hurlburt, H. E.↗

NASA NTRS1985

Comparison of Two Orographical Data Sets for the GLAS Fourth Order GCM

The development of a 2 deg latitude by 2.5 deg longitude version of the GLAS Fourth Order General Circulation Model has necessitated the specification of a correspondingly fine horizontal resolution orographic data set to act as a lower boundary condition for the GCM. The S1 topography attempts to relate the mean areally averaged height of such terrain while the Q3 topography emphasizes the effect of the flow of the tallest peaks in such regions by specifying an exaggerated significant height. In order to assess the relative merits of these two orographic data sets. A series of tests was initiated to evaluate the comparative weather forecasting and climate simulation skills of the GLAS Fourth Order GCM when the S1 and Q3 topographies are applied to the lower boundary. Three sets of Northern Hemispheric winter forecasts at the 2 deg x 2.5 deg resolution indicate that the Q3 topography gives slightly better results over the Northern Hemisphere than does the S1 topography. It is apparent that more forecasts will be necessary at both horizontal resolutions before any definitive conclusions are made regarding the choice of an optimal orographic data set.

Helfand, H. M.↗

NASA NTRS1994

Implementation of a state of the art automated system for the production of cloud/water vapor motion winds from geostationary satellites

The thrust of the proposed effort under this contract is aimed at improving techniques to track water vapor data in sequences of imagery from geostationary satellites. In regards to this task, significant testing, evaluation, and progress was accomplished during this period. Sets of winds derived from Meteosat data were routinely produced during Atlantic hurricane events in the 1993 season. These wind sets were delivered via Internet in real time to the Hurricane Research Division in Miami for their evaluation in a track forecast model. For eighteen cases in which 72-hour forecasts were produced, thirteen resulted in track forecast improvements (some quite significant). In addition, quality-controlled Meteosat water vapor winds produced by NESDIS were validated against rawinsondes, yielding an 8 m/s RMS. This figure is comparable to upper-level cloud drift wind accuracies. Given the complementary horizontal coverage in cloud-free areas, we believe that water vapor vectors can supplement cloud-drift wind information to provide good full-disk coverage of the upper tropospheric flow. The impact of these winds on numerical analysis and forecasts will be tested in the next reporting period.

Velden, Christopher S.↗

NASA NTRSDate not supplied

Model Evaluation and Intercomparison Using Data Collected by the Langley Mobile Ozone Lidar in Hampton, Virginia

Throughout the year 2022, the Langley Mobile Ozone Lidar (LMOL) has been frequently collecting ozone and aerosol measurements in the lower troposphere. The lidar is located in the parking lot behind the Atmospheric Sciences building at NASA Langley in Hampton, Virginia, approximately 37.095 N, -76.389 W. The data was collected during a range of several distinct atmospheric conditions, including stratospheric intrusions, surface frontal passages, and long-range transported wildfire smoke plumes. We use this data to evaluate and intercompare the forecast accuracy of two atmospheric chemistry models: the GEOS Composition Forecasting model (GEOS-CF) and the Weather Research and Forecasting model with Chemistry (WRF-Chem). Both models make daily three-dimensional forecasts of many trace gases and species for the contiguous United States. Over a range of ten distinct collection events, each spanning 36 hours to nearly seven days, the forecast models predict tropospheric ozone at NASA Langley with reasonable accuracy. The models best predict the timing and shape of the observed stratospheric intrusions in the middle troposphere but often vary in the magnitude of the ozone mixing ratios. For other atmospheric conditions, there is more variability in the model accuracy. Here, we summarize the accuracy of the models for all events and investigate reasons for differences between the models and the lidar.

Daniel B. Phoenix↗

NASA NTRSDate not supplied

Insights Into the Hydrology of the Congo Peatlands Through Land Surface Modeling and Data Assimilation

The 16.8 million ha of peatlands in the Cuvette Centrale wetland complex in the Congo Basin is one of the largest peatland regions on Earth but still highly understudied. Understanding the hydrological functioning of these peatlands and the effects of external disturbances thereon remains a major challenge. Recent research suggested fundamental hydrological differences between the Congo peatlands and the well-studied Southeast Asian peatlands. The Congo peatlands have a doming gradient that is up to ten times smaller, and they are influenced by river hydrology to some extent. In this study, we explore the Congo peatland hydrology through land surface modeling and data assimilation. We build upon our recently developed tropical PEATCLSM module (Apers et al., 2022) that was parameterized based on data from Southeast Asian peatlands due to the lack of field data from other tropical peatland regions. In a first step, we derive Congo-specific peat hydraulic and discharge function parameters from a scalar parametrization of water level dynamics in the Congo peatlands, using observed water level data at two locations. These Congo-specific parameters differ considerably from the original literature-based parameters from Southeast Asian peatlands. In a second step, we apply our original and Congo-specific parameters in an assimilation scheme for L-band brightness temperature (Tb) data from the Soil Moisture and Ocean Salinity (SMOS) mission. The data assimilation results are used in two ways. First, the effect of these parameters on the simulated peatland hydrology and the observation-minus-forecast Tb residuals is evaluated. It is hypothesized that the new parameters reduce the previously reported modeling errors over the Congo peatlands and reduce the residuals in Tb as well. Second, we analyze the data assimilation diagnostics to learn about other model improvement possibilities. In preliminary results, we found long periods of temporally autocorrelated total water storage increments (difference of pre- and post-update) that coincided with anomalies in river stages measured upstream of the peatlands. Since PEATLCSM neglects possible river influence, this concurrence suggests that the typically used grid-based approach of land surface models should be combined with a river routing scheme over the Congo peatlands.

Sebastian Apers↗

NASA NTRS1999

Observed Impacts

Rosenzweig, Cynthia↗

NASA NTRS2000

Section on Observed Impacts on El Nino

Agricultural applications of El Nino forecasts are already underway in some countries and need to be evaluated or re-evaluated. For example, in Peru, El Nino forecasts have been incorporated into national planning for the agricultural sector, and areas planted with rice and cotton (cotton being the more drought-tolerant crop) are adjusted accordingly. How well are this and other such programs working? Such evaluations will contribute to the governmental and intergovernmental institutions, including the Inter-American Institute for Global Change Research and the US National Ocean and Atmospheric Agency that are fostering programs to aid the effective use of forecasts. As El Nino climate forecasting grows out of the research mode into operational mode, the research focus shifts to include the design of appropriate modes of utilization. Awareness of and sensitivity to the costs of prediction errors also grow. For example, one major forecasting model failed to predict the very large El Nino event of 1997, when Pacific sea-surface temperatures were the highest on record. Although simple correlations between El Nino events and crop yields may be suggestive, more sophisticated work is needed to understand the subtleties of the interplay among the global climate system, regional climate patterns, and local agricultural systems. Honesty about the limitations of an forecast is essential, especially when human livelihoods are at stake. An end-to-end analysis links tools and expertise from the full sequence of ENSO cause-and-effect processes. Representatives from many disciplines are needed to achieve insights, e.g, oceanographers and atmospheric scientists who predict El Nino events, climatologists who drive global climate models with sea-surface temperature predictions, agronomists who translate regional climate connections in to crop yield forecasts, and economists who analyze market adjustments to the vagaries of climate and determine the value of climate forecasts. Methods include historical studies to understand past patterns and to test hindcasts of the prediction tools, crop modeling, spatial analysis and remote sensing. This research involves expanding, deepening, and applying the understanding of physical climate to the fields of agronomy and social science; and the reciprocal understanding of crop growth and farm economics to climatology. Delivery of a regional climate forecast with no information about how the climate forecast was derived limits its effectiveness. Explanation of a region's major climate driving forces helps to place a seasonal forecast in context. Then, a useful approach is to show historical responses to previous El Nino events, and projections, with uncertainty intervals, of crop response from dynamic process crop growth models. Regional ID forecasts should be updated with real-time weather conditions. Since every El Nino event is different, it is important to track, report and advise on each new event as it unfolds. The stability of human enterprises depends on understanding both the potentialities and the limits of predictability. Farmers rely on past experience to anticipate and respond to fluctuations in the biophysical systems on which their livelihoods depend. Now scientists are improving their ability to predict some major elements of climate variability. The improvements in the reliability of El Nino forecasts are encouraging, but seasonal forecasts for agriculture are not, and will probably never be completely infallible, due to the chaotic nature of the climate system. Uncertainties proliferate as we extend beyond Pacific sea-surface temperatures to climate teleconnections and agricultural outcomes. The goal of this research is to shed as a clear light as possible on these inherent uncertainties and thus to contribute to the development of appropriate responses to El Nino and other seasonal forecasts for a range of stakeholders, which, ultimately, includes food consumers everywhere.

Rosenzweig, Cynthia↗

NASA NTRS1984

The impact of satellite temperature soundings on the forecasts of a small national meteorological service

The impact of introducing satellite temperature sounding data on a numerical weather prediction model of a national weather service is evaluated. A dry five level, primitive equation model which covers most of the Northern Hemisphere, is used for these experiments. Series of parallel forecast runs out to 48 hours are made with three different sets of initial conditions: (1) NOSAT runs, only conventional surface and upper air observations are used; (2) SAT runs, satellite soundings are added to the conventional data over oceanic regions and North Africa; and (3) ALLSAT runs, the conventional upper air observations are replaced by satellite soundings over the entire model domain. The impact on the forecasts is evaluated by three verification methods: the RMS errors in sea level pressure forecasts, systematic errors in sea level pressure forecasts, and errors in subjective forecasts of significant weather elements for a selected portion of the model domain. For the relatively short range of the present forecasts, the major beneficial impacts on the sea level pressure forecasts are found precisely in those areas where the satellite sounding are inserted and where conventional upper air observations are sparse. The RMS and systematic errors are reduced in these regions. The subjective forecasts of significant weather elements are improved with the use of the satellite data. It is found that the ALLSAT forecasts are of a quality comparable to the SAR forecasts.

Wolfson, N.↗

NASA NTRS2009

An Anomaly Correlation Skill Score for the Evaluation of the Performance of Hyperspectral Infrared Sounders

With the availability of very accurate forecasts, the metric of accuracy alone for the evaluation of the performance of a retrieval system can produce misleading results. A useful characterization of the quality of a retrieval system and its potential to contribute to an improved weather forecast is its skill, which we define as the ability to make retrievals of geophysical parameters which are closer to the truth than the six hour forecast, when the truth differs significantly from the forecast. We illustrate retrieval skill using one day of AMSU and AIRS data with three different retrieval algorithms, which result in retrievals for more than 90% of the potential retrievals under clear and cloudy conditions. Two of the three algorithms have better than 1 K rms "RAOB quality" accuracy on the troposphere, but only one has skill between 900 and 100 mb. AIRS was launched on the EOS Aqua spacecraft in May 2002 into a 705 km polar sun-synchronous orbit with accurately maintained 1:30 PM ascending node. Essentially uninterrupted data are freely available since September 2002.

retrieval↗

NASA NTRSDate not supplied

Evaluation of TAO Observation System on ENSO Predictions from the GMAO S2S Forecast System

Since the early 1990’s, the Tropical Atmosphere Ocean (TAO) mooring array has been instrumental for observing Kelvin and Rossby wave propagation which is key for El Nino/Southern Oscillation (ENSO) prediction. However, recent funding and programmatical issues have highlighted the need to rigorously assess the impact of the TAO observing system on ENSO predictions. Therefore, we evaluate the TAO using data assimilation observation denial experiments (also known as Observing System Evaluation or OSE experiments). This presentation will evaluate the TAO observing impact on both reanalyses and prediction of the big 2015 El Nino. We have completed reanalyses for July 2014-Dec 2015 for both the CONTROL experiment (that assimilates all available data) and the NOTAO experiment (that is identical to the CONTROL but withholds all TAO observations) using the best available NASA GEOS-S2S V3 seasonal prediction system. Validation of these reanalyses shows that TAO assimilation generally improves comparisons of temperature and salinity versus gridded in situ observations. Temperature is universally improved above the thermocline near the equator, but the biggest improvement is found in the eastern Pacific, just below the thermocline, where the variation of the thermocline defines ENSO events. In addition, a surprising result is that even with relatively few observations, salinity is improved throughout the equatorial region except near 120oW near the surface. ENSO forecasts were performed that were initialized from these CONTROL and NOTAO reanalyses. For the 9-month forecasts which were initialized in January, July, and October 2015, the NINO3.4 SST shows that the CONTROL forecasts are warmer and closer to observations than the NOTAO forecasts. We will show that upwelling and shoaling of the mixed layer amplifies the ENSO signal due to TAO assimilation. Prior to (after) April 2015, this upwelling is caused by relatively stronger Rossby (Kelvin) waves in the CONTROL than in the NOTAO experiments.

E. Hackert↗

NASA NTRS2010

Regional Precipitation Forecast with Atmospheric InfraRed Sounder (AIRS) Profile Assimilation

Advanced technology in hyperspectral sensors such as the Atmospheric InfraRed Sounder (AIRS; Aumann et al. 2003) on NASA's polar orbiting Aqua satellite retrieve higher vertical resolution thermodynamic profiles than their predecessors due to increased spectral resolution. Although these capabilities do not replace the robust vertical resolution provided by radiosondes, they can serve as a complement to radiosondes in both space and time. These retrieved soundings can have a significant impact on weather forecasts if properly assimilated into prediction models. Several recent studies have evaluated the performance of specific operational weather forecast models when AIRS data are included in the assimilation process. LeMarshall et al. (2006) concluded that AIRS radiances significantly improved 500 hPa anomaly correlations in medium-range forecasts of the Global Forecast System (GFS) model. McCarty et al. (2009) demonstrated similar forecast improvement in 0-48 hour forecasts in an offline version of the operational North American Mesoscale (NAM) model when AIRS radiances were assimilated at the regional scale. Reale et al. (2008) showed improvements to Northern Hemisphere 500 hPa height anomaly correlations in NASA's Goddard Earth Observing System Model, Version 5 (GEOS-5) global system with the inclusion of partly cloudy AIRS temperature profiles. Singh et al. (2008) assimilated AIRS temperature and moisture profiles into a regional modeling system for a study of a heavy rainfall event during the summer monsoon season in Mumbai, India. This paper describes an approach to assimilate AIRS temperature and moisture profiles into a regional configuration of the Advanced Research Weather Research and Forecasting (WRF-ARW) model using its three-dimensional variational (3DVAR) assimilation system (WRF-Var; Barker et al. 2004). Section 2 describes the AIRS instrument and how the quality indicators are used to intelligently select the highest-quality data for assimilation. Section 3 presents an overall precipitation improvement with AIRS assimilation during a 37-day case study period, and Section 4 focuses on a single case study to further investigate the meteorological impact of AIRS profiles on synoptic scale models. Finally, Section 5 provides a summary of the paper.

Chou, S.-H.↗

NASA NTRS2010

Space Weather Products at the Community Coordinated Modeling Center

The Community Coordinated Modeling Center (CCMC) is a US inter-agency activity aiming at research in support of the generation of advanced space weather models. As one of its main functions, the CCMC provides to researchers the use of space science models, even if they are not model owners themselves. The second CCMC activity is to support Space Weather forecasting at national Space Weather Forecasting Centers. This second activity involves model evaluations, model transitions to operations, and the development of space weather forecasting tools. Owing to the pace of development in the science community, new model capabilities emerge frequently. Consequently, space weather products and tools involve not only increased validity, but often entirely new capabilities. This presentation will review the present state of space weather tools as well as point out emerging future capabilities.

Hesse, Michael↗

NASA NTRS2014

Development of Super Ensemble-Based Aviation Turbulence Guidance (SEATG) for Air Traffic Management

A new method for forecasting turbulence is developed and evaluated using the high resolution weather model and in situ turbulence observations from commercial aircraft. The new method is an ensemble of various turbulence metrics from multiple time-lagged ensemble forecasts created using a sequence of four procedures. These include weather modeling, calculation of turbulence metrics, mapping the metrics into a common turbulence-scale, and production of final forecast. The new method uses similar methodology as current operational turbulence forecast with three improvements. First, it uses a higher resolution ((delta)x = 3 km) weather model to capture cloud resolving scale phenomena. Second, it computes the metrics for multiple forecasts that are combined at the same valid time resulting in a time-lagged ensemble of multiple turbulence metrics. Finally, it provides both deterministic and probabilistic turbulence forecasts. Results show the new forecasts match well with observed radar reflectivity along a surface front as well as convectively induced turbulence outside the clouds on research period. Overall performance skill of the new turbulence forecast compared with the observed EDR data during the research period is superior to any single turbulence metric. The probabilistic turbulence forecast is used in an example air traffic management application for creating a wind-optimal route considering turbulence information. The wind-optimal route passing through areas of 50% potential for moderate-or-greater turbulence and the lateral turbulence avoidance routes starting from three different waypoints along the wind-optimal route from Los Angeles international airport to John F. Kennedy international airport are calculated using different turbulence forecasts. This example shows additional flight time is required to avoid potential turbulence encounters.

modeling↗

NASA NTRS1989

Weight and cost forecasting for advanced manned space vehicles

A mass and cost estimating computerized methology for predicting advanced manned space vehicle weights and costs was developed. The user friendly methology designated MERCER (Mass Estimating Relationship/Cost Estimating Relationship) organizes the predictive process according to major vehicle subsystem levels. Design, development, test, evaluation, and flight hardware cost forecasting is treated by the study. This methodology consists of a complete set of mass estimating relationships (MERs) which serve as the control components for the model and cost estimating relationships (CERs) which use MER output as input. To develop this model, numerous MER and CER studies were surveyed and modified where required. Additionally, relationships were regressed from raw data to accommodate the methology. The models and formulations which estimated the cost of historical vehicles to within 20 percent of the actual cost were selected. The result of the research, along with components of the MERCER Program, are reported. On the basis of the analysis, the following conclusions were established: (1) The cost of a spacecraft is best estimated by summing the cost of individual subsystems; (2) No one cost equation can be used for forecasting the cost of all spacecraft; (3) Spacecraft cost is highly correlated with its mass; (4) No study surveyed contained sufficient formulations to autonomously forecast the cost and weight of the entire advanced manned vehicle spacecraft program; (5) No user friendly program was found that linked MERs with CERs to produce spacecraft cost; and (6) The group accumulation weight estimation method (summing the estimated weights of the various subsystems) proved to be a useful method for finding total weight and cost of a spacecraft.

Williams, Raymond↗

NASA NTRS2011

Developing and Evaluating RGB Composite MODIS Imagery for Applications in National Weather Service Forecast Offices

Satellite remote sensing has gained widespread use in the field of operational meteorology. Although raw satellite imagery is useful, several techniques exist which can convey multiple types of data in a more efficient way. One of these techniques is multispectral compositing. The NASA Short-term Prediction Research and Transition (SPoRT) Center has developed two multispectral satellite imagery products which utilize data from the Moderate Resolution Imaging Spectroradiometer (MODIS) aboard NASA's Terra and Aqua satellites, based upon products currently generated and used by the European Organization for the Exploitation of Meteorological Satellites (EUMETSAT). The nighttime microphysics product allows users to identify clouds occurring at different altitudes, but emphasizes fog and low cloud detection. This product improves upon current spectral difference and single channel infrared techniques. Each of the current products has its own set of advantages for nocturnal fog detection, but each also has limiting drawbacks which can hamper the analysis process. The multispectral product combines each current product with a third channel difference. Since the final image is enhanced with color, it simplifies the fog identification process. Analysis has shown that the nighttime microphysics imagery product represents a substantial improvement to conventional fog detection techniques, as well as provides a preview of future satellite capabilities to forecasters.

Oswald, Hayden↗

NASA NTRS2011

Evaluating the Impact of Atmospheric Infrared Sounder (AIRS) Data On Convective Forecasts

The Short-term Prediction Research and Transition Center (SPoRT) is a collaborative partnership between NASA and operational forecasting partners, including a number of National Weather Service (NWS) offices. SPoRT provides real-time NASA products and capabilities to its partners to address specific operational forecast challenges. The mission of SPoRT is to transition observations and research capabilities into operations to help improve short-term weather forecasts on a regional scale. Two areas of focus are data assimilation and modeling, which can to help accomplish SPoRT's programmatic goals of transitioning NASA data to operational users. Forecasting convective weather is one challenge that faces operational forecasters. Current numerical weather prediction (NWP) models that operational forecasters use struggle to properly forecast location, timing, intensity and/or mode of convection. Given the proper atmospheric conditions, convection can lead to severe weather. SPoRT's partners in the National Oceanic and Atmospheric Administration (NOAA) have a mission to protect the life and property of American citizens. This mission has been tested as recently as this 2011 severe weather season, which has seen more than 300 fatalities and injuries and total damages exceeding $10 billion. In fact, during the three day period from 25-27 April, 1,265 storms reports (362 tornado reports) were collected making this three day period one of most active in American history. To address the forecast challenge of convective weather, SPoRT produces a real-time NWP model called the SPoRT Weather Research and Forecasting (SPoRT-WRF), which incorporates unique NASA data sets. One of the NASA assets used in this unique model configuration is retrieved profiles from the Atmospheric Infrared Sounder (AIRS).The goal of this project is to determine the impact that these AIRS profiles have on the SPoRT-WRF forecasts by comparing to a current operational model and a control SPoRT-WRF model that does not contain AIRS profiles.

Kozlowski, Danielle↗