Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Forecasting Lightning at Kennedy Space Center/Cape Canaveral Air Force Station, Florida

The Applied Meteorology Unit (AMU) developed a set of statistical forecast equations that provide a probability of lightning occurrence on Kennedy Space Center (KSC) I Cape Canaveral Air Force Station (CCAFS) for the day during the warm season (May September). The 45th Weather Squadron (45 WS) forecasters at CCAFS in Florida include a probability of lightning occurrence in their daily 24-hour and weekly planning forecasts, which are briefed at 1100 UTC (0700 EDT). This information is used for general scheduling of operations at CCAFS and KSC. Forecasters at the Spaceflight Meteorology Group also make thunderstorm forecasts for the KSC/CCAFS area during Shuttle flight operations. Much of the current lightning probability forecast at both groups is based on a subjective analysis of model and observational data. The objective tool currently available is the Neumann-Pfeffer Thunderstorm Index (NPTI, Neumann 1971), developed specifically for the KSCICCAFS area over 30 years ago. However, recent studies have shown that 1-day persistence provides a better forecast than the NPTI, indicating that the NPTI needed to be upgraded or replaced. Because they require a tool that provides a reliable estimate of the daily thunderstorm probability forecast, the 45 WS forecasters requested that the AMU develop a new lightning probability forecast tool using recent data and more sophisticated techniques now possible through more computing power than that available over 30 years ago. The equation development incorporated results from two research projects that investigated causes of lightning occurrence near KSCICCAFS and over the Florida peninsula. One proved that logistic regression outperformed the linear regression method used in NPTI, even when the same predictors were used. The other study found relationships between large scale flow regimes and spatial lightning distributions over Florida. Lightning, probabilities based on these flow regimes were used as candidate predictors in the equation development. Fifteen years (1 989-2003) of warm season data were used to develop the forecast equations. The data sources included a local network of cloud-to-ground lightning sensors called the Cloud-to-Ground Lightning Surveillance System (CGLSS), 1200 UTC Florida synoptic soundings, and the 1000 UTC CCAFS sounding. Data from CGLSS were used to determine lightning occurrence for each day. The 1200 UTC soundings were used to calculate the synoptic-scale flow regimes and the 1000 UTC soundings were used to calculate local stability parameters, which were used as candidate predictors of lightning occurrence. Five logistic regression forecast equations were created through careful selection and elimination of the candidate predictors. The resulting equations contain five to six predictors each. Results from four performance tests indicated that the equations showed an increase in skill over several standard forecasting methods, good reliability, an ability to distinguish between non-lightning and lightning days, and good accuracy measures and skill scores. Given the overall good performance the 45 WS requested that the equations be transitioned to operations and added to the current set of tools used to determine the daily lightning probability of occurrence.

Lambert, Winfred↗

Application of Synoptic Magnetograms for Prediction of Solar Activity Using Ensemble Kalman Filter

Solar activity predictions using the data assimilation approach have demonstrated great potential to build reliable long-term forecasts of solar activity. In particular, it has been shown that the Ensemble Kalman Filter (EnKF) method applied to a non-linear dynamo model is capable of predicting solar activity up to one sunspot cycle ahead in time, as well as estimating the properties of the next cycle a few years before it begins. These developments assume an empirical relationship between the mean toroidal magnetic field flux and the sunspot number. Estimated from the sunspot number series, variations of the toroidal field have been used to assimilate the data into the Parker-Kleeorin-Ruzmakin (PKR) dynamo model by applying the EnKF method. The dynamo model describes the evolution of the toroidal and poloidal components of the magnetic field and the magnetic helicity. Full-disk magnetograms provide more accurate and complete input data by constraining both the toroidal and poloidal global field components, but these data are available only for the last four solar cycles. In this presentation, using the available magnetogram data, we discuss development of the methodology and forecast quality criteria (including forecast uncertainties and sources of errors). We demonstrate the influence of limited time series observations on the accuracy of solar activity predictions. We present EnKF predictions of the upcoming Solar Cycle 25 based on both the sunspot number series and observed magnetic fields and discuss the uncertainties and potential of the data assimilation approach.

Kitiashvili, Irina N.↗

AIRS: Improving Weather Forecasting and Providing New Data on Greenhouse Gases

This paper discusses the performance of AIRS and examines how it is meeting its operational and research objectives based on the experience of more than 2 yr with AIRS data. We describe the science background and the performance of AIRS in terms of the accuracy and stability of its observed spectral radiances. We examine the validation of the retrieved temperature and water vapor profiles against collocated operational radiosondes, and then we assess the impact thereof on numerical weather forecasting of the assimilation of the AIRS spectra and the retrieved temperature. We close the paper with a discussion on the retrieval of several minor tropospheric constituents from AIRS spectra.

remote sensing↗

Comparative Accuracies of Models for Drag Prediction During Geomagnetically Disturbed Periods: A First Principles Model Versus Empirical Models

We examine the accuracy of density prediction by the first principles model Thermosphere Ionosphere Electrodynamics General Circulation Model (TIEGCM) developed by the National Center for Atmospheric Research and compare it to the accuracy of three empirical models: Jacchia 71, the Naval Research Laboratory Mass Spectrometer Incoherent Scatter Extended 2000 (NRLMSIS), Jacchia 1971, and Jacchia-Bowman 2008. Comparisons are made for three large storms: the October 2003 storm, the March 2013 storm, and the March 2015 storm. To evaluate the accuracy of these models we use tracking data for nine space objects in low Earth orbit. Additionally, we evaluate the accuracy of the TIEGCM and NRLMSIS with data from high precision accelerometers on the Challenging Minisatellite Payload (CHAMP) and Gravity field and Circulation Explorer (GOCE) satellites. The goal is to assess the use of a first principles model as a potential tool for forecasting satellite drag during large magnetic storms. For the storms considered, we found the TIEGCM, JB2008, and NRLMSIS models to be substantially more accurate than the Jacchia 71 model. The accuracies of the TIEGCM and JB2008 models were similar, but overall, the TIEGCM was more accurate. We found smaller differences for TIEGCM versus CHAMP than for NRLMIS for the Halloween Storm, and smaller differences than results published for JB2008 and the assimilative model HASDM. The empirical models are at present more practical for operational purposes, but the TIEGCM, developed as a research model, with a greater focus on operational use offers the potential for improved utility during stressing conditions.

R. L. Walterscheid↗

Leveraging Observing System Simulation Experiments for Satellite Instrument Design: Advancements and Challenges

This abstract highlights NASA's OSSE framework, developed at the Global Modeling and Assimilation Office, which has become a widely adopted tool for evaluating the impact of new observations on weather forecasts. The framework involves simulating realistic observations by introducing errors to mimic real-world scenarios. By utilizing advanced radiative transfer modeling, the accuracy of simulated observations is significantly improved, enhancing the reliability of experimental outcomes. The talk focuses on recent progress and challenges in three key areas. Firstly, it explores the techniques used to simulate synthetic observations, a crucial aspect of OSSE experiments. Secondly, the presentation also discusses the challenges of examining the observation errors that need to be added to the perfect observations to generate realistic simulated observations. Lastly, the assimilation of synthetic observations and their impact on forecast skills is evaluated, providing valuable insights for optimizing current and future observing systems for improving the weather forecasts. By sharing recent advancements and acknowledging challenges, this presentation seeks to inspire researchers to leverage the OSSE framework in weather forecasting. NASA's OSSE techniques hold promise for a better understanding of the atmosphere and the development of more accurate and reliable weather predictions.

Isaac Moradi↗

Sensor fusion techniques for predicting thunderstorm evolution using lightning and radar networks

A pattern recognition scheme that is used to generate initial seeds or 'first guess' fields for clustering the discrete lightning discharges into storm cells is presented. The clustering process is critically dependent on the prior accuracy of the lightning location estimates. The generation of subsequent storm life-cycle time series (for extrapolation forecasting) also relies on the cluster analysis procedure assigning the correct number of lightning discharges (objects) to the proper storms (groups). The advantages and limitations of different clustering strategies for storm identification and tracking are examined. Storm identification with lightning data alone is compared to storm identification with radar alone, and some synergies for sensor fusion are explored.

Goodman, Steven J.↗

Efficient Methods to Assimilate Satellite Retrievals Based on Information Content: Suboptimal Retrieval Assimilation - Part 2

One of the outstanding problems in data assimilation has been and continues to be how best to utilize satellite data while balancing the tradeoff between accuracy and computational cost. A number of weather prediction centers have recently achieved remarkable success in improving their forecast skill by changing the method by which satellite data are assimilated into the forecast model from the traditional approach of assimilating retrievals to the direct assimilation of radiances in a variational framework. The operational implementation of such a substantial change in methodology involves a great number of technical details, e.g., pertaining to quality control procedures, systematic error correction techniques, and tuning of the statistical parameters in the analysis algorithm. Although there are clear theoretical advantages to the direct radiance assimilation approach, it is not obvious at all to what extent the improvements that have been obtained so far can be attributed to the change in methodology, or to various technical aspects of the implementation. The issue is of interest because retrieval assimilation retains many practical and logistical advantages which may become even more significant in the near future when increasingly high-volume data sources become available. The central question we address here is: how much improvement can we expect from assimilating radiances rather than retrievals, all other things being equal? We compare the two approaches in a simplified one-dimensional theoretical framework, in which problems related to quality control and systematic error correction are conveniently absent. By assuming a perfect radiative transfer model and perfect knowledge of radiance and background error covariances, we are able to formulate a nonlinear local error analysis for each assimilation method. Direct radiance assimilation is optimal in this idealized context, while the traditional method of assimilating retrievals is suboptimal because it ignores the cross-covariances between background errors and retrieval errors. We show that interactive retrieval assimilation (where the same background used for assimilation is also used in the retrieval step) is equivalent to direct assimilation of radiances with suboptimal analysis weights. We illustrate and extend these theoretical arguments with several one-dimensional assimilation experiments, where we estimate vertical atmospheric profiles using simulated data from both the High-resolution InfraRed Sounder 2 (HIRS2) and the future Atmospheric InfraRed Sounder (AIRS).

Joiner, J.↗

Comparison of Mean Climate Trends in the Northern Hemisphere Between N.C.E.P. and Two Atmosphere-Ocean Model Forced Runs

Results are presented for two greenhouse gas experiments of the Goddard Institute for Space Studies Atmosphere-Ocean Model (AOM). The computed trends of surface pressure, surface temperature, 850, 500 and 200 mb geopotential heights and related temperatures of the model for the time frame 1960-2000 are compared to those obtained from the National Centers for Environmental Prediction observations. A spatial correlation analysis and mean value comparison are performed, showing good agreement. A brief general discussion about the statistics of trend detection is presented. The domain of interest is the Northern Hemisphere (NH) because of the higher reliability of both the model results and the observations. The accuracy that this AOM has in describing the observed regional and NH climate trends makes it reliable in forecasting future climate changes.

Lucarini, Valerio↗

Probability Index of Low Stratus and Fog at Dawn using Dual Geostationary Satellite Observations from COMS and FY-2D near the Korean Peninsula

We developed a new remote sensing method for detecting low stratus and fog (LSF) at dawn in terms of probability index (PI) of LSF from simultaneous stereo observations of two geostationary-orbit satellites; the Korean Communication, Ocean, and Meteorological Satellite (COMS; 128.2°E); and the Chinese FengYun satellite (FY-2D; 86.5°E). The algorithm was validated near the Korean Peninsula between the months of April and August from April 2012 to June 2015, by using surface observations at 45 meteorological stations in South Korea. The optical features of LSF were estimated by using satellite retrievals and simulated data from the radiative transfer model. The PI was calculated using the combination of three satellite-observed variables: 1) the reflectance at 0.67 μm (R(0.67)) from COMS, and 2) the FY-2D R(0.67) minus the COMS R(0.67) (△R(0.67)) and (3) the FY-2D-COMS difference in the brightness temperature difference between 3.7 and 11.0 μm (ΔBTD(3.7-11)). The three variables, adopted from the top three probability of detection (POD) scores for their fog detection thresholds: △R(0.67) (0.82) > ΔBTD(3.7-11) (0.73) > R(0.67) (0.70) > BTD(3.7-11) (0.51). The LSF PI for this algorithm was significantly better in the two case studies compared to that using COMS only (i.e., R(0.67) or BTD(3.7-11)), so that this improvement was due to △R(0.67) and ΔBTD(3.7-11). Overall, PI in the LSF spatial distribution has the merits of a high detection rate, a specific probability display, and a low rate of seasonality and variability in detection accuracy. Therefore, PI would be useful for monitoring LSF in near-real-time, and to further its forecast ability, using next-generation satellites.

fog↗

Jefferson County Ecological Conservation: Quantifying the Effects of Hydrologic Restoration in the Camas National Wildlife Refuge and Mud Lake Wildlife Management Area

Wetlands in the Camas National Wildlife Refuge and Mud Lake Wildlife Management Area, a rare landscape feature in the Intermountain West, are crucial for migratory birds along the Pacific Flyway, yet these wetlands have experienced a noticeable decline in extent and inundation over the last 40+ years. Partners at the U.S. Fish and Wildlife Service and Idaho Department of Fish and Game have ongoing restoration efforts that are yet to be quantified. To assist these partners, we used NASA Earth observations to quantify change in wetland extent and determine if the restoration projects met the intended impact. The QA_PIXEL band from Landsat 5 Thematic Mapper (TM) and Landsat 8 Operational Land Imager (OLI) was used to identify water. Landsat 8 OLI imagery was also used for classifying landcover in ArcGIS Pro for 2016 and 2020 and to forecast landcover in 2060 using TerrSet’s Land Change Modeler. We also compared lidar data from 2011 and 2019 to detect changes in vegetation height, ground elevation, and surface water levels, and Sentinel-2 Multispectral Instrument (MSI) imagery to detect changes in vegetation health. Classification results indicated overall accuracies over 84% and Kappa indices above 0.80, well surpassing random classification performance. From 2016 to 2020 our classifications showed an 825 acre increase in wetland extent, and our forecasted 2060 model showed a 2795 acre decrease. Combining our partners’ knowledge of the area with our analyses, we created a remote sensing workflow to enhance future monitoring and decision-making. This study demonstrated the feasibility of NASA Earth observations in quantifying wetlands, informing restoration projects, and supporting avian conservation.

Cassidy Bromka↗

Weather Intelligent Navigation Data and Models for Aviation Planning (WINDMAP)

WINDMAP addresses the emerging needs in the aviation community of providing real-time weather forecasting to improve the safety of low altitude aircraft operations. This is accomplished through the integration of real-time observations from autonomous systems, such as drones and urban air taxis, with numerical weather prediction models and flight management and safety systems. To solve this problem, several technical challenges have been identified. These include (1) developing autonomous UAS capable of conducting observations accurately and reliably; (2) determining the number and frequency of required observations and the sensitivity of these observations in data sparse regions of the lower atmosphere;(3) assimilating dense observational data into models in real-time with sufficient resolution and accuracy; (4) developing novel physics-based reduced order models capable of incorporating diverse data sets; and (5)integrating real-time forecasting into UTM and DAA (detect-and-avoid) architectures for path planning and navigation. The goal of this proposed effort is to demonstrate the value of using small UAS to collect measurements of the dynamic and thermodynamic properties of the lower atmosphere at scales that match or exceed the spatio-temporal resolution of today’s best numerical weather prediction models

Koushik Datta↗

A High-Performance Computing Predictive GNSS Performance Monitor for Autonomous Air Vehicles in Urban Environments

This report offers analysis and design insights for leveraging High-Performance Computing (HPC) to predict line-of-sight (LOS) Global Navigation Satellite System (GNSS) availability in a city. This work is motivated by the emerging fields of Advanced and Urban Air Mobility (AAM/UAM), where regulatory authorities are seeking city-scale, meter-resolution risk forecasting in order to safely integrate new flight missions with existing urban life and infrastructure. This work addresses the technical challenge of efficiently computing urban GNSS satellite visibility to predict GNSS performance metrics under these requirements. We present a new HPC-optimized shadow casting algorithm variant as a ray-based approach to forecasting satellite visibility. We apply this algorithm variant in a software-defined prognostic service which generates a GNSS navigation risk-correlated map as a path planning-style potential field. We detail dominant computational burdens, viable simplifying assumptions, and different algorithmic implementations, intending to demonstrate a baseline of computation time needed by each stage in such a service. We conclude by analyzing the prototype service’s prediction accuracy compared to receiver data from Corpus Christi, Texas. This informs design trade-offs along the dimensions of hardware, computation time, and tolerable forecasting error (including proportions of false positives and false negatives).

GNSS↗

Accurate Radiometry from Space: An Essential Tool for Climate Studies

The Earth s climate is undoubtedly changing; however, the time scale, consequences and causal attribution remain the subject of significant debate and uncertainty. Detection of subtle indicators from a background of natural variability requires measurements over a time base of decades. This places severe demands on the instrumentation used, requiring measurements of sufficient accuracy and sensitivity that can allow reliable judgements to be made decades apart. The International System of Units (SI) and the network of National Metrology Institutes were developed to address such requirements. However, ensuring and maintaining SI traceability of sufficient accuracy in instruments orbiting the Earth presents a significant new challenge to the metrology community. This paper highlights some key measurands and applications driving the uncertainty demand of the climate community in the solar reflective domain, e.g. solar irradiances and reflectances/radiances of the Earth. It discusses how meeting these uncertainties facilitate significant improvement in the forecasting abilities of climate models. After discussing the current state of the art, it describes a new satellite mission, called TRUTHS, which enables, for the first time, high-accuracy SI traceability to be established in orbit. The direct use of a primary standard and replication of the terrestrial traceability chain extends the SI into space, in effect realizing a metrology laboratory in space . Keywords: climate change; Earth observation; satellites; radiometry; solar irradiance

Fox, Nigel↗

Operational applications of NOAA-VHRR imagery in Alaska

Near-real time operational applications of NOAA satellite enhanced thermal infrared imagery to snow monitoring for river flood forecasts, and a photographic overlay technique of imagery to enhance snowcover are presented. Ground truth comparisons show a thermal accuracy of approximately + or - 1 C for detection of surface radiative temperatures. The application of NOAA imagery to flood mapping is also presented.

Seifert, R. D.↗

Inter-Comparison of CHARM Data and WSR-88D Storm Integrated Rainfall

A localized precipitation network has been established over a 4000 sq km region of northern Alabama in support of local weather and climate research at the Global Hydrology and Climate Center (GHCC) in Huntsville. This Cooperative Huntsville-Area Rainfall Measurement (CHARM) network is comprised of over 80 volunteers who manually take daily rainfall measurements from 85 sites. The network also incorporates 20 automated gauges that report data at 1-5 minute intervals on a 24 h a day basis. The average spacing of the gauges in the network is about 6 kin, however coverage in some regions benefit from gauges every 1-2 km. The 24 h rainfall totals from the CHARM network have been used to validate Stage III rainfall estimates of daily and storm totals derived from the WSR-88D radars that cover northern Alabama. The Stage III rainfall product is produced by the Lower Mississippi River Forecast Center (LMRFC) in support of their daily forecast operations. The intercomparisons between the local rain gauge and the radar estimates have been useful to understand the accuracy and utility of the Stage III data. Recently, the Stage III and CHARM rainfall measurements have been combined to produce an hourly rainfall dataset at each CHARM observation site. The procedure matches each CHARM site with a time sequence of Stage III radar estimates of precipitation. Hourly stage III rainfall estimates were used to partition the rain gauge values to the time interval over which they occurred. The new hourly rain gauge dataset is validated at selected points where 1-5 minute rainfall measurements have been made. This procedure greatly enhances the utility of the CHARM data for local weather and hydrologic modeling studies. The conference paper will present highlights of the Stage III intercomparison and some examples of the combined radar / rain gauge product demonstrating its accuracy and utility in deriving an hourly rainfall product from the 24 h CHARM totals.

Jedlovec, Gary J.↗

Capitol Reef Ecological Conservation: Mapping Vegetation Functional Groups to Inform Invasive Vegetation Management, Ecological Conservation and Restoration in Capitol Reef National Park

Invasive exotic plant (IEP) species have been found within the park boundaries of Capitol Reef National Park (CARE) in Utah. Currently, remotely sensed datasets such as the Rangeland Analysis Platform (RAP) from the United States Department of Agriculture (USDA) have been used to investigate IEP species within the park, but validation of the national RAP program is necessary for informing decisions at a local scale. CARE seeks a remote monitoring solution that can precisely target managerial efforts within the park’s challenging terrain and hard-to-reach locations. To fulfill this objective, we harnessed Landsat 8 Operational Land Imager (OLI) imagery and leveraged Random Forest (RF) modeling to generate classification maps characterizing vegetation functional groups for 2013 and 2022 within the park. Subsequently, the Land Change Modeler (LCM) in Idrisi TerrSet facilitated the production of a predicted classification map for 2033. The team also devised an annual grass probability map to accentuate areas impacted by exotic grasses. A comparative assessment between the RF classification map and the RAP map for 2022 revealed an overall agreement of 47.41%, with disparities primarily arising from differences in bare soil and shrub areas. Significantly, the 2022 RF-generated classification map showcased an impressive overall accuracy of 92.17%. In short, the probability map, the land cover change detection spanning 2013 to 2022, and the forecasting of observed trends into the future aids in the evaluation of invasive plant impacts and facilitation of CARE’s preparedness for potential ecological disturbances. Notably, in comparison to the RAP, the RF classification method generates functional group maps that are more representative of the study area.

Vanchy Li↗

Space-based Doppler lidar sampling strategies: Algorithm development and simulated observation experiments

Lidar Atmospheric Wind Sounder (LAWS) Simulation Models (LSM) were developed to evaluate the potential impact of global wind observations on the basic understanding of the Earth's atmosphere and on the predictive skills of current forecast models (GCM and regional scale). Fully integrated top to bottom LAWS Simulation Models for global and regional scale simulations were developed. The algorithm development incorporated the effects of aerosols, water vapor, clouds, terrain, and atmospheric turbulence into the models. Other additions include a new satellite orbiter, signal processor, line of sight uncertainty model, new Multi-Paired Algorithm and wind error analysis code. An atmospheric wind field library containing control fields, meteorological fields, phenomena fields, and new European Center for Medium Range Weather Forecasting (ECMWF) data was also added. The LSM was used to address some key LAWS issues and trades such as accuracy and interpretation of LAWS information, data density, signal strength, cloud obscuration, and temporal data resolution.

Emmitt, G. D.↗

Implementation of a state of the art automated system for the production of cloud/water vapor motion winds from geostationary satellites

The thrust of the proposed effort under this contract is aimed at improving techniques to track water vapor data in sequences of imagery from geostationary satellites. In regards to this task, significant testing, evaluation, and progress was accomplished during this period. Sets of winds derived from Meteosat data were routinely produced during Atlantic hurricane events in the 1993 season. These wind sets were delivered via Internet in real time to the Hurricane Research Division in Miami for their evaluation in a track forecast model. For eighteen cases in which 72-hour forecasts were produced, thirteen resulted in track forecast improvements (some quite significant). In addition, quality-controlled Meteosat water vapor winds produced by NESDIS were validated against rawinsondes, yielding an 8 m/s RMS. This figure is comparable to upper-level cloud drift wind accuracies. Given the complementary horizontal coverage in cloud-free areas, we believe that water vapor vectors can supplement cloud-drift wind information to provide good full-disk coverage of the upper tropospheric flow. The impact of these winds on numerical analysis and forecasts will be tested in the next reporting period.

Velden, Christopher S.↗