Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

UNCERTAINTY IN THE GLOBAL FORECAST SYSTEM

We validated one year of Global Forecast System (GFS) predictions of surface meteorological variables (wind speed, air temperature, dewpoint temperature, air pressure) over the entire planet for forecasts extending from zero hours into the future (an analysis) to 36 hours. Approximately 12,000 surface stations world-wide were included in this analysis. Root-Mean-Square- Errors (RMSE) increased as the forecast period increased from zero to 36 hours, but the initial RMSE were almost as large as the 36 hour forecast RMSE for all variables. Typical RMSE were 3 C for air temperature, 2-3mb for sea-level pressure, 3.5 C for dewpoint temperature and 2.5 m/s for wind speed. Approximately 20-40% of the GFS errors can be attributed to a lack of resolution of local features. We attribute the large initial RMSE for the zero hour forecasts to the inability of the GFS to resolve local terrain features that often dominate local weather conditions, e.g., mountain- valley circulations and sea and land breezes. Since the horizontal resolution of the GFS (about 1{sup o} of latitude and longitude) prevents it from simulating these locally-driven circulations, its performance will not improve until model resolution increases by a factor of 10 or more (from about 100 km to less than 10 km). Since this will not happen in the near future, an alternative for the near term to improve surface weather analyses and predictions for specific points in space and time would be implementation of a high-resolution, limited-area mesoscale atmospheric prediction model in regions of interest.

54 ENVIRONMENTAL SCIENCES↗

Use of three-cornered hat error estimates in MERRA-2 to guide an improved reanalysis-Part 1

The three-cornered hat (3CH) method estimates the uncertainties of three different co-located model or observational data sets (Anthes and Rieckh, 2018; Sjoberg et al., 2021). Rieckh et al. (2021) used the 3CH method to compare the random error statistics of different global forecast and reanalysis models, as well as radio occultation (RO) and radiosonde observations. That study showed that the MERRA-2 reanalysis, while having smaller errors in the stratosphere than its predecessor MERRA, had larger errors in the troposphere than many of the other data sets analyzed. The MERRA-2 errors were particularly large in the tropics. In a collaborative effort between UCAR’s COSMIC (Constellation Observing System for Meteorology, Ionosphere and Meteorology) program and NASA’s Global Modeling and Assimilation Office (GMAO), we carried out further 3CH error diagnostics to help isolate the causes of these larger errors and help guide the development of an improved reanalysis. This presentation summarizes random error statistics associated with MERRA-2, ECMWF’s ERA5 reanalysis, and COSMIC-2 (C2) RO observations. We compute 3CH error variance estimates of refractivity, as well as temperature and specific humidity using UCAR’s COSMIC Data Analysis and Archive Center (CDAAC) improved 1D-variational (1D-Var) retrieval (wetPf2) over 15 latitude bands from 45S to 45N. The 1D-Var retrievals of specific humidity and temperature for C2 use NCEP’s Global Forecast System (GFS) as the background. Anthes et al. (2021) showed that it gives accurate estimates of temperature and specific humidity in the tropics and subtropics, even in the challenging environment of intense Hurricane Dorian (2019). This presentation confirms the previous results that MERRA-2 has significantly larger errors in the tropics and subtropics than either C2 or ERA5. Its errors are larger between 30S and 30N compared to 30-45 N-S latitudes, and are also larger over land compared to oceans. Most of the MERRA-2 refractivity errors come from specific humidity, except over land below 3 km where temperature errors are large. These results suggest that moist convection and atmospheric boundary layer physics in MERRA-2 may be responsible for a significant part of the higher uncertainties. These results are being used to guide GMAO in developing an improved next-generation reanalysis, as shown in a companion presentation submitted to this conference (El Akkraoui et al., 2021), which extends this study and describes improvements to MERRA-2 leading to the next GMAO reanalysis.

Jeremiah Sjoberg↗

Analysis of operator splitting errors for near-limit flame simulations

High-fidelity simulations of ignition, extinction and oscillatory combustion processes are of practical interest in a broad range of combustion applications. Splitting schemes, widely employed in reactive flow simulations, could fail for stiff reaction–diffusion systems exhibiting near-limit flame phenomena. The present work first employs a model perfectly stirred reactor (PSR) problem with an Arrhenius reaction term and a linear mixing term to study the effects of splitting errors on the near-limit combustion phenomena. Analysis shows that the errors induced by decoupling of the fractional steps may result in unphysical extinction or ignition. The analysis is then extended to the prediction of ignition, extinction and oscillatory combustion in unsteady PSRs of various fuel/air mixtures with a 9-species detailed mechanism for hydrogen oxidation and an 88-species skeletal mechanism for n-heptane oxidation, together with a Jacobian-based analysis for the time scales. The tested schemes include the Strang splitting, the balanced splitting, and a newly developed semi-implicit midpoint method. Results show that the semi-implicit midpoint method can accurately reproduce the dynamics of the near-limit flame phenomena and it is second-order accurate over a wide range of time step size. For the extinction and ignition processes, both the balanced splitting and midpoint method can yield accurate predictions, whereas the Strang splitting can lead to significant shifts on the ignition/extinction processes or even unphysical results. With an enriched H radical source in the inflow stream, a delay of the ignition process and the deviation on the equilibrium temperature are observed for the Strang splitting. On the contrary, the midpoint method that solves reaction and diffusion together matches the fully implicit accurate solution. The balanced splitting predicts the temperature rise correctly but with an over-predicted peak. For the sustainable and decaying oscillatory combustion from cool flames, both the Strang splitting and the midpoint method can successfully capture the dynamic behavior, whereas the balanced splitting scheme results in significant errors.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Modeling injection-induced fault slip using long short-term memory networks

Stress changes due to changes in fluid pressure and temperature in a faulted formation may lead to the opening/shearing of the fault. This can be due to subsurface (geo)engineering activities such as fluid injections and geologic disposal of nuclear waste. Such activities are expected to rise in the future making it necessary to assess their short- and long-term safety. Here, a new machine learning (ML) approach to model pore pressure and fault displacements in response to high-pressure fluid injection cycles is developed. The focus is on fault behavior near the injection borehole. To capture the temporal dependencies in the data, long short-term memory (LSTM) networks are utilized. To prevent error accumulation within the forecast window, four critical measures to train a robust LSTM model for predicting fault response are highlighted: (i) setting an appropriate value of LSTM lag, (ii) calibrating the LSTM cell dimension, (iii) learning rate reduction during weight optimization, and (iv) not adopting an independent injection cycle as a validation set. Several numerical experiments were conducted, which demonstrated that the ML model can capture peaks in pressure and associated fault displacement that accompany an increase in fluid injection. The model also captured the decay in pressure and displacement during the injection shut-in period. Further, the ability of an ML model to highlight key changes in fault hydromechanical activation processes was investigated, which shows that ML can be used to monitor risk of fault activation and leakage during high pressure fluid injections.

58 GEOSCIENCES↗

The potential of different artificial neural network (ANN) techniques in daily global solar radiation modeling based on meteorological data

The main objective of present study is to predict daily global solar radiation (GSR) on a horizontal surface, based on meteorological variables, using different artificial neural network (ANN) techniques. Daily mean air temperature, relative humidity, sunshine hours, evaporation, and wind speed values between 2002 and 2006 for Dezful city in Iran (32 16'N, 48 25'E), are used in this study. In order to consider the effect of each meteorological variable on daily GSR prediction, six following combinations of input variables are considered: (I)Day of the year, daily mean air temperature and relative humidity as inputs and daily GSR as output. (II)Day of the year, daily mean air temperature and sunshine hours as inputs and daily GSR as output. (III)Day of the year, daily mean air temperature, relative humidity and sunshine hours as inputs and daily GSR as output. (IV)Day of the year, daily mean air temperature, relative humidity, sunshine hours and evaporation as inputs and daily GSR as output. (V)Day of the year, daily mean air temperature, relative humidity, sunshine hours and wind speed as inputs and daily GSR as output. (VI)Day of the year, daily mean air temperature, relative humidity, sunshine hours, evaporation and wind speed as inputs and daily GSR as output. Multi-layer perceptron (MLP) and radial basis function (RBF) neural networks are applied for daily GSR modeling based on six proposed combinations. The measured data between 2002 and 2005 are used to train the neural networks while the data for 214 days from 2006 are used as testing data. The comparison of obtained results from ANNs and different conventional GSR prediction (CGSRP) models shows very good improvements (i.e. the predicted values of best ANN model (MLP-V) has a mean absolute percentage error (MAPE) about 5.21% versus 10.02% for best CGSRP model (CGSRP 5)). (author)

14 SOLAR ENERGY↗

Assimilation of satellite images into a sediment transport model of Lake Michigan.

In this paper we develop and examine several schemes for combining daily images obtained from the Sea-viewing Wide Field Spectrometer (SeaWiFS) with a two-dimensional sediment transport model of Lake Michigan. We consider two data assimilation methods, direct insertion and a kriging-based approach, and perform a forecasting study focused on a 2-month period in spring 1998 when a large storm caused substantial amounts of sediment resuspension and horizontal sediment transport in the lake. By beginning with the simplest possible forecast method and sequentially adding complexity we are able to assess the improvements offered by combining the satellite data with the numerical model. In our application, we find that data assimilation schemes that include both the data and the lake dynamics improve forecast root mean square error by 40% over purely model-based approaches and by 20% over purely data-based approaches.

54 ENVIRONMENTAL SCIENCES↗

Stochastic modelling of intermittent fluctuations in the scrape-off layer: Correlations, distributions, level crossings, and moment estimation

A stochastic model is presented for intermittent fluctuations in the scrape-off layer of magnetically confined plasmas. The fluctuations in the plasma density are modeled by a super-position of uncorrelated pulses with fixed shape and duration, describing radial motion of blob-like structures. In the case of an exponential pulse shape and exponentially distributed pulse amplitudes, predictions are given for the lowest order moments, probability density function, auto-correlation function, level crossings, and average times for periods spent above and below a given threshold level. Also, the mean squared errors on estimators of sample mean and variance for realizations of the process by finite time series are obtained. These results are discussed in the context of single-point measurements of fluctuations in the scrape-off layer, broad density profiles, and implications for plasma–wall interactions due to the transient transport events in fusion grade plasmas. The results may also have wide applications for modelling fluctuations in other magnetized plasmas such as basic laboratory experiments and ionospheric irregularities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

BINARY FREQUENCIES IN A SAMPLE OF GLOBULAR CLUSTERS. I. METHODOLOGY AND INITIAL RESULTS

Binary stars are thought to be a controlling factor in globular cluster evolution, since they can heat the environmental stars by converting their binding energy to kinetic energy during dynamical interactions. Through such interaction, the binaries determine the time until core collapse. To test predictions of this model, we have determined binary fractions for 35 clusters. Here we present our methodology with a representative globular cluster NGC 4590. We use Hubble Space Telescope archival Advanced Camera for Surveys data in the F606W and F814W bands and apply point-spread-function-fitting photometry to obtain high quality color-magnitude diagrams. We formulate the star superposition effect as a Poisson probability distribution function, with parameters optimized through Monte Carlo simulations. A model-independent binary fraction of (6.2 {+-} 0.3)% is obtained by counting stars that extend to the red side of the residual color distribution after accounting for the photometric errors and the star superposition effect. A model-dependent binary fraction is obtained by constructing models with a known binary fraction and an assumed binary mass-ratio distribution function. This leads to a binary fraction range of 6.8%-10.8%, depending on the assumed shape to the binary mass-ratio distribution, with the best fit occurring for a binary distribution that favors low mass ratios (and higher binary fractions). We also represent the method for radial analysis of the binary fraction in the representative case of NGC 6981, which shows a decreasing trend for the binary fraction toward the outside, consistent with theoretical predictions for the dynamical effect on the binary fraction.

79 ASTRONOMY AND ASTROPHYSICS↗

GAPS IN THE GD-1 STAR STREAM

GD-1 is a long, thin, Milky Way star stream that has readily visible density variations along its length. We quantify the locations, sizes, and statistical significance of the density structure, i.e., gaps, using a set of scaled filters. The shapes of the filters are based on the gaps that develop in simulations of dark matter sub-halos crossing a star stream. The high Galactic latitude 8.4 kpc long segment of GD-1 that we examine has 8 {+-} 3 gaps of 99% significance or greater, with the error estimated on the basis of tests of the gap-filtering technique. The cumulative distribution of gaps more than three times the width of the stream is in good agreement with predictions for dark matter sub-halo encounters with cold star streams. The number of gaps narrower than three times the width of the GD-1 stream falls well below the cold stream prediction which is taken into account for the gap creation rate integrated over all sizes. Simple warm stream simulations scaled to GD-1 show that the falloff in gaps is expected for sub-halos below a mass of 10{sup 6} M{sub Sun }. The GD-1 gaps requires 100 sub-halos >10{sup 6} M{sub Sun} within 30 kpc, the apocenter of GD-1 orbit. These results are consistent with LCDM sub-halo predictions but further improvements in stream signal-to-noise and gap modeling will be welcome.

79 ASTRONOMY AND ASTROPHYSICS↗

NOVA AQUILAE 1918 (V603 Aql) FADED BY 0.44 MAG PER CENTURY FROM 1938 TO 2013

We present the light curve of the old nova V603 Aql (Nova Aql 1918) from 1898-1918 and 1934-2013 using 22,721 archival magnitudes. All of our magnitudes are either in, or accurately transformed into, the Johnson B and V magnitude systems. This is vital because offsets in old sequences and the visual-to-V transformation can cause errors of 0.1-1.0 mag if not corrected. Our V603 Aql light curve is the first time that this has been done for any nova. Our goal was to see the evolution of the mass accretion rate on a century timescale, and to test the long-standing prediction of the Hibernation model that old novae should be fading significantly in the century after their eruption is over. The 1918 nova eruption was completely finished by 1938 when the nova decline stopped, and when the star had faded to fainter than its pre-nova brightness of B = 11.43 ± 0.03 mag. We find that the nova light from 1938 to 2013 was significantly fading, with this being seen consistently in three independent data sets (the Sonneberg plates in B, the American Association of Variable Star Observers (AAVSO) V light curve, and the non-AAVSO V light curve). We find that V603 Aql has been declining in brightness at an average rate of 0.44 ± 0.04 mag per century since 1938. This work provides remarkable confirmation of an important prediction of the Hibernation model.

79 ASTRONOMY AND ASTROPHYSICS↗

Improving nuclear mass predictions through the Garvey-Kelson relations

We describe a procedure to improve the nuclear mass predictions obtained by means of the Garvey-Kelson iterative process. This is achieved by reducing the degrees of freedom involved in the process, expressing the Garvey-Kelson relations in terms of one-neutron and one-proton separation energies, and using a theoretical estimation for them. This approach has the effect that the intrinsic error associated with the iterative process grows significantly more slowly. This leads to a better quality of nuclear mass predictions and therefore extends the range for which the predictions are accurate. We test these ideas using different mass models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

TU-C-17A-10: Patient Features Based Dosimetric Pareto Front Prediction In Esophagus Cancer Radiotherapy

Purpose: The purpose of this study is to study the feasibility of the dosimetric pareto front (PF) prediction based on patient anatomic and dosimetric parameters for esophagus cancer patients. Methods: Sixty esophagus patients in our institution were enrolled in this study. A total 2920 IMRT plans were created to generated PF for each patient. On average, each patient had 48 plans. The anatomic and dosimetric features were extracted from those plans. The mean lung dose (MLD), mean heart dose (MHD), spinal cord max dose and PTV homogeneous index (PTVHI) were recorded for each plan. The principal component analysis (PCA) was used to extract overlap volume histogram (OVH) features between PTV and other critical organs. The full dataset was separated into two parts include the training dataset and the validation dataset. The prediction outcomes were the MHD and MLD for the current study. The spearman rank correlation coefficient was used to evaluate the correlation between the anatomical features and dosimetric features. The PF was fit by the the stepwise multiple regression method. The cross-validation method was used to evaluation the model. Results: The mean prediction error of the MHD was 465 cGy with 100 repetitions. The most correlated factors were the first principal components of the OVH between heart and PTV, and the overlap between heart and PTV in Z-axis. The mean prediction error of the MLD was 195 cGy. The most correlated factors were the first principal components of the OVH between lung and PTV, and the overlap between lung and PTV in Z-axis. Conclusion: It is feasible to use patients anatomic and dosimetric features to generate a predicted PF. Additional samples and further studies were required to get a better prediction model.

60 APPLIED LIFE SCIENCES↗

Optimal Control of a Surge-Mode WEC in Random Waves

The objective of this project was to develop one or more real-time feedback and feed-forward (MPC) control algorithms for an Oscillating Surge Wave Converter (OSWC) developed by RME called SurgeWEC™ that leverages recent innovations in wave energy converter (WEC) control theory to maximize power production in random wave environments. The control algorithms synthesized innovations in dynamic programming and nonlinear wave dynamics using anticipatory wave sensors and localized sensor measurements; e.g. position and velocity of the WEC Power Take Off (PTO), with predictive wave forecasting data. The result was an advanced control system that uses feedback or feed-forward data from an array of sensor channels comprised of both localized and deployed sensors fused into a single decision process that optimally compensates for uncertainties in the system dynamics, wave forecasts, and sensor measurement errors.

16 TIDAL AND WAVE POWER↗

A Study on Modeled Wind Speed Errors Using the U.S. Department of Energy Buoys

Pacific Northwest National Laboratory (PNNL) operates two AXYS WindSentinel lidar buoys for the U.S. Department of Energy’s Wind Energy Technologies Office. The purpose of these buoys is to collect hub-height winds and supporting meteorological and oceanographic information to facilitate the development of wind energy in the U.S. waters. The first deployment for one buoy was off the coast of Virginia from December 2014 to May 2016, and the first deployment for the other buoy was off the coast of New Jersey from November 2015 until February 2017. This report describes recent analysis of data collected during these first two deployments. Specifically, we compare hub-height wind speed estimates using Monin-Obukhov Similarity Theory (MOST) to the lidar measurements, and examine how those errors are affected by wind direction, atmospheric stability, wind-wave direction differences, and various measures of the wave-state. The comparisons are done using standard similarity functions based on MOST; including the Businger - Dyer, the Beljaars & Holtslag and the Vickers & Mahrt similarity functions. All models produce large errors over the range of atmospheric stabilities that were observed, with the largest errors occurring for stable flows. The Vickers & Mahrt function resulted in the largest overall bias and standard deviation, while Beljaars & Holtslag function gave the smallest bias and standard deviation due to its better performance under stable conditions. The models perform best under unstable conditions, but even in this regime there is a consistent overestimation of the wind speed of between roughly 0 to 1 ms -1 compared to the lidar measurements. We identify specific metocean conditions (i.e. stability and wind and wave directions) at each of the deployment locations that lead to large errors in MOST predictions. Finally, a coupled ocean-atmosphere model framework was investigated to simulate large errors in weather research forecasting (WRF).

17 WIND ENERGY↗

Accurate Fault Prediction of BlueGene/P RAS Logs Via Geometric Reduction

The authors are building two algorithms for fault prediction using raw system-log data. This work is preliminary, and has only been applied to a limited dataset, however the results seem promising. The conclusions are that: (1) obtaining useful data from RAS-logs is challenging; (2) extracting concentrated information improves efficiency and accuracy; and (3) function evaluation algorithms are fast and lend well to scaling.

97 MATHEMATICS AND COMPUTING↗

The effect of increased horizontal resolution on GLA Fourth Order model forecasts

A benchmark series of ten-day weather forecasts has been run with the GLA Fourth Order GCM with both a 4 deg latitude by 5 deg longitude resolution and a 2 deg latitude by 2.5 deg longitude resolution. Ensemble statistics of forecast skill and maps of systematic error fields have been generated for both resolutions. The enhanced resolution added 24 hours of useful predictive skill to the sea level pressure forecasts and 6 hours to the 500 mb height forecasts, but 5 to 6 days into the forecasts the advantage of the finer resolution was lost. The systematic error fields showed that by 8 days the 'climate drift' of the 2 x 2.5 deg forecasts had become pronounced and had caused the loss of predictive skill relative to the 4 x 5 deg forecasts. Additional results indicate that a gravity wave drag parameterization scheme might alleviate the climate drift problem.

Helfand, H. M.↗

Evaluation and use of TOVS retrievals at NMC

In a current analysis procedure at the National Meteorological Center (NMC), a first guess analysis (from the latest 6 or 12 hour forecast) is updated by new data. In the newest analysis procedures, which are based on optimum interpolation, the observational correction depends on the size of preassigned, expected observational errors versus the size of expected errors in the first guess forecast. In the case of Northern Hemisphere ocean temperatures, the latter are around 2 degrees. The infrared satellite retrievals have a similar size "error". If (as assumed) their errors are uncorrelated with the first guess error, they will improve the analysis. The larger errors of the microwave retrievals, however, mean that they will be given little weight in the analysis. An evaluation of the TIROS-N retrievals is currently underway at NMC to determine the impact of satellite derived data within operational analysis schemes, to isolate possible problems within current retrieval methods, and to offer possible solutions for these problems.

Phillips, N. A.↗