Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Matching Observations to Model Resolution for Future Weather and Climate Applications

High spatial resolution sounding observations will improve initialization and assimilation into the next generation forecast models and validation of the next generation of climate models. One such advanced sounder concept for low earth orbit is the Advanced Remote-sensing Imaging Emission Spectrometer (ARIES) which proposes to provide highvspatial hyperspectral resolution observations in the mid to longwave infrared. This paper explores the effects of spatial resolution on the errors expected from the combined use of models and observations for representing scene information. We calculate the frequency response of the instrument and model and determine the error at any given spatial frequency. The results show that it is vital to have observations match the spatial resolution of models to minimize the uncertainty in the representation of the scene contents.

spatial resolution↗

Grid Resolution Study over Operability Space for a Mach 1.7 Low Boom External Compression Inlet

This paper presents a statistical methodology whereby the probability limits associated with CFD grid resolution of inlet flow analysis can be determined which provide quantitative information on the distribution of that error over the specified operability range. The objectives of this investigation is to quantify the effects of both random (accuracy) and systemic (biasing) errors associated with grid resolution in the analysis of the Lockheed Martin Company (LMCO) N+2 Low Boom external compression supersonic inlet. The study covers the entire operability space as defined previously by the High Speed Civil Transport (HSCT) High Speed Research (HSR) program goals. The probability limits in terms of a 95.0% confidence interval on the analysis data were evaluated for four ARP1420 inlet metrics, namely (1) total pressure recovery (PFAIP), (2) radial hub distortion (DPH/P), (3) ) radial tip distortion (DPT/P), and (4) ) circumferential distortion (DPC/P). In general, the resulting +/-0.95 delta Y interval was unacceptably large in comparison to the stated goals of the HSCT program. Therefore, the conclusion was reached that the "standard grid" size was insufficient for this type of analysis. However, in examining the statistical data, it was determined that the CFD analysis results at the outer fringes of the operability space were the determining factor in the measure of statistical uncertainty. Adequate grids are grids that are free of biasing (systemic) errors and exhibit low random (precision) errors in comparison to their operability goals. In order to be 100% certain that the operability goals have indeed been achieved for each of the inlet metrics, the Y+/-0.95 delta Y limit must fall inside the stated operability goals. For example, if the operability goal for DPC/P circumferential distortion is ≤0.06, then the forecast Y for DPC/P plus the 95% confidence interval on DPC/P, i.e. +/-0.95 delta Y, must all be less than or equal to 0.06.

Grid↗

Quantifying the benefits of improved satellite remote-sensing observations for inverse modeling of NOx and NMVOC emissions

This study aims to demonstrate the benefits of using novel high spatiotemporal retrieval products from newer satellites for top-down emission estimates of nitrogen oxides (NO x ) and non-methane volatile organic compounds (NMVOCs) for the summer of 2019 over the contiguous United States. Recent satellite retrievals have not only advanced spatiotemporal resolution but also greatly reduced error and uncertainty due to reduced noise in the retrievals compared to spaceborne sensors launched in the past. We applied inverse modeling techniques using tropospheric nitrogen dioxide (NO 2 ) and formaldehyde (H-CHO) column retrieval products from the Ozone Monitoring Instrument (OMI) and TROPOspheric Monitoring Instrument (TROPOMI) in conjunction with the Weather Research Forecast and Community Multiscale Air Quality Modeling system (WRF-CMAQ). In order to provide a better representation of background chemical composition and avoid misalignment of emission adjustment, we applied monthly scaling factors for ozone (O 3 ) and CO boundary concentrations in addition to the inclusion of lightning and aviation emissions. Satellite-constrained NO x and NMVOCs posterior emissions showed a mitigated discrepancy between observed and modeled columns. The improvement in the model performance was greater when using TROPOMI, primarily benefiting from reduced errors/biases of the satellite retrievals that enabled us to explore corresponding changes in O 3 concentrations and production sensitivity regimes using the ratio of H-CHO and NO 2 .

remote sensing↗

Complex Biological Event Extraction from Full Text using Signatures of Linguistic and Semantic Features

Building on technical advances from the BioNLP 2009 Shared Task Challenge, the 2011 challenge sets forth to generalize techniques to other complex biological event extraction tasks. In this paper, we present the implementation and evaluation of a signature-based machine-learning technique to predict events from full texts of infectious disease documents. Specifically, our approach uses novel signatures composed of traditional linguistic features and semantic knowledge to predict event triggers and their candidate arguments. Using a leave-one out analysis, we report the contribution of linguistic and shallow semantic features in the trigger prediction and candidate argument extraction. Lastly, we examine evaluations and posit causes for errors of infectious disease track subtasks.

59 BASIC BIOLOGICAL SCIENCES↗

Influences of Cloud Microphysics on the Components of Solar Irradiance in the WRF-Solar Model

An accurate forecast of Global Horizontal solar Irradiance (GHI) and Direct Normal Irradiance (DNI) in cloudy conditions remains a major challenge in the solar energy industry. This study focuses on the impact of cloud microphysics on GHI and its partition into DNI and Diffuse Horizontal Irradiance (DHI) using the Weather Research and Forecasting model specifically designed for solar radiation applications (WRF-Solar) and seven microphysical schemes. Three stratocumulus (Sc) and five shallow cumulus (Cu) cases are simulated and evaluated against measurements at the US Department of Energy’s Atmospheric Radiation Measurement (ARM) user facility, Southern Great Plains (SGP) site. Results show that different microphysical schemes lead to spreads in simulated solar irradiance components up to 75% and 350% from their ensemble means in the Cu and Sc cases, respectively. The Cu cases have smaller microphysical sensitivity due to a limited cloud fraction and smaller domain-averaged cloud water mixing ratio compared to Sc cases. Cloud properties also influence the partition of GHI into DNI and DHI, and the model simulates better GHI than DNI and DHI due to a non-physical error compensation between DNI and DHI. The microphysical schemes that produce more accurate liquid water paths and effective radii of cloud droplets have a better overall performance.

54 ENVIRONMENTAL SCIENCES↗

Calibration of urban building energy model using smart meter data for district peak load prediction

Urban building energy modeling (UBEM) is a powerful approach to assessing baseline building energy performance and retrofits with new technologies across building stocks in cities. However, the accuracy of UBEM is often constrained by the limited availability of reliable data about building characteristics and operations, such as envelope efficiency levels, HVAC system performance, and end-use load patterns. Existing research has performed UBEM calibration using annual or monthly energy consumption data, which falls short when higher-resolution time series applications are needed, such as peak load prediction for utility operation planning. This study presents a new framework for calibrating building energy models at urban scale using smart meter data, targeting the accurate prediction of summer peak electricity loads to support robust grid planning. The framework first integrates various data sources to enhance baseline input assumptions for building models, and then calibrates the baseline models through a pattern-matching approach. A case study using CityBES and two years of AMI data from over 9000 residential customers in Portland, Oregon, demonstrated the workflow and its effectiveness. The calibrated models achieved a daily peak load mean absolute percentage error of 2.6 % during the heatwave in the calibration year, and 2.0 % in the validation year using another year of AMI data. Using the calibrated models, we analyzed the demand flexibility potential of the district building stock as an application of UBEM calibration. The findings affirm the appropriate use of UBEM for peak electric load forecasting and demand side management at the utility distribution system level.

AMI data↗

Wind and Weather Variability within the Californian Offshore Wind Energy Areas

Weather variability over the Northeast Pacific (NEP) region and its influence on wind resources within the Californian offshore wind energy areas (WEAs) at Humboldt and Morro Bay are characterized using 20-years reanalysis model and satellite data. The hub-height (180 m) winds at both locations are predominantly northwesterly driven by the NEP high pressure system, with strong coastal gradients in surface pressure, fluxes, planetary boundary layer (PBL) depths and cloudiness. These sharp coastal gradients and strong annual cycles of temperature and moisture advections pose potential challenges in accurately modeling the local wind resource. Hub-height wind speeds and power capacity factors significantly vary for different regimes of PBL depths, surface fluxes and rain area fractions. This highlights the importance of studying the physical mechanisms driving these weather regimes, hence our analysis of how large-scale NEP weather variability drives the local meteorology at the WEAs. Furthermore, at both WEAs, PBL tops and cloud boundaries intersect the rotor layer (80-280 m) more than 30% and 20% of the time, respectively. While PBL depths significantly modulates hub-height winds and power, cloud boundaries do not have a similar impact, likely due to reanalysis errors in simulating cloud boundaries accurately. These findings underscore the challenges in deploying tall wind turbines in shallow cloudy boundary layers, where the interaction between clouds, precipitation, and atmospheric layers can impact turbine efficiency. As turbines grow taller and are deployed in more complex meteorological conditions, understanding these interactions is crucial for improving wind power forecasting and optimizing energy production in coastal regions.

17 WIND ENERGY↗

Simulation of wind and solar energy generation over California with E3SM SCREAM regionally refined models at 3.25 km and 800 m resolutions

This study presents wind and solar power generation estimates derived from the US Department of Energy’s Simple Cloud-Resolving E3SM Atmosphere Model (SCREAM) Regionally Refined Models (RRM) over California at 3.25 km and 800 m horizontal resolutions, using the Python wrapper for the System Advisor Model (PySAM). The resulting wind and solar generation estimates are compared to monthly capacity factors reported to the Energy Information Administration (EIA), High-Resolution Rapid Refresh (HRRR, 3 km resolution) forecast model, and E3SM North American regionally refined model (NARRM, 25 km resolution). We systematically assess the impacts of generation modeling assumptions, meteorological models, and horizontal resolution. Results show that resolution plays a dominant role for wind energy: increasing from 25 to 3.25 km brings qualitative and quantitative improvements, most notably by resolving the phase error in the seasonal cycle found in coarser simulations. However, further refinement to 800 m offers minimal gains. SCREAM performs better than HRRR for solar power generation in single- and dual-axis tracking systems, likely due to more accurate surface radiation. The sensitivity of PySAM to system configuration, particularly for axis-tracking modeling in photovoltaics, is also highlighted. Overall, SCREAM-RRM shows strong potential for high-resolution energy assessments, with future progress depending on more in situ observations and clearer quantification of uncertainties in generation modeling.

Geosciences↗

Unstructured Grid Adaptation: Status, Potential Impacts, and Recommended Investments Toward CFD Vision 2030

Unstructured grid adaptation is a powerful tool to control discretization error for Computational Fluid Dynamics (CFD). It has enabled key increases in the accuracy, automation, and capacity of some fluid simulation applications. Slotnick et al. provides a number of case studies in the CFD Vision 2030 Study: A Path to Revolutionary Computational Aerosciences to illustrate the current state of CFD capability and capacity. The authors forecast the potential impact of emerging High Performance Computing (HPC) environments forecast in the year 2030 and identify that mesh generation and adaptivity continue to be significant bottlenecks in the CFD work flow. These bottlenecks may persist because very little government investment has been targeted in these areas. To motivate investment, the impacts of improved grid adaptation technologies are identified. The CFD Vision 2030 Study roadmap and anticipated capabilities in complementary disciplines are quoted to provide context for the progress made in grid adaptation in the past fifteen years, current status, and a forecast for the next fifteen years with recommended investments. These investments are specific to mesh adaptation and impact other aspects of the CFD process. Finally, a strategy is identified to diffuse grid adaptation technology into production CFD work flows.

Park, Michael A.↗

Analytics-at-scale of Sensor Data for Digital Monitoring in Nuclear Plants (3 rd Annual Report)

Nuclear power plants collect and store large volumes of heterogeneous data from various components and systems. With recent advances in machine learning (ML) techniques, these data can be leveraged to develop diagnostic and short-term forecasting models to better predict future equipment condition. Maintenance operations can then be planned in advance whenever degraded performance is predicted, thus resulting in fewer unplanned outages and the optimization of maintenance activities. This enables lower maintenance costs and improves the overall economics of nuclear power. This report primarily focuses on developing a short-term forecasting process that leverages a feature selection process to distill large volumes of heterogeneous data and predict specific equipment parameters. A variety of feature selection methods, including Shapley Additive Explanations (SHAP) and variance inflation factor (VIF), were used to select the optimal features as inputs for three ML methods: long short-term memory (LSTM) networks, support vector regression (SVR), and random forest (RF). Each combination of model and input features was used to predict a pump bearing temperature both 1 and 24 hours in advance, based on actual plant system data. The optimal inputs for the LSTM and SVR were selected using the SHAP values, while the optimal input for the RF consisted solely of the response variable itself. Each model produced similar 1-hour-ahead predictions, with root mean square errors (RMSEs) of roughly 0.006. For the 24-hour-ahead predictions, differences could be seen between LSTM, SVR, and RF, as reflected by model performances of 0.036 ± 0.014, 0.0026 ± 0, and 0.063 ± 0.004 RMSE, respectively. As big data and continuous online monitoring become more widely available, the proposed feature selection process can be used for many applications beyond the prediction of process parameters within nuclear infrastructure. This report summarizes the Fiscal Year 2021 research progress encompassing the (1) data cleaning and feature selection necessary for ML applications; (2) development of short-term forecasting models to predict future plant process parameters for both single and multiple time steps ahead; and (3) validation of the feature selection methods and short-term forecasting models given new data from different systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

An Evaluation of Two Internal Surrogates for Determining the Three-Dimensional Position of Peripheral Lung Tumors

Purpose: Both carina and diaphragm positions have been used as surrogates during respiratory-gated radiotherapy. We studied the correlation of both surrogates with three-dimensional (3D) tumor position. Methods and Materials: A total of 59 repeat artifact-free four-dimensional (4D) computed tomography (CT) scans, acquired during uncoached breathing, were identified in 23 patients with Stage I lung cancer. Repeat scans were co-registered to the initial 4D CT scan, and tumor, carina, and ipsilateral diaphragm were manually contoured in all phases of each 4D CT data set. Correlation between positions of carina and diaphragm with 3D tumor position was studied by use of log-likelihood ratio statistics. Models to predict 3D tumor position from internal surrogates at end inspiration (EI) and end expiration (EE) were developed, and model accuracy was tested by calculating SDs of differences between predicted and actual tumor positions. Results: Motion of both the carina and diaphragm significantly correlated with tumor motion, but log-likelihood ratios indicated that the carina was more predictive for tumor position. When craniocaudal tumor position was predicted by use of craniocaudal carina positions, the SDs of the differences between the predicted and observed positions were 2.2 mm and 2.4 mm at EI and EE, respectively. The corresponding SDs derived with the diaphragm positions were 3.7 mm and 3.9 mm at EI and EE, respectively. Prediction errors in the other directions were comparable. Prediction accuracy was similar at EI and EE. Conclusions: The carina is a better surrogate of 3D tumor position than diaphragm position. Because residual prediction errors were observed in this analysis, additional studies will be performed using audio-coached scans.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Effective Continuum Thresholds for Quark-Hadron Duality in Dispersive Sum Rules

Modifying the standard approaches to nonperturbative QCD based on Borel-transformed dispersive sum rules by allowing the effective continuum thresholds required for the implementation of quark-hadron duality to depend on the Borel parameters and on any relevant momentum promises to entail higher accuracy and reliable error estimates for the extracted predictions of hadron features.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

An orbit fit program for localizing errors in RHIC

Many errors in an accelerator are evidenced as transverse kicks to the beam which distort the beam trajectory. Therefore, the information of the errors are imprinted in the distorted orbits, which are different from what would be predicted by the optics model. In this note, we introduce an algorithm for fitting the orbit based on an on-line optics model. By comparing the measured and fitted orbits, we first present results validating the algorithm. We then apply the algorithm and localize the location of the elusive source of vertical diurnal variations observed in RHIC. The difference of two trajectories (linear accelerator) or closed orbits (storage ring) should match exactly a betatron oscillation, which is predictable by the optics model, in an ideal machine. However, in the presence of errors, the measured trajectory deviates from prediction since the model is imperfect. Comparison of measurement to model can be used to detect such errors. To do so the initial conditions (phase space parameters at any point) must be determined which can be done by comparing the difference orbit to prediction using only a few beam position monitors (BPMs). The fitted orbit can be propagated along the beam line based on the optics model. Measurement and model will agree up to the point of an error. The error source can be better localized by additionally fitting the difference orbit using downstream BPMs and back-propagating the solution. If one dominating error source exist in the machine, the fitted orbit will deviate from the difference orbit at the same point.

43 PARTICLE ACCELERATORS↗

APPLICATION OF BAYESIAN AND GEOSTATISTICAL MODELING TO THE ENVIRONMENTAL MONITORING OF CS-137 AT THE IDAHO NATIONAL LABORATORY

At the Idaho National Laboratory (INL) Cs-137 concentrations above the U.S. Environmental Protection Agency risk-based threshold of 0.23 pCi/g may increase the risk of human mortality due to cancer. As a leader in nuclear research, the INL has been conducting nuclear activities for decades. Elevated anthropogenic radionuclide levels including Cs-137 are a result of atmospheric weapons testing, the Chernobyl accident, and nuclear activities occurring at the INL site. Therefore environmental monitoring and long-term surveillance of Cs-137 is required to evaluate risk. However, due to the large land area involved, frequent and comprehensive monitoring is limited. Developing a spatial model that predicts Cs-137 concentrations at unsampled locations will enhance the spatial characterization of Cs-137 in surface soils, provide guidance for an efficient monitoring program, and pinpoint areas requiring mitigation strategies. The predictive model presented herein is based on applied geostatistics using a Bayesian analysis of environmental characteristics across the INL site, which provides kriging spatial maps of both Cs-137 estimates and prediction errors. Comparisons are presented of two different kriging methods, showing that the use of secondary information (i.e., environmental characteristics) can provide improved prediction performance in some areas of the INL site.

54 ENVIRONMENTAL SCIENCES↗

A framework for WRF to WRF-IBM grid nesting to enable multiscale simulations

With advances in computational power, mesoscale models, such as the Weather Research and Forecasting (WRF) model, are often pushed to higher resolutions. As the model’s horizontal resolution is refined, the maximum resolved terrain slope will increase. Because WRF uses a terrain-following coordinate, this increase in resolved terrain slopes introduces additional grid skewness. At high resolutions and over complex terrain, this grid skewness can introduce large numerical errors that require methods, such as the immersed boundary method, to keep the model accurate and stable. Our implementation of the immersed boundary method in the WRF model, WRF-IBM, has proven effective at microscale simulations over complex terrain. WRF-IBM uses a non-conforming grid that extends beneath the model’s terrain. Boundary conditions at the immersed boundary, the terrain, are enforced by introducing a body force term to the governing equations at points directly beneath the immersed boundary. Nesting between a WRF parent grid and a WRF-IBM child grid requires a new framework for initialization and forcing of the child WRF-IBM grid. This framework will enable concurrent multi-scale simulations within the WRF model, improving the accuracy of high-resolution simulations and enabling simulations across a wide range of scales.

54 ENVIRONMENTAL SCIENCES↗

First estimation of high-resolution solar photovoltaic resource maps over China with Fengyun-4A satellite and machine learning

Fengyun-4A (FY-4A), which is the latest-generation Chinese geostationary meteorological satellite, measures solar reflection and thermal emission with high temporal, spatial, and spectral resolutions. It is expected to be highly beneficial for solar resource assessment and forecasting in China. This study is the first to estimate, using FY-4A and a random forest model, the global horizontal irradiance (GHI) at a 4-km–15-min spatio-temporal resolution over China, as a means to arrive at a solar photovoltaic (PV) resource map. In terms of GHI estimates, the root mean square error and mean bias error between hourly measured and retrieved values are 147.02 (35.2%), –5.64 W/m 2 (–1.4%), respectively, whereas the values of daily estimates are 29.20 (18.0%), –2.97 W/m 2 (–1.3%). The retrieval accuracy is found much better for instances with solar zenith angles smaller than 60°. Relatively larger errors are found at locations in the Sichuan Basin and northeastern China, which can be attributed to bright surfaces and/or strong cloud transients. With the retrieved irradiance, PV resource is derived through a physical model chain. The annual mean PV resource map suggests that, over most of the west areas, the annual mean effective irradiance exceeds 1700 kWh/m 2 , with the highest value found in Tibet (around 2000 kWh/m 2 per annum). Eastern China has an annual effective irradiance of only 1300–1500 kWh/m 2 . In conclusion, the region with poorest solar resource is the Sichuan Basin (less than 1100 kWh/m 2 per annum).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Capturing non-Gaussianity of the large-scale structure with weighted skew-spectra

The forthcoming generation of wide-field galaxy surveys will probe larger volumes and galaxy densities, thus allowing for a much larger signal-to-noise ratio for higher-order clustering statistics, in particular the galaxy bispectrum. Extracting this information, however, is more challenging than using the power spectrum due to more complex theoretical modeling, as well as significant computational cost of evaluating the bispectrum signal and the error budget. To overcome these challenges, several proxy statistics have been proposed in the literature, which partially or fully capture the information in the bispectrum, while being computationally less expensive than the bispectrum. One such statistics are weighted skew-spectra, which are cross-spectra of the density field and appropriately weighted quadratic fields. Using Fisher forecasts, we show that the information in these skew-spectra is equivalent to that in the bispectrum for parameters that appear as amplitudes in the bispectrum model, such as galaxy bias parameters or the amplitude of primordial non-Gaussianity. We consider three shapes of the primordial bispectrum: local, equilateral and that due to massive particles with spin two during inflation. In conclusion, to obtain constraints that match those from a measurement of the full bispectrum, we find that it is crucial to account for the full covariance matrix of the skew-spectra.

79 ASTRONOMY AND ASTROPHYSICS↗

Comparison of Global Precipitation Estimates across a Range of Temporal and Spatial Scales

Characteristics of precipitation estimates for rate and amount from three global high-resolution precipitation products (HRPPs), four global climate data records (CDRs), and four reanalyses are compared. All datasets considered have at least daily temporal resolution. Estimates of global precipitation differ widely from one product to the next, with some differences likely due to differing goals in producing the estimates. HRPPs are intended to produce the best snapshot of the precipitation estimate locally. CDRs of precipitation emphasize homogeneity over instantaneous accuracy. Precipitation estimates from global reanalyses are dynamically consistent with the large-scale circulation but tend to compare poorly to rain gauge estimates since they are forecast by the reanalysis system and precipitation is not assimilated. Regional differences among the estimates in the means and variances are as large as the means and variances, respectively. Even with similar monthly totals, precipitation rates vary significantly among the estimates. Temporal correlations among datasets are large at annual and daily time scales, suggesting that compensating bias errors at annual and random errors at daily time scales dominate the differences. However, the signal-to-noise ratio at intermediate (monthly) time scales can be large enough to result in high correlations overall. It is shown that differences on annual time scales and continental regions are around 0.8 mm day -1 , which corresponds to 23 W m -2 . These wide variations in the estimates, even for global averages, highlight the need for better constrained precipitation products in the future.

54 ENVIRONMENTAL SCIENCES↗