Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluating the 3D PBL scheme for wind energy applications in the complex terrain of Altamont Pass, CA

In this study, the 3D PBL scheme, developed and tested during previous WETO projects, was used to simulate daily speedup flows in the Altamont Pass Wind Resource Area of California. These flows were observed as part of the WFIP2 companion experiment HilFlowS, which examined potential power output from taller turbines in the Altamont region. The regularity of the observed speedup events during the summer months, combined with the importance of terrain-induced wind acceleration, makes them a useful case study for evaluating mesoscale forecast models, which often underperform in regions of complex terrain. Compared to a traditional one-dimensional PBL scheme, the 3D PBL scheme shows evidence of improved wind speed predictions, including an ability to capture atypical wind speed profiles and reduce model overestimates of wind speed across the turbine rotor region. Such improvements will be necessary for wind farm siting and power forecasting, especially as taller turbines are deployed in complex terrain.

17 WIND ENERGY↗
DOE OSTI2020

A Featureless Infrared Transmission Spectrum for the Super-puff Planet Kepler-79d

Extremely low-density planets (“super-puffs”) are a small but intriguing subset of the transiting planet population. With masses in the super-Earth range (1 − 10 M{sub ⊕}) and radii akin to those of giant planets (> 4 R{sub ⊕}), their large envelopes may have been accreted beyond the water snow line and many appear to be susceptible to catastrophic mass loss. Both the presence of water and the importance of mass loss can be explored using transmission spectroscopy. Here, we present new Hubble space telescope WFC3 spectroscopy and updated Kepler transit depth measurements for the super-puff Kepler-79d. We do not detect any molecular absorption features in the 1.1 − 1.7 μm WFC3 bandpass, and the combined Kepler and WFC3 data are consistent with a flat-line model, indicating the presence of aerosols in the atmosphere. We compare the shape of Kepler-79d’s transmission spectrum to predictions from a microphysical haze model that incorporates an outward particle flux due to ongoing mass loss. We find that photochemical hazes offer an attractive explanation for the observed properties of super-puffs like Kepler-79d, as they simultaneously render the near-infrared spectrum featureless and reduce the inferred envelope mass-loss rate by moving the measured radius (optical depth unity surface during transit) to lower pressures. We revisit the broader question of mass-loss rates for super-puffs and find that the age estimates and mass-loss rates for the majority of super-puffs can be reconciled if hazes move the photosphere from the typically assumed pressure of ∼10 mbar to ∼10 μbar.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Moderate-resolution K-band Spectroscopy of Substellar Companion κ Andromedae b

We present moderate-resolution (R ∼ 4000) K-band spectra of the “super-Jupiter,” κ Andromedae b. The data were taken with the OSIRIS integral field spectrograph at Keck Observatory. The spectra reveal resolved molecular lines from H{sub 2}O and CO, and are compared to a custom PHOENIX atmosphere model grid appropriate for young planetary-mass objects. We fit the data using a Markov chain Monte Carlo forward-modeling method. Using a combination of our moderate-resolution spectrum and low-resolution, broadband data from the literature, we derive an effective temperature of T {sub eff} = 1950–2150 K, a surface gravity of logg=3.5--4.5, and a metallicity of [M/H] = −0.2–0.0. These values are consistent with previous estimates from atmospheric modeling and the currently favored young age of the system (<50 Myr). We derive a C/O ratio of 0.70{sub −0.24}{sup +0.09} for the source, broadly consistent with the solar C/O ratio. This, coupled with the slightly subsolar metallicity, implies a composition consistent with that of the host star, and is suggestive of formation by a rapid process. The subsolar metallicity of κ Andromedae b is also consistent with predictions of formation via gravitational instability. Further constraints on formation of the companion will require measurement of the C/O ratio of κ Andromedae A. We also measure the radial velocity of κ Andromedae b for the first time, with a value of −1.4 ± 0.9 km s{sup −1} relative to the host star. We find that the derived radial velocity is consistent with the estimated high eccentricity of κ Andromedae b.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Predictive performance of multi-model ensemble forecasts of COVID-19 across European nations

Background: Short-term forecasts of infectious disease burden can contribute to situational awareness and aid capacity planning. Based on best practice in other fields and recent insights in infectious disease epidemiology, one can maximise the predictive performance of such forecasts if multiple models are combined into an ensemble. Here, we report on the performance of ensembles in predicting COVID-19 cases and deaths across Europe between 08 March 2021 and 07 March 2022. Methods: We used open-source tools to develop a public European COVID-19 Forecast Hub. We invited groups globally to contribute weekly forecasts for COVID-19 cases and deaths reported by a standardised source for 32 countries over the next 1–4 weeks. Teams submitted forecasts from March 2021 using standardised quantiles of the predictive distribution. Each week we created an ensemble forecast, where each predictive quantile was calculated as the equally-weighted average (initially the mean and then from 26th July the median) of all individual models’ predictive quantiles. We measured the performance of each model using the relative Weighted Interval Score (WIS), comparing models’ forecast accuracy relative to all other models. We retrospectively explored alternative methods for ensemble forecasts, including weighted averages based on models’ past predictive performance. Results: Over 52 weeks, we collected forecasts from 48 unique models. We evaluated 29 models’ forecast scores in comparison to the ensemble model. We found a weekly ensemble had a consistently strong performance across countries over time. Across all horizons and locations, the ensemble performed better on relative WIS than 83% of participating models’ forecasts of incident cases (with a total N=886 predictions from 23 unique models), and 91% of participating models’ forecasts of deaths (N=763 predictions from 20 models). Across a 1–4 week time horizon, ensemble performance declined with longer forecast periods when forecasting cases, but remained stable over 4 weeks for incident death forecasts. In every forecast across 32 countries, the ensemble outperformed most contributing models when forecasting either cases or deaths, frequently outperforming all of its individual component models. Among several choices of ensemble methods we found that the most influential and best choice was to use a median average of models instead of using the mean, regardless of methods of weighting component forecast models. Conclusions: Our results support the use of combining forecasts from individual models into an ensemble in order to improve predictive performance across epidemiological targets and populations during infectious disease epidemics. Our findings further suggest that median ensemble methods yield better predictive performance more than ones based on means. Our findings also highlight that forecast consumers should place more weight on incident death forecasts than incident case forecasts at forecast horizons greater than 2 weeks. Funding: AA, BH, BL, LWa, MMa, PP, SV funded by National Institutes of Health (NIH) Grant 1R01GM109718, NSF BIG DATA Grant IIS-1633028, NSF Grant No.: OAC-1916805, NSF Expeditions in Computing Grant CCF-1918656, CCF-1917819, NSF RAPID CNS-2028004, NSF RAPID OAC-2027541, US Centers for Disease Control and Prevention 75D30119C05935, a grant from Google, University of Virginia Strategic Investment Fund award number SIF160, Defense Threat Reduction Agency (DTRA) under Contract No. HDTRA1-19-D-0007, and respectively Virginia Dept of Health Grant VDH-21-501-0141, VDH-21-501-0143, VDH-21-501-0147, VDH-21-501-0145, VDH-21-501-0146, VDH-21-501-0142, VDH-21-501-0148. AF, AMa, GL funded by SMIGE - Modelli statistici inferenziali per governare l'epidemia, FISR 2020-Covid-19 I Fase, FISR2020IP-00156, Codice Progetto: PRJ-0695. AM, BK, FD, FR, JK, JN, JZ, KN, MG, MR, MS, RB funded by Ministry of Science and Higher Education of Poland with grant 28/WFSN/2021 to the University of Warsaw. BRe, CPe, JLAz funded by Ministerio de Sanidad/ISCIII. BT, PG funded by PERISCOPE European H2020 project, contract number 101016233. CP, DL, EA, MC, SA funded by European Commission - Directorate-General for Communications Networks, Content and Technology through the contract LC-01485746, and Ministerio de Ciencia, Innovacion y Universidades and FEDER, with the project PGC2018-095456-B-I00. DE., MGu funded by Spanish Ministry of Health / REACT-UE (FEDER). DO, GF, IMi, LC funded by Laboratory Directed Research and Development program of Los Alamos National Laboratory (LANL) under project number 20200700ER. DS, ELR, GG, NGR, NW, YW funded by National Institutes of General Medical Sciences (R35GM119582; the content is solely the responsibility of the authors and does not necessarily represent the official views of NIGMS or the National Institutes of Health). FB, FP funded by InPresa, Lombardy Region, Italy. HG, KS funded by European Centre for Disease Prevention and Control. IV funded by Agencia de Qualitat i Avaluacio Sanitaries de Catalunya (AQuAS) through contract 2021-021OE. JDe, SMo, VP funded by Netzwerk Universitatsmedizin (NUM) project egePan (01KX2021). JPB, SH, TH funded by Federal Ministry of Education and Research (BMBF; grant 05M18SIA). KH, MSc, YKh funded by Project SaxoCOV, funded by the German Free State of Saxony. Presentation of data, model results and simulations also funded by the NFDI4Health Task Force COVID-19 ( https://www.nfdi4health.de/task-force-covid-19-2 ) within the framework of a DFG-project (LO-342/17-1). LP, VE funded by Mathematical and Statistical modelling project (MUNI/A/1615/2020), Online platform for real-time monitoring, analysis and management of epidemic situations (MUNI/11/02202001/2020); VE also supported by RECETOX research infrastructure (Ministry of Education, Youth and Sports of the Czech Republic: LM2018121), the CETOCOEN EXCELLENCE (CZ.02.1.01/0.0/0.0/17-043/0009632), RECETOX RI project (CZ.02.1.01/0.0/0.0/16-013/0001761). NIB funded by Health Protection Research Unit (grant code NIHR200908). SAb, SF funded by Wellcome Trust (210758/Z/18/Z).

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

WASTE TREATMENT PLANT (WTP) LIQUID EFFLUENT TREATABILITY EVALUATION (SEPTEMBER 2004)

A forecast of the radioactive, dangerous liquid effluents expected to be produced by the Waste Treatment Plant (WTP) was provided by Bechtel National, Inc. (BNI 2004). The forecast represents the liquid effluents generated from the processing of Tank Farm waste through the end-of-mission for the WTP. The WTP forecast is provided in the Appendices. The WTP liquid effluents will be stored, treated, and disposed of in the Liquid Effluent Retention Facility (LERF) and the Effluent Treatment Facility (ETF). Both facilities are located in the 200 East Area and are operated by Fluor Hanford, Inc. (FH) for the US. Department of Energy (DOE). The treatability of the WTP liquid effluents in the LERF/ETF was evaluated. The evaluation was conducted by comparing the forecast to the LERF/ETF treatability envelope (Aromi 1997), which provides information on the items which determine if a liquid effluent is acceptable for receipt and treatment at the LERF/ETF. The format of the evaluation corresponds directly to the outline of the treatability envelope document. Except where noted, the maximum annual average concentrations over the range of the 27 year forecast was evaluated against the treatability envelope. This is an acceptable approach because the volume capacity in the LERF Basin will equalize the minimum and maximum peaks. Background information on the LERF/ETF design basis is provided in the treatability envelope document.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Uncovering heterogeneous intercommunity disease transmission from neutral allele frequency time series

The COVID-19 pandemic has underscored the need for accurate epidemic forecasting to predict pathogen spread, evolution, and evaluate intervention strategies. Forecast reliability hinges on detailed knowledge of disease transmission across population segments, which may be inferred from contact surveys or mobility data. However, these indirect approaches make it difficult to estimate rare transmissions between socially or geographically distant communities. We show that the steep ramp-up of genome sequencing surveillance during the pandemic can be leveraged to directly identify transmission patterns between geographically defined communities. Our approach uses a hidden Markov model to infer the fraction of infections a community imports from others based on how rapidly allele frequencies in the focal community converge to those in the donor communities. Applying this method to SARS-CoV-2 sequencing data from England and the United States, we uncover networks of intercommunity transmission that reflect geographical relationships while exposing significant long-range interactions. The scaling of importation rate with distance is consistent across both countries, yet weaker than expected based on mobility data, highlighting limitations of indirect inference. We show that transmission patterns can change between waves of variants of concern and analyze how the inferred heterogeneity in intercommunity transmission impacts evolutionary forecasts. While applied here to geographically defined communities, our approach could be applied to those defined by other traits (e.g., age, socioeconomic status), provided time-series data can be stratified accordingly. Overall, our study highlights population genomic time series data as a crucial record of epidemiological interactions, which can be deciphered using tree-free inference methods.

Okada, Takashi [Department of Physics; University ↗
DOE OSTI2021

Trade-offs between individual and ensemble forecasts of an emerging infectious disease

Probabilistic forecasts play an indispensable role in answering questions about the spread of newly emerged pathogens. However, uncertainties about the epidemiology of emerging pathogens can make it difficult to choose among alternative model structures and assumptions. To assess the potential for uncertainties about emerging pathogens to affect forecasts of their spread, we evaluated the performance 16 forecasting models in the context of the 2015-2016 Zika epidemic in Colombia. Each model featured a different combination of assumptions about human mobility, spatiotemporal variation in transmission potential, and the number of virus introductions. We found that which model assumptions had the most ensemble weight changed through time. We additionally identified a trade-off whereby some individual models outperformed ensemble models early in the epidemic, but on average the ensembles outperformed all individual models. Our results suggest that multiple models spanning uncertainty across alternative assumptions are necessary to obtain robust forecasts for emerging infectious diseases.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Flow Forecasting on New England’s Great River Hydro (CRADA 549) (Final Report)

Great River Hydro (GRH) is New England's largest conventional hydropower generator and operates sustainable hydropower systems in Vermont, New Hampshire, and Massachusetts. Several of GRH’s hydropower projects on the Connecticut River are largely constrained to operate as run-of-river; however, though a new FERC license they have opportunity in the form of flex hours where they are allowed to deviate operations to capture favorable market conditions or emergency operations. To maximize value from these new operations, GRH is considering new sources of forecasted inflow. Pacific Northwest National Laboratory (PNNL) is evaluating the quality of two commercial inflow forecasts for GRH under DOE Water Power Technology Office’s Notice of Opportunity for Technical Assistance: Improving Hydropower’s Value through Informed Decision Making. This project will provide an unbiased evaluation of the accuracy of inflow forecasts available through commercial vendors. GRH will use this information to support their decision on which inflow forecast to use under their new FERC license and to assess the overall value of the available inflow forecasting tools and practices. In this talk we will discuss details of the near real-time forecast evaluation process, the metrics involved in the evaluation, and some preliminary results. In addition, we’ll touch on the second phase of the project which involves evaluating scheduling strategies that identify windows of opportunity to change operations in ways that increase profit through participation in day ahead and real time markets.

13 HYDRO ENERGY↗
DOE OSTI2022

National and subnational short-term forecasting of COVID-19 in Germany and Poland during early 2021

During the COVID-19 pandemic there has been a strong interest in forecasts of the short-term development of epidemiological indicators to inform decision makers. In this study we evaluate probabilistic real-time predictions of confirmed cases and deaths from COVID-19 in Germany and Poland for the period from January through April 2021. We evaluate probabilistic real-time predictions of confirmed cases and deaths from COVID-19 in Germany and Poland. These were issued by 15 different forecasting models, run by independent research teams. Moreover, we study the performance of combined ensemble forecasts. Evaluation of probabilistic forecasts is based on proper scoring rules, along with interval coverage proportions to assess calibration. The presented work is part of a pre-registered evaluation study. We find that many, though not all, models outperform a simple baseline model up to four weeks ahead for the considered targets. Ensemble methods show very good relative performance. The addressed time period is characterized by rather stable non-pharmaceutical interventions in both countries, making short-term predictions more straightforward than in previous periods. However, major trend changes in reported cases, like the rebound in cases due to the rise of the B.1.1.7 (Alpha) variant in March 2021, prove challenging to predict. Multi-model approaches can help to improve the performance of epidemiological forecasts. However, while death numbers can be predicted with some success based on current case and hospitalization data, predictability of case numbers remains low beyond quite short time horizons. Additional data sources including sequencing and mobility data, which were not extensively used in the present study, may help to improve performance.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Error-Level-Controlled Synthetic Forecasts for Renewable Generation

Renewable energy resources, including solar and wind energy, play a significant role in sustainable energy systems. However, the inherent uncertainty and intermittency of renewable generation pose challenges to the safe and efficient operation of power systems. Recognizing the importance of short-term (hours ahead) renewable generation forecasting in power systems operation, it becomes crucial to address the potential inaccuracies in these forecasts. To systematically evaluate the performance of controllers in the presence of imperfect forecasts, we generate synthetic forecasts using actual renewable generation profiles (one from solar and one from wind). These synthetic forecasts incorporate different levels of statistical error, allowing us to control and manipulate the accuracy of the predictions. The primary objective is to employ synthetic forecasts with controlled yet realistic error levels to systematically investigate how controllers adapt to variations in forecast accuracy, providing valuable insights into their robustness and effectiveness under real-world conditions.

Array↗
DOE OSTI2026

FFTSF: Revisiting Sub-Seasonal Streamflow Forecasting with Simple Feedforward Network

Accurate short-to-subseasonal streamflow forecasts are vital for water management, including flood preparedness, drought mitigation, hydropower scheduling, and ecosystem protection. However, extending a forecast beyond a few days remains challenging due to complexity of hydrological processes. While recent self-attention based transformer architectures such as iTransformer have gained traction in time-series forecasting, these models suffer from several critical limitations: (1) significant computational overhead that scales quadratically with sequence length, (2) vulnerability to overfitting on limited hydrological datasets, (3) degraded performance on long-horizon forecasts due to attention decay, and (4) excessive architectural complexity that hampers interpretability and operational deployment. In this study, we propose a simple Feedforward Time Series Forecasting (FFTSF) network that directly addresses these limitations through its lightweight architecture and long-range forecasting capabilities. We evaluate FFTSF across 178 USGS stream gauges spanning diverse climate regimes by forecasting lead times of 1-, 7-, 14-, and 30-days. Our results demonstrate that FFTSF achieves competitive performance at short lead times (NSE of 0.778 for 1-day forecasts) while substantially outperforming complex baselines at longer forecast period, achieving the highest NSE (0.271) at 30-day forecasts with greater robustness and stability. For 30-day forecasts, FFTSF achieves a 71% improvement over NLinear, 57% improvement over DLinear and 12% improvement over the computationally intensive iTransformer while requiring fewer computational resources. Our findings reveal that architectural complexity is not necessary for hydrological forecasting, demonstrating that well-designed simple models can outperform attention mechanisms for subseasonal streamflow forecasting. The computational efficiency and consistent long-range performance of FFTSF make it suitable for water management applications where reliable extended forecasts are essential.

Krishnan Kutty Ambika, Anukesh [ORNL] (ORCID:00000↗
DOE OSTI2024

Evaluating the Accuracy of Machine Learning Forecasts

To improve the accuracy of forecasting in machine learning, we must investigate multiple machine learning models and see how accurately they can predict values after training. We used seven machine learning models to try and get more accurate predictions. The models that were used were ARIMA, SES, MLP, CART, LightGBM, and XGBoost. We used a processed dataset from a Terminal at LAX that had the number of people traveling through terminal X every hour in March from 2015-2019. We trained our models with the dates March 6 - March 19 to predict the value for March 20th and the hours 6:00 am to 6:00 pm since those are the most popular traveling hours. By using the different models, we had varying results of accuracy when estimating the amount of people traveling through terminal X on March 20th. We know that machine learning models are helpful for forecasting and by seeing how accurately these models can predict, we can see how forecasting can be helpful for other issues. Using these methods, airports can use forecasting to predict the amount of people coming in and out and can use these predictions to prepare their resource management, operational efficiency, and overall passenger experience.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Physics-Based DNI Model for Advancing Solar Resource Assessment and Forecasting: Preprint

Direct Normal Irradiance (DNI) is one of the most used quantities to quantify the magnitude of solar energy resource. The concept of DNI is often interpreted differently for ground measurements and solar forecasting by numerical weather prediction (NWP) models, leading to substantial bias during evaluation of DNI forecasts especially under cloudy-sky conditions. To eliminate the bias, we use the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) to provide a physics-based solution of solar radiation in the circumsolar region. The FARMS-DNI is implemented in the Weather Research and Forecasting model with solar extensions (WRF-Solar) to forecast day-ahead DNI in the north America. By comparing with conventional predictions from WRF-Solar and satellite observations from the National Solar Radiation Data Base (NSRDB), we found significant improvements in our prediction of DNI.

DNI↗
DOE OSTI2024

Quantifying the Turbulent Entrainment‐Mixing Processes Based on Z ‐LWC Relationships of Cloud Droplets

Abstract Turbulent entrainment‐mixing processes profoundly influence the relationship between radar reflectivity factor and liquid water content ( Z ‐LWC) of cloud droplets. However, quantification of the entrainment‐mixing mechanisms based on the Z ‐LWC relationship is still lacking. To address this gap, 12,218 entrainment‐mixing cases are simulated using the Explicit Mixing Parcel Model. We examine the variations of the parameters in the power‐law relationship Z = a LWC b , and the relationship between parameter b and homogeneous mixing degree ( ψ ), a measure quantifying entrainment‐mixing processes. The results indicate that parameter b distributes within the range of 1–2, with a positive correlation between parameter b and ψ . The b ‐ ψ relationship is fitted, which connects the Z ‐LWC relationship for various entrainment‐mixing types. The results suggest the potential for employing a remote sensing approach to investigate the entrainment‐mixing mechanisms of non‐precipitating small cumulus/stratocumulus clouds, thereby overcoming the limitations of traditional observational studies that rely solely on aircraft observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Evaluation of the 2022 West Nile virus forecasting challenge, USA

Abstract Background West Nile virus (WNV) is the most common cause of mosquito-borne disease in the continental USA, with an average of ~1200 severe, neuroinvasive cases reported annually from 2005 to 2021 (range 386–2873). Despite this burden, efforts to forecast WNV disease to inform public health measures to reduce disease incidence have had limited success. Here, we analyze forecasts submitted to the 2022 WNV Forecasting Challenge, a follow-up to the 2020 WNV Forecasting Challenge. Methods Forecasting teams submitted probabilistic forecasts of annual West Nile virus neuroinvasive disease (WNND) cases for each county in the continental USA for the 2022 WNV season. We assessed the skill of team-specific forecasts, baseline forecasts, and an ensemble created from team-specific forecasts. We then characterized the impact of model characteristics and county-specific contextual factors (e.g., population) on forecast skill. Results Ensemble forecasts for 2022 anticipated a season at or below median long-term WNND incidence for nearly all (> 99%) counties. More counties reported higher case numbers than anticipated by the ensemble forecast median, but national caseload (826) was well below the 10-year median (1386). Forecast skill was highest for the ensemble forecast, though the historical negative binomial baseline model and several team-submitted forecasts had similar forecast skill. Forecasts utilizing regression-based frameworks tended to have more skill than those that did not and models using climate, mosquito surveillance, demographic, or avian data had less skill than those that did not, potentially due to overfitting. County-contextual analysis showed strong relationships with the number of years that WNND had been reported and permutation entropy (historical variability). Evaluations based on weighted interval score and logarithmic scoring metrics produced similar results. Conclusions The relative success of the ensemble forecast, the best forecast for 2022, suggests potential gains in community ability to forecast WNV, an improvement from the 2020 Challenge. Similar to the previous challenge, however, our results indicate that skill was still limited with general underprediction despite a relative low incidence year. Potential opportunities for improvement include refining mechanistic approaches, integrating additional data sources, and considering different approaches for areas with and without previous cases. Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Surface Energy Balance Responses to Radiative Forcing in the Central Arctic From MOSAiC and Models

The Arctic surface energy budget (SEB) couples the atmosphere with the sea ice, making it useful for both studying surface processes as well as evaluating models. Improved understanding of atmosphere-ice interactions is required to improve models, requiring year-round observations to address seasonally dependent biases. This work uses novel observations from the MOSAiC expedition to quantify the responses of surface fluxes to radiative forcing over sea ice throughout a complete annual cycle. We identify two primary regimes of flux response: an ice growth regime in winter and an ice melt regime in summer. In the growth regime, changes in radiative forcing impact upwelling longwave, sensible heat, and subsurface heat fluxes, whereas in the melt regime changes in radiative forcing primarily alter the amount of melt and subsurface transmission because the surface temperature is fixed. These observed responses of surface fluxes to radiative forcing are used to evaluate seven weather forecast models during the ice growth regime. In most models, the responses of surface fluxes to radiative forcing do not match observations. Many models also have biased downwelling longwave. One model (the Coupled Arctic Forecast System; CAFS) adequately captures both the mean radiative forcing and the flux responses in winter. CAFS is further evaluated against observations spanning the full MOSAiC year, demonstrating sufficient agreement to provide a more generalized understanding of these SEB process relationships across the Arctic.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The WRF-Solar Ensemble Prediction System to Provide Solar Irradiance Probabilistic Forecasts

In this study, we introduce the recently developed WRF-solar ensemble prediction system and a calibration method. The performances of forecast models are evaluated using the National Solar Radiation Database observational analysis for day-ahead solar irradiance predictions. The results demonstrate that the ensemble forecast improves the quality of the forecasts by considering the uncertainty of each ensemble member. The analog ensemble calibration contributed to the reduction of positive bias and an overall improvement in the probabilistic attributes, such as reliability and statistical consistency.

14 SOLAR ENERGY↗