Search NASA⌕ Search

SEARCH · Search NASA

Results for “error impact analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Ice storage model-predictive control in an office building with PV: scenario, error and sensitivity analysis

Thermal energy storage (TES) can enable more building-sited renewable electricity generation and lower utility bill costs for buildings owners and occupants, especially when there are high demand and variable time-of-use (TOU) charges. A model predictive control (MPC) strategy can offer additional savings over a schedule-based control with added complexity and reliance on forecasts. Here, this study examines savings for medium office buildings with chiller plants in three locations with building-installed solar photovoltaics (PV) to understand the impact of MPC. Control setpoints are fixed by a schedule-based control or optimized by nonlinear MPC. These control setpoints are actuated within EnergyPlus building models to simulate the utility cost of the chiller plant. NLP solutions can be unstable or unrealistic, but our results show that by regularizing the NLP, the solutions can be reasonably followed by the building model. MPC models make simplifications that lead to errors once the controller is participating in and changing the operation of the building. These errors average 9 % across the cases, showing that the most important parts of the system are represented. The no-thermal load costs are computed to show that the optimization can in some cases achieve both the minimum TOU and minimum monthly demand costs by demand management while reducing TOU energy costs by energy arbitrage. The MPC saves 35–66 % in the annual chiller plant operating costs, which is an additional savings above the schedule by 1–33 %. PV and TES are complementary and mostly independent, but a load with PV often results in better performance for the schedule. Our case study and sensitivity analysis show the importance of modeling and optimization for complex rates, but also the circumstances wherein a simpler strategy achieves the same performance with less potential for error.

14 SOLAR ENERGY↗

Error Propagation in a System Model

Embodiments of the present subject matter can enable the analysis of signal value errors for system models. In an example, signal value errors can be propagated through the functional blocks of a system model to analyze possible effects as the signal value errors impact incident functional blocks. This propagation of the errors can be applicable to many models of computation including avionics models, synchronous data flow, and Kahn process networks.

Schloegel, Kirk↗

Expanding Our Understanding of What Constitutes a Safety-Relevant Occurrence

Focusing on undesired operator behaviors is pervasive in system design and safety management cultures. This focus limits the data that are collected, the questions that are asked during data analysis, and therefore our understanding of what operators do in everyday work. Human performance represents a significant source of safety data that includes both desired and undesired actions. When safety is characterized only in terms of errors and failures, the vast majority of human impacts on system safety and performance are ignored. The outcomes of safety data analyses dictate what is learned from those data, which in turn informs safety policies and safety-related decision making. When learning opportunities are systematically restricted by focusing only on rare failure events, not only do we learn less (and less often), but we can draw misleading conclusions by relying on a non-representative sample of human performance data. The study of human contributions to safety represents a vast and largely unexplored opportunity to learn. Changes in how we define and think about safety can highlight new opportunities for collection and analysis of safety-relevant data. Developing an integrated safety picture to better inform system design, safety-related decision making and policies depends upon identifying, collecting, and interpreting safety producing behaviors in addition to safety reducing behaviors.

Jon B Holbrook↗

SU-F-T-14: Dosimetric Impacts of Various Uncertainties in Cervical Cancer HDR Brachytherapy: Are Conventional Point Doses Good Surrogates for 3D Dosimetry?

Purpose: In the context of evaluating dosimetric impacts of a variety of uncertainties involved in HDR Tandem-and-Ovoid treatment, to study the correlations between conventional point doses and 3D volumetric doses. Methods: For 5 cervical cancer patients treated with HDR T&O, 150 plans were retrospectively created to study dosimetric impacts of the following uncertainties: (1) inter-fractional applicator displacement between two treatment fractions within a single insertion by applying Fraction#1 plan to Fraction#2 CT; (2) positional dwell error simulated from −5mm to 5mm in 1mm steps; (3) simulated temporal dwell error of 0.05s, 0.1s, 0.5s, and 1s. The original plans were based on point dose prescription, from which the volume covered by the prescription dose was generated as the pseudo target volume to study the 3D target dose effect. OARs were contoured. The point and volumetric dose errors were calculated by taking the differences between original and simulated plans. The correlations between the point and volumetric dose errors were analyzed. Results: For the most clinically relevant positional dwell uncertainty of 1mm, temporal uncertainty of 0.05s, and inter-fractional applicator displacement within the same insertion, the mean target D90 and V100 deviation were within 1%. Among these uncertainties, the applicator displacement showed the largest potential target coverage impact (2.6% on D90) as well as the OAR dose impact (2.5% and 3.4% on bladder D2cc and rectum D2cc). The Spearman correlation analysis shows a correlation coefficient of 0.43 with a p-value of 0.11 between target D90 coverage and H point dose. Conclusion: With the most clinically relevant positional and temporal dwell uncertainties and patient interfractional applicator displacement within the same insertion, the dose error is within clinical acceptable range. The lack of correlation between H point and 3D volumetric dose errors is a motivator for the use of 3D treatment planning in cervical HDR brachytherapy.

60 APPLIED LIFE SCIENCES↗

Evaluating IMRT and VMAT dose accuracy: Practical examples of failure to detect systematic errors when applying a commonly used metric and action levels

Purpose: This study (1) examines a variety of real-world cases where systematic errors were not detected by widely accepted methods for IMRT/VMAT dosimetric accuracy evaluation, and (2) drills-down to identify failure modes and their corresponding means for detection, diagnosis, and mitigation. The primary goal of detailing these case studies is to explore different, more sensitive methods and metrics that could be used more effectively for evaluating accuracy of dose algorithms, delivery systems, and QA devices.Methods: The authors present seven real-world case studies representing a variety of combinations of the treatment planning system (TPS), linac, delivery modality, and systematic error type. These case studies are typical to what might be used as part of an IMRT or VMAT commissioning test suite, varying in complexity. Each case study is analyzed according to TG-119 instructions for gamma passing rates and action levels for per-beam and/or composite plan dosimetric QA. Then, each case study is analyzed in-depth with advanced diagnostic methods (dose profile examination, EPID-based measurements, dose difference pattern analysis, 3D measurement-guided dose reconstruction, and dose grid inspection) and more sensitive metrics (2% local normalization/2 mm DTA and estimated DVH comparisons).Results: For these case studies, the conventional 3%/3 mm gamma passing rates exceeded 99% for IMRT per-beam analyses and ranged from 93.9% to 100% for composite plan dose analysis, well above the TG-119 action levels of 90% and 88%, respectively. However, all cases had systematic errors that were detected only by using advanced diagnostic techniques and more sensitive metrics. The systematic errors caused variable but noteworthy impact, including estimated target dose coverage loss of up to 5.5% and local dose deviations up to 31.5%. Types of errors included TPS model settings, algorithm limitations, and modeling and alignment of QA phantoms in the TPS. Most of the errors were correctable after detection and diagnosis, and the uncorrectable errors provided useful information about system limitations, which is another key element of system commissioning.Conclusions: Many forms of relevant systematic errors can go undetected when the currently prevalent metrics for IMRT/VMAT commissioning are used. If alternative methods and metrics are used instead of (or in addition to) the conventional metrics, these errors are more likely to be detected, and only once they are detected can they be properly diagnosed and rooted out of the system. Removing systematic errors should be a goal not only of commissioning by the end users but also product validation by the manufacturers. For any systematic errors that cannot be removed, detecting and quantifying them is important as it will help the physicist understand the limits of the system and work with the manufacturer on improvements. In summary, IMRT and VMAT commissioning, along with product validation, would benefit from the retirement of the 3%/3 mm passing rates as a primary metric of performance, and the adoption instead of tighter tolerances, more diligent diagnostics, and more thorough analysis.

61 RADIATION PROTECTION AND DOSIMETRY↗

Comparative analysis of operational forecasts versus actual weather conditions in airline flight planning, volume 4

The impact of more timely and accurate weather data on airline flight planning with the emphasis on fuel savings is studied. This volume of the report discusses the results of Task 4 of the four major tasks included in the study. Task 4 uses flight plan segment wind and temperature differences as indicators of dates and geographic areas for which significant forecast errors may have occurred. An in-depth analysis is then conducted for the days identified. The analysis show that significant errors occur in the operational forecast on 15 of the 33 arbitrarily selected days included in the study. Wind speeds in an area of maximum winds are underestimated by at least 20 to 25 kts. on 14 of these days. The analysis also show that there is a tendency to repeat the same forecast errors from prog to prog. Also, some perceived forecast errors from the flight plan comparisons could not be verified by visual inspection of the corresponding National Meteorological Center forecast and analyses charts, and it is likely that they are the result of weather data interpolation techniques or some other data processing procedure in the airlines' flight planning systems.

Keitz, J. F.↗

Assessing the predictive impact of factor fixing with an adaptive uncertainty-based approach .

Despite widespread use of factor fixing in environmental modeling, its effect on model predictions has received little attention and is instead commonly presumed to be negligible. We propose a proof-of-concept adaptive method for systematically investigating the impact of factor fixing. The method uses Global Sensitivity Analysis methods to identify groups of sensitive parameters, then quantifies which groups can be safely fixed at nominal values without exceeding a maximum acceptable error, demonstrated using the 21-dimensional Sobol’ G-function. Furthermore, three error measures are considered for quantities of interest, namely Relative Mean Absolute Error, Pearson Product-Moment Correlation and Relative Variance. Results demonstrate that factor fixing may cause large errors in the model results unexpectedly, when preliminary analysis suggests otherwise, and that the default value selected affects the number of factors to fix. To improve the applicability and methodological development of factor fixing, a new research agenda encompassing five opportunities is discussed for further attention.

54 ENVIRONMENTAL SCIENCES↗

Verification of the astrometric performance of the Korean VLBI network, using comparative SFPR studies with the VLBA AT 14/7 mm

The Korean VLBI Network (KVN) is a new millimeter VLBI dedicated array with the capability to simultaneously observe at multiple frequencies, up to 129 GHz. The innovative multi-channel receivers present significant benefits for astrometric measurements in the frequency domain. The aim of this work is to verify the astrometric performance of the KVN using a comparative study with the VLBA, a well-established instrument. For that purpose, we carried out nearly contemporaneous observations with the KVN and the VLBA, at 14/7 mm, in 2013 April. The KVN observations consisted of simultaneous dual frequency observations, while the VLBA used fast frequency switching observations. We used the Source Frequency Phase Referencing technique for the observational and analysis strategy. We find that having simultaneous observations results in superior compensation for all atmospheric terms in the observables, in addition to offering other significant benefits for astrometric analysis. We have compared the KVN astrometry measurements to those from the VLBA. We find that the structure blending effects introduce dominant systematic astrometric shifts, and these need to be taken into account. We have tested multiple analytical routes to characterize the impact of the low-resolution effects for extended sources in the astrometric measurements. The results from the analysis of the KVN and full VLBA data sets agree within 2σ of the thermal error estimate. We interpret the discrepancy as arising from the different resolutions. We find that the KVN provides astrometric results with excellent agreement, within 1σ, when compared to a VLBA configuration that has a similar resolution. Therefore, this comparative study verifies the astrometric performance of the KVN using SFPR at 14/7 mm, and validates the KVN as an astrometric instrument.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluation and use of TOVS retrievals at NMC

In a current analysis procedure at the National Meteorological Center (NMC), a first guess analysis (from the latest 6 or 12 hour forecast) is updated by new data. In the newest analysis procedures, which are based on optimum interpolation, the observational correction depends on the size of preassigned, expected observational errors versus the size of expected errors in the first guess forecast. In the case of Northern Hemisphere ocean temperatures, the latter are around 2 degrees. The infrared satellite retrievals have a similar size "error". If (as assumed) their errors are uncorrelated with the first guess error, they will improve the analysis. The larger errors of the microwave retrievals, however, mean that they will be given little weight in the analysis. An evaluation of the TIROS-N retrievals is currently underway at NMC to determine the impact of satellite derived data within operational analysis schemes, to isolate possible problems within current retrieval methods, and to offer possible solutions for these problems.

Phillips, N. A.↗

Optical analysis of the star-tracker telescope for Gravity Probe

A ray tracing modeling of the star tracker telescope for Gravity Probe was used to predict the character of the output signal and its sensitivity to fabrication errors. In particular, the impact of the optical subsystem on the requirement of 1 milliarc second signal linearity over a + or - 50 milliarc second range was examined. Photomultiplier and solid state detector options were considered. Recommendations are made.

Zissa, D. E.↗

On Simulating the Impacts of Open Water Bodies on the SMAP Passive Soil Moisture Data Product

The Soil Moisture Active and Passive (SMAP) mission is a NASA earth science mission aiming at improving our understanding of the dynamics of the cycles of energy, water, and carbon at global scales. The mission features two complementary sensors on the same low-Earth orbiting platform: an L-band synthetic aperture radar (SAR) operating at 1.26 GHz and an L-band radiometer operating at 1.41 GHz. Together these instruments will provide global mapping of soil moisture and freeze/thaw states in 2-3 days, with a tentative launch date in 2014. The work reported in this study focuses primarily on the development of the SMAP radiometer-only soil moisture data product. For passive soil moisture retrieval at satellite footprint scales, one way to improve retrieval accuracy is to correct for the microwave emission from open water bodies prior to retrieval. The accuracy of this correction will depend on not only the locations of these water bodies, but also the geolocation accuracy of the instrument. As perfect knowledge is never attainable in practice, it is important to assess the impacts of these uncertainties on the SMAP radiometer observations and hence the passive soil moisture retrieval accuracy. In this presentation, we present the results of our preliminary assessment on the impacts of these uncertainties. Our study consists of two parts: (1) a sensitivity analysis on the SMAP radiometer observations due to uncertainties in water-body classification, and (2) realistic global simulations that take into account of additional uncertainties (e.g., geolocation and ancillary data) and SMAP-specific instrument characteristics (e.g., orbit sampling and antenna pattern). The results will provide valuable prelaunch guidance to the SMAP team in identifying different error sources and their relative impacts on the passive soil moisture data product.

Chan, Steven↗

A large-scale study of soft-errors on GPUs in the field

Parallelism provided by the GPU architecture has enabled domain scientists to simulate physical phenomena at a much faster rate and finer granularity than what was previously possible by CPU-based large-scale clusters. Architecture researchers have been investigating reliability characteristics of GPUs and innovating techniques to increase the reliability of these emerging computing devices. Such efforts are often guided by technology projections and simplistic scientific kernels, and performed using architectural simulators and modeling tools. Lack of large-scale field data impedes the effectiveness of such efforts. This study attempts to bridge this gap by presenting a large-scale field data analysis of GPU reliability. We characterize and quantify different kinds of soft-errors on the Titan supercomputer's GPU nodes. Our study uncovers several interesting and previously unknown insights about the characteristics and impact of soft-errors.

Nie, Bin↗

Observations of Global and Regional Ionospheric Irregularities and Scintillation Using GNSS Tracking Networks

The rate of TEC index (ROTI) is a measurement that characterizes ionospheric irregularities. It can be obtained from standard GNSS dual-frequency phase data collected using a geodetic type of GNSS receiver. By processing GPS data from ground-based networks of International GNSS Service and Continuously Operating Reference Station (CORS), ROTI maps have been produced to observe global and regional scintillation activities. A major mid-latitude scintillation event in the contiguous United States is reported here that was captured in ROTI maps produced using CORS GPS data collected during a space weather storm. The analyses conducted in this work and previously by another group indicate that ROTI is a good occurrence indicator of both amplitude and phase scintillations of GPS L-band signals, even though the magnitudes of ROTI, S4, and sigma(sub phi) can be different. For example, our analysis indicates that prominent ROTI and the L1 phase scintillation (sigma(sub phi)) are well correlated temporally in the polar region while L1 amplitude scintillation rarely occurs. The differences are partially attributed to physics processes in different latitude regions, such as high-speed plasma convection in the polar region that can suppress the amplitude scintillation. An analysis of the impact of ionospheric scintillation on precise positioning, which requires use of dual-frequency phase data, is also conducted. The results indicate that significant (more than an order of magnitude) positioning errors can occur under phase scintillation conditions.

ionospheric measurements↗

Assimilation of AERONET and MODIS AOT Observations Using Variational and Ensemble Data Assimilation Methods and Its Impact on Aerosol Forecasting Skill

Data assimilation of Aerosol Robotic Network (AERONET) and Moderate Resolution Imaging Spectroradiometer (MODIS) aerosol optical thickness (AOT) for aerosol forecasting was tested within the Navy Aerosol Analysis Prediction System (NAAPS) framework, using variational and ensemble data assimilation methods. Navy aerosol forecasting currently makes use of a deterministic NAAPS simulation coupled to Navy Variational Data Assimilation System for aerosol optical depth, a two-dimensional variational data assimilation system, for MODIS AOT assimilation. An ensemble version of NAAPS (ENAAPS) coupled to an ensemble adjustment Kalman filter (EAKF) from the Data Assimilation Research Testbed was recently developed, allowing for a range of data assimilation and forecasting experiments to be run with deterministic NAAPS and ENAAPS. The main findings are that the EAKF, with its flow-dependent error covariances, makes better use of sparse observations such as AERONET AOT. Assimilating individual AERONET observations in the two-dimensional variational system can increase the analysis errors when observations are located in high AOT gradient regions. By including AERONET with MODIS AOT assimilation, the magnitudes of peak aerosol events (AOT> 1) were better captured with improved temporal variability, especially in India and Asia where aerosol prediction is a challenge. Assimilating AERONET AOT with MODIS had little impact on the 24 h forecast skill compared to MODIS assimilation only, but differences were found downwind of AERONET sites. The 24 h forecast skill was approximately the same for forecasts initialized with analyses from AERONET AOT assimilation alone compared to MODIS assimilation, particularly in regions where the AERONET network is dense; including the United States and Europe, indicating that AERONET could serve as a backup observation network for over-land synoptic-scale aerosol events.

Rubin, Juli I.↗

Bayesian calibration of groundwater models with input data uncertainty

Effective water resources management typically relies on numerical models to analyze groundwater flow and solute transport processes. Groundwater models are often subject to input data uncertainty, as some inputs (such as recharge and well pumping rates) are estimated and subject to uncertainty. Current practices of groundwater model calibration often overlook uncertainties in input data; this can lead to biased parameter estimates and compromised predictions. Through a synthetic case study of surface–ground water interaction under changing pumping conditions and land use, we investigate the impacts of uncertain pumping and recharge rates on model calibration and uncertainty analysis. We then present a Bayesian framework of model calibration to handle uncertain input of groundwater models. The framework implements a marginalizing step to account for input data uncertainty when evaluating likelihood. It was found that not accounting for input uncertainty may lead to biased, overconfident parameter estimates because parameters could be over–adjusted to compensate for possible input data errors. Parameter compensation can have deleterious impacts when the calibrated model is used to make forecast under a scenario that is different from calibration conditions. By marginalizing input data uncertainty, the Bayesian calibration approach effectively alleviates parameter compensation and gives more accurate predictions in the synthetic case study. The marginalizing Bayesian method also decomposes prediction uncertainty into uncertainties contributed by parameters, input data, and measurements. Furthermore, the results underscore the need to account for input uncertainty to better inform postmodeling decision making.

54 ENVIRONMENTAL SCIENCES↗

Observation of Absorbing Aerosols Above Clouds over the South-East Atlantic Ocean from the Geostationary Satellite SEVIRI – Part 1: Method Description and Sensitivity

High temporal resolution observations from satellites have a great potential for studying the impact of biomass burning aerosols and clouds over the South East Atlantic Ocean (SEAO). This paper presents a method developed to retrieve simultaneously aerosol and cloud properties in aerosol above cloud conditions from the geostationary instrument Meteosat Second Generation/Spinning Enhanced Visible and Infrared Imager (MSG/SEVIRI). The above-cloud Aerosol Optical Thickness (AOT), the Cloud Optical Thickness (COT) and the Cloud droplet Effective Radius (CER) are derived from the spectral contrast and the magnitude of the signal measured in three channels in the visible to shortwave infrared region. The impact of the absorption from atmospheric gases on the satellite signal is corrected by applying transmittances calculated using the water vapour profiles from a Met Office forecast model. The sensitivity analysis shows that a 10% error on the humidity profile leads to an 18.5% bias on the above-cloud AOT, which highlights the importance of an accurate atmospheric correction scheme. In situ measurements from the CLARIFY-2017 airborne field campaign are used to constrain the aerosol size distribution and refractive index that is assumed for the aforementioned retrieval algorithm. The sensitivities in the retrieved AOT, COT and CER to the aerosol model assumptions are assessed. Between 09:00-15:00 UTC, an uncertainty of 40% is estimated on the above-cloud AOT, which is dominated by the sensitivity of the retrieval to the single scattering albedo. The absorption AOT is less sensitive to the aerosol assumptions with an uncertainty generally lower than 17% between 09:00-15:00 UTC. Outside of that time range, as the scattering angle decreases, the sensitivity of the AOT and the absorption AOT to the aerosol model increases. The retrieved cloud properties are only weakly sensitive to the aerosol model assumptions throughout the day, with biases lower than 6% on the COT and 3% on the CER. The stability of the retrieval over time is analysed. For observations outside of the backscattering glory region, the time-series of the aerosol and cloud properties are physically consistent, which confirms the ability of the retrieval to monitor the temporal evolution of aerosol above cloud events over the SEAO.

Peers, Fanny↗

Observation of absorbing aerosols above clouds over the south-east Atlantic Ocean from the geostationary satellite SEVIRI – Part 1: Method description and sensitivity

High-temporal-resolution observations from satellites have a great potential for studying the impact of biomass burning aerosols and clouds over the south-east Atlantic Ocean (SEAO). This paper presents a method developed to simultaneously retrieve aerosol and cloud properties in aerosol above-cloud conditions from the geostationary instrument Meteosat Second Generation/Spinning Enhanced Visible and Infrared Imager (MSG/SEVIRI). The above-cloud aerosol optical thickness (AOT), the cloud optical thickness (COT) and the cloud droplet effective radius (CER) are derived from the spectral contrast and the magnitude of the signal measured in three channels in the visible to shortwave infrared region. The impact of the absorption from atmospheric gases on the satellite signal is corrected by applying transmittances calculated using the water vapour profiles from a Met Office forecast model. The sensitivity analysis shows that a 10 % error on the humidity profile leads to an 18.5 % bias on the above-cloud AOT, which highlights the importance of an accurate atmospheric correction scheme. In situ measurements from the CLARIFY-2017 airborne field campaign are used to constrain the aerosol size distribution and refractive index that is assumed for the aforementioned retrieval algorithm. The sensitivities in the retrieved AOT, COT and CER to the aerosol model assumptions are assessed. Between 09:00 and 15:00 UTC, an uncertainty of 40 % is estimated on the above-cloud AOT, which is dominated by the sensitivity of the retrieval to the single-scattering albedo. The absorption AOT is less sensitive to the aerosol assumptions with an uncertainty generally lower than 17 % between 09:00 and 15:00 UTC. Outside of that time range, as the scattering angle decreases, the sensitivity of the AOT and the absorption AOT to the aerosol model increases. The retrieved cloud properties are only weakly sensitive to the aerosol model assumptions throughout the day, with biases lower than 6 % on the COT and 3 % on the CER. The stability of the retrieval over time is analysed. For observations outside of the backscattering glory region, the time series of the aerosol and cloud properties are physically consistent, which confirms the ability of the retrieval to monitor the temporal evolution of aerosol above-cloud events over the SEAO.

cloud properties↗

Assimilation of SMAP Observations Over Land Improves the Simulation and Prediction of Tropical Cyclone Idai

This work is focused on the role of soil moisture in the prediction of tropical cyclones (TCs) approaching land and after landfall. Soil moisture conditions can impact the circulation and structure of an existing tropical cyclone (TC) when part or all of the circulation is over land. For example, dry land surface conditions may lead to faster dissipation of a TC over land (often associated with changes in precipitation structure), whereas very wet conditions may help sustain or in rare cases re-intensify a TC. Moreover, the presence of strong soil moisture gradients may affect the symmetry and development of the TC circulation leading to changes in its over-land track. While the link between soil moisture conditions and TC evolution in proximity to land is relatively well understood in theory, applications of these findings in the context of numerical weather prediction (NWP) have been limited. Here we present a case study that explores the potential of improving TC predictions through an improved soil moisture initialization in an NWP framework. Specifically, we examine the impact of assimilating observations from the NASA Soil Moisture Active Passive (SMAP) mission into the NASA Goddard Earth Observing System (GEOS) global weather model on the prediction of South-West Indian Ocean TC Idai (2019). SMAP provides accurate L-band (1.4 GHz) brightness temperatures (Tb) observations that are sensitive to soil moisture globally and at high revisit times of 2-3 days. It has previously been shown that the assimilation of SMAP Tb observations significantly improves modeled land surface states. Thus, it is expected that SMAP can be used to constrain land surface initial conditions and potentially benefit TC forecasts. Here we present two sets of retrospective forecasts of TC Idai that are compared in an Observing System Experiment framework at ¼ degree resolution: (i) forecasts initialized from an analysis that is comparable to the GEOS operational analysis (without SMAP Tb assimilation) and (ii) forecasts initialized from an analysis that additionally assimilates SMAP brightness temperature observations over land using a weakly-coupled land analysis. We find that the assimilation of SMAP meaningfully improves the representation of TC Idai’s structure as well as the prediction of its intensity and track. The analyzed TC size, as measured by the wind speed radius, is improved by up to 18% in the analysis with SMAP assimilation relative to the control run. The forecast intensity error, measured against the observed intensity, is reduced by up to 23%. At the 1/4-degree resolution used here, GEOS unavoidably under-estimates TC intensity and over-estimates TC size. The SMAP assimilation therefore corrects the model in the right direction, leading to a storm that is more energetic and more compact. Furthermore, we find that the along-track forecast error is reduced by up to 34%, indicating a more accurate propagation speed, which is consistent with the fact that TC speed over land is strongly affected by surface processes. The impact of SMAP assimilation on the forecast cross-track error is neutral. Across the TC forecast skill metrics used here, the improvements from SMAP DA are largest at lead times of 36 to 72 hours, suggesting that the predictability of forecasts at shorter lead times may be dominated by short-term convective processes, while the land and its longer memory gains in importance as a source of predictability on a 2-3 day timescale. We further investigated the underlying mechanisms leading to the skill improvements from SMAP data assimilation by isolating the land areas that directly influence TC Idai using a back trajectory analysis. We find that the assimilation of SMAP leads to wetter soil moisture conditions that cause an increased latent heat flux, which ultimately results in TC analyzed representation that has higher column-integrated total moisture content and total energy compared to the analysis in the control run without SMAP assimilation. Overall, the results highlight that the assimilation of SMAP observations into a global numerical weather prediction model can lead to pronounced improvements of TC predictions. This is a crucial step towards a better mitigation of the socio-economic impact of landfalling TCs and thus safeguarding human lives. Finally, our study presents an event-based approach that assesses the impact of land data assimilation for a particular weather event rather than by globally averaging differences in skill. We argue that global skill assessments – while necessary – can mute the impact of land data assimilation, because the land’s influence on the atmosphere is constrained to certain locations and certain times. Instead, the event-based approach better highlights the true potential of land data assimilation in the context of NWP, especially for extreme events when accurate predictions are critical.

Jana Kolassa↗