Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Extreme Precipitation and High-Impact Landslides

It is well known that extreme or prolonged rainfall is the dominant trigger of landslides; however, there remain large uncertainties in characterizing the distribution of these hazards and meteorological triggers at the global scale. Researchers have evaluated the spatiotemporal distribution of extreme rainfall and landslides at local and regional scale primarily using in situ data, yet few studies have mapped rainfall-triggered landslide distribution globally due to the dearth of landslide data and consistent precipitation information. This research uses a newly developed Global Landslide Catalog (GLC) and a 13-year satellite-based precipitation record from Tropical Rainfall Measuring Mission (TRMM) data. For the first time, these two unique products provide the foundation to quantitatively evaluate the co-occurence of precipitation and rainfall-triggered landslides globally. The GLC, available from 2007 to the present, contains information on reported rainfall-triggered landslide events around the world using online media reports, disaster databases, etc. When evaluating this database, we observed that 2010 had a large number of high-impact landslide events relative to previous years. This study considers how variations in extreme and prolonged satellite-based rainfall are related to the distribution of landslides over the same time scales for three active landslide areas: Central America, the Himalayan Arc, and central-eastern China. Several test statistics confirm that TRMM rainfall generally scales with the observed increase in landslide reports and fatal events for 2010 and previous years over each region. These findings suggest that the co-occurrence of satellite precipitation and landslide reports may serve as a valuable indicator for characterizing the spatiotemporal distribution of landslide-prone areas in order to establish a global rainfall-triggered landslide climatology. This research also considers the sources for this extreme rainfall, citing teleconnections from ENSO as likely contributors to regional precipitation variability. This work demonstrates the potential for using satellite-based precipitation estimates to identify potentially active landslide areas at the global scale in order to improve landslide cataloging and quantify landslide triggering at daily, monthly and yearly time scales.

Kirschbaum, Dalia↗

CloudSat-Constrained Cloud Ice Water Path and Cloud Top Height Retrievals from MHS 157 and 183.3 GHz Radiances

Ice water path (IWP) and cloud top height (ht) are two of the key variables in determining cloud radiative and thermodynamical properties in climate models. Large uncertainty remains among IWP measurements from satellite sensors, in large part due to the assumptions made for cloud microphysics in these retrievals. In this study, we develop a fast algorithm to retrieve IWP from the 157, 183.3+/-3 and 190.3 GHz radiances of the Microwave Humidity Sounder (MHS) such that the MHS cloud ice retrieval is consistent with CloudSat IWP measurements. This retrieval is obtained by constraining the empirical forward models between collocated and coincident measurements of CloudSat IWP and MHS cloud-induced radiance depression (Tcir) at these channels. The empirical forward model is represented by a lookup table (LUT) of Tcir-IWP relationships as a function of ht and the frequency channel.With ht simultaneously retrieved, the IWP is found to be more accurate. The useful range of the MHS IWP retrieval is between 0.5 and 10 kg/sq m, and agrees well with CloudSat in terms of the normalized probability density function (PDF). Compared to the empirical model, current operational radiative transfer models (RTMs) still have significant uncertainties in characterizing the observed Tcir-IWP relationships. Therefore, the empirical LUT method developed here remains an effective approach to retrieving ice cloud properties from the MHS-like microwave channels.

cloud top height↗

Sensitivity of Simulated Global Ocean Carbon Flux Estimates to Forcing by Reanalysis Products

Reanalysis products from MERRA, NCEP2, NCEP1, and ECMWF were used to force an established ocean biogeochemical model to estimate air-sea carbon fluxes (FCO2) and partial pressure of carbon dioxide (pCO2) in the global oceans. Global air-sea carbon fluxes and pCO2 were relatively insensitive to the choice of forcing reanalysis. All global FCO2 estimates from the model forced by the four different reanalyses were within 20% of in situ estimates (MERRA and NCEP1 were within 7%), and all models exhibited statistically significant positive correlations with in situ estimates across the 12 major oceanographic basins. Global pCO2 estimates were within 1% of in situ estimates with ECMWF being the outlier at 0.6%. Basin correlations were similar to FCO2. There were, however, substantial departures among basin estimates from the different reanalysis forcings. The high latitudes and tropics had the largest ranges in estimated fluxes among the reanalyses. Regional pCO2 differences among the reanalysis forcings were muted relative to the FCO2 results. No individual reanalysis was uniformly better or worse in the major oceanographic basins. The results provide information on the characterization of uncertainty in ocean carbon models due to choice of reanalysis forcing.

MERRA↗

Assessment of the Gaussian Covariance Approximation over an Earth-Asteroid Encounter Period

In assessing the risk an asteroid may pose to the Earth, the asteroids state is often predicted for many years, often decades. Only by accounting for the asteroids initial state uncertainty can a measure of the risk be calculated. With the asteroids state uncertainty growing as a function of the initial velocity uncertainty, orbit velocity at the last state update, and the time from the last update to the epoch of interest, the asteroids position uncertainties can grow to many times the size of the Earth when propagated to the encounter risk corridor. This paper examines the merits of propagating the asteroids state covariance as an analytical matrix. The results of this study help to bound the efficacy of applying different metrics for assessing the risk an asteroid poses to the Earth. Additionally, this work identifies a criterion for when different covariance propagation methods are needed to continue predictions after an Earth-encounter period.

planetary defense↗

Assessment of the Gaussian Covariance Approximation over an Earth-Asteroid Encounter Period

In assessing the risk an asteroid may pose to the Earth, the asteroids state is often predicted for many years, often decades. Only by accounting for the asteroids initial state uncertainty can a measure of the risk be calculated. With the asteroids state uncertainty growing as a function of the initial velocity uncertainty, orbit velocity at the last state update, and the time from the last update to the epoch of interest, the asteroids position uncertainties can grow to many times the size of the Earth when propagated to the encounter risk corridor. This paper examines the merits of propagating the asteroids state covariance as an analytical matrix. The results of this study help to bound the efficacy of applying different metrics for assessing the risk an asteroid poses to the Earth. Additionally, this work identifies a criterion for when different covariance propagation methods are needed to continue predictions after an Earth-encounter period.

uncertainty characterization↗

NASA's Black Marble Nighttime Lights Product Suite

NASA's Black Marble nighttime lights product suite (VNP46) is available at 500 meters resolution since January 2012 with data from the Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) onboard the Suomi National Polar-orbiting Platform (SNPP). The retrieval algorithm, developed and implemented for routine global processing at NASA's Land Science Investigator-led Processing System (SIPS), utilizes all high-quality, cloud-free, atmospheric-, terrain-, vegetation-, snow-, lunar-, and stray light-corrected radiances to estimate daily nighttime lights (NTL) and other intrinsic surface optical properties. Key algorithm enhancements include: (1) lunar irradiance modeling to resolve non-linear changes in phase and libration; (2) vector radiative transfer and lunar bidirectional surface anisotropic reflectance modeling to correct for atmospheric and BRDF (Bidirectional Reflectance Distribution Function) effects; (3) geometric-optical and canopy radiative transfer modeling to account for seasonal variations in NTL; and (4) temporal gap-filling to reduce persistent data gaps. Extensive benchmark tests at representative spatial and temporal scales were conducted on the VNP46 time series record to characterize the uncertainties stemming from upstream data sources. Initial validation results are presented together with example case studies illustrating the scientific utility of the products. This includes an evaluation of temporal patterns of NTL dynamics associated with urbanization, socioeconomic variability, cultural characteristics, and displaced populations affected by conflict. Current and planned activities under the Group on Earth Observations (GEO) Human Planet Initiative are aimed at evaluating the products at different geographic locations and time periods representing the full range of retrieval conditions.

Suomi-NPP↗

Analytical Techniques for Retrieval of Atmospheric Composition with the Quadrupole Mass Spectrometer of the Sample Analysis at Mars Instrument Suite on Mars Science Laboratory

The Sample Analysis at Mars (SAM) instrument suite is the largest scientific payload on the Mars Science Laboratory (MSL) Curiosity rover, which landed in Mars׳ Gale Crater in August 2012. As a miniature geochemical laboratory, SAM is well-equipped to address multiple aspects of MSL׳s primary science goal, characterizing the potential past or present habitability of Gale Crater. Atmospheric measurements support this goal through compositional investigations relevant to martian climate evolution. SAM instruments include a quadrupole mass spectrometer, a tunable laser spectrometer, and a gas chromatograph that are used to analyze martian atmospheric gases as well as volatiles released by pyrolysis of solid surface materials (Mahaffy et al., 2012). This report presents analytical methods for retrieving the chemical and isotopic composition of Mars׳ atmosphere from measurements obtained with SAM׳s quadrupole mass spectrometer. It provides empirical calibration constants for computing volume mixing ratios of the most abundant atmospheric species and analytical functions to correct for instrument artifacts and to characterize measurement uncertainties. Finally, we discuss differences in volume mixing ratios of the martian atmosphere as determined by SAM (Mahaffy et al., 2013) and Viking (Owen et al., 1977, Oyama and Berdahl, 1977) from an analytical perspective. Although the focus of this paper is atmospheric observations, much of the material concerning corrections for instrumental effects also applies to reduction of data acquired with SAM from analysis of solid samples.

quadropole mass spectometer↗

Updates of Moderate Resolution Imaging Spectroradiometer On-Orbit Calibration Uncertainty Assessments

The Moderate Resolution Imaging Spectroradiometer (MODIS) instruments have successfully operated for more than 18 and 16 years, respectively, on-board the NASA’s Earth Observing System Terra and Aqua spacecraft. Both Terra and Aqua MODIS have significantly contributed to the advance of global Earth remote sensing applications with a broad range of science products that have been continuously produced since the beginning of each mission and freely distributed to users worldwide. MODIS collects data in 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB), covering wavelengths from 0.41 to 14.4 μm. Its level 1B (L1B) data products, which provide the input for the MODIS high-level science products, include the top of the atmosphere reflectance factors for the RSB, radiances for both the RSB and TEB, and associated uncertainty indices (UI) at a pixel-by-pixel level. This paper provides a brief review of MODIS L1B calibration algorithms, including a number of improvements made in recent years. It presents an update of sensor calibration uncertainty assessments with a focus on several new contributors resulting from on-orbit changes in sensor characteristics, approaches developed to address these changes, and the impact due to on-orbit changes on the L1B data quality. Also discussed are remaining challenges and potential improvements to be made to continuously maintain sensor calibration and data quality, particularly those related to the quality of MODIS L1B uncertainty.

Spectroradiometer↗

NASA's Black Marble Product Suite: Validation Strategy

NASA's Black Marble nighttime lights product suite (VNP46) is available at 500m resolution since January 2012 with data fro the Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) onboard the Suomi National Polar-orbiting Platform (SNPP). The retrieval algorithm, developed and implemented for routine global processing at NASA's Land Science Investigator-led Processing System (SIPS), utilizes all high-quality, cloud-free, atmospheric-terrain, vegetation, snow, lunar and stray light corrected radiances to estimate daily nighttime lights (NTL) and other intrinsic surface optical properties. Extensive benchmark tests at representative spatial and temporal scales were conducted on the VNP46 time series record to characterize the uncertainties stemming from upstream data sources. Current and planned validation activities under the Group on Earth Observations (GEO) Human Planet Initiative are aimed at evaluating the products at difference geographic locations and time periods representing the full range of retrieval conditions.

GEO Human Planet↗

Physical Evaluation of GPM DPR Single- and Dual-Wavelength Algorithms

A physical evaluation of the rain profiling retrieval algorithms for the Dual-frequency Precipitation Radar (DPR) aboard the Global Precipitation Measurement (GPM) core satellite is carried out by applying them to the hydrometeor profiles generated from measured raindrop size distributions (DSD). The DSD-simulated radar profiles are used as input to the algorithms, and their estimates of hydrometeors' parameters are compared with the same quantities derived directly from the DSD data (or truth). The retrieval accuracy is assessed by the degree to which the estimates agree with the truth. To check the validity and robustness of the retrievals, the profiles are constructed for cases ranging from fully correlated (or uniform) to totally uncorrelated DSDs along the columns. Investigation into the sensitivity of the retrieval results to the model assumptions is made to characterize retrieval uncertainties and identify error sources. Comparisons between the single- and dual-wavelength algorithm performance are carried out with either a single- or dual-wavelength constraint of the path integral or differential path integral attenuation. The results suggest that the DPR dual-wavelength algorithm generally provides accurate range-profiled estimates of rainfall rate and mass-weighted diameter with the dual-wavelength estimates superior in accuracy to those from the single-wavelength retrievals.

Liang Liao↗

An AeroCom–AeroSat study: intercomparison of satellite AOD datasets for aerosol model evaluation

To better understand and characterize current uncertainties in the important observational constraint of climate models of aerosol optical depth (AOD), we evaluate and intercompare 14 satellite products, representing nine different retrieval algorithm families using observations from five different sensors on six different platforms. The satellite products (super-observations consisting of 1°×1° daily aggregated retrievals drawn from the years 2006, 2008 and 2010) are evaluated with AErosol RObotic NETwork (AERONET) and Maritime Aerosol Network (MAN) data. Results show that different products exhibit different regionally varying biases (both under- and overestimates) that may reach ±50 %, although a typical bias would be 15 %–25 % (depending on the product). In addition to these biases, the products exhibit random errors that can be 1.6 to 3 times as large. Most products show similar performance, although there are a few exceptions with either larger biases or larger random errors. The intercomparison of satellite products extends this analysis and provides spatial context to it. In particular, we show that aggregated satellite AOD agrees much better than the spatial coverage (often driven by cloud masks) within the 1°×1° grid cells. Up to ∼50 % of the difference between satellite AOD is attributed to cloud contamination. The diversity in AOD products shows clear spatial patterns and varies from 10 % (parts of the ocean) to 100 % (central Asia and Australia). More importantly, we show that the diversity may be used as an indication of AOD uncertainty, at least for the better performing products. This provides modellers with a global map of expected AOD uncertainty in satellite products, allows assessment of products away from AERONET sites, can provide guidance for future AERONET locations and offers suggestions for product improvements. We account for statistical and sampling noise in our analyses. Sampling noise, variations due to the evaluation of different subsets of the data, causes important changes in error metrics. The consequences of this noise term for product evaluation are discussed.

Aerosol↗

Transitioning TEMPO Data for Air Quality Management Applications at the NASA SPoRT Center

The TEMPO mission has been observing air pollutants every hour during the daytime across its Field of Regard (FoR) covering greater North America since First Light on August 2, 2023. The highly anticipated public release of TEMPO data occurred on May 20, 2024, consisting of level 2 and level 3 trace gas data products of nitrogen dioxide, formaldehyde, and ozone. The NASA SPoRT Center is developing value-added products and tools to support the TEMPO mission and Early Adopters program with special attention on stakeholder from air agencies. One component of our work is focused on evaluating the TEMPO products over stakeholder target areas using Pandora and surface monitor observations to characterize the uncertainties and develop best practices for processing and analyzing TEMPO data. Methods for oversampling TEMPO data to 1 km resolution are being applied over the target areas to resolve fine-scale emission sources and pollutant gradients. Machine learning techniques using TEMPO, surface monitor, and model data to estimate surface-level nitrogen dioxide concentrations are being developed over the target areas. A SPoRT viewer for TEMPO has been launched for providing visualizations of the TEMPO products and an ArcGIS dashboard is being designed for enabling air agency stakeholders to efficiently analyze TEMPO data. Training materials including user guides are being developed to ensure the effective and sustained use of TEMPO data at our stakeholder agencies. One major goal of our TEMPO initiatives at SPoRT is to better enable the inclusion of TEMPO data in air quality management applications such as exceptional event demonstrations through our close engagement with stakeholders. This talk will provide an update on our SPoRT activities and showcase use cases of TEMPO data for monitoring different emission sources including wildland fire smoke.

Air Quality↗

A Performance Forecasting Framework for Concentrating Solar Power Systems

This presentation will summarize a methodology used to characterize the uncertainty in performance of a contrived CSP project. As well as develop a case study in which we backcast the projected and actual annual performance of an existing plant. Finally will highlight the importance of several assumptions and the use of time series inputs in obtaining realistic estimates.

concentrating solar power↗

Characterizing Supernovae Neutrinos in MARLEY

This summer I worked on characterizing the uncertainties in neutrino-argon interactions due to the optical model potential. Functionally, this was a great deal of new experience coding in C++. I wrote a script using MARLEY(Gardiner 2019) to compute both the branching ratios and exclusive cross sections for a whole host of different decay processes from the unstable Potassium nucleus created by a v+Ar charged current interaction. These decays were computed through MARLEY, governed by a global parametrization of the Optical Model potential(Koning-Delaroche 2003). Helpfully, Pruitt+ 2023 provided public supplemental material outlining 400 separate "universes" for the optical model potential parameters. These "universes" represent uncertainties on the optical potential itself, and I wrote code to incorporate them into the MARLEY framework and quantify their impact on the predictions of neutrino-argon cross sections. This stands as the first computation of nuclear de-excitation systematic errors on cross sections in this energy band for v+Ar interactions, a critical step to understanding the science we can do with DUNE in the tens-of-MeV band.

Abu El-Haj, Luca↗

Importance of cross reaction covariance data for user applications

The characterization of the uncertainty in radiation damage metrics presents many challenges. This paper examines the current approaches to characterizing radiation damage metrics such as hydrogen and helium gas production, material heating, trapped charge in microelectronics, and lattice displacement damage. Critical uncertainty aspects go beyond just the material cross sections and involve the consideration of energy-dependent cross reaction correlations, the recoil ion energy spectrum, and models used for the partitioning of the recoil ion energy into various forms of energy deposition. This paper starts with a review of terminology and then examines the current approaches in the characterization of uncertainty in radiation damage metrics for several applications. The major deficiencies in the uncertainty of the damage metric characterization are also identified.

36 MATERIALS SCIENCE↗

Probabilistic predictions and uncertainty estimation for radiological and nuclear effects modeling

Better characterization of meteorological uncertainty is needed to predict the effects of radiological and nuclear releases in the atmosphere. Multi-physics ensembles of atmospheric simulations can estimate uncertainty of physical processes, but they are often limited for computational reasons. Because weather uncertainty is important for emergency response applications, but the conventional way of running multi-physics ensembles is infeasible, we have developed new machine learning-based methods that quickly estimate and identify key sources of meteorological uncertainty. Machine learning accelerates the analysis of weather uncertainty by iteratively learning about model physics options that affect plume predictions. We have demonstrated the power of machine learning by creating a large multi-physics weather and dispersion ensemble dataset containing 1,200 simulations for two hypothetical radiological release scenarios. By training on less than 10% of the ensemble, we can quickly and accurately predict different outcomes, including the mass of radiological material deposited and spatial distribution and extent of contaminated areas.

54 ENVIRONMENTAL SCIENCES↗

SMART Deliverable 6.1.2a: Application of the ORION tool to the IBDP Carbon Storage Site

Forecasting and managing potential induced seismic activity is one of the challenges facing commercialscale geologic carbon sequestration (GCS), as well as other geologic energy extraction and byproduct disposal technologies. Historically, the process to develop robust, science-based forecasts of induced seismicity has required an integrated effort from experts in seismology, geomechanics, and reservoir engineering to manage data, develop and evaluate models of subsurface processes, and to calibrate and interpret the results from a range of models to understand site behavior relative to prescribed standards and in the context of uncertainty in geologic characterization data, forecasting models, and operational scenario uncertainty. The Operational Forecasting of Induced Seismicity (ORION) toolkit is an open-source, observation-based forecasting toolkit that is being co-developed by two U.S. DOE-funded initiatives: the National Risk Assessment Partnership (NRAP) and the Scienceinformed Machine Learning for Accelerating Real Time Decisions in Subsurface Applications (SMART) Initiative. ORION is designed to provide functionality to support decision making about seismic hazard analysis and risk management for GCS stakeholders ranging from the public to site operators to expert seismologists. The tool, which is written as open-source code in the Python programming language, is composed of a desktop graphical user interface (GUI) and an underlying forecasting engine. The forecasting engine uses available reservoir properties, well and fluid injection scenario details, and observed seismic catalog data as inputs to produce a set of temporal and spatio-temporal seismic forecasts.

58 GEOSCIENCES↗

Evaluation of Improved Pushback Forecasts Derived from Airline Ground Operations Data

Accurate and timely predictions of airline pushbacks can potentially lead to improved performance of automated decision-support tools for airport surface traffic, thus reducing the variability and average duration of costly airline delays. One factor which affects the realization of these benefits is the level of uncertainty inherent in the turn processes. To characterize this inherent uncertainty, three techniques are developed for predicting time-to-go until pushback as a function of available ground-time; elapsed ground-time; and the status (not-started/in-progress/completed) of individual turn processes (cleaning, fueling, etc.). These techniques are tested against a large and detailed dataset covering approximately l0(exp 4) real-world turn operations obtained through collaboration with Deutsche Lufthansa AG. Even after the dataset is filtered to obtain a sample of turn operations with minimal uncertainty, the standard deviation of forecast error for all three techniques is lower-bounded away from zero, indicating that turn operations have a significant stochastic component. This lower-bound result shows that decision-support tools must be designed to incorporate robust mechanisms for coping with pushback demand stochasticity, rather than treating the pushback demand process as a known deterministic input.

Carr, Francis↗