Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Assessment of MODIS Reflected Solar Calibration Uncertainty

Determination of the calibration accuracy and traceability of a remote sensing instrument is a driving issue in the use of satellite data for calibration inter-comparisons and studying climate change. The Terra and Aqua MODerate Resolution Imaging Spectroradiometer (MODIS) instruments have successfully operated for more than 11 and 9 years, respectively. Twenty of the thirty six MODIS spectral bands are in the reflected solar region with center wavelengths ranging from 0.41 to 2.2 microns. MODIS reflective solar band (RSB) on-orbit calibration is reflectance based through the use of an on-board solar diffuser (SO). The calibration uncertainty requirements are +/-2.0% for the RSB reflectance factors at sensor specified typical scene reflectances or radiances. The SO bi-directional reflectance factor (BRF) was characterized pre-launch and its on-orbit changes are tracked by an on-board solar diffuser stability monitor (SDSM). This paper provides an assessment of MODIS RSB on-orbit calibration traceability and uncertainty for its Level 1B (L1B) reflectance factors. It examines in details each of the uncertainty contributors, including those from pre-launch measurements as well as on-orbit observations. Common challenging issues and differences due to individual sensors' specific characteristics and on-orbit performance are also discussed in this paper. Guidance and recommendations are presented, based on lessons from MODIS RSB calibration uncertainty assessment, for the development of future instrument calibration and validation plans.

Xiong, Xiaoxiong↗

MODIS On-orbit Calibration Uncertainty Assessment

MODIS has 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB). Compared to its heritage sensors, MODIS was developed with very stringent calibration uncertainty requirements. As a result, MODIS was designed and built with a set of on-board calibrators (OBC), which allow key sensor performance parameters and on-orbit calibration coefficients to be monitored and updated. In terms of its calibration traceability, MODIS RSB calibration is reflectance based using an on-board solar diffuser (SD) and the TEB calibration is radiance based using an on-board blackbody (BB). In addition to on-orbit calibration coefficients derived from its OBC, calibration parameters determined from sensor pre-launch calibration and characterization are used in both the RSB and TEB calibration and retrieval algorithms. This paper provides a brief description of MODIS calibration methodologies and an in-depth analysis of its on-orbit calibration uncertainties. Also discussed in this paper are uncertainty contributions from individual components and differences due to Terra and Aqua MODIS instrument characteristics and on-orbit performance.

Chiang, Vincent↗

Updates of Moderate Resolution Imaging Spectroradiometer On-Orbit Calibration Uncertainty Assessments

The Moderate Resolution Imaging Spectroradiometer (MODIS) instruments have successfully operated for more than 18 and 16 years, respectively, on-board the NASA’s Earth Observing System Terra and Aqua spacecraft. Both Terra and Aqua MODIS have significantly contributed to the advance of global Earth remote sensing applications with a broad range of science products that have been continuously produced since the beginning of each mission and freely distributed to users worldwide. MODIS collects data in 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB), covering wavelengths from 0.41 to 14.4 μm. Its level 1B (L1B) data products, which provide the input for the MODIS high-level science products, include the top of the atmosphere reflectance factors for the RSB, radiances for both the RSB and TEB, and associated uncertainty indices (UI) at a pixel-by-pixel level. This paper provides a brief review of MODIS L1B calibration algorithms, including a number of improvements made in recent years. It presents an update of sensor calibration uncertainty assessments with a focus on several new contributors resulting from on-orbit changes in sensor characteristics, approaches developed to address these changes, and the impact due to on-orbit changes on the L1B data quality. Also discussed are remaining challenges and potential improvements to be made to continuously maintain sensor calibration and data quality, particularly those related to the quality of MODIS L1B uncertainty.

Spectroradiometer↗

VIIRS Thermal Emissive Bands L1B Calibration Uncertainty

The Visible Infrared Imaging Radiometer Suite (VIIRS) is a key instrument on-board the Suomi National Polar-orbiting Partnership (S-NPP) spacecraft. The S-NPP launched in October 2011 and it has been collecting valuable Earth science data with VIIRS and four other instruments for more than five years. The VIIRS Characterization Support Team (VCST) of the National Aeronautics and Space Administration (NASA) Science Investigator-led Processing Systems (SIPS) is designed to support the VIIRS sensor pre-launch geometric and radiometric characterization and to access on-orbit long-term Level-1B (L1B) calibration and performance. This paper reviews the VIIRS thermal emissive bands (TEB), covering wavelengths from 3.7 to 12.0 μm, L1B radiometric calibration algorithms and presents the calibration uncertainty methodology which will be implanted in the L1B processing software. Discussions will be focused on the key uncertainty parameters and the application in L1B.

S-NPP VIIRS TEB Uncertainty↗

The Simons Observatory: impact of bandpass, polarization angle and calibration uncertainties on small-scale power spectrum analysis

We study the effects due to mismatches in passbands, polarization angles, and temperature and polarization calibrations in the context of the upcoming cosmic microwave background experiment Simons Observatory (SO). Using the SO multi-frequency likelihood, we estimate the bias and the degradation of constraining power in cosmological and astrophysical foreground parameters assuming different levels of knowledge of the instrumental effects. We find that incorrect but reasonable assumptions about the values ofall the systematics examined here can have significant effects on cosmologicalanalyses, hence requiring marginalization approaches at the likelihood level.When doing so, we find that the most relevant effect is due to bandpass shifts. When marginalizing over them, the posteriors of parameters describing astrophysical microwave foregrounds (such as radio point sources or dust) get degraded, while cosmological parameters constraints are not significantly affected.Marginalization over polarization angles with up to 0.25$^{°}$ uncertainty causes an irrelevant bias ≲ 0.05 σ in all parameters.Marginalization over calibration factors in polarization broadens the constraints on the effective number of relativistic degrees of freedom N$_{eff}$ by a factor 1.2, interpreted here as a proxy parameter for non standard model physics targeted by high-resolution CMB measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Calibration Uncertainty in Ocean Color Satellite Sensors and Trends in Long-term Environmental Records

Launched in late 2011, the Visible Infrared Imaging Radiometer Suite (VIIRS) aboard the Suomi National Polar-orbiting Partnership (NPP) spacecraft is being evaluated by NASA to determine whether this sensor can continue the ocean color data record established through the Sea-Viewing Wide Field-of-view Sensor (SeaWiFS) and the MODerate resolution Imaging Spectroradiometer (MODIS). To this end, Goddard Space Flight Center generated evaluation ocean color data products using calibration techniques and algorithms established by NASA during the SeaWiFS and MODIS missions. The calibration trending was subjected to some initial sensitivity and uncertainty analyses. Here we present an introductory assessment of how the NASA-produced time series of ocean color is influenced by uncertainty in trending instrument response over time. The results help quantify the uncertainty in measuring regional and global biospheric trends in the ocean using satellite remote sensing, which better define the roles of such records in climate research.

environment↗

Beyond pinball loss: Quantile methods for calibrated uncertainty quantification

Amongthemanywaysofquantifying uncertainty in a regression setting, specifying the full quantile function is attractive, as quantiles are amenable to interpretation and evaluation. A model that predicts the true conditional quantiles for each input, at all quantile levels, presents a correct and efficient representation of the underlying uncertainty. To achieve this, many current quantile-based methods focus on optimizing the pinball loss. However, this loss restricts the scope of applicable regression models, limits the ability to target many desirable properties (e.g. calibration, sharpness, centered intervals), and may produce poor conditional quantiles. In this work, we develop new quantile methods that address these shortcomings. In particular, we propose methods that can apply to any class of regression model, select an explicit balance between calibration and sharpness, optimize for calibration of centered intervals, and produce more accurate conditional quantiles. We provide a thorough experimental evaluation of our methods, which includes a high dimensional uncertainty quantification task in nuclear fusion.

97 MATHEMATICS AND COMPUTING↗

Bayesian Inference and the Effects of Varying Uncertainty Models in Charring Ablator Calibration and Uncertainty Quantification Problems

The Mars Science Laboratory (MSL) vehicle utilized a heat shield constructed from NASA’s Phenolic-Impregnated Carbon Ablator (PICA) material to protect the main structure from the high enthalpy environment encountered during hypersonic atmospheric entry. During the vehicle’s descent through Martian atmosphere, multiple thermocouples embedded within the heat shield captured in-depth material temperature data that allow for studies to be conducted on current material response reconstruction tools. In the present work, material temperature data obtained from thermocouples within the MISP-4 plug (MEDLI (Mars Science Laboratory Entry, Descent, and Landing Instrument) Integrated Sensor Plug) are utilized in the calibration of Theoretical Ablative Composite for Open Testing (TACOT) model parameters in conjunction with NASA’s Porous material Analysis Toolbox (PATO) through Bayesian inference where uncertainty due to parametric, modeling, and experimental sources is simultaneously quantified. Prior to the study, a sensitivity analysis is performed through computation of the robust Sobol indices in an effort to study the relationship between input space and model response and to reduce the dimensionality of the statistical inverse problem. The Bayesian inference methodology necessitates an a-priori choice to be made for the uncertainty model for which numerous possibilities are available. Across most works, however, only basic additive or multiplicative models are utilized with pre-defined magnitudes of uncertainty based on a-priori knowledge or to-be-calibrated multipliers of static covariance matrix structures. The present effort explores the effects of informed uncertainty models, ones with temporal dependence that are simultaneously calibrated through Bayesian inference, on calibrated results for parameters that make up the uncertain input space.

Sensitivity Analysis↗

Physics-based hybrid machine learning for critical heat flux prediction with uncertainty quantification

Critical heat flux (CHF) is a key quantity in nuclear system modeling due to its impact on heat transfer, safety margins, and reactor performance. This study develops and validates an uncertainty-aware hybrid modeling approach that combines machine learning with physics-based models to predict CHF in cases of dryout. The Biasi and Bowring empirical correlations were paired with three ML uncertainty quantification (UQ) techniques: deep neural network (DNN) ensembles, Bayesian neural networks (BNNs), and deep Gaussian processes (DGPs). A pure ML model without a base model was evaluated for comparison. Model performance was assessed under plentiful (7,350 points) and limited (9 points) training data scenarios using parity, uncertainty distributions, and calibration curves. Results show that the Biasi hybrid DNN ensemble achieved the best overall performance, with a mean absolute relative error of 1.846%, and well-calibrated uncertainty estimates. The BNN-based hybrids showed slightly higher error (2.14%) but superior uncertainty calibration. DGP models underperformed, with over 6% error and poor uncertainty calibration. All hybrid models outperformed pure machine learning configurations, demonstrating resistance against data scarcity. These findings indicate that hybrid modeling significantly improves predictive accuracy, interpretability, and resilience to data scarcity. The integration of uncertainty awareness provides actionable confidence in CHF predictions, which is vital for safety-critical decisions in nuclear applications. This hybrid approach offers a viable pathway for deploying ML models in reactor analysis tools while preserving domain knowledge and physical consistency.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

MODIS Radiometric Calibration and Uncertainty Assessment

Since launch, Terra and Aqua MODIS have collected more than II and 9 years of datasets for comprehensive studies of the Earth's land, ocean, and atmospheric properties. MODIS observations are made in 36 spectral bands: 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB). Compared to its heritage sensors, MODIS was developed with very stringent calibration and uncertainty requirements. As a result, MODIS was designed and built with a set of state of the art on-board calibrators (OBC), which allow key sensor performance parameters and on-orbit calibration coefficients to be monitored and updated if necessary. In terms of its calibration traceability, MODIS RSB calibration is reflectance based using an on-board solar diffuser (SD) and the TEB calibration is radiance based using an on-board blackbody (BB). In addition to on-orbit calibration coefficients derived from its OBC, calibration parameters determined from sensor pre-launch calibration and characterization are used in both the RSB and TEB calibration and retrieval algorithms. This paper provides a brief description of MODIS calibration methodologies and discusses details of its on-orbit calibration uncertainties. It assesses uncertainty contributions from individual components and differences between Terra and Aqua MODIS due to their design characteristics and on-orbit periormance. Also discussed in this paper is the use of MODIS LIB uncertainty index CUI) product.

Xiong, Xiaoxiong↗

Uncertainty Analysis of Inertial Model Attitude Sensor Calibration and Application with a Recommended New Calibration Method

Statistical tools, previously developed for nonlinear least-squares estimation of multivariate sensor calibration parameters and the associated calibration uncertainty analysis, have been applied to single- and multiple-axis inertial model attitude sensors used in wind tunnel testing to measure angle of attack and roll angle. The analysis provides confidence and prediction intervals of calibrated sensor measurement uncertainty as functions of applied input pitch and roll angles. A comparative performance study of various experimental designs for inertial sensor calibration is presented along with corroborating experimental data. The importance of replicated calibrations over extended time periods has been emphasized; replication provides independent estimates of calibration precision and bias uncertainties, statistical tests for calibration or modeling bias uncertainty, and statistical tests for sensor parameter drift over time. A set of recommendations for a new standardized model attitude sensor calibration method and usage procedures is included. The statistical information provided by these procedures is necessary for the uncertainty analysis of aerospace test results now required by users of industrial wind tunnel test facilities.

Tripp, John S.↗

Method for Ground-to-Space Laser Calibration System

The present invention comprises an approach for calibrating the sensitivity to polarization, optics degradation, spectral and stray light response functions of instruments on orbit. The concept is based on using an accurate ground-based laser system, Ground-to-Space Laser Calibration (GSLC), transmitting laser light to instrument on orbit during nighttime substantially clear-sky conditions. To minimize atmospheric contribution to the calibration uncertainty the calibration cycles should be performed in short time intervals, and all required measurements are designed to be relative. The calibration cycles involve ground operations with laser beam polarization and wavelength changes.

Lukashin, Constantine↗

Method for Ground-to-Satellite Laser Calibration System

The present invention comprises an approach for calibrating the sensitivity to polarization, optics degradation, spectral and stray light response functions of instruments on orbit. The concept is based on using an accurate ground-based laser system, Ground-to-Space Laser Calibration (GSLC), transmitting laser light to instrument on orbit during nighttime substantially clear-sky conditions. To minimize atmospheric contribution to the calibration uncertainty the calibration cycles should be performed in short time intervals, and all required measurements are designed to be relative. The calibration cycles involve ground operations with laser beam polarization and wavelength changes.

Lukashin, Constantine↗

Pre-launch Radiometric Calibration and Uncertainty Analysis of Landsat Thermal Infrared Sensor 2

The Thermal Infrared Sensor-2 that will be on-board Landsat 9 has undergone a pre-launch testing campaign to characterize its radiometric, spectral, and spatial performance and demonstrate compliance to its requirements. This work reviews key elements of the instrument-level radiometric testing using an SI traceable source to derive its uncertainties. Those arising from on-orbit calibration using the TIRS-2 on-board blackbody are also discussed. We use a Monte Carlo approach to propagate the uncertainties through a non-linear calibration equation and address both random and systematic uncertainty terms. Achieving the required performance demonstrates the instrument’s potential for enhancing our understanding of the Earth’s environment.

Landsat↗

Prelaunch Radiometric Calibration and Uncertainty Analysis of Landsat Thermal Infrared Sensor 2

The Thermal Infrared Sensor-2 (TIRS-2) that will be onboard Landsat 9 has undergone a prelaunch testing campaign to characterize its radiometric, spectral, and spatial performances and demonstrate compliance to its requirements. This work reviews the key elements of the instrument-level radiometric testing using an SI-traceable source to derive its uncertainties. Those arising from on-orbit calibration using the TIRS-2 onboard blackbody are also discussed. We use a Monte Carlo approach to propagate the uncertainties through a nonlinear calibration equation and address both random and systematic uncertainty terms. Achieving the required performance demonstrates the instrument's potential for enhancing our understanding of the Earth's environment.

Aaron Pearlman↗

Bayesian calibration and uncertainty quantification of a rate-dependent cohesive zone model for polymer interfaces

In this work we present a rate-dependent cohesive zone model for the fracture of polymeric interfaces and performs a Bayesian calibration, an uncertainty quantification, and a sensitivity analysis for the model. The proposed cohesive zone model accounts for both reversible elastic and irreversible rate-dependent separation sliding deformation at the interface. The viscous dissipation due to the irreversible opening at the interface is modeled using elastic-viscoplastic kinematics that incorporates the effects of strain rate. Inverse calibration of parameters for such complex models through trial and error is challenging due to the large number of parameters of the model. Moreover, the calibrated parameter values are often non-unique and uncertain when the available experimental data is limited. To tackle this challenge, we employ a Bayesian calibration approach to identify parameters from experimental data, the resulting parameters significantly enhance the accuracy of the model. To quantify the uncertainty associated with the inverse parameter estimation, a modular Bayesian approach is employed to calibrate the unknown model parameters, accounting for the parameter uncertainty of the cohesive zone model. The advantages of the Bayesian calibration over a deterministic parameter fit are demonstrated. Further, to quantify the model uncertainties, such as incorrect assumptions or missing physics, a discrepancy function is introduced, which significantly improves the model’s prediction. Finally, the total uncertainty of the model is quantified in a predictive setting. A sensitivity analysis is performed to assess how changes in the input variables of the model affect the peak load, facilitating the identification of a concise set of highly influential parameters. The present approach can be used for calibration and uncertainty quantification for other complex computational mechanics models. It should also facilitate the designing of interface materials under uncertainty.

42 ENGINEERING↗