Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty characterization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Robust Vision-based Multi-spacecraft Guidance Navigation and Control using CNN-based Pose Estimation

In this paper, we present an end-to-end simulation framework for tracking an uncooperative Target spacecraft in Low Earth Orbit using a CubeSat-class Ego spacecraft outfitted with a camera. Currently, capturing high-fidelity realistic images in space for this scenario is difficult and exorbitantly expensive. Therefore, we developed a framework to simulate the spacecraft orbits in Basilisk software and generate high-fidelity realistic images of spacecraft in Unreal Engine, including the effects from Sun, Earth, Moon and stars. The Ego spacecraft uses cameras to capture images of the uncooperative Target and estimates its position and attitude using a CNN based 6DOF pose estimation pipeline, eliminating need for large SWAP-C(Size, Weight, Power and Cost) sensors like LIDAR or reliance on inter-spacecraft communication, This CNN, which is motivated by ESA’s Pose Estimation challenge of 2019, is trained using simulated data from our end-to-end simulation framework. We compare the performance of two distinct CNNbased algorithms for pose estimation along a nominal trajectory. In presence of non-Gaussian modeling uncertainties, the statedependent estimation error is characterized with a quadratic upper-bound. The quadratically-bounded error can be used by a robust controller to maneuver

Rahmani, Amir↗

Effects of Natural Variability on the Use of Standard Deviation to Represent Measurement Uncertainties in Atmospheric Composition Studies

Measurement uncertainty is defined as a “non-negative parameter characterizing the dispersion of the quantity values being attributed to a measurand”. It is most common that the uncertainties of GAW hourly measurements, such as greenhouse gas measurements, are reported as standard deviations derived from individual sampling at a higher time resolution (e.g., 1 min). In contrast, the uncertainties of GAW measurements of reactive gases and aerosol properties are reported in percentiles covering the same probability. A quick look at hourly CO 2 data from Cape Grim, Australia yielded some interesting findings: the hourly standard deviation is, on average, more than a factor of 10 higher for the measurements under non-background conditions (over 50% observations), while the difference in average CO 2 amount fraction was less than 2 ppm. The dramatic contrast cannot be explained by the difference in measurement uncertainties, but can largely be attributed the natural variability, or episodic ambient CO 2 variation reflecting changes in meteorological conditions or emissions. These initial findings motivated a more in-depth analysis of the ground-based measurements of trace gases and aerosol properties. This analysis will be using continuous 1 min ground site observations to construct time averaged statistical indicators to evaluate whether the standard deviation is adequate to represent the dispersion, especially under marked influence by natural variability. The suitability of this representation can be determined by examining the difference between the standard deviation and percentiles encompassing the same probability. We will examine time intervals of 1 hour, 3 hours, and 24 hours, with the latter time intervals chosen to match those commonly used in model assessments. We will also investigate how natural variability can alter the probability distribution of the measurands and how adequate the quadrature propagation of uncertainties is under these conditions. The results will include several trace gases (e.g., CO 2 , CO, O 3 , and NO 2 ) with a range of measurement techniques (e.g., PANDORA, in situ), atmospheric lifetimes, and aerosol properties (e.g. scattering coefficient). The findings from this analysis should provide some useful feedback on the best practices for uncertainty reporting.

Measurement Uncertainty↗

Characterization of Neutron Emission Rates of Commercial 252 Cf Sources

Accurate knowledge of 252 Cf neutron emission rates is critical for modeling and fast-neutron experiments, yet commercial sources are often supplied without traceable calibration or uncertainty estimates. This report describes a method to characterize 252 Cf sources using a pulse-shape-discrimination (PSD) scintillator. The scintillator was efficiency-calibrated against a time-tagged 252 Cf fission chamber manufactured at ORNL over 40 years ago. Isotopic evolution of the calibration source was modeled using Bateman equations to account for changes in the effective average neutrons per fission at the time of measurement. The calibrated scintillator was then used to measure absolute emission rates of several commercial 252 Cf sources, revealing deviations of up to 12% from nominal manufacturer values. This methodology provides a practical approach for establishing uncertainty-quantified 252 Cf neutron emission rates, improving fidelity in simulations and supporting the accurate interpretation of measurements.

46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗

Low-Cost Evaluation of EO-1 Hyperion and ALI for Detection and Biophysical Characterization of Forest Logging in Amazonia (NCC5-481)

Major uncertainties exist regarding the rate and intensity of logging in tropical forests worldwide: these uncertainties severely limit economic, ecological, and biogeochemical analyses of these regions. Recent sawmill surveys in the Amazon region of Brazil show that the area logged is nearly equal to total area deforested annually, but conversion of survey data to forest area, forest structural damage, and biomass estimates requires multiple assumptions about logging practices. Remote sensing could provide an independent means to monitor logging activity and to estimate the biophysical consequences of this land use. Previous studies have demonstrated that the detection of logging in Amazon forests is difficult and no studies have developed either the quantitative physical basis or remote sensing approaches needed to estimate the effects of various logging regimes on forest structure. A major reason for these limitations has been a lack of sufficient, well-calibrated optical satellite data, which in turn, has impeded the development and use of physically-based, quantitative approaches for detection and structural characterization of forest logging regimes. We propose to use data from the EO-1 Hyperion imaging spectrometer to greatly increase our ability to estimate the presence and structural attributes of selective logging in the Amazon Basin. Our approach is based on four "biogeophysical indicators" not yet derived simultaneously from any satellite sensor: 1) green canopy leaf area index; 2) degree of shadowing; 3) presence of exposed soil and; 4) non-photosynthetic vegetation material. Airborne, field and modeling studies have shown that the optical reflectance continuum (400-2500 nm) contains sufficient information to derive estimates of each of these indicators. Our ongoing studies in the eastern Amazon basin also suggest that these four indicators are sensitive to logging intensity. Satellite-based estimates of these indicators should provide a means to quantify both the presence and degree of structural disturbance caused by various logging regimes. Our quantitative assessment of Hyperion hyperspectral and ALI multi-spectral data for the detection and structural characterization of selective logging in Amazonia will benefit from data collected through an ongoing project run by the Tropical Forest Foundation, within which we have developed a study of the canopy and landscape biophysics of conventional and reduced-impact logging. We will add to our base of forest structural information in concert with an EO-1 overpass. Using a photon transport model inversion technique that accounts for non-linear mixing of the four biogeophysical indicators, we will estimate these parameters across a gradient of selective logging intensity provided by conventional and reduced impact logging sites. We will also compare our physical ly-based approach to both conventional (e.g., NDVI) and novel (e.g., SWIR-channel) vegetation indices as well as to linear mixture modeling methods. We will cross-compare these approaches using Hyperion and ALI imagers to determine the strengths and limitations of these two sensors for applications of forest biophysics. This effort will yield the first physical ly-based, quantitative analysis of the detection and intensity of selective logging in Amazonia, comparing hyperspectral and improved multi-spectral approaches as well as inverse modeling, linear mixture modeling, and vegetation index techniques.

Asner, Gregory P.↗

Autonomous Assessment and Predictive Capabilities for Low-Altitude Urban Flight Operations

The integration of unmanned aerial vehicles in the national airspace will introduce new vehicle types, technologies, and operational paradigms for which safety must be maintained and hazards mitigated. One approach is to attempt to design for possible hazards and unsafe incidents that can occur at different phases of flight (pre-flight, in-flight, and post-flight) and during ground operations. Another is to mitigate safety incidents by implementing changes to policies, procedures, regulations, and design to cover personnel, equipment, and aircraft during operations. These and other techniques, not described herein, are typically conservative or adhoc in that they reduce the likelihood of risk after safety incidents have occurred. In this work, the goal is to develop a more predictive capability to monitor and mitigate risk and hazards to safety “in-time” enough for decisions to be made. In line with NASA’s Aeronautics Mission Directorate Strategic Thrust 5 [1] (In-Time System-Wide Safety Assurance), the System-Wide Safety (SWS) project under which this work falls, is developing and demonstrating innovative and safety-oriented solutions that enable modernization and aviation transformation. To that effect, this work will detail data-driven efforts on the SWS project to develop a number of safety-critical services for in-time monitoring and mitigation of hazards to low-altitude flight operations. First, hazards to these operations are identified based on previous work by NASA [2,3] and others in the aerospace industry. These hazards include (i) unsafe proximity to other vehicles, property, and people on the ground, (ii) critical system failures such as communication signal/GPS loss, unexpected propulsion system degradation, engine/power failure, and (iii) operational/environmental issues such as severe weather and gusty winds. For these hazards, safety metrics, which can be quantified and assessed are defined, models to monitor and predict them are developed, and flight test data is generated to develop, validate, and test these models, considering the complex interplay of the different hazards that define them [4-6]. In addition, the uncertainty in the non-deterministic effects that cannot be modeled nor predicted and unknown unknowns that arise after design/testing and during operations must be handled in rigorous manner. As a result, for each of the developed safety metrics, their dependencies on one another are characterized and a framework for handling the uncertainties inherent in the modeling, algorithms, and measurements required for prediction is also developed [7]. To that effect, this presentation will describe the safety metrics and services already developed and underway under the System-Wide Safety project that utilize data-driven techniques for the identification of anomalies, precursors, and trends (APTs) to monitor and mitigate hazards to safety, in-time, for urban flight operations in low-altitude airspace.

Okolo, Wendy A.↗

Enhancing the Operational Resilience of Advanced Reactors with Digital Twins by Recurrent Neural Networks

Because of a lack of operational data and uncertainty in evaluation model for abnormal and accident scenarios, the established operating procedures can be biased in characterizing the reactor states and ensuring operational resilience. To reduce uncertainty associated with actual plant conditions, digital twin (DT) technology is suggested to support operator’s decision-making by effectively extracting and using knowledge of the current and future plant states from the knowledge base. This study first builds a knowledge base based on the characterization of issue space and the simulation tool. Next, this study discusses diagnosis and prognosis DTs for enhancing operational resilience by recovering the complete states of reactors and by predicting the future reactor behaviors. Finally, the decision-making module of the control system can determine the optimal control strategy that meets operational goals during loss-of-flow scenarios. To demonstrate and evaluate the DTs capability for supporting the operations of nuclear reactors, this study develops and assesses both the diagnosis and prognosis DTs in a nearly autonomous management and control system for an Experimental Breeder Reactor-II simulator during different loss-of-flow scenarios.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A high-throughput approach for statistical process optimization in Laser Powder Bed Fusion

Process variability is inherent in metal additive manufacturing (AM). However, it is often overlooked in process optimization frameworks, constraining the understanding of process uncertainties and their influence on parameter selection. To address this, we present an integrated framework that combines high-throughput single-track experiments, GAN-based melt pool geometry extraction, robust statistical and machine learning modeling, and uncertainty-quantified process mapping. Process variability is characterized through single-track melt pool behaviors, and its influence on defect formation is systematically quantified to enable statistically guided process parameter optimization. This approach is demonstrated on Laser Powder Bed Fusion (L-PBF) of stainless steel 316L, effectively capturing the interplay between process parameters, melt pool variability, and defect probability. By integrating uncertainty quantification into process optimization, this study provides a structured methodology for addressing variability challenges in AM quality control, ultimately contributing to enhanced manufacturing reliability.

Laser Powder Bed Fusion↗

Navigating Epistemic Uncertainty in the Management of Flash Droughts

Abstract: Flash droughts, characterized by their rapid onset, sharply contrast with the typically gradual development of traditional droughts. These events are triggered by a combination of low rainfall and high evaporation rates, driven by elevated temperatures, making them particularly challenging to predict and prepare for. As a relatively new concept, flash drought is not well understood, which introduces significant epistemic uncertainties regarding their nature and detection methods. This under-detection hinders planners' ability to effectively manage these events. Despite these uncertainties, flash droughts can have significant impacts, raising the question: how can decision-makers prepare for such events given the current knowledge gaps? To address this, we propose a methodological framework aimed at enhancing flash drought preparedness by guiding the selection of appropriate indicators based on their detection capabilities and the decision-makers' level of risk aversion. Our approach involves evaluating six different flash drought indicators and analyzing the level of agreement among them. Additionally, we consider the decision-makers' risk aversion, distinguishing between those who require consensus across all methods (risk-takers) and those who act based on a single method's indication (risk-averse). The insights gained from this study offer a pathway towards more informed decision-making processes regarding flash droughts, potentially mitigating their adverse effects through better preparedness and response strategies.

climate resilience↗

A Reference Ocean Surface Emission and Backscatter Model from Microwaves to Infrared

Satellite observations are vital for the initialization of Numerical Weather Prediction models, and very important for climate monitoring and prediction, as well as other applications such as hydrology and flood awareness prediction. Knowledge of radiative contributions from the Earth's surface is needed to sound the lower troposphere from space. The lack of a reference quality ocean emission and backscatter model is a major gap in our ability to provide absolute calibration of the satellite based observing system. Uncertainty in emissivity models is not well characterized and different models are used for different spectral bands, for active and passive instruments. An International Space Science Institute (ISSI) team was put together [4] to address these issues. The objectives of the team are to provide a reference model as a community software (i.e., documented and freely available code), that is maintained and supported, has traceable uncertainty estimations, and that enables new science from microwaves to infrared with bidirectional reflectance distribution function (BRDF) capability. We will present the model and its various components, discussing the choices between various parameterizations, building on the LOCEAN model of [2]. The model predictions will be evaluated at various frequencies, including comparisons to radiometric observations by SMAP, AMSR2 and GMI (e.g., [5]). We will discuss early model evaluation in the infrared and for active microwave sensors. Areas of ongoing research include improving the foam parametrization (coverage and emissivity) to provide consistent performances across frequencies, building on [1], and the azimuthal dependence of the active and passive signals. The model will be used to generate training data for fast models e.g., Fastem, [3], that are used in operational data assimilation and climate re-analysis.

Emmanuel Dinnat↗

Efficient compressive and Bayesian characterization of biphoton frequency spectra

Frequency-bin qudits constitute a promising tool for quantum information processing, but their high dimensionality can make for tedious characterization measurements. Here we introduce and compare compressive sensing and Bayesian mean estimation for recovering the spectral correlations of entangled photon pairs. Using a conventional compressive sensing algorithm, we reconstruct joint spectra with up to a 26-fold reduction in measurement time compared to the equivalent raster scan. Applying a custom Bayesian model to the same data, we then additionally realize reliable and consistent quantification of uncertainty. Finally, these efficient methods of biphoton characterization should advance our ability to use the high degree of parallelism and complexity afforded by frequency-bin encoding.

42 ENGINEERING↗

Chapter 13: Errors and Uncertainties Associated with Quasi-Global Satellite Precipitation Products

Measuring precipitation on a global scale is only possible from satellite platforms. Satellite precipitation estimates are based on geosynchronous infrared sensors on geostationary satellites, characterized by high sampling frequency, and polar-orbiting microwave sensors on low-Earth-orbiting satellites with less-frequent sampling. Assessing satellite product performance is fundamental to infer the reliability of such estimates and effectively use them in water resources management, extreme event characterization, disease control, or weather forecasting. Nevertheless, errors and uncertainties associated with satellite precipitation products are often masked due to temporal and spatial sampling, as well as bias-corrections against a reference dataset. Moreover, the verification of satellite precipitation products is easier over land areas, where rain gauges and ground radars are available as benchmark, but extremely limited over the oceans. Substantial work still remains to better quantify relative and absolute errors and uncertainties within satellite-based precipitation products over land and oceans.

Viviana Maggioni↗

Combined Uncertainty and A-Posteriori Error Bound Estimates for General CFD Calculations: Theory and Software Implementation

This workshop presentation discusses the design and implementation of numerical methods for the quantification of statistical uncertainty, including a-posteriori error bounds, for output quantities computed using CFD methods. Hydrodynamic realizations often contain numerical error arising from finite-dimensional approximation (e.g. numerical methods using grids, basis functions, particles) and statistical uncertainty arising from incomplete information and/or statistical characterization of model parameters and random fields. The first task at hand is to derive formal error bounds for statistics given realizations containing finite-dimensional numerical error [1]. The error in computed output statistics contains contributions from both realization error and the error resulting from the calculation of statistics integrals using a numerical method. A second task is to devise computable a-posteriori error bounds by numerically approximating all terms arising in the error bound estimates. For the same reason that CFD calculations including error bounds but omitting uncertainty modeling are only of limited value, CFD calculations including uncertainty modeling but omitting error bounds are only of limited value. To gain maximum value from CFD calculations, a general software package for uncertainty quantification with quantified error bounds has been developed at NASA. The package provides implementations for a suite of numerical methods used in uncertainty quantification: Dense tensorization basis methods [3] and a subscale recovery variant [1] for non-smooth data, Sparse tensorization methods[2] utilizing node-nested hierarchies, Sampling methods[4] for high-dimensional random variable spaces.

CFD↗

Development and Characterization of a Low-Pressure Calibration System for Hypersonic Wind Tunnels

Minimization of uncertainty is essential for accurate ESP measurements at very low free-stream static pressures found in hypersonic wind tunnels. Statistical characterization of environmental error sources requires a well defined and controlled calibration method. A calibration system has been constructed and environmental control software developed to control experimentation to eliminate human induced error sources. The initial stability study of the calibration system shows a high degree of measurement accuracy and precision in temperature and pressure control. Control manometer drift and reference pressure instabilities induce uncertainty into the repeatability of voltage responses measured from the PSI System 8400 between calibrations. Methods of improving repeatability are possible through software programming and further experimentation.

Green, Del L.↗

Uncertainty Quantification in GADRAS Inverse Modeling

The Gamma Detector Response and Analysis Software (GADRAS) package includes an inverse modeling tool that is helpful in identifying characteristics of unknown radioactive materials. Traditionally, uncertainties in this analysis were derived solely from measurement data quality and the fit of synthetic spectra. This paper aims to rigorously quantify additional sources of uncertainty, focusing on uncertainties arising from measurements being analyzed, Detector Response Function (DRF) characterization, and DRF extrapolation. Applying these findings to the BeRPBall benchmark data set, we demonstrated the impact of these uncertainties on plutonium and polyethylene estimates. The results underscore the importance of incorporating diverse uncertainty sources to enhance the accuracy and reliability of GADRAS’s inverse modeling capabilities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Wind Plant Performance Prediction Benchmark Phase 1 (Technical Report)

Financial risk resulting from the uncertainty associated with developing, owning, and operating wind power plants remains a barrier to reducing the levelized cost of energy (LCOE). On average, modern wind power plants in the U.S. underperform their expected annual energy output by 3.5-4.5% , with many underperforming by over 10%. To compensate for this uncertainty, investors require a larger return on investment (ROI) and apply "knock-down" factors that mask much of the underlying sources of uncertainty. Wind energy projects thus have reduced access to low-cost capital. Furthermore, operating wind plants often take a simple approach to estimating operations & maintenance (O&M) costs (e.g. straight-line estimates based on similar plants), which can eat into profits. To overcome these issues, the wind industry must improve the models they use for estimating wind plant performance and operations. An industry consortium (IC) requested that the National Renewable Energy Laboratory (NREL) lead a Department of Energy (DOE) working group to benchmark the accuracy of wind power plant energy predictions against real operational data. The IC was also motivated by DOE and NREL's potential to characterize systematic energy underperformance, identify sources of uncertainty, and explore root causes. The Wind Plant Performance Prediction (WP3) project was created out of this request, and this report represents the successful completion of Phase 1 of the WP3 project. During the project, wind plant owners provided both pre-construction and operational data to NREL. The pre-construction data was provided to wind resource assessment (WRA) consultants so they could conduct energy yield assessments (EYA). NREL took all of the completed EYAs, along with the operational data, and conducted an operational assessment to benchmark the EYA results against actual operational data. Given the large amounts of sensitive data required for this effort, as well as historical opposition to sharing data within industry, successful completion of Phase 1 represents an unprecedented milestone for industry data sharing. To improve the accuracy and confidence of pre-construction EYAs, wind plant owners and investors need better, more certain, energy yield predictions. The WP3 Benchmark Project is an industry-driven response to this reality. For the first time, industry has taken the important step of working together at scale, sharing valuable operational data with DOE and NREL in order to investigate the sources of bias and uncertainty in these energy estimates. This IC provides wind plant preconstruction and operational data to NREL in an organized and documented fashion and provides guidance and feedback as needed. The IC also provides introspection of the design of experiment, key metrics of success, data challenges, analysis best practices, and quality of results.

17 WIND ENERGY↗

Prediction of natural frequency variability due to uncertainty in material properties

Composite materials are widely used in various types of modern engineering structures. Traditional studies on composite structures have been based on the assumption that the material properties of the composites are characterized by a priori known elastic moduli, and no uncertainties of these moduli have been considered. However, the composite materials are invariably subject to a certain amount of scatter in their measured elastic moduli. To a large extent, the properties of composite materials are dependent on the fabrication process. But even the composite materials manufactured by the same process demonstrate differences in their elastic properties. This paper proposes a new, non-probabilistic method to predict the variability in the natural frequencies of the composite cylindrical shell, resulting from the unavoidable scatter in elastic moduli. The available measurements of elastic moduli are fitted by the four-dimensional uncertainty ellipsoid. The upper and lower bounds of the natural frequency are derived. With these bounds, designers will have a better understanding of the real dynamic behavior of the structure.

Li, Y. W.↗

Trajectory Planning for Mission Survivability of Autonomous Vehicles in Moderately to Extremely Uncertain Environments

Trajectory planning is a particularly challenging task for autonomous vehicles when the uncertainties in their operating environment cannot be characterized statistically. In this paper, we propose a receding horizon control strategy with novel trajectory planning policies that enable dynamic updating of the planned trajectories of autonomous vehicles operating in environments where potential conflicts are, from a statistical perspective, either partially known or completely unknown. The proposed policies utilize two metrics: (1) the number of feasible trajectories; and (2) the robustness of the feasible trajectories. We measure the effectiveness of the suggested policies in terms of mission survivability, which is defined as the probability that the primary mission is accomplished or, if that is not possible, the vehicle lands safely at an alternative site. We show that a linear combination of both metrics is an effective objective function when there is a mix of partially known and unknown uncertainties. When the operating environment is dominated by unknown disturbances, maximizing the number of feasible trajectories results in the highest mission survivability. These findings have significant implications for achieving safe aviation. autonomy.

Aviation autonomy↗