Search NASA⌕ Search

SEARCH · Search NASA

Results for “errors and uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

Physical Evaluation of GPM DPR Single- and Dual-Wavelength Algorithms

A physical evaluation of the rain profiling retrieval algorithms for the Dual-frequency Precipitation Radar (DPR) aboard the Global Precipitation Measurement (GPM) core satellite is carried out by applying them to the hydrometeor profiles generated from measured raindrop size distributions (DSD). The DSD-simulated radar profiles are used as input to the algorithms, and their estimates of hydrometeors' parameters are compared with the same quantities derived directly from the DSD data (or truth). The retrieval accuracy is assessed by the degree to which the estimates agree with the truth. To check the validity and robustness of the retrievals, the profiles are constructed for cases ranging from fully correlated (or uniform) to totally uncorrelated DSDs along the columns. Investigation into the sensitivity of the retrieval results to the model assumptions is made to characterize retrieval uncertainties and identify error sources. Comparisons between the single- and dual-wavelength algorithm performance are carried out with either a single- or dual-wavelength constraint of the path integral or differential path integral attenuation. The results suggest that the DPR dual-wavelength algorithm generally provides accurate range-profiled estimates of rainfall rate and mass-weighted diameter with the dual-wavelength estimates superior in accuracy to those from the single-wavelength retrievals.

Liang Liao↗

The WRF Lightning Forecasting Algorithm: Sensitivities to Microphysics and Boundary Layer Physics Schemes

As with WRF model simulated convection in general, LFA output is sensitive to cloud and PBL physics. WRF convection is also sensitive to model initialization uncertainties and unresolved errors.  Large sensitivity exists in HRRR-like Thompson microphysics and PBL, for which original LFA calibration constant needs to be multiplied by 1.13 to give proper FRD amplitudes. Thompson microphysics scheme also shows poorest correlations relative to reference data, suggesting low predictability of HRRR LFA output. Need to validate HRRR LFA against GLM observations.

weather prediction↗

A comparison between CERES TOA Radiative Fluxes and Airborne Radiative Flux Measurements from ARISE

Uncertainty in top-of-atmosphere (TOA) radiation fluxes observations are larger in the Arctic than in other regions. These uncertainties are due to the low sun angles and the highly reflective, anisotropic, and heterogeneous surface conditions. Quantifying, attributing, and reducing Arctic TOA radiative flux uncertainty enables a better understanding of the rapidly changing Arctic. To advance this goal, we compare the Cloud and Earth’s Radiant Energy System (CERES) TOA radiative fluxes with Arctic Radiation-IceBridge Sea and Ice Experiment (ARISE) campaign measurements collected in September 2014. We compare CERES TOA and aircraft radiative flux measurements using two complementary approaches: grid box average fluxes and instantaneously matched footprints. The grid box mean flux comparison indicates an agreement between CERES and aircraft measurements within 2σ uncertainty (calibration and inversion) in the longwave for all five grid boxes and for four-of-five grid boxes in the shortwave; shortwave and longwave mean differences are -7.9 and +2.3 Wm 2, respectively. The comparison of 36 40 instantaneously matched footprints with aircraft measurements reveals mean differences of -120.25 and -1.00.4 Wm 2 in the shortwave and longwave, respectively. To further explore the persistent negative difference in the shortwave, Wwe further quantify the effects of temporal and spatial sampling differences, angular distribution models, and scene identification to CERES-aircraft differences. Our analysis indicates that sampling differences (including scene evolution) account for an additional 1.8 and 1.7% uncertainty in the shortwave and longwave, respectively and , but indicates no bias. After accounting for this sampling uncertainty, all CERES-aircraft grid box mean fluxes agree within 2σ uncertainty. Scene identification errors due to sea ice concentration data set differences exhibit no bias in the shortwave flux difference and indicate the possibility of substantial differences in the CERES fluxes in specific cases with large spatial heterogeneity. Considering the instantaneously matched footprints, we find that the angular distribution models account may account for up to 7.3 Wm-2 of the persistent CERES-aircraft shortwave flux difference due to systematic differences in the anisotropy for sea ice partly cloudy scenes. Additional analysis using a special programmable scan model with the CERES FM2 instrument suggests a significant view zenith angle dependence of the CERES fluxes for sea ice partly cloudy scenes where shortwave fluxes systematically decrease with increasing view zenith angle; no dependence is found for other scene types. We conclude that (1) spatial heterogeneity and scene temporal evolution substantially limit our ability to use aircraft measurements to place strong constraints on CERES TOA fluxes and (2) that the representation of anisotropy in sea ice partly cloudy scenes is likely a significant factor contributing to the persistent negative CERES-aircraft shortwave flux difference in this comparison and require additional data to analysis fully quantify the potential bias.

Patrick C. Taylor↗

Radiative Flux Measurements from ARISE: A Comparison with CERES Top-of-Atmosphere Radiative Fluxes

Uncertainty in top-of-atmosphere (TOA) radiation fluxes observations are larger in the Arctic than in other regions. These uncertainties are due to the low sun angles and the highly reflective, anisotropic, and heterogeneous surface conditions. Quantifying, attributing, and reducing Arctic TOA radiative flux uncertainty enables a better understanding of the rapidly changing Arctic. To advance this goal, we compare the Cloud and Earth’s Radiant Energy System (CERES) TOA radiative fluxes with Arctic Radiation-IceBridge Sea and Ice Experiment (ARISE) campaign measurements collected in September 2014. We compare CERES TOA and aircraft radiative flux measurements using two complementary approaches: grid box average fluxes and instantaneously matched footprints. The grid box mean flux comparison indicates an agreement between CERES and aircraft measurements within 2 uncertainty (calibration and inversion) in the longwave for all five grid boxes and for four-of-five grid boxes in the shortwave; shortwave and longwave mean differences are -7.9 and +2.3 Wm‑2, respectively. The comparison of 36 instantaneously matched footprints with aircraft measurements reveals mean differences of -10.5 and 0.4 Wm‑2 in the shortwave and longwave, respectively. To further explore the persistent negative difference in the shortwave, we further quantify the effects of temporal and spatial sampling differences, angular distribution models, and scene identification to CERES-aircraft differences. Our analysis indicates that sampling differences (including scene evolution) account for an additional 1.8 and 1.7% uncertainty in the shortwave and longwave, respectively and indicates no bias. After accounting for this sampling uncertainty, all CERES-aircraft grid box mean fluxes agree within 2 uncertainty. Scene identification errors due to sea ice concentration data set differences exhibit no bias in the shortwave flux difference and indicate the possibility of substantial differences in the CERES fluxes in specific cases with large spatial heterogeneity. Considering the instantaneously matched footprints, we find that the angular distribution models account may account for up to ‑7.3 Wm-2 of the persistent CERES-aircraft shortwave flux difference due to systematic differences in the anisotropy for sea ice partly cloudy scenes. Additional analysis using a special scan model with the CERES FM2 instrument suggests a significant view zenith angle dependence of the CERES fluxes for sea ice partly cloudy scenes where shortwave fluxes systematically decrease with increasing view zenith angle; no dependence is found for other scene types. We conclude that (1) spatial heterogeneity and scene temporal evolution substantially limit our ability to use aircraft measurements to place strong constraints on CERES TOA fluxes and (2) that the representation of anisotropy in sea ice partly cloudy scenes is a significant factor contributing to the persistent negative CERES-aircraft shortwave flux difference in this comparison and require additional data to analysis fully quantify the potential bias.

Patrick C Taylor↗

Optimized Trajectory Correction Burn Placement for NRHO Orbit Maintenance

NASA's future Artemis missions plan to utilize a near rectilinear halo orbit (NRHO) in the lunar vicinity to facilitate access to the lunar surface and place other critical assets to support human exploration. This exploration architecture requires a vehicle to remain in the NRHO for long periods of time ranging from several days, to weeks, to months, and even years. Consequently, periodic orbit maintenance burns become essential to ensure the spacecraft follows the desired reference trajectory in an efficient yet effective manner despite crew activity, navigation uncertainty, maneuver execution errors, disturbance accelerations, orbit insertion dispersions, and other system limitations. This work introduces a targeting algorithm that can be utilized to analyze a variety of targeting constraints and parameters that maximizes overall performance. Techniques associated with robust trajectory optimization are used to identify the optimized number and placement for NRHO trajectory correction (NTC) burns that accounts for the mission schedule, both a primary and backup navigation system, targeting strategies and burn plan configurations, vehicle venting, thruster selection, and integrated GN\&C performance. A notional scenario extracted from the NASA Artemis III mission is used to motivate and demonstrate these concepts and performance results.

Linear Covariance Analysis↗

Parameterization of Vertical Cloud Distribution from C3M and MERRA Data Using ML Method

Clouds play a key role in regulating the hydrological cycle and the Earth's radiative energy budget. However, global climate models (GCMs) with a horizontal grid spacing on the order of 100 km have limitations in representing sub-grid cloud dynamics with spatial scales on the order of 1 km, leading to potential uncertainties in cloud radiative feedback on the global scale. In our research, we will leverage the capabilities of Deep Machine Learning (DML) methods to construct parameterizations of sub-grid volumetric cloud fraction (VCF), which is the frequency of occurrence on a grid volume accumulated in the horizontal and vertical directions. Our investigation delves into the intricate relationship between VCF obtained from the NASA CALIPSO-CloudSat-CERES-MODIS (CCCM) satellite observation data and 3-D MERRA-2 reanalysis meteorological profiling data (e.g., wind, relative humidity, temperature). Through a comprehensive one-year data training utilizing the Sequence to Sequence DML method, we have successfully disentangled the complicated cloud formation dynamics across diverse meteorological conditions through a day-to-day analysis framework. Preliminary findings reveal promising statistical agreements in geographical and vertical distributions and seasonal variations of volumetric cloud fraction between ML prediction and satellite measurements. These results underscore the aptitude of our DML model to discern underlying cloud physical processes and accurately represent sub-grid cloud formation dynamics. Additionally, we have also employed trained neural network to analyze uncertainties arising from errors in meteorological data, further enhancing the robustness of our VCF parameterization.

Shan Zeng↗

Randomization in Characterizing the Subsurface

Current methods for characterizing Earth’s subsurface, such as standard inverse techniques, are not sufficiently accurate to meet the needs of modern applications in the fields of energy exploration, environmental management, and global security. While increasing the quantity of field measurements and robustness of the applied data-/model-analysis methods can improve accuracy, such approaches can be computationally impractical for large data sets and complex site conditions. Thus, there is a need to develop economically-feasible and robust computational methods while maintaining accuracy. For example, in-field drilling for geothermal operations may yield high failure rates, resulting in unacceptably high costs; errors and/or large uncertainties in the estimated subsurface characteristics are the main impediment to the successful siting of an in-field well. This problem is not uniquely geothermal. Accurate characterization of uncertain subsurface properties is also essential for monitoring storage of carbon dioxide, estimating pathways of subsurface contaminant transport, and supervising ground-based nuclear-explosion tests.

58 GEOSCIENCES↗

Polarization and Centre-of-mass Energy Calibration at FCC-ee

The first stage of the FCC (Future Circular Collider) is a high-luminosity electron-positron collider (FCC-ee) with centre-of-mass energy ranging from 88 to 365 GeV, to study with high precision the Z, W, Higgs and top particles, with samples of $5 \times 10^{12}$ Z bosons, $10^8$ W pairs, $10^6$ Higgs bosons and $10^6$ top quark pairs. A cornerstone of the physics program lays in the precise (ppm) measurements of the W and Z masses and widths, as well as forward-backward asymmetries. To this effect the centre-of-mass energy distribution should be determined with the high precision. This document describes the capacity offered by FCC-ee, starting with transverse polarization of the beams around the Z pole and the W pair threshold. A running scheme based on regular measurements of the beam energy by resonant depolarization of pilot bunches, during physics data taking, is proposed. The design for polarization wigglers, polarimeter and depolarizer is outlined. The $e^\pm$ beam energies will be monitored with a relative precision of $10^{-6}$. The centre-of-mass energy is derived subject to further corrections, related to the beam acceleration, synchrotron radiation and beamstrahlung; these effects are identified and evaluated. Dimuon events $e^+e^- \to \mu^+ \mu^-$, recorded in the detectors, provide with great precision the beam crossing angle, the centre-of-mass energy spread, and the $e^+$ and $e^-$ energy difference. Monitoring methods to minimize absolute error and relative uncertainties are discussed. The impact on the physics measurements is given. A programme of further simulations, design, monitoring and R&D is outlined.

43 PARTICLE ACCELERATORS↗

A BI-LEVEL APPROACH TO FUTURE POWER SYSTEM CO-OPTIMIZATION WITH HIGH PENETRATION OF RENEWABLE ENERGY AND RESPONSIVE DEMAND

Electricity generation accounts for nearly half of the total CO2 emissions in the United States. For this reason, the development and integration of renewable resources will play an essential role in achieving the societal objective of mitigating climate change through reduction of greenhouse gas emissions. In conjunction with the environmental benefits of renewable energy, the most common renewable sources, such as wind and solar, also increase the uncertainties surrounding generation in power systems, which adds significant challenges to the system operation and planning. The uncertainties and forecasting errors surrounding renewable generation are normally addressed through the use of reserves from traditional generators. At greater levels of renewable penetration, sufficient generator reserves may not be available or economically viable. In contrast, the promise of demand-side resources in this arena lies in the spatially widespread availability, rapid response potential, and lower cost of features that already exist in the system. However, the challenge of responsive demand arises from the need to understand, manage, and incentivize a very large number of resources to participate effectively in efficient operation of the complex power system. Since demand response comes from the distribution system, microgrids as the basic building blocks of future distribution systems will be a critical environment for the study of demand response. To support integration of microgrids with flexible loads in future power systems, the operational mode of power systems will need to evolve. Therefore, it is going to be critical to have new and efficient co-optimization methods for coordination of the various power market participants and the scheduling of resources in the power systems of the future. Motivated by the rapid increase in renewable penetration, the need for effective demand response programs, and a changing system structure, this dissertation seeks to define a new strategy that supports co-optimization of various participants in power systems with emphasis on high renewable penetration and demand response. This strategy has three components; 1) an exploration of the capabilities of different types of demand response programs in a microgrid, 2) development and implementation of a bi-level framework for co-optimization of the main grid with high renewable penetration and a microgrid with demand response capabilities, and 3) expansion of the bi-level framework from a microgrid to a general distribution system to explore the advantages of the bi-level co-optimization approach over the traditional optimization approach. Conclusions of this work illustrate that the stochastic rolling horizon approach could effectively manage the operation of a microgrid with various demand response programs. In addition, the bi-level approach is a promising co-optimization framework for the transmission and distribution levels that could increase system renewable penetration and reduce operation costs. Compared to the traditional framework, the bi-level framework yields more equitable cost sharing patterns among the market participants as well as better support for the power system evolution.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Bayesian calibration of reactor neutron flux spectrum using activation detectors measurements: Application to CALIBAN reactor

In this paper, we present calibration methods in order to estimate reactor neutron flux spectrum and its uncertainties by using integral activation measurements. These techniques are performed using Bayesian and MCMC framework. These methods are applied to integral activation experiments in the cavity of the CALIBAN reactor. We estimate the neutron flux and its related uncertainties. The originality of this work is that these uncertainties take into account measurements uncertainties, cross-sections uncertainties and model error. In particular, our results give a very good approximation of the total flux and indicate that neutron flux from MCNP simulation for energies above about 5 MeV seems to overestimate the 'real flux'. (authors)

97 MATHEMATICS AND COMPUTING↗

Quantifying structural errors in cloud condensation nuclei activity from reduced representation of aerosol size distributions

Aerosol effects on clouds and radiation are the dominant contribution to uncertainty in radiative forcing relative to the pre-industrial atmosphere. While previous studies have assessed the impact of parametric uncertainty on modeled forcing, structural errors from the numerical representation of particle distributions have not been well quantified. Here we present a framework for quantifying error in aerosol size distributions and cloud condensation nuclei activity, which we apply to the widely used 4-mode version of the Modal Aerosol Module (MAM4). Box model predictions from the MAM4 are evaluated against the Particle Monte Carlo Model for Simulating Aerosol Interactions and Chemistry (PartMC-MOSAIC), a benchmark model that tracks the evolution of individual particles. We show that size distributions simulated by MAM4 diverge from those simulated by PartMC-MOSAIC after only a few hours of aging by condensation and coagulation in polluted conditions, which leads to large errors in modeled cloud condensation nuclei concentrations. We find that differences between MAM4 and PartMC-MOSAIC are largest under polluted conditions, where the size distribution evolves rapidly though aging by condensation of semi-volatile substances and coagulation among particles. These findings suggest that structural error in modeled aerosol properties contributes to the large inter-model variability in aerosol radiative forcing.

Fierce, Laura M.↗

Model Form Error Correction for a Black-Box Thermal Battery Heat Transfer Simulation

Thermal batteries are crucial for supplying power to high-consequence engineering applications such as rockets. Computational simulations have been developed to predict thermal battery behavior, but these simulations often suffer from modeling errors, including model form uncertainty. Addressing this uncertainty can be achieved by quantifying either the model discrepancy in the output or the model form error (MFE) in the governing equation. MFE is particularly valuable as it can be better extrapolated beyond observed outputs, which is essential for predictions involving changes in external system loading, system configuration and geometry, or output quantities. This paper employs a state estimation approach to estimate MFE using experimental data and then utilizes machine learning (ML) to model its relationship with state variables. A nonintrusive technique is used to estimate MFE in a black-box thermal battery heat transfer simulation. The trained machine learning model for MFE is then applied to correct simulation predictions under extrapolated initial conditions and battery configurations. In conclusion, the methodology's performance is evaluated using additional experimental data, demonstrating its effectiveness in improving prediction accuracy.

Batteries↗

MO-FG-CAMPUS-JeP3-01: A Statistical Model for Analyzing the Rotational Error of Single Iso-Center Technique

Purpose: To develop a generalized statistical model that incorporates the treatment uncertainty from the rotational error of single iso-center technique, and calculate the additional PTV (planning target volume) margin required to compensate for this error. Methods: The random vectors for setup and additional rotation errors in the three-dimensional (3D) patient coordinate system were assumed to follow the 3D independent normal distribution with zero mean, and standard deviations σx, σy, σz, for setup error and a uniform σR for rotational error. Both random vectors were summed, normalized and transformed to the spherical coordinates to derive the chi distribution with 3 degrees of freedom for the radical distance ρ. PTV margin was determined using the critical value of this distribution for 0.05 significant level so that 95% of the time the treatment target would be covered by ρ. The additional PTV margin required to compensate for the rotational error was calculated as a function of σx, σy, σz and σR. Results: The effect of the rotational error is more pronounced for treatments that requires high accuracy/precision like stereotactic radiosurgery (SRS) or stereotactic body radiotherapy (SBRT). With a uniform 2mm PTV margin (or σx =σy=σz=0.7mm), a σR=0.32mm will decrease the PTV coverage from 95% to 90% of the time, or an additional 0.2mm PTV margin is needed to prevent this loss of coverage. If we choose 0.2 mm as the threshold, any σR>0.3mm will lead to an additional PTV margin that cannot be ignored, and the maximal σR that can be ignored is 0.0064 rad (or 0.37°) for iso-to-target distance=5cm, or 0.0032 rad (or 0.18°) for iso-to-target distance=10cm. Conclusions: The rotational error cannot be ignored for high-accuracy/-precision treatments like SRS/SBRT, particularly when the distance between the iso-center and target is large.

60 APPLIED LIFE SCIENCES↗

Parameter uncertainties for imperfect surrogate models in the low-noise regime

Abstract Bayesian regression determines model parameters by minimizing the expected loss, an upper bound to the true generalization error. However, this loss ignores model form error, or misspecification, meaning parameter uncertainties are significantly underestimated and vanish in the large data limit. As misspecification is the main source of uncertainty for surrogate models of low-noise calculations, such as those arising in atomistic simulation, predictive uncertainties are systematically underestimated. We analyze the true generalization error of misspecified, near-deterministic surrogate models, a regime of broad relevance in science and engineering. We show that posterior parameter distributions must cover every training point to avoid a divergence in the generalization error and design a compatible ansatz which incurs minimal overhead for linear models. The approach is demonstrated on model problems before application to thousand-dimensional datasets in atomistic machine learning. Our efficient misspecification-aware scheme gives accurate prediction and bounding of test errors in terms of parameter uncertainties, allowing this important source of uncertainty to be incorporated in multi-scale computational workflows.

Swinburne, Thomas D. (ORCID:0000000232554257)↗

Predictive Capability Maturity Model Demonstration for Cylindrical Cavity Coupling Using Gemma in the Next Generation Workflow

The predictive capability maturity model (PCMM) uses the expert elicitation process to generate credibility evidence for a particular analysis. To ensure Gemma has the capability to efficiently produce this credibility evidence, next generation workflows (NGW) are created for the solution verification, calibration/validation, and input uncertainty quantification portions of the PCMM assessment. These workflows are then used on the Higgins cylinder problem, which is representative of applications involving external-to-internal electromagnetic field coupling through a slot. The uncertainties calculated using these workflows are then used to calculate the validation comparison error and the validation uncertainty for the model following the American Society of Mechanical Engineers (ASME) verification and validation (V&V) 20 standard. These workflows will enable analysts to iterate each element of PCMM more efficiently than if completed without using a NGW workflow. An example of this iterative process is shown in Section 7.2.

42 ENGINEERING↗

Evaluation of monthly rainfall estimates derived from the special sensor microwave/imager (SSM/I) over the tropical Pacific

Estimates of monthly rainfall have been computed over the tropical Pacific using passive microwave satellite observations from the special sensor microwave/imager (SSM/I) for the period from July 1987 through December 1990. These monthly estimates are calibrated using data from a network of Pacific atoll rain gauges in order to account for systematic biases and are then compared with several visible and infrared satellite-based rainfall estimation techniques for the purpose of evaluating the performance of the microwave-based estimates. Although several key differences among the various techniques are observed, the general features of the monthly rainfall time series agree very well. Finally, the significant error sources contributing to uncertainties in the monthly estimates are examined and an estimate of the total error is produced. The sampling error characteristics are investigated using data from two SSM/I sensors and a detailed analysis of the characteristics of the diurnal cycle of rainfall over the oceans and its contribution to sampling errors in the monthly SSM/I estimates is made using geosynchronous satellite data. Based on the analysis of the sampling and other error sources the total error was estimated to be of the order of 30 to 50% of the monthly rainfall for estimates averaged over 2.5 deg x 2.5 deg latitude/longitude boxes, with a contribution due to diurnal variability of the order of 10%.

Berg, Wesley↗

Uncertainty in vertically integrated liquid water content due to radar reflectivity observation error

Radar reflectivity is used to estimate meteorological quantities such as rainfall rate, liquid water content, and the related quantity, vertically integrated liquid (VIL) water content. The estimation of any of these quantities depends on several assumptions related to the characteristics of the physical processes controlling the occurrence and character of water in the atmosphere. Additionally, there are many sources of error associated with radar observations, such as those due to brighthand, hail, and drop size distribution approximations. This work addresses one error of interest, the radar reflectivity observation error; other error sources are assumed to be corrected or negligible. The result is a relationship between the uncertainty in VIL water content and radar reflectivity measurement error. An example application illustrates the estimation of VIL uncertainty from typical radar reflectivity observations and indicates that the coefficient of variation in VIL is much larger than the coefficient of variation in radar reflectivity.

French, Mark N.↗

Optimizing Service Restoration in Distribution Systems With Uncertain Repair Time and Demand

This paper proposes a novel method to co-optimize the distribution system operation and repair crew routing for outage restoration after extreme weather events. A two-stage stochastic mixed integer linear program is developed. The first stage is to dispatch the repair crews to the damaged components. The second stage is distribution system restoration using distributed generators, and reconfiguration. We consider demand uncertainty in terms of a truncated normal forecast error distribution, and model the uncertainty of the repair time using a lognormal distribution. A new decomposition approach, combined with the progressive hedging algorithm, is developed for solving large-scale outage management problems in an effective and timely manner. Furthermore, the proposed method is validated on modified IEEE 34- and 8500-bus distribution test systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗