Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

A Comprehensive Analysis of Uncertainties in Warm-Rain Parameterizations in Climate Models Based on In Situ Measurements

Abstract Because of the coarse grid size of Earth system models (ESMs), representing warm-rain processes in ESMs is a challenging task involving multiple sources of uncertainty. Previous studies evaluated warm-rain parameterizations mainly according to their performance in emulating collision–coalescence rates for local droplet populations over a short period of a few seconds. The representativeness of these local process rates comes into question when applied in ESMs for grid sizes on the order of 100 km and time steps on the order of 20–30 min. We evaluate several widely used warm-rain parameterizations in ESM application scenarios. In the comparison of local and instantaneous autoconversion rates, the two parameterization schemes based on numerical fitting to stochastic collection equation (SCE) results perform best. However, because of Jessen’s inequality, their performance deteriorates when grid-mean, instead of locally resolved, cloud properties are used in their simulations. In contrast, the effect of Jessen’s inequality partly cancels the overestimation problem of two semianalytical schemes, leading to an improvement in the ESM-like comparison. In the assessment of uncertainty due to the large time step of ESMs, it is found that the rainwater tendency simulated by the SCE is roughly linear for time steps smaller than 10 min, but the nonlinearity effect becomes significant for larger time steps, leading to errors up to a factor of 4 for a time step of 20 min. After considering all uncertainties, the grid-mean and time-averaged rainwater tendency based on the parameterization schemes is mostly within a factor of 4 of the local benchmark results simulated by SCE.

Meteorology & Atmospheric Sciences↗

A review of thermo-hydro-mechanical modeling of coupled processes in fractured rock: From continuum to discontinuum perspective

Coupled thermo-hydro-mechanical (THM) processes in fractured rock are playing a crucial role in geoscience and geoengineering applications. Diverse and conceptually distinct approaches have emerged over the past decades in both continuum and discontinuum perspectives leading to significant progress in their comprehending and modeling. This review paper offers an integrated perspective on existing modeling methodologies providing guidance for model selection based on the initial and boundary conditions. By comparing various models, one can better assess the uncertainties in predictions, particularly those related to the conceptual models. The review explores how these methodologies have significantly enhanced the fundamental understanding of how fractures respond to fluid injection and production, and improved predictive capabilities pertaining to coupled processes within fractured systems. It emphasizes the importance of utilizing advanced computational technologies and thoroughly considering fundamental theories and principles established through past experimental evidence and practical experience. The selection and calibration of model parameters should be based on typical ranges and applied to the specific conditions of applications. The challenges arising from inherent heterogeneity and uncertainties, nonlinear THM coupled processes, scale dependence, and computational limitations in representing field scale fractures are discussed. Realizing potential advances on computational capacity calls for methodical conceptualization, mathematical modeling, selection of numerical solution strategies, implementation, and calibration to foster simulation outcomes that intricately reflect the nuanced complexities of geological phenomena. Future research efforts should focus on innovative approaches to tackle the hurdles and advance the state-of-the-art in this critical field of study.

Coupling scheme↗

ProZES: the methodology and software tool for assessment of assigned share of radiation in probability of cancer occurrence

ProZES is a software tool for estimating the probability that a given cancer was caused by preceding exposure to ionising radiation. ProZES calculates this probability, the assigned share, for solid cancers and hematopoietic malignant diseases, in cases of exposures to low-LET radiation, and for lung cancer in cases of exposure to radon. User-specified inputs include birth year, sex, type of diagnosed cancer, age at diagnosis, radiation exposure history and characteristics, and smoking behaviour for lung cancer. Cancer risk models are an essential part of ProZES. Linking disease and exposure to radiation involves several methodological aspects, and assessment of uncertainties received particular attention. ProZES systematically uses the principle of multi-model inference. Models of radiation risk were either newly developed or critically re-evaluated for ProZES, including dedicated models for frequent types of cancer and, for less common diseases, models for groups of functionally similar cancer sites. The low-LET models originate mostly from the study of atomic bomb survivors in Hiroshima and Nagasaki. Risks predicted by these models are adjusted to be applicable to the population of Germany and to different time periods. Adjustment factors for low dose rates and for a reduced risk during the minimum latency time between exposure and cancer are also applied. The development of the methodology and software was initiated and supported by the German Federal Ministry for the Environment, Nature Conservation and Nuclear Safety (BMU) taking up advice by the German Commission on Radiological Protection (SSK, Strahlenschutzkommission). These provide the scientific basis to support decision making on compensation claims regarding malignancies following occupational exposure to radiation in Germany.

97 MATHEMATICS AND COMPUTING↗

Contrasting effects of lake breeze and urbanization on heat stress in Chicago metropolitan area

This study used the latest Weather Research and Forecasting (WRF) model coupled with multi -layer urban canopy models to investigate contrasting effects from urbanization and lake breeze on summer heat stress over the Chicago metropolitan area (CMA). Comparisons between the model and in situ observations show that this coupled modeling system better captures urban locations' diurnal pattern of surface air temperature, skin temperature and relative humidity, with root mean square error reduced from 1.58 to 1.80 degrees C to 1.14-1.31 degrees C, 3.11-3.55 degrees C to 1.81-2.21 degrees C, and 10.73-11.35% to 7.84-8.60%, respectively, compared to WRF without coupling the urban canopy models. Two sensitivity experiments were conducted to isolate the influence of lake breeze and urbanization: one replaced the urban land use with cropland over the CMA, and the other filled all of Lake Michigan with cropland. Three different heat stress indices were computed to assess the uncertainties of heat stress response to changes in air temperature, relative humidity, and wind conditions. Results show that, when the lake has the largest cooling effect on air temperature, it also increases the relative humidity the most, and vice versa for urban warming and drying effects. Urbanization intensifies heat stress at night, and extends the heat caution period by up to 4 h over inland urban grids; the lake breeze relieves heat stress during afternoon (when the heat stress is the worst), and shortens the heat caution period by 1-3 h over inland urban grids and 3-4 h over coastal urban grids. In conclusion, the intensification of heat stress over the CMA due to urbanization is more than four times greater than the reduction from the lake breeze in the late afternoon and evening.

54 ENVIRONMENTAL SCIENCES↗

Prioritization of Early-Stage Research and Development of a Hydrogel-Encapsulated Anaerobic Technology for Distributed Treatment of High Strength Organic Wastewater

This study aims to support the prioritization of research and development (R&D) pathways of an anaerobic technology leveraging hydrogel-encapsulated biomass to treat high-strength organic industrial wastewaters, enabling decentralized energy recovery and treatment to reduce organic loading on centralized treatment facilities. To characterize the sustainability implications of early-stage design decisions and to delineate R&D targets, an encapsulated anaerobic process model was developed and coupled with design algorithms for integrated process simulation, techno-economic analysis, and life cycle assessment under uncertainty. Across the design space, a single-stage configuration with passive biogas collection was found to have the greatest potential for financial viability and the lowest life cycle carbon emission. Through robust uncertainty and sensitivity analyses, we found technology performance was driven by a handful of design and technological factors despite uncertainty surrounding many others. Hydraulic retention time and encapsulant volume were identified as the most impactful design decisions for the levelized cost and carbon intensity of chemical oxygen demand (COD) removal. Encapsulant longevity, a technological parameter, was the dominant driver of system sustainability and thus a clear R&D priority. Ultimately, we found encapsulated anaerobic systems with optimized fluidized bed design have significant potential to provide affordable, carbon-negative, and distributed COD removal from high strength organic wastewaters if encapsulant longevity can be maintained at 5 years or above.

Anaerobic Treatment↗

Sources of Subseasonal-To-Seasonal Predictability of Atmospheric Rivers and Precipitation in the Western United States

Atmospheric rivers (ARs) account for a large portion of winter precipitation in the western US. To evaluate the sources of AR and precipitation predictability at subseasonal-to-seasonal timescales, we examine the relationships between two climate modes, the El Niño/Southern Oscillation (ENSO) and Madden-Julian oscillation (MJO), and winter hydroclimate in the western US. Our analysis uses a large ensemble of the Weather Research and Forecast (WRF) model simulations from 1981 to 2017, facilitating the assessment of uncertainty in climate mode-AR relationship due to climate variability and short length of observations. Over the North Pacific basin, we find ENSO-related latitudinal shifts of ARs, but ENSO has little effect on basin-wide averaged AR frequency. Over the western US, there is some uncertainty in the ENSO-AR connection due to the impacts of ENSO indices and datasets. However, extreme El Niño events defined by the ENSO longitude index are consistently linked to increased landfalling AR activity. The MJO can lead to significantly enhanced or suppressed landfalling AR activity in the large-ensembles, depending on the phase of MJO and time lag, while observations are too short in length to robustly show this signal. ENSO substantially modulates the MJO-AR relationship, triggering variegated responses of landfalling ARs and AR precipitation in La Niña and El Niño years. Our findings highlight the need to evaluate concurrent effects of different climate modes on ARs and precipitation, and may shed light on a path toward more accurate subseasonal-to-seasonal prediction of ARs and precipitation over the western US.

54 ENVIRONMENTAL SCIENCES↗

Designing an Observing System to Study the Surface Biology and Geology (SBG) of the Earth in the 2020s

Abstract Observations of planet Earth from space are a critical resource for science and society. Satellite measurements represent very large investments and United States (US) agencies organize their effort to maximize the return on that investment. The US National Research Council conducts a survey of Earth science and applications to prioritize observations for the coming decade. The most recent survey prioritized a visible to shortwave infrared imaging spectrometer and a multispectral thermal infrared imager to meet a range of needs for studying Surface Biology and Geology (SBG). SBG will be the premier integrated observatory for observing the emerging impacts of climate change by characterizing the diversity of plant life and resolving chemical and physiological signatures. It will address wildfire risk, behavior, and recovery as well as responses to hazards such as oil spills, toxic minerals in minelands, harmful algal blooms, landslides, and other geological hazards. The SBG team analyzed needed instrument characteristics (spatial, temporal, and spectral resolutions, measurement uncertainty) and assessed the cost, mass, power, volume, and risk of different architectures. We present an overview of the Research and Applications trade‐study analysis of algorithms, calibration and validation needs, and societal applications with specifics of substudies detailed in other articles in this special collection. We provide a value framework to converge from hundreds down to three candidate architectures recommended for development. The analysis identified valuable opportunities for international collaboration to increase the revisit frequency, adding value for all partners, leading to a clear measurement strategy for an observing system architecture.

54 ENVIRONMENTAL SCIENCES↗

Multi‐Layered Systems for Permanent Geologic Storage of CO 2 at the Gigatonne Scale

Abstract The effectiveness of Carbon Capture and Storage (CCS) as an imperative decarbonization technology relies on the sealing capacity of a fine‐grained caprock to permanently store CO 2 deep underground. Uncertainties in assessing the caprock sealing capacity increase with the spatial and temporal scales and may delay CCS deployment at the gigatonne scale. We have developed a computationally efficient transport model to capture the dynamics of basin‐wide upward CO 2 migration in a multi‐layered setting over geological time scales. We find that massive capillary breakthrough and viscous flow of CO 2 , even through pervasively fractured caprocks, are unlikely to occur and compromise the storage security. Potential leakage from the injection reservoir is hampered by repetitive layering of overlying caprocks. This finding agrees with geologic intuition and should be understandable by the public, contributing to the development of climate policies around this technology with increased confidence that CO 2 will be indefinitely contained in the subsurface.

58 GEOSCIENCES↗

Planck 2018 results XI. Polarized dust foregrounds

The study of polarized dust emission has become entwined with the analysis of the cosmic microwave background (CMB) polarization in the quest for the curl-like B-mode polarization from primordial gravitational waves and the low-multipole E-mode polarization associated with the reionization of the Universe. We used the new Planck PR3 maps to characterize Galactic dust emission at high latitudes as a foreground to the CMB polarization and use end-to-end simulations to compute uncertainties and assess the statistical significance of our measurements. We present Planck EE, BB, and TE power spectra of dust polarization at 353 GHz for a set of six nested high-Galactic-latitude sky regions covering from 24 to 71% of the sky. We present power-law fits to the angular power spectra, yielding evidence for statistically significant variations of the exponents over sky regions and a difference between the values for the EE and BB spectra, which for the largest sky region are α EE = -2.42 ± 0.02 and α BB = -2.54 ± 0.02, respectively. The spectra show that the TE correlation and E/B power asymmetry discovered by Planck extend to low multipoles that were not included in earlier Planck polarization papers due to residual data systematics. We also report evidence for a positive TB dust signal. Combining data from Planck and WMAP, we have determined the amplitudes and spectral energy distributions (SEDs) of polarized foregrounds, including the correlation between dust and synchrotron polarized emission, for the six sky regions as a function of multipole. This quantifies the challenge of the component-separation procedure that is required for measuring the low-ℓ reionization CMB E-mode signal and detecting the reionization and recombination peaks of primordial CMB B modes. The SED of polarized dust emission is fit well by a single-temperature modified black-body emission law from 353 GHz to below 70 GHz. For a dust temperature of 19.6 K, the mean dust spectral index for dust polarization is β d P = 1.53±0.02. The difference between indices for polarization and total intensity is β d P -β d I = 0.05±0.03. By fitting multi-frequency cross-spectra between Planck data at 100, 143, 217, and 353 GHz, we examine the correlation of the dust polarization maps across frequency. We find no evidence for a loss of correlation and provide lower limits to the correlation ratio that are tighter than values we derive from the correlation of the 217- and 353 GHz maps alone. If the Planck limit on decorrelation for the largest sky region applies to the smaller sky regions observed by sub-orbital experiments, then frequency decorrelation of dust polarization might not be a problem for CMB experiments aiming at a primordial B-mode detection limit on the tensor-to-scalar ratio r ≃ 0.01 at the recombination peak. However, the Planck sensitivity precludes identifying how difficult the component-separation problem will be for more ambitious experiments targeting lower limits on r.

79 ASTRONOMY AND ASTROPHYSICS↗

Identification of heavy, energetic, hadronically decaying particles using machine-learning techniques

Machine-learning (ML) techniques are explored to identify and classify hadronic decays of highly Lorentz-boosted W/Z/Higgs bosons and top quarks. Techniques without ML have also been evaluated and are included for comparison. The identification performances of a variety of algorithms are characterized in simulated events and directly compared with data. The algorithms are validated using proton-proton collision data at $\sqrt{s}$ = 13TeV, corresponding to an integrated luminosity of 35.9 fb -1 . Systematic uncertainties are assessed by comparing the results obtained using simulation and collision data. The new techniques studied in this paper provide significant performance improvements over non-ML techniques, reducing the background rate by up to an order of magnitude at the same signal efficiency.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Impacts of Dispatch Strategies and Forecast Errors on the Economics of Behind-the-Meter PV-Battery Systems

To assess the economic value of batteries in hybrid PV-battery systems, one must create a dispatch profile for the battery. Many analyses of battery value assume perfect forecasts of PV generation and load, determining an upper limit on the value of the battery. Prior work that accounts for forecast uncer- tainty often does so in the context of a single dispatch algorithm, which does not provide a baseline for comparison. Furthermore, when multiple dispatch algorithms are assessed with uncertainty, the benefits considered are for diesel generation in a microgrid, not retail rate savings. This work addresses the gaps in the literature by comparing the performance of both heuristic and optimal dispatch algorithms for retail rate savings under forecast uncertainty, and provides comparisons of the robustness of these algorithms and their associated estimates of economic value. We find that using a perfect forecast can overestimate the value of hybrid PV-battery systems between 1% and 8% compared to the reality of using a day-ahead forecast, depending on the dispatch algorithm used. Thus, accounting for forecast uncertainty in system design and analysis will significantly improve the accuracy of modeled system values.

batteries↗

Effects of finite sampling on fatigue damage estimation of wind turbine components: A statistical study

The variability of the wind turbine loads complicates fatigue assessment in the design phase, as performing simulations covering the entire lifetime is computationally expensive. The current work provides important information for assessing the uncertainty in fatigue damage estimation due to finite data. Here we study the sample size effect on mean, variance, and skewness of damage in each wind bin, identify the important wind bins, and study the uncertainty propagation from each wind bin to the lifetime damage using 3600 aeroelastic simulations and bootstrapping. To achieve less than 1% error in the damage estimation across all load channels in the current case study, at least 100 turbulence seeds are needed. Damage in different wind bins follows a lognormal distribution when using the conventional approach of six seeds. The provided insights and information allow the designer to achieve a specific level of accuracy for a given computational cost using strategic bin sampling.

17 WIND ENERGY↗

Considering uncertainties expands the lower tail of maize yield projections

Crop yields are sensitive to extreme weather events. Improving the understanding of the mechanisms and the drivers of the projection uncertainties can help to improve decisions. Previous studies have provided important insights, but often sample only a small subset of potentially important uncertainties. Here we expand on a previous statistical modeling approach by refining the analyses of two uncertainty sources. Specifically, we assess the effects of uncertainties surrounding crop-yield model parameters and climate forcings on projected crop yield. We focus on maize yield projections in the eastern U.S.in this century. We quantify how considering more uncertainties expands the lower tail of yield projections. We characterized the relative importance of each uncertainty source and show that the uncertainty surrounding yield model parameters is the main driver of yield projection uncertainty.

59 BASIC BIOLOGICAL SCIENCES↗

Verification and Validation of MFiX-PIC

This work is aimed at verification and validation (V&V) of particle-in-cell (PIC) approach in the National Energy Technology Laboratory’s (NETL) Multiphase Flow with Interphase eXchanges (MFiX-PIC) which was officially released in April 2019. Under verification, the results from MFiX-PIC are compared with exact or analytical solutions, while experimental results are used for benchmarking under validation. The test suite consists of the following cases: Terminal velocity. Particle advection in time-varying flow field. Particle settling in a dense medium. Evaporation. Rayleigh-Taylor instability. Minimum fluidization. Mini-circulating fluidized bed. The cases reported in a format consistent with the existing Verification and Validation Manual (Musser et al., 2018) explore a wide range of flow velocities and concentration regimes. Only one case considered in this work verifies the implementation of heat and mass transfer routines in MFiX-PIC, while a few other studies are currently underway to further expand the validation space in reacting flows. This study highlights the need for a rigorous analysis to objectively quantify the effect of model parameters. In addition, there is a scarcity of high-quality experimental data in the literature suitable for validating PIC methodology. Future efforts would include performing experiments which provide results for a valuable database. While designing such experiments, particle count should be significant to have sufficient particles per parcel while maintaining an optimal parcel to cell volume ratio. Also, datasets should have objectively assessed experimental uncertainty whereby confidence interval in those measurements become more explicit.

42 ENGINEERING↗

Dispersion Validation for Flow Involving a Large Structure Revisited: 45 Degree Rotation

The atmospheric dispersion of contaminants in the wake of a large urban structure is a challenging fluid mechanics problem of interest to the scientific and engineering communities. Magnetic Resonance Velocimetry (MRV) and Magnetic Resonance Concentration (MRC) are relatively new techniques that leverage diagnostic equipment used primarily by the medical field to make 3D engineering measurements of flow and contaminant dispersal. SIERRA/Fuego, a computational fluid dynamics (CFD) code at Sandia National Labs is employed to make detailed comparisons to the dataset to evaluate the quantitative and qualitative accuracy of the model. This work is the second in a series of scenarios. In the prior work, a single large building in an array of similar buildings was considered with the wind perpendicular to a building face. In this work, the geometry is rotated by 45 degrees and improved studies are performed for simulation credibility. The comparison exercise shows conditionally good comparisons between the model and experiment. Model uncertainties are assessed through parametric variations. Various methods of quantifying the accuracy between experiments and data are examined Three-dimensional analysis of accuracy is performed. The effort helped identify deficiencies in the techniques used to make these comparisons, and further methods development therefore becomes one of the main recommendations for follow-on work.

42 ENGINEERING↗

Report on Data Quality Required for Modeling an MSR

Calculations were performed to assess how uncertainties in molten salt property values impact the results of behavior models of molten salt reactor systems under steady-state conditions. The thermophysical and thermochemical properties of salt mixtures being considered for use in molten salt reactors are not yet well characterized and methods used to measure property values to molten salts are not yet well established. The limited property data for salts of interest that are available in the literature are inconsistent and unreliable. Many methods used to measure property values remain developmental in the sense that not all variables affecting measured values have been identified or controlled during the measurement and not all aspects of the measurements affecting data quality are calibrated. A prior report described the repeatability of measurements made at Argonne and the reproducibility of measurements made with the same salts at several institutions is being evaluated. There is significant uncertainty in measured property values due to instrumental limitations and the effects of contaminants in the salts used to make the measurements that impacts predictions of salt behavior in a reactor. Most salts of interest are multicomponent eutectic or near-eutectic mixtures and both uncertainty in the salt composition and uncertainty in measured values. Furthermore, the salt composition evolves over time due to the uptake of impurities from the atmosphere and corrosion of containment vessels. More significantly, fission products will accumulate during operation that change the salt compositions and property values. MSR developers need to understand how this uncertainty in the basic property data of the fuel will impact modeling predictions for normal reactor operation as well was in transient scenarios that will impact the safety basis. The calculations and analyses in this report address the impact of uncertainty in measured property values under steady-state conditions through a generalized parametric study. The pooled uncertainty from contributions by a number of factors were considered and quantified, including varying composition due to impurities and fission products, imprecision in the measured values, and uncontrolled aspects of the measurement. In this way, we can begin to gain an understanding of the magnitude of the impact uncertainty will have in modeling MSR systems.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗