Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

Special Issue on Uncertainty Quantification in Multiscale System Design and Simulation

The importance of uncertainty has been recognized in various modeling, simulation, and analysis applications, where inherent assumptions and simplifications affect the accuracy of model predictions for physical phenomena. As model predictions are now heavily relied upon for simulation-based system design, which includes new materials, vehicles, mechanical and civil structures, and even new drugs, wrong model predictions could potentially cause catastrophic consequences. Therefore, uncertainty and associated risks due to model errors should be quantified to support robust systems engineering.

42 ENGINEERING↗

Process damping identification using Bayesian learning and time domain simulation

Process damping can provide improved machining productivity by increasing the stability limit at low spindle speeds. However, existing methods for identifying process damping models experimentally require specialized setups and/or multiple cutting tests. While the phenomenon is well known, the modeling challenges limit pre-process parameter selection that leverages the potential increases in material removal rates. This paper proposes a physics-informed Bayesian method that can identify the cutting force and process damping models from a limited set of test cuts without requiring direct measurements of cutting force or vibration. The method uses time domain simulation to incorporate process damping and provide a basis for test selection. Here, new strategies for efficient sampling and dimensionality reduction are applied to lower computation time and minimize the effect of model error. The proposed method is demonstrated and the identified cutting and damping force coefficients are compared to values obtained using machining tests and least-squares fitting.

42 ENGINEERING↗

Coexistent quantum channel characterization using quantum process tomography with spectrally resolved detection

The coexistence of classical and quantum signals over the same optical fiber is critical for quantum networks operating within the existing communications infrastructure. Here, we characterize the quantum channel that results from distributing approximate single-photon polarization-encoded qubits simultaneously with classical light of varying intensities through a 25 km fiber-optic channel. We use spectrally resolved quantum process tomography with a newly developed Bayesian reconstruction method to estimate the quantum channel from experimental data, both with and without classical noise. Furthermore, we show that the coexistent fiber-based quantum channel has high process fidelity with an ideal depolarizing channel if the noise is dominated by Raman scattering. These results aid future development of quantum repeater designs and quantum error-correcting codes which benefit from realistic channel error models.

Chapman, Joseph↗

Estimation of three-dimensional intrinsic dosimetric uncertainties resulting from using deformable image registration for dose mapping

Purpose: This article presents a general procedural framework to assess the point-by-point precision in mapped dose associated with the intrinsic uncertainty of a deformable image registration (DIR) for any arbitrary patient. Methods: Dose uncertainty is obtained via a three-step process. In the first step, for each voxel in an imaging pair, a cluster of points is obtained by an iterative DIR procedure. In the second step, the dispersion of the points due to the imprecision of the DIR method is used to compute the spatial uncertainty. Two different ways to quantify the spatial uncertainty are presented in this work. Method A consists of a one-dimensional analysis of the modules of the position vectors, whereas method B performs a more detailed 3D analysis of the coordinates of the points. In the third step, the resulting spatial uncertainty estimates are used in combination with the mapped dose distribution to compute the point-by-point dose standard deviation. The process is demonstrated to estimate the dose uncertainty induced by mapping a 62.6 Gy dose delivered on maximum exhale to maximum inhale of a ten-phase four-dimensional lung CT. Results: For the demonstration lung image pair, the standard deviation of inconsistency vectors is found to be up to 9.2 mm with a mean {sigma} of 1.3 mm. This uncertainty results in a maximum estimated dose uncertainty of 29.65 Gy if method A is used and 21.81 Gy for method B. The calculated volume with dose uncertainty above 10.00 Gy is 602 cm{sup 3} for method A and 1422 cm{sup 3} for method B. Conclusions: This procedure represents a useful tool to evaluate the precision of a mapped dose distribution due to the intrinsic DIR uncertainty in a patient. The procedure is flexible, allowing incorporation of alternative intrinsic error models.

60 APPLIED LIFE SCIENCES↗

SU-E-T-613: Dosimetric Consequences of Systematic MLC Leaf Positioning Errors

Purpose: The purpose of this study is to determine the dosimetric consequences of systematic MLC leaf positioning errors for clinical IMRT patient plans so as to establish detection tolerances for quality assurance programs. Materials and Methods: Dosimetric consequences were simulated by extracting mlc delivery instructions from the TPS, altering the file by the specified error, reloading the delivery instructions into the TPS, recomputing dose, and extracting dose-volume metrics for one head-andneck and one prostate patient. Machine error was simulated by offsetting MLC leaves in Pinnacle in a systematic way. Three different algorithms were followed for these systematic offsets, and are as follows: a systematic sequential one-leaf offset (one leaf offset in one segment per beam), a systematic uniform one-leaf offset (same one leaf offset per segment per beam) and a systematic offset of a given number of leaves picked uniformly at random from a given number of segments (5 out of 10 total). Dose to the PTV and normal tissue was simulated. Results: A systematic 5 mm offset of 1 leaf for all delivery segments of all beams resulted in a maximum PTV D98 deviation of 1%. Results showed very low dose error in all reasonably possible machine configurations, rare or otherwise, which could be simulated. Very low error in dose to PTV and OARs was shown in all possible cases of one leaf per beam per segment being offset (<1%), or that of only one leaf per beam being offset (<.2%). The errors resulting from a high number of adjacent leaves (maximum of 5 out of 60 total leaf-pairs) being simultaneously offset in many (5) of the control points (total 10–18 in all beams) per beam, in both the PTV and the OARs analyzed, were similarly low (<2–3%). Conclusions: The above results show that patient shifts and anatomical changes are the main source of errors in dose delivered, not machine delivery. These two sources of error are “visually complementary” and uncorrelated (albeit not additive in the final error) and one can easily incorporate error resulting from machine delivery in an error model based purely on tumor motion.

60 APPLIED LIFE SCIENCES↗

MIST_paper

Code to reproduce results from and implement functionality described in "A Bayesian error model for synthesis and sequencing of oligonucleotides", Marrs, FW, Gratz, D, and Erkkila, TH.

Marrs, Frank↗

Benchmarking Simulated Precipitation in Earth System Models

Earth system models (ESMs) bridge observationally based and theoretical understanding of the Earth system. They are among the most often used tools to study a variety of questions related to variability and changes in Earth’s climate. For many applications, ESMs must realistically simulate observed large-scale precipitation patterns and seasonal cycles that have a multitude of societal and national security implications. Despite steady improvement in the simulation of precipitation, model errors in many aspects of precipitation characteristics limit the use of ESMs both in understanding Earth system variability and change and for decision-making.

54 ENVIRONMENTAL SCIENCES↗

Earth System Reanalysis in Support of Climate Model Improvements

Recent climate model developments, established through increased model resolution, have led to substantial improvements in model simulations of the time-evolving, coupled Earth system and its subcomponents. However, regardless of resolution, climate models will always produce climate features and variability that differ from the real world and will be prone to biases. This is due to many remaining uncertainties, such as in parametric and structural model uncertainty, in the initial conditions prescribed, and in the prescribed (scenario) forcing which varies on decadal to centennial timescales. Further model improvements are expected to arise specifically from improved representation of physical processes realized through model-data fusion. This will create an unprecedented opportunity to better exploit a large array of Earth observations, from in situ measurements to weather radars and satellite observations, as the resolved scales of the models approach those of the observations. For this, climate DA will be the central tool to bring models and observations into consistency, by improving initial conditions, inferring uncertain model parameters and structure, and quantifying uncertainty. Generally, there will be advantages and complementarities of adjoint-based smoother approaches, ensemble-based filter approaches, or new ML-inspired approaches. Yet, the ever-increasing model resolution will present growing challenges arising from computational cost, calling for new ways of performing data assimilation and model optimization. Using the complementarity in a hybrid approach, blending tools and concepts from variational, ensemble and ML methods might be what is required in the future. In this context ML could be important to handle non-linear responses, and to better approximate non-Gaussian distributions.

54 ENVIRONMENTAL SCIENCES↗

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗

Assessment of Warm and Dry Bias over ARM SGP Site in E3SMv2 and E3SM-MMF

Abstract Many climate models exhibit a dry and warm bias over the central United States during the summer months, including the Energy Exascale Earth System Model (E3SM) and its Multiscale Modeling Framework (MMF) configuration. Understanding the causes of this bias is important to shine a light on this common model error and reduce the uncertainty in future projections. In this study, we use E3SMv2 and E3SM-MMF to assess how parameterized and resolved convection affect temperature and precipitation biases over the Southern Great Plains site of the Atmospheric Radiation Measurement program. Both configurations overestimate near-surface temperature and underestimate precipitation at the ARM SGP site. The bias is associated with a lack of low-level clouds during days without precipitation and too much incoming solar radiation causing the surface to warm. Low-level cloud fraction in E3SM-MMF during the nonprecipitating days is lower in comparison to E3SMv2 and observation, consistent with the larger warm bias. We also find that the underestimated precipitation can be characterized as “too frequent, too weak” in E3SMv2 and “too rare, too intense” in E3SM-MMF. These deficiencies conspire to sustain the warm and dry bias over the central United States.

54 ENVIRONMENTAL SCIENCES↗

Patterns of Precipitation Change and Climatological Uncertainty among CMIP5 Models, with a Focus on the Midlatitude Pacific Storm Track

Projections of modeled precipitation ( P ) change in global warming scenarios demonstrate marked intermodel disagreement at regional scales. Empirical orthogonal functions (EOFs) and maximum covariance analysis (MCA) are used to diagnose spatial patterns of disagreement in the simulated climatology and end-of-century P changes in phase 5 of the Coupled Model Intercomparison Project (CMIP5) archive. The term principal uncertainty pattern (PUP) is used for any robust mode calculated when applying these techniques to a multimodel ensemble. For selected domains in the tropics, leading PUPs highlight features at the margins of convection zones and in the Pacific cold tongue. The midlatitude Pacific storm track is emphasized given its relevance to wintertime P projections over western North America. The first storm-track PUP identifies a sensitive region of disagreement in P increases over the eastern midlatitude Pacific where the storm track terminates, related to uncertainty in an eastward extension of the climatological jet. The second PUP portrays uncertainty in a zonally asymmetric meridional shift of storm-track P , related to uncertainty in the extent of a poleward jet shift in the western Pacific. Both of these modes appear to arise primarily from intermodel differences in the response to radiative forcing, distinct from sampling of internal variability. The leading storm-track PUPs for P and zonal wind change exhibit similarities to the leading uncertainty patterns for the historical climatology, indicating important and parallel sensitivities in the eastern Pacific storm-track terminus region. However, expansion coefficients for climatological uncertainties tend to be weakly correlated with those for end-of-century change.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Diurnal and Semi-Diurnal Cycle of Precipitation in CMIP6 Models Using Satellite- and Ground-Based Observations

We report the diurnal and semi-diurnal cycle of precipitation simulated from CMIP6 models during 1996-2005 are evaluated globally between 60°S and 60°N, as well as at ten selected locations representing three categories of diurnal cycle of precipitation: (1) afternoon precipitation over land, (2) early morning precipitation over ocean, and (3) nocturnal precipitation over land. Three satellite-based and two ground-based rainfall products are used to evaluate the climate models. Globally, the ensemble mean of CMIP6 models shows a diurnal phase of 3 to 4 hours earlier over land and 1 to 2 hours earlier over ocean, when compared with the latest satellite products. These biases are in line with what were found in previous versions of climate models but reduced compared to the CMIP5 ensemble mean. Analysis at the selected locations complimented with in-situ measurements further reinforces these results. Several CMIP6 models have shown a significant improvement in the diurnal cycle of precipitation compared to their CMIP5 counterparts, notably on delaying afternoon precipitation over land. This can be attributed to the use of more sophisticated convective parameterizations. Most models are still unable to capture the nocturnal peak associated with elevated convection and propagating mesoscale convective systems, with a few exceptions that allow convection to be initiated above the boundary layer to capture nocturnal elevated convection. We also quantify an encouraging consistency between the satellite- and ground-based precipitation measurements despite differing spatiotemporal resolutions and sampling periods, which provides confidence in using them to evaluate the diurnal and semi-diurnal cycle of precipitation in climate models.

58 GEOSCIENCES↗

Physics-Dynamics Coupling in Weather, Climate, and Earth System Models: Challenges and Recent Progress

Geophysical models of the atmosphere and ocean invariably involve parameterizations. These represent two distinct areas: a) Subgrid processes which the model cannot (yet) resolve, due to its discrete resolution, and b) sources in the equation, due to radiation for example. Hence coupling between these physics parameterizations and the resolved fluid dynamics and also between the dynamics of the different fluids in the system (air and water) is necessary. This coupling is an important aspect of geophysical models. However, often model development is strictly segregated into either physics or dynamics. Hence, this area has many more unanswered questions than in-depth understanding. Furthermore, recent developments in the design of dynamical cores (significant increase of resolution, move to non-hydrostatic equation sets etc), extended process physics (prognostic micro physics, 3D turbulence, non-vertical radiation etc) and predicted future changes of the computational infrastructure (Exascale with its need for task parallelism, data locality and asynchronous time stepping for example) is adding even more complexity and new questions.

Gross, Markus↗

Assimilation of Satellite-Derived Soil Moisture for Improved Forecasts of the Great Plains Low-Level Jet

In the context of forecasting societally impactful Great Plains low-level jets (GPLLJs), the potential added value of satellite soil moisture (SM) data assimilation (DA) is high. GPLLJs are both sensitive to regional soil moisture gradients and frequent drivers of severe weather, including mesoscale convective systems. An untested hypothesis is that SM DA is more effective in forecasts of weakly synoptically forced, or uncoupled GPLLJs, than in forecasts of cyclone-induced coupled GPLLJs. Using the NASA Unified Weather Research and Forecasting (NU-WRF) Model, 75 GPLLJs are simulated at 9-km resolution both with and without NASA Soil Moisture Active Passive SM DA. Differences in modeled SM, surface sensible (SH) and latent heat (LH) fluxes, 2-m temperature (T2), 2-m humidity (Q2), PBL height (PBLH), and 850-hPa wind speed (W850) are quantified for individual jets and jet-type event subsets over the south-central Great Plains, as well as separately for each GPLLJ sector (entrance, core, and exit). At the GPLLJ core, DA-related changes of up to 5.4 kg m–2 in SM can result in T2, Q2, LH, SH, PBLH, and W850 differences of 0.68°C, 0.71 g kg –2 , 59.9 W m –2 , 52.4 W m –2 , 240 m, and 4 m s –1 , respectively. W850 differences focus along the jet axis and tend to increase from south to north. Further, jet-type differences are most evident at the GPLLJ exit where DA increases and decreases W850 in uncoupled and coupled GPLLJs, respectively. Data assimilation marginally reduces negative wind speed bias for all jets, but the correction is greater for uncoupled GPLLJs, as hypothesized.

54 ENVIRONMENTAL SCIENCES↗

Geometric Interpretation of the Cluster Location Problem Part I: Theory

We present a new framing of the seismic location problem using principles drawn from differential geometry. Our interpretation relies upon the common assumption that travel times observed across a network are continuous, differentiable functions of source location. In consequence, travel‐time functions constitute a differentiable map between the source region and a Riemannian manifold. The manifold is said to be the image of the source region embedded in a generally high‐dimension travel‐time vector space. A cluster of events in the source region has an image of discrete points on the manifold, that, except in the simplest cases, cannot be viewed directly. However, it is possible to project the image of a cluster into a tangent space of the manifold for direct visualization. The projection operator can be computed directly from the data without a velocity model, but produces a distorted rendering of the cluster geometry. With a model we can predict the distortions and correct them to estimate cluster geometry. We develop these points with the simplest possible example, one for which direct visualization of the manifold is possible, using the example as an introduction to the relevant concepts from differential geometry in a familiar setting. The tangent space, a local linearization of the manifold, plays a key role. We develop a metric to estimate the limits of linearization, that is, to determine when the curvature of the manifold invalidates the linear assumption. We also examine the interplay of model error, inadequate network geometry, and pick error. We then generalize our results from the simple case to the general case of 3D source regions observed by general networks. Although we do suggest a new “project and correct” method for location, we do not develop it into a practical algorithm. In conclusion, our intention rather is to highlight new analytical methods grounded in differential geometry.

East Pacific Ocean Islands↗

Moment Tensor Source-Type Analysis for the Democratic People's Republic of Korea-Declared Nuclear Explosions (2006-2017) and 3 September 2017 Collapse Event

The Democratic People's Republic of Korea (DPRK) conducted its sixth announced nuclear test on 3 September 2017 03:30 UTC (mb 6.1). There was an aftershock 8.5 min later (mb 4.1). Such aftershocks were noteworthy and often associated with post–nuclear explosion collapses. We performed moment tensor (MT) and network sensitivity solution (NSS) analysis using regional long-period surface-wave and first-motion (FM) polarities. We also extended this analysis to the previous five DPRK nuclear tests. The NSS results, which include MT solution uncertainties, show large isotropic components for the events and are within the population of other U.S. nuclear and collapse events on the fundamental lune. The FM data improved the NNS source-type resolution. The agreement between MT seismic moments and independent coda-envelope amplitudes indicated no biases with the Earth model error or poorly constrained seismic moment for shallow seismic sources. The MT for the collapse is not a pure implosion and consistent with an equivalent tensional closing crack mechanism and two-sided vertical point force.

58 GEOSCIENCES↗

2020 natural gas LCA appendices Rev1

This collection is the data-centric appendices for the report Life Cycle Analysis of Natural Gas Extraction and Power Generation: U.S. 2020 Emissions Profile. It consists of Appendix A: Additional Modeling Parameters [spreadsheet]; Appendix B: Water Burdens [spreadsheet]; Appendix D: Simulation of Liquids Unloading [python script and spreadsheet]; Appendix E: Detailed GHG Results for All Scenarios [spreadsheet]; Appendix F: Full Inventory Results [spreadsheet]; and Appendix I: Stage-Level Natural Gas Loss and Consumption Rates [spreadsheet]. These results have been updated from the previous version (https://edx.netl.doe.gov/dataset/2020-natural-gas-lca-data-appendices) to correct a modeling error where the same post-processing natural gas composition was used instead of the intended regional compositions.

Appendices↗

NETL Natural Gas Lifecycle Model 2020 Rev1

This is the excel-based life cycle model that contains all the parameters and Monte Carlo simulation capabilities to model the techno-regions contained in the report: Life Cycle Analysis of Natural Gas Extraction and Power Generation: U.S. 2020 Emissions Profile. This is an update to a previous version (https://edx.netl.doe.gov/dataset/netl-natural-gas-lifecycle-model) and corrects a modeling error in the post-processing natural gas composition.

Calcium Chloride↗