Search NASA⌕ Search

SEARCH · Search NASA

Results for “error models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

AI/ML-Enhanced Wind Forecasts for Reducing Uncertainty in Prescribed Fire Planning

Prescribed fire is a vital tool for ecosystem management and wildfire risk reduction but its escalation is constrained by overly conservative burn windows because of uncertainties, for instance, in wind forecasts. This review describes the state of the art in weather product use by fire/smoke models and identifies three priority research gaps that artificial intelligence/machine learning (AI/ML) is well positioned to address: (1) spatial and temporal downscaling to meter-scale, sub-hourly wind fields; (2) bias correction for systematic model errors in complex terrain; and (3) robust uncertainty quantification to inform ensemble-based simulations. Emerging AI/ML techniques offer promising frameworks to address all three challenges. By providing high-resolution, bias-corrected, and probabilistic wind fields, AI/ML-enhanced forecasts will allow for expanded burn windows, improved ignition strategy design and a reduced reliance on expert intuition, especially when a prescribed fire is introduced into new areas.

54 ENVIRONMENTAL SCIENCES↗

Subtropical marine low stratiform cloud deck spatial errors in the E3SMv1 Atmosphere Model

Marine low-level clouds continue to be poorly simulated in models despite many studies and field experiments devoted to their improvement. Here we focus on the spatial errors in the cloud decks in the Department of Energy Earth system model (E3SM) relative to the satellite climatology by calculating centroid distances, area ratios, and overlap ratios. Since model dynamics is better simulated than clouds, these errors are attributed primarily to the model physics. To gain additional insight, we performed a sensitivity run in which model winds were nudged to those of reanalysis. This results in a large change (but not necessarily an improvement) in the simulated cloud decks. These differences between simulations are mainly due to the interactions between model dynamics and physics. These results suggest that both model physics (widely recognized) and its interaction with dynamics (less recognized) are important to model improvement in simulating these low-level clouds.

Brunke, Michael A.↗

The effect of horizontal resolution on systematic errors of the GLA forecast model

Systematic prediction errors of the Goddard Laboratory for Atmospheres (GLA) forecast system are reduced when the higher-resolution (2 x 2.5 deg) model version is used. Based on a budget analysis of the 200-mb eddy streamfunction, the improvement of stationary eddy forecasting is seen to be caused by the following mechanism: by increasing the horizontal spatial resolution of the forecast model, atmospheric diabatic heating over the three tropical continents is changed in a way that intensifies the planetary-scale divergent circulations associated with the three pairs of divergent-convergent centers over these continents. The intensified divergent circulation results in an enhancement of vorticity sources in the Northern Hemisphere. The additional vorticity is advected eastward by a stationary wave train along 30 deg N, thereby reducing systematic errors in the lower-resolution (4 x 5 deg) GLA model.

Chen, Tsing-Chang↗

A numerical comparison of precipitating turbulent flows between large‐eddy simulation and one‐dimensional turbulence

This study presents the results of computational fluid dynamics simulations of a multiphase, reacting, turbulent mixing layer in an idealized geometry. The purpose is to compare large‐eddy simulation (LES) to one‐dimensional turbulence (ODT) and examine the trends of the flow under differing mixing conditions. Aqueous streams are mixed together to precipitate polymorphs of calcium carbonate. The polymorphs of calcium carbonate are tracked numerically using population balance equations (PBE). Each PBE contains all of the relevant physical models to track the particle evolution including nucleation, growth, and aggregation. A simple subgrid mixing model that is convenient for use with PBEs was implemented in the LES code. The higher spatial resolution achievable with ODT allowed an investigation on the effect of resolution on the mixing‐model error. The Reynolds number of the flow is varied and is shown to cause a decrease in average particle sizes with higher mixing rates. © 2015 American Institute of Chemical Engineers AIChE J , 61: 3185–3197, 2015

Abboud, Alex W.↗

Identifying attributes of CO 2 leakage zones in shallow aquifers using a parametric level set method: Original Research Article: Identifying attributes of CO 2 leakage zones in shallow aquifers using a parametric level set method

Leakage through abandoned wells and geologic faults poses the greatest risk to CO 2 storage permanence. For shallow aquifers, secondary CO 2 plumes emanating from the leak zones may go undetected for a sustained period of time and has the greatest potential to cause large-scale and long-term environmental impacts. Identification of the attributes of leak zones, including their shape, location, and strength, is required for environmental risk assessment. This study applies a parametric level set (PaLS) method to characterize leak zones. Level set methods are appealing for tracking topological changes and recovering unknown shapes of objects. However, level set evolution using the conventional level set methods is computationally challenging. In PaLS, the level set function is approximated by using a weighted sum of basis functions and the level set evolution problem is replaced by an optimization problem. The efficacy of PaLS is demonstrated by reconstructing attributes of a CO 2 leak zone in a carbonate aquifer. Our results show that PaLS is a robust source identification method that can recover the approximate leak zone locations in the presence of measurement errors, model parameter uncertainty, and inaccurate guesses of source flux strengths. Accurate delineation of source geometry is achievable when a relatively dense observation network is used. The PaLS-based, source recovery framework introduced in this work is generic and can be adapted for any reactive transport model by simply switching the pre- and post-processing routines.

54 ENVIRONMENTAL SCIENCES↗

Analyzing count data with measurement error

In this article, we analyze observed count data such as the number of defects in a steel product where the observed counts are the true counts measured with errors. We account for the measurement error by using a measurement error model based on a latent lognormal (LLN) distribution. We consider making inference about a single population (e.g., from samples of a production lot) and a regression model (e.g., from runs of a designed experiment), where the measurement system properties are known, that is, the parameters of the LLN distribution are known. Then, we consider simultaneous inference for the single population and regression model as well as the measurement system. We demonstrate the proposed methodology with both simulated and real observed counts.

42 ENGINEERING↗

Data-driven high-dimensional statistical inference with generative models

Crucial to many measurements at the LHC is the use of correlated multi-dimensional information to distinguish rare processes from large backgrounds, which is complicated by the poor modeling of many of the crucial backgrounds in Monte Carlo simulations. In this work, we introduce HI-SIGMA, a method to perform unbinned high-dimensional statistical inference with data-driven background distributions. In contradistinction to many applications of Simulation Based Inference in High Energy Physics, HI-SIGMA relies on generative ML models, rather than classifiers, to learn the signal and background distributions in the high-dimensional space. These ML models allow for interpretable inference while also incorporating model errors and other sources of systematic uncertainties. We showcase this methodology on a simplified version of a di-Higgs measurement in the bbγγ final state, where the di-photon resonance allows for background interpolation from sidebands into the signal region. We demonstrate that HI-SIGMA provides improved sensitivity as compared to standard classifier-based methods, and that systematic uncertainties can be straightforwardly incorporated by extending methods which have been used for histogram based analyses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Coupling Approaches with Non-matching Grids for Classical Linear Elasticity and Bond-based Peridynamic Models in 1D

Local-nonlocal coupling approaches provide a means to combine the computational efficiency of local models and the accuracy of nonlocal models. To facilitate the coupling of the two models, non-matching grids are often desirable as nonlocal grids usually require a finer resolution than local grids. In that case, it is often convenient to resort to interpolation operators so that models can exchange information in the overlap regions when nodes from the two grids do not coincide. This paper studies three existing coupling approaches, namely 1) a method that enforces matching displacements in an overlap region, 2) a variant that enforces a constraint on the stresses instead, and 3) a method that considers a variable horizon in the vicinity of the interfaces. Further, the effect of the interpolation order and of the grid ratio on the performance of the three coupling methods with non-matching grids is carefully studied on one-dimensional examples using polynomial manufactured solutions. The numerical results show that the degree of the interpolants should be chosen with care to avoid introducing additional modeling errors, or simply minimize these errors, in the coupling approach.

97 MATHEMATICS AND COMPUTING↗

Discrete element simulation of Pebble Bed Reactors on graphics processing units

Prediction of pebble positions in a Pebble Bed Reactor (PBR) is necessary for both reactor physics and thermal hydraulics simulations as the arrangement of pebbles has a significant impact on the resulting core power, coolant flow, and fuel temperature. Knowledge of pebble movement as the fuel is cycled through the core is also critical for predicting the fuel residence time and subsequently, the fuel burnup. Simulation with the Discrete Element Method (DEM) can provide knowledge of both the fuel packing and the fuel movement during cycling. Previous works that have performed 3D full-core DEM simulation of PBRs have used simplified models that neglect reflector wall features. This work employs a graphics processing unit (GPU)-enabled DEM code, Project Chrono, to analyze the differences in pebble packing and pebble velocities between a simplified smooth PBR reflector and a more realistic reflector that includes circular wall features. Additionally, a sensitivity study is performed on the depth of the wall features to ensure that crystallization is prevented. Project Chrono is also validated for PBR cycling applications using experimental data. It is found that wall features with a depth of at least 0.5 pebble diameters significantly reduce crystallization in the near-wall region, leading to discrepancies in both packing fraction and pebble velocity in this region compared to the simplified reflector models. These discrepancies are found to lead to roughly a 5–10% difference in the prediction of the near-wall porosity and a 10% difference in the prediction of the velocity of pebbles near the wall. As a result of these discrepancies, it is suggested that future DEM simulations of PBRs include wall features to reduce modeling errors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Application of automated measurement and verification to utility energy efficiency program data

Trustworthy savings calculations are critical to convincing regulators of both the cost-effectiveness of energy efficiency program investments and their ability to defer supply-side capital investments. Today’s methods for measurement and verification (M&V) of energy savings constitute a significant portion of the total costs of energy efficiency programs. They also require time-consuming data acquisition. A spectrum of savings calculation approaches is used, with some relying more heavily on measured data and others relying more heavily on estimated, modeled, or stipulated data. The increasing availability of “smart” meters and devices that report near-real time data, combined with new analytical approaches to quantify savings, offers the potential to conduct M&V more quickly and at lower cost, with comparable or improved accuracy. Commercial energy management and information systems (EMIS) technologies are beginning to offer these ‘M&V 2.0’ capabilities, and program administrators want to understand how they might assist programs in quickly and accurately measuring energy savings. This paper presents the results of recent testing of the ability to use automation to streamline the M&V process. In this paper, we apply an automated whole-building M&V tool to historic data sets from energy efficiency programs to begin to explore the accuracy, cost, and time trade-offs between more traditional M&V, and these emerging streamlined methods that use high-resolution energy data and automated computational intelligence. For the data sets studied we evaluate the fraction of buildings that are well suited to automated baseline characterization, the uncertainty in gross savings that is due to M&V 2.0 tools’ model error, and indications of labor time savings, and how the automated savings results compare to prior, traditionally determined savings results. The results show that 70% of the buildings were well suited to the automated approach. In a majority of the cases (80%) savings and uncertainties for each individual building were quantified to levels above the criteria in ASHRAE Guideline 14. In addition the findings suggest that M&V 2.0 methods may also offer time-savings relative to traditional approaches. Lastly, we discuss the implications of these findings relative to the potential evolution of M&V, and pilots currently being launched to test how M&V automation can be integrated into ratepayer-funded programs and professional implementation and evaluation practice.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Scalable tuning of building models to hourly data

Energy models of existing buildings are unreliable unless calibrated so they correlate well with actual energy usage. Manual tuning requires a skilled professional, is prohibitively expensive for small projects, imperfect, non-repeatable, non-transferable, and not scalable to the dozens of sensor channels that smart meters, smart appliances, and cheap/ubiquitous sensors are beginning to make available today. A scalable, automated methodology is needed to quickly and intelligently calibrate building energy models to all available data, increase the usefulness of those models, and facilitate speed-and-scale penetration of simulation-based capabilities into the marketplace for actualized energy savings. The "Autotune'' project is a novel, model-agnostic methodology which leverages supercomputing, large simulation ensembles, and big data mining with multiple machine learning algorithms to allow automatic calibration of simulations that match measured experimental data in a way that is deployable on commodity hardware. This paper shares several methodologies employed to reduce the combinatorial complexity to a computationally tractable search problem for hundreds of input parameters. Furthermore, accuracy metrics are provided which quantify model error to measured data for either monthly or hourly electrical usage from a highly-instrumented, emulated-occupancy research home.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Incidence of Changes in Respiration-Induced Tumor Motion and Its Relationship With Respiratory Surrogates During Individual Treatment Fractions

Purpose: To determine how frequently (1) tumor motion and (2) the spatial relationship between tumor and respiratory surrogate markers change during a treatment fraction in lung and pancreas cancer patients. Methods and Materials: A Cyberknife Synchrony system radiographically localized the tumor and simultaneously tracked three respiratory surrogate markers fixed to a form-fitting vest. Data in 55 lung and 29 pancreas fractions were divided into successive 10-min blocks. Mean tumor positions and tumor position distributions were compared across 10-min blocks of data. Treatment margins were calculated from both 10 and 30 min of data. Partial least squares (PLS) regression models of tumor positions as a function of external surrogate marker positions were created from the first 10 min of data in each fraction; the incidence of significant PLS model degradation was used to assess changes in the spatial relationship between tumors and surrogate markers. Results: The absolute change in mean tumor position from first to third 10-min blocks was >5 mm in 13% and 7% of lung and pancreas cases, respectively. Superior-inferior and medial-lateral differences in mean tumor position were significantly associated with the lobe of lung. In 61% and 54% of lung and pancreas fractions, respectively, margins calculated from 30 min of data were larger than margins calculated from 10 min of data. The change in treatment margin magnitude for superior-inferior motion was >1 mm in 42% of lung and 45% of pancreas fractions. Significantly increasing tumor position prediction model error (mean {+-} standard deviation rates of change of 1.6 {+-} 2.5 mm per 10 min) over 30 min indicated tumor-surrogate relationship changes in 63% of fractions. Conclusions: Both tumor motion and the relationship between tumor and respiratory surrogate displacements change in most treatment fractions for patient in-room time of 30 min.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Using complex resistivity imaging to infer biogeochemical processes associated with bioremediation of a uranium-contaminated aquifer

Experiments at the Department of Energy’s Rifle Integrated Field Research Challenge (IFRC) site near Rifle, Colorado (USA) have demonstrated the ability to remove uranium from groundwater by stimulating the growth and activity of Geobacter species through acetate amendment. Prolonging the activity of these strains in order to optimize uranium bioremediation has prompted the development of minimally-invasive and spatially-extensive monitoring methods diagnostic of their in situ activity and the end products of their metabolism. Here we demonstrate the use of complex resistivity imaging for monitoring biogeochemical changes accompanying stimulation of indigenous aquifer microorganisms during and after a prolonged period (100+ days) of acetate injection. A thorough raw-data statistical analysis of discrepancies between normal and reciprocal measurements and incorporation of a new power-law phase-error model in the inversion were used to significantly improve the quality of the resistivity phase images over those obtained during previous monitoring experiments at the Rifle IRFC site. The imaging results reveal spatiotemporal changes in the phase response of aquifer sediments, which correlate with increases in Fe(II) and precipitation of metal sulfides (e.g., FeS) following the iterative stimulation of iron and sulfate reducing microorganism. Only modest changes in resistivity magnitude were observed over the monitoring period. The largest phase anomalies (>40 mrad) were observed hundreds of days after halting acetate injection, in conjunction with accumulation of Fe(II) in the presence of residual FeS minerals, reflecting preservation of geochemically reduced conditions in the aquifer – a prerequisite for ensuring the long-term stability of immobilized, redox-sensitive contaminants, such as uranium.

54 ENVIRONMENTAL SCIENCES↗

Quantifying uncertainties in global and regional temperature change using an ensemble of observational estimates: The HadCRUT4 data set

Recent developments in observational near-surface air temperature and sea-surface temperature analyses are combined to produce HadCRUT4, a new data set of global and regional temperature evolution from 1850 to the present. This includes the addition of newly digitized measurement data, both over land and sea, new sea-surface temperature bias adjustments and a more comprehensive error model for describing uncertainties in sea-surface temperature measurements. An ensemble approach has been adopted to better describe complex temporal and spatial interdependencies of measurement and bias uncertainties and to allow these correlated uncertainties to be taken into account in studies that are based upon HadCRUT4. Climate diagnostics computed from the gridded data set broadly agree with those of other global near-surface temperature analyses. Fitted linear trends in temperature anomalies are approximately 0.07°C/decade from 1901 to 2010 and 0.17°C/decade from 1979 to 2010 globally. Northern/southern hemispheric trends are 0.08/0.07°C/decade over 1901 to 2010 and 0.24/0.10°C/decade over 1979 to 2010. Linear trends in other prominent near-surface temperature analyses agree well with the range of trends computed from the HadCRUT4 ensemble members.

54 ENVIRONMENTAL SCIENCES↗

Robust Multiyear Climate Impacts of Volcanic Eruptions in Decadal Prediction Systems

Abstract Major tropical volcanic eruptions have a large impact on climate, but there have only been three major eruptions during the recent relatively well‐observed period. Models are therefore an important tool to understand and predict the impacts of an eruption. This study uses five state‐of‐the‐art decadal prediction systems that have been initialized with the observed state before volcanic aerosols are introduced. The impact of the volcanic aerosols is found by subtracting the results of a reference experiment where the volcanic aerosols are omitted. We look for the robust impact across models and volcanoes by combining all the experiments, which helps reveal a signal even if it is weak in the models. The models used in this study simulate realistic levels of warming in the stratosphere, but zonal winds are weaker than the observations. As a consequence, models can produce a pattern similar to the North Atlantic Oscillation in the first winter following the eruption, but the response and impact on surface temperatures are weaker than in observations. Reproducing the pattern, but not the amplitude, may be related to a known model error. There are also impacts in the Pacific and Atlantic Oceans. This work contributes toward improving the interpretation of decadal predictions in the case of a future large tropical volcanic eruption.

54 ENVIRONMENTAL SCIENCES↗

Connecting Large‐Scale Meteorological Patterns to Extratropical Cyclones in CMIP6 Climate Models Using Self‐Organizing Maps

Abstract Extratropical cyclones (ETCs) are responsible for the majority of cool‐season extreme events in the northeastern United States (NEUS), often leading to high‐impact weather conditions that can have wide‐ranging socioeconomic impacts. Evaluating the ability of climate models to adequately simulate ETC dynamics is essential for improving model performance and increasing confidence in future projections used by stakeholders and policymakers. ETCs are traditionally studied using techniques such as case studies and synoptic typing, however, these approaches can be time‐consuming, require subjective analysis, and do not necessarily identify the coincident large‐scale meteorological patterns (LSMPs). Here, we apply self‐organizing maps (SOMs) as an automated machine‐learning approach to characterize the LSMPs and associated frequency and intensity of discrete ETC events over NEUS. The dominant patterns of geopotential height variability are identified through SOM analysis of five reanalysis products during the last four decades. ETC events are tracked using TempestExtremes and are integrated with SOMs to classify the accumulated cyclone activity (ACA) associated with each pattern. We then evaluate the skill of CMIP6 historical experiments in simulating the LSMPs and ETC events identified in the SOM. Our results identify a robust bias toward more zonal patterns, with models struggling to reproduce the more amplified patterns typically associated with the highest cyclone activity. While model resolution has some impact on simulation credibility, model configuration appears to be more important in LSMP representation. The vast majority of CMIP6 models produce too few ETCs, although model errors are distributed around historical reanalyses when ACA is normalized by storm frequency.

54 ENVIRONMENTAL SCIENCES↗

Envisioning U.S. Climate Predictions and Projections to Meet New Challenges

In the face of a changing climate, the understanding, predictions, and projections of natural and human systems are increasingly crucial to prepare and cope with extremes and cascading hazards, determine unexpected feedbacks and potential tipping points, inform long-term adaptation strategies, and guide mitigation approaches. Increasingly complex socio-economic systems require enhanced predictive information to support advanced practices. Such new predictive challenges drive the need to fully capitalize on ambitious scientific and technological opportunities. These include the unrealized potential for very high-resolution modeling of global-to-local Earth system processes across timescales, reduction of model biases, enhanced integration of human systems and the Earth Systems, better quantification of predictability and uncertainties; expedited science-to-service pathways, and co-production of actionable information with stakeholders. Enabling technological opportunities include exascale computing, advanced data storage, novel observations and powerful data analytics, including artificial intelligence and machine learning. Looking to generate community discussions on how to accelerate progress on U.S. climate predictions and projections, representatives of Federally-funded U.S. modeling groups outline here perspectives on a six-pillar national approach grounded in climate science that builds on the strengths of the U.S. modeling community and agency goals. This calls for an unprecedented level of coordination to capitalize on transformative opportunities, augmenting and complementing current modeling center capabilities and plans to support agency missions. Tangible outcomes include projections with horizontal spatial resolutions finer than 10 km, representing extremes and associated risks in greater detail, reduced model errors, better predictability estimates, and more customized projections to support next generation climate services.

54 ENVIRONMENTAL SCIENCES↗

A Kriging-Based Approach to Autonomous Experimentation with Applications to X-Ray Scattering

Abstract Modern scientific instruments are acquiring data at ever-increasing rates, leading to an exponential increase in the size of data sets. Taking full advantage of these acquisition rates will require corresponding advancements in the speed and efficiency of data analytics and experimental control. A significant step forward would come from automatic decision-making methods that enable scientific instruments to autonomously explore scientific problems—that is, to intelligently explore parameter spaces without human intervention, selecting high-value measurements to perform based on the continually growing experimental data set. Here, we develop such an autonomous decision-making algorithm that is physics-agnostic, generalizable, and operates in an abstract multi-dimensional parameter space. Our approach relies on constructing a surrogate model that fits and interpolates the available experimental data, and is continuously refined as more data is gathered. The distribution and correlation of the data is used to generate a corresponding uncertainty across the surrogate model. By suggesting follow-up measurements in regions of greatest uncertainty, the algorithm maximally increases knowledge with each added measurement. This procedure is applied repeatedly, with the algorithm iteratively reducing model error and thus efficiently sampling the parameter space with each new measurement that it requests. We validate the method using synthetic data, demonstrating that it converges to faithful replica of test functions more rapidly than competing methods, and demonstrate the viability of the approach in an experimental context by using it to direct autonomous small-angle (SAXS) and grazing-incidence small-angle (GISAXS) x-ray scattering experiments.

36 MATERIALS SCIENCE↗