Search NASA⌕ Search

SEARCH · Search NASA

Results for “error models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Quantum error mitigation by hidden inverses protocol in superconducting quantum devices

We present a method to improve the convergence of variational algorithms based on hidden inverses (HIs) to mitigate coherent errors. In the context of error mitigation, this means replacing the hardware implementation of certain Hermitian gates with their inverses. Doing so results in noise cancellation and a more resilient quantum circuit. This approach improves performance in a variety of two-qubit error models where the noise operator also inverts with the gate inversion. We apply the mitigation scheme on superconducting quantum processors running the variational quantum eigensolver (VQE) algorithm to find the H 2 ground-state energy. When implemented on superconducting hardware we find that the mitigation scheme effectively reduces the energy fluctuations in the parameter learning path in VQE, reducing the number of iterations for a converged value. We also provide a detailed numerical simulation of VQE performance under different noise models and explore how HIs and randomized compiling affect the underlying loss landscape of the learning problem. These simulations help explain our experimental hardware outcomes, helping to connect lower-level gate performance to application-specific behavior in contrast to metrics like fidelity which often do not provide an intuitive insight into observed high level performance.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Microscopic constraints for the equation of state and structure of neutron stars: A Bayesian model mixing framework

Bayesian model mixing (BMM) is a statistical technique that can combine constraints from different regions of an input space in a principled way. Here we extend our BMM framework for the equation of state (EOS) of strongly interacting matter from symmetric nuclear matter to asymmetric matter, specifically focusing on zero-temperature, charge-neutral, 𝛽-equilibrated matter. We use Gaussian processes (GPs) to infer constraints on the neutron-star matter EOS at intermediate densities from two different microscopic theories: chiral effective-field theory (𝜒⁢EFT) at baryon densities around nuclear saturation, 𝑛 𝐵 ∼ 𝑛 0 , and perturbative QCD at asymptotically high baryon densities, 𝑛 𝐵 ⩾ 20⁢𝑛 0 . The uncertainties of the 𝜒⁢EFT and pQCD EOSs are obtained using the BUQEYE truncation error model. We demonstrate the flexibility of our framework through the use of two categories of GP kernels: conventional stationary kernels and a nonstationary changepoint kernel. We use the latter to explore potential constraints on the dense matter EOS by including exogenous data representing theory predictions and heavy-ion collision measurements at densities ⩾ 2⁢𝑛 0 . We also use our EOSs to obtain neutron-star mass-radius relations and their uncertainties. Finally, our framework, whose implementation will be available through a GitHub repository, provides a prior distribution for the EOS that can be used in large-scale neutron-star inference frameworks.

Bayesian methods↗

Spatially Dependent Multiple Testing Under Model Misspecification, With Application to Detection of Anthropogenic Influence on Extreme Climate Events

The Weather Risk Attribution Forecast (WRAF) is a forecasting tool that uses output from global climate models to make simultaneous attribution statements about whether and how greenhouse gas emissions have contributed to extreme weather across the globe. However, in conducting a large number of simultaneous hypothesis tests, the WRAF is prone to identifying false “discoveries.” A common technique for addressing this multiple testing problem is to adjust the procedure in a way that controls the proportion of true null hypotheses that are incorrectly rejected, or the false discovery rate (FDR). Unfortunately, generic FDR procedures suffer from low power when the hypotheses are dependent, and techniques designed to account for dependence are sensitive to misspecification of the underlying statistical model. In this paper, we develop a Bayesian decision-theoretical approach for dependent multiple testing and a nonparametric hierarchical statistical model that flexibly controls false discovery and is robust to model misspecification. We illustrate the robustness of our procedure to model error with a simulation study, using a framework that accounts for generic spatial dependence and allows the practitioner to flexibly specify the decision criteria. Finally, we apply our procedure to several seasonal forecasts and discuss implementation for the WRAF workflow. Lastly, supplementary materials for this article, including a standardized description of the materials available for reproducing the work, are available as an online supplement.

54 ENVIRONMENTAL SCIENCES↗

Stochastic Richardson Extrapolation Based Numerical Error Estimation for Kinetic Plasma Simulations

We present a numerical error estimation technique specifically formulated to deal with stochastic code output with multiple discretization parameters. This method is based on multiple fits to an error model with arbitrary convergence rates and cross-coupling terms, performed using nonlinear optimization. The fitting approach varies by the type of residual norm which influences the importance of outliers, and weights which influences the relative importance of data points in the coarse and refined regions of discretization parameter space. To account for the influence of stochastic noise, these fits are performed on multiple bootstrap values based on the underlying response data set. Using an automated discretization domain selection scheme, the fits are performed on a series of reduced sets of discretization levels in order to find an optimal fully-converged result estimate in the minimum variance sense; this automated approach enables straightforward analysis of multiple quantities of interest and/or time and spatially-dependent response data. The overall numerical error analysis method is useful for verification and validation problems for stochastic simulation methods and forms a key component in the overall uncertainty quantification process. The method was demonstrated for steady and unsteady electron diode problems simulated using a particle-in-cell kinetic plasma code, demonstrating excellent results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Sloan Digital Sky Survey COADD: 275 deg{sup 2} of deep Sloan Digital Sky Survey imaging on stripe 82

We present details of the construction and characterization of the coaddition of the Sloan Digital Sky Survey (SDSS) Stripe 82 ugriz imaging data. This survey consists of 275 deg{sup 2} of repeated scanning by the SDSS camera over –50° ≤ α ≤ 60° and –1.°25 ≤ δ ≤ +1.°25 centered on the Celestial Equator. Each piece of sky has ∼20 runs contributing and thus reaches ∼2 mag fainter than the SDSS single pass data, i.e., to r ∼ 23.5 for galaxies. We discuss the image processing of the coaddition, the modeling of the point-spread function (PSF), the calibration, and the production of standard SDSS catalogs. The data have an r-band median seeing of 1.''1 and are calibrated to ≤1%. Star color-color, number counts, and PSF size versus modeled size plots show that the modeling of the PSF is good enough for precision five-band photometry. Structure in the PSF model versus magnitude plot indicates minor PSF modeling errors, leading to misclassification of stars as galaxies, as verified using VVDS spectroscopy. There are a variety of uses for this wide-angle deep imaging data, including galactic structure, photometric redshift computation, cluster finding and cross wavelength measurements, weak lensing cluster mass calibrations, and cosmic shear measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

TU-AB-201-05: Automatic Adaptive Per-Operative Re-Planning for HDR Prostate Brachytherapy - a Simulation Study On Errors in Needle Positioning

Purpose: To develop adaptive planning with feedback for MRI-guided focal HDR prostate brachytherapy with a single divergent needle robotic implant device. After each needle insertion, the dwell positions for that needle are calculated and the positioning of remaining needles and dosimetry are both updated based on MR imaging. Methods: Errors in needle positioning may occur due to inaccurate needle insertion (caused by e.g. the needle’s bending) and unpredictable changes in patient anatomy. Consequently, the dose plan quality might dramatically decrease compared to the preplan. In this study, a procedure was developed to re-optimize, after each needle insertion, the remaining needle angulations, source positions and dwell times in order to obtain an optimal coverage (D95% PTV>19 Gy) without exceeding the constraints of the organs at risk (OAR) (D10% urethra<21 Gy, D1cc bladder<12 Gy and D1cc rectum<12 Gy). Complete HDR procedures with 6 needle insertions were simulated for a patient MR-image set with PTV, prostate, urethra, bladder and rectum delineated. Random angulation errors, modeled by a Gaussian distribution (standard deviation of 3 mm at the needle’s tip), were generated for each needle insertion. We compared the final dose parameters for the situations (I) without re-optimization and (II) with the automatic feedback. Results: The computation time of replanning was below 100 seconds on a current desk computer. For the patient tested, a clinically acceptable dose plan was achieved while applying the automatic feedback (median(range) in Gy, D95% PTV: 19.9(19.3–20.3), D10% urethra: 13.4(11.9–18.0), D1cc rectum: 11.0(10.7–11.6), D1cc bladder: 4.9(3.6–6.8)). This was not the case without re-optimization (median(range) in Gy, D95% PTV: 19.4(14.9–21.3), D10% urethra: 12.6(11.0–15.7), D1cc rectum: 10.9(8.9–14.1), D1cc bladder: 4.8(4.4–5.2)). Conclusion: An automatic guidance strategy for HDR prostate brachytherapy was developed to compensate errors in needle positioning and improve the dose distribution. Without re-optimization, target coverage and OAR constraints may not be achieved. M. Borot de Battisti is funded by Philips Medical Systems Nederland B.V.; M. Moerland is principal investigator on a contract funded by Philips Medical Systems Nederland B.V.; G. Hautvast and D. Binnekamp are full-time employees of Philips Medical Systems Nederland B.V.

60 APPLIED LIFE SCIENCES↗

Collaborative Research: Advancing Arctic Climate Projection Capability at Seasonal to Decadal Scales (Final Technical Report)

The Regional Arctic System Model (RASM) at process resolving configurations has been used to (i) advance understanding of physical processes and feedbacks involved in Arctic amplification and (ii) understand and potentially reduce uncertainty in prediction of arctic climate change at seasonal to decadal scales. RASM consists the atmosphere (Weather and Research Forecasting model, WRF), ocean (Parallel Ocean Program, POP), sea ice (CICE), land hydrology (Variable Infiltration Capacity model, VIC), river routing scheme (RVIC), marine biogeochemistry components and the coupling framework (CPL7). Its domain is pan-Arctic, with the atmosphere and land components configured on a 50-km or 25-km grid and four configurations of the ocean and sea ice components: 1/12°(~9.3km) or 1/48°(~2.4km) and 45 or 60 vertical layers. These RASM configurations have been motivated by the emerging exascale capability for high performance computing to improve model fidelity. The dynamical downscaling of reanalysis allows comparison of RASM results with observations in place and time to: (i) advance system level understanding of physical processes and coupling involved in an event, (ii) optimize model parameter space, (iii) diagnose and reduce model biases and (iv) produce realistic and consistent across all the components initial conditions for predictions and predictability studies, which are all unique capabilities not available in global Earth System Models (ESMs). An evaluation of RASM 1.0 (Cassano et al. 2017) revealed that it had a cold bias over the oceans and a warm bias over land areas due largely to cloud and radiation biases in the model, with too little cloud cover simulated over land and too much cloud cover simulated over sub-polar oceans. This study has motivated an upgrade to WRF version 3.7.1 in RASM and allowed for the inclusion of the radiative impact of convective clouds. A variety of atmospheric physics parameterizations were evaluated against observations (e.g. data from the Arctic Clouds in Summer Experiment (ACSE); Sedlar et al. 2020) to identify an optimal suite of WRF physics options in RASM. The RASM with the optimized WRF physics were used to study the impact of strong mesoscale winds over the ocean around the southern tip of Greenland (DuVivier and Cassano 2016) and their impact on oceanic convection (DuVivier et al. 2017a). Data from the PolarWinds field campaign were used to evaluate WRF boundary layer physics and resolution impacts on the simulation of a Greenland barrier wind event (DuVivier et al. 2017b). The RVIC streamflow routing model has been implemented in RASM to realistically represent high-resolution streamflow processes (Hamman et al. 2017) and to couple the land buoyancy fluxes to the ocean. The RASM-RVIC high-resolution data set of all coastal freshwater fluxes for the Arctic drainage basin and surrounding areas for 1979-2014 was published as a separate product (https://doi.org/10.5281/zenodo.293037). The fidelity of atmospheric momentum transfer to and the response of polar marine Ekman layer in RASM and Community Earth System Model (CESM) was investigated by Roberts et al. (2015). The increased frequency of oceanic flux exchange in CESM, following the RASM guidance, caused a considerable increase in the median inertial ice speed across the Southern Ocean and parts of the Arctic. A comprehensive evaluation of the RASM1.0 atmosphere-ocean-sea ice-land interface was completed by Brunke et al. (2018). RASM was also demonstrated for its capability to simulate extreme events in agreement with observations in space and time (Lee et al. submitted). In particular, the development of three open water events, known as polynyas, have been simulated north of Greenland in February of 2011, 2017 and 2018, in agreement with satellite observations for the past four decades. The optimized RASM sea ice results have been favorably evaluated against satellite observations and a subset of eleven CMIP6 models (Watts et al. submitted). In a complementary project, Jin et al. (2018) have shown that RASM with higher-resolution and new sea-ice processes contributed to lower model errors in sea-ice conditions, concentrations of nutrients and ice algae, in comparison to results from the coarse-resolution (1°) CESM. In two other complementary studies, RASM results were used (i) to explain areas of concentrated use by bowhead whales, the seasonal progression in the use, and the physical environment within those areas (Citta et al. 2015) and (ii) for a synthesis of fall bowhead whales distribution and migration in the Bering-Chukchi-Beaufort (BCB) Sea to investigate whale movements and feeding to the local ocean hydrography and currents (Citta et al. 2018). However, the multi-decadal output from the CESM Large Ensemble yielded unrealistic forcing. Instead, the shorter NCEP CFSv2 9-month forecasts were successfully tested and afforded an increased ensemble size (~30) to demonstrate gains of dynamical downscaling at sub-seasonal to intra-annual time scales. The improved model physics and coupling among RASM model components have yielded more realistic representation of the sea ice cover and consistent across all model components initial conditions. Consequently, RASM demonstrates significant gains compared to simulation of sea ice in the NCEP reanalysis. In addition, RASM 6-month ensemble forecasts yield very realistic sea ice distribution, which demonstrates both significant gains of dynamical downscaling and the continued impact of the initial conditions on forecasts out to 6 months (https://nps.edu/web/rasm/predictions). A follow up study using RASM for dynamical downscaling of the more realistic CESM initialized Decadal Prediction Large Ensemble output is currently ongoing as part of the DOE RGMA HiLAT-RASM project.

54 ENVIRONMENTAL SCIENCES↗

ADVANCED WAVEFORM SIMULATION FOR SEISMIC MONITORING EVENTS

This quarter, we have focused on several tasks: (1) Building a high-quality catalog of earthquake source parameters for the Middle East and East Asia. In East Asia, we computed source parameters using the CAP method for a set of events studied by Herrman et al., (MRR, 2006) using a complete waveform technique. Results indicated excellent agreement with the moment magnitudes in the range 3.5 -5.5. Below magnitude 3.5 the scatter increases. For events with more than 2-3 observations at different azimuths, we found good agreement of focal mechanisms. Depths were generally consistent, although differences of up to 10 km were found. These results suggest that CAP modeling provides estimates of source parameters at least as reliable as complete waveform modeling techniques. However, East Asia and the Yellow Sea Korean Paraplatform (YSKP) region studied are relatively laterally homogeneous and may not benefit from the CAP method’s flexibility to shift waveform segments to account for path-dependent model errors. A more challenging region to study is the Middle East where strong variations in sedimentary basin, crustal thickness and crustal and mantle seismic velocities greatly impact regional wave propagation. We applied the CAP method to a set of events in and around Iran and found good agreement between estimated focal mechanisms and those reported by the Global Centroid Moment Tensor (CMT) catalog. We found a possible bias in the moment magnitudes that may be due to the thick low-velocity crust in the Iranian Plateau. (2) Testing Methods on a Lifetime Regional Data Set. In particular, the recent 2/21/08 Nevada Event and Aftershock Sequence occurred in the middle of USArray, producing over a thousand records per event. The tectonic setting is quite similar to Central Iran and thus provides an excellent testbed for CAP+ at ranges out to 10°, including extensive observations of crustal thinning and thickening and various Pnl complexities. Broadband modeling in 1D, 2D, and 3D will be presented. (3) Shallow Crustal Structure and Sparse Network Source Inversions for Southern California. We conducted a detailed test of a recently developed technique, CAPloc, in recovering source parameters including location and depth based on tomographic maps. We tested two-station solutions against 160 well determined events which worked well except for paths crossing deep basins and along mountain ridges.

58 GEOSCIENCES↗

AI/ML-Enhanced Wind Forecasts for Reducing Uncertainty in Prescribed Fire Planning

Prescribed fire is a vital tool for ecosystem management and wildfire risk reduction but its escalation is constrained by overly conservative burn windows because of uncertainties, for instance, in wind forecasts. This review describes the state of the art in weather product use by fire/smoke models and identifies three priority research gaps that artificial intelligence/machine learning (AI/ML) is well positioned to address: (1) spatial and temporal downscaling to meter-scale, sub-hourly wind fields; (2) bias correction for systematic model errors in complex terrain; and (3) robust uncertainty quantification to inform ensemble-based simulations. Emerging AI/ML techniques offer promising frameworks to address all three challenges. By providing high-resolution, bias-corrected, and probabilistic wind fields, AI/ML-enhanced forecasts will allow for expanded burn windows, improved ignition strategy design and a reduced reliance on expert intuition, especially when a prescribed fire is introduced into new areas.

54 ENVIRONMENTAL SCIENCES↗

Subtropical marine low stratiform cloud deck spatial errors in the E3SMv1 Atmosphere Model

Marine low-level clouds continue to be poorly simulated in models despite many studies and field experiments devoted to their improvement. Here we focus on the spatial errors in the cloud decks in the Department of Energy Earth system model (E3SM) relative to the satellite climatology by calculating centroid distances, area ratios, and overlap ratios. Since model dynamics is better simulated than clouds, these errors are attributed primarily to the model physics. To gain additional insight, we performed a sensitivity run in which model winds were nudged to those of reanalysis. This results in a large change (but not necessarily an improvement) in the simulated cloud decks. These differences between simulations are mainly due to the interactions between model dynamics and physics. These results suggest that both model physics (widely recognized) and its interaction with dynamics (less recognized) are important to model improvement in simulating these low-level clouds.

Brunke, Michael A.↗

A numerical comparison of precipitating turbulent flows between large‐eddy simulation and one‐dimensional turbulence

This study presents the results of computational fluid dynamics simulations of a multiphase, reacting, turbulent mixing layer in an idealized geometry. The purpose is to compare large‐eddy simulation (LES) to one‐dimensional turbulence (ODT) and examine the trends of the flow under differing mixing conditions. Aqueous streams are mixed together to precipitate polymorphs of calcium carbonate. The polymorphs of calcium carbonate are tracked numerically using population balance equations (PBE). Each PBE contains all of the relevant physical models to track the particle evolution including nucleation, growth, and aggregation. A simple subgrid mixing model that is convenient for use with PBEs was implemented in the LES code. The higher spatial resolution achievable with ODT allowed an investigation on the effect of resolution on the mixing‐model error. The Reynolds number of the flow is varied and is shown to cause a decrease in average particle sizes with higher mixing rates. © 2015 American Institute of Chemical Engineers AIChE J , 61: 3185–3197, 2015

Abboud, Alex W.↗

Identifying attributes of CO 2 leakage zones in shallow aquifers using a parametric level set method: Original Research Article: Identifying attributes of CO 2 leakage zones in shallow aquifers using a parametric level set method

Leakage through abandoned wells and geologic faults poses the greatest risk to CO 2 storage permanence. For shallow aquifers, secondary CO 2 plumes emanating from the leak zones may go undetected for a sustained period of time and has the greatest potential to cause large-scale and long-term environmental impacts. Identification of the attributes of leak zones, including their shape, location, and strength, is required for environmental risk assessment. This study applies a parametric level set (PaLS) method to characterize leak zones. Level set methods are appealing for tracking topological changes and recovering unknown shapes of objects. However, level set evolution using the conventional level set methods is computationally challenging. In PaLS, the level set function is approximated by using a weighted sum of basis functions and the level set evolution problem is replaced by an optimization problem. The efficacy of PaLS is demonstrated by reconstructing attributes of a CO 2 leak zone in a carbonate aquifer. Our results show that PaLS is a robust source identification method that can recover the approximate leak zone locations in the presence of measurement errors, model parameter uncertainty, and inaccurate guesses of source flux strengths. Accurate delineation of source geometry is achievable when a relatively dense observation network is used. The PaLS-based, source recovery framework introduced in this work is generic and can be adapted for any reactive transport model by simply switching the pre- and post-processing routines.

54 ENVIRONMENTAL SCIENCES↗

Analyzing count data with measurement error

In this article, we analyze observed count data such as the number of defects in a steel product where the observed counts are the true counts measured with errors. We account for the measurement error by using a measurement error model based on a latent lognormal (LLN) distribution. We consider making inference about a single population (e.g., from samples of a production lot) and a regression model (e.g., from runs of a designed experiment), where the measurement system properties are known, that is, the parameters of the LLN distribution are known. Then, we consider simultaneous inference for the single population and regression model as well as the measurement system. We demonstrate the proposed methodology with both simulated and real observed counts.

42 ENGINEERING↗

Data-driven high-dimensional statistical inference with generative models

Crucial to many measurements at the LHC is the use of correlated multi-dimensional information to distinguish rare processes from large backgrounds, which is complicated by the poor modeling of many of the crucial backgrounds in Monte Carlo simulations. In this work, we introduce HI-SIGMA, a method to perform unbinned high-dimensional statistical inference with data-driven background distributions. In contradistinction to many applications of Simulation Based Inference in High Energy Physics, HI-SIGMA relies on generative ML models, rather than classifiers, to learn the signal and background distributions in the high-dimensional space. These ML models allow for interpretable inference while also incorporating model errors and other sources of systematic uncertainties. We showcase this methodology on a simplified version of a di-Higgs measurement in the bbγγ final state, where the di-photon resonance allows for background interpolation from sidebands into the signal region. We demonstrate that HI-SIGMA provides improved sensitivity as compared to standard classifier-based methods, and that systematic uncertainties can be straightforwardly incorporated by extending methods which have been used for histogram based analyses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Coupling Approaches with Non-matching Grids for Classical Linear Elasticity and Bond-based Peridynamic Models in 1D

Local-nonlocal coupling approaches provide a means to combine the computational efficiency of local models and the accuracy of nonlocal models. To facilitate the coupling of the two models, non-matching grids are often desirable as nonlocal grids usually require a finer resolution than local grids. In that case, it is often convenient to resort to interpolation operators so that models can exchange information in the overlap regions when nodes from the two grids do not coincide. This paper studies three existing coupling approaches, namely 1) a method that enforces matching displacements in an overlap region, 2) a variant that enforces a constraint on the stresses instead, and 3) a method that considers a variable horizon in the vicinity of the interfaces. Further, the effect of the interpolation order and of the grid ratio on the performance of the three coupling methods with non-matching grids is carefully studied on one-dimensional examples using polynomial manufactured solutions. The numerical results show that the degree of the interpolants should be chosen with care to avoid introducing additional modeling errors, or simply minimize these errors, in the coupling approach.

97 MATHEMATICS AND COMPUTING↗

Discrete element simulation of Pebble Bed Reactors on graphics processing units

Prediction of pebble positions in a Pebble Bed Reactor (PBR) is necessary for both reactor physics and thermal hydraulics simulations as the arrangement of pebbles has a significant impact on the resulting core power, coolant flow, and fuel temperature. Knowledge of pebble movement as the fuel is cycled through the core is also critical for predicting the fuel residence time and subsequently, the fuel burnup. Simulation with the Discrete Element Method (DEM) can provide knowledge of both the fuel packing and the fuel movement during cycling. Previous works that have performed 3D full-core DEM simulation of PBRs have used simplified models that neglect reflector wall features. This work employs a graphics processing unit (GPU)-enabled DEM code, Project Chrono, to analyze the differences in pebble packing and pebble velocities between a simplified smooth PBR reflector and a more realistic reflector that includes circular wall features. Additionally, a sensitivity study is performed on the depth of the wall features to ensure that crystallization is prevented. Project Chrono is also validated for PBR cycling applications using experimental data. It is found that wall features with a depth of at least 0.5 pebble diameters significantly reduce crystallization in the near-wall region, leading to discrepancies in both packing fraction and pebble velocity in this region compared to the simplified reflector models. These discrepancies are found to lead to roughly a 5–10% difference in the prediction of the near-wall porosity and a 10% difference in the prediction of the velocity of pebbles near the wall. As a result of these discrepancies, it is suggested that future DEM simulations of PBRs include wall features to reduce modeling errors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Application of automated measurement and verification to utility energy efficiency program data

Trustworthy savings calculations are critical to convincing regulators of both the cost-effectiveness of energy efficiency program investments and their ability to defer supply-side capital investments. Today’s methods for measurement and verification (M&V) of energy savings constitute a significant portion of the total costs of energy efficiency programs. They also require time-consuming data acquisition. A spectrum of savings calculation approaches is used, with some relying more heavily on measured data and others relying more heavily on estimated, modeled, or stipulated data. The increasing availability of “smart” meters and devices that report near-real time data, combined with new analytical approaches to quantify savings, offers the potential to conduct M&V more quickly and at lower cost, with comparable or improved accuracy. Commercial energy management and information systems (EMIS) technologies are beginning to offer these ‘M&V 2.0’ capabilities, and program administrators want to understand how they might assist programs in quickly and accurately measuring energy savings. This paper presents the results of recent testing of the ability to use automation to streamline the M&V process. In this paper, we apply an automated whole-building M&V tool to historic data sets from energy efficiency programs to begin to explore the accuracy, cost, and time trade-offs between more traditional M&V, and these emerging streamlined methods that use high-resolution energy data and automated computational intelligence. For the data sets studied we evaluate the fraction of buildings that are well suited to automated baseline characterization, the uncertainty in gross savings that is due to M&V 2.0 tools’ model error, and indications of labor time savings, and how the automated savings results compare to prior, traditionally determined savings results. The results show that 70% of the buildings were well suited to the automated approach. In a majority of the cases (80%) savings and uncertainties for each individual building were quantified to levels above the criteria in ASHRAE Guideline 14. In addition the findings suggest that M&V 2.0 methods may also offer time-savings relative to traditional approaches. Lastly, we discuss the implications of these findings relative to the potential evolution of M&V, and pilots currently being launched to test how M&V automation can be integrated into ratepayer-funded programs and professional implementation and evaluation practice.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Scalable tuning of building models to hourly data

Energy models of existing buildings are unreliable unless calibrated so they correlate well with actual energy usage. Manual tuning requires a skilled professional, is prohibitively expensive for small projects, imperfect, non-repeatable, non-transferable, and not scalable to the dozens of sensor channels that smart meters, smart appliances, and cheap/ubiquitous sensors are beginning to make available today. A scalable, automated methodology is needed to quickly and intelligently calibrate building energy models to all available data, increase the usefulness of those models, and facilitate speed-and-scale penetration of simulation-based capabilities into the marketplace for actualized energy savings. The "Autotune'' project is a novel, model-agnostic methodology which leverages supercomputing, large simulation ensembles, and big data mining with multiple machine learning algorithms to allow automatic calibration of simulations that match measured experimental data in a way that is deployable on commodity hardware. This paper shares several methodologies employed to reduce the combinatorial complexity to a computationally tractable search problem for hundreds of input parameters. Furthermore, accuracy metrics are provided which quantify model error to measured data for either monthly or hourly electrical usage from a highly-instrumented, emulated-occupancy research home.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗