Search NASA⌕ Search

SEARCH · Search NASA

Results for “model calibration techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

A Method to Test Model Calibration Techniques

This paper describes a method for testing model calibration techniques. Calibration is commonly used in conjunction with energy retrofit audit models. An audit is conducted to gather information about the building needed to assemble an input file for a building energy modeling tool. A calibration technique is used to reconcile model predictions with utility data, and then the 'calibrated model' is used to predict energy savings from a variety of retrofit measures and combinations thereof. Current standards and guidelines such as BPI-2400 and ASHRAE-14 set criteria for 'goodness of fit' and assume that if the criteria are met, then the calibration technique is acceptable. While it is logical to use the actual performance data of the building to tune the model, it is not certain that a good fit will result in a model that better predicts post-retrofit energy savings. Therefore, the basic idea here is that the simulation program (intended for use with the calibration technique) is used to generate surrogate utility bill data and retrofit energy savings data against which the calibration technique can be tested. This provides three figures of merit for testing a calibration technique, 1) accuracy of the post-retrofit energy savings prediction, 2) closure on the 'true' input parameter values, and 3) goodness of fit to the utility bill data. The paper will also discuss the pros and cons of using this synthetic surrogate data approach versus trying to use real data sets of actual buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2016

A Method to Test Model Calibration Techniques: Preprint

This paper describes a method for testing model calibration techniques. Calibration is commonly used in conjunction with energy retrofit audit models. An audit is conducted to gather information about the building needed to assemble an input file for a building energy modeling tool. A calibration technique is used to reconcile model predictions with utility data, and then the 'calibrated model' is used to predict energy savings from a variety of retrofit measures and combinations thereof. Current standards and guidelines such as BPI-2400 and ASHRAE-14 set criteria for 'goodness of fit' and assume that if the criteria are met, then the calibration technique is acceptable. While it is logical to use the actual performance data of the building to tune the model, it is not certain that a good fit will result in a model that better predicts post-retrofit energy savings. Therefore, the basic idea here is that the simulation program (intended for use with the calibration technique) is used to generate surrogate utility bill data and retrofit energy savings data against which the calibration technique can be tested. This provides three figures of merit for testing a calibration technique, 1) accuracy of the post-retrofit energy savings prediction, 2) closure on the 'true' input parameter values, and 3) goodness of fit to the utility bill data. The paper will also discuss the pros and cons of using this synthetic surrogate data approach versus trying to use real data sets of actual buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

ReNew100: Reliable Power System Operation with 100% Renewable Generation

The ReNew100 project has developed and demonstrated an operator support system (OSS) to operate power systems with 100% renewable power generation from inverter-based resources (IBRs) like wind and solar that significantly reduces the risk of widespread power outages in a simulated operational environment at Technology Readiness Level (TRL) 6. The OSS achieves resilient operation for power systems under changing operation modes including varying combinations of conventional and renewable generation, including cases with 100% renewable generation from wind and solar IBRs. The OSS continuously monitors the N-1 security of the power system, which refers to the ability of the power systems to survive single outages of power system elements, like the loss of a generator or a power line, without causing widespread power outages beyond those expected and planned for. If the OSS identifies that the system is not N-1 secure, an automatic Controller Parameter Optimization (CoPO) developed within Renew100 is activated to optimize the N-1 security of the system by tuning controller parameters within different assets like batteries, wind, and solar plants. The core innovation of ReNew100 is the development of this CoPO as well as the demonstration of the OSS for a real-time simulation of the Hawai'i Island power system. Moreover, Renew100 has developed new model calibration techniques for dynamic power system models and demonstrated them for Hawai'i Island.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

A probabilistic inverse prediction method for predicting plutonium processing conditions

In the past decade, nuclear chemists and physicists have been conducting studies to investigate the signatures associated with the production of special nuclear material (SNM). In particular, these studies aim to determine how various processing parameters impact the physical, chemical, and morphological properties of the resulting special nuclear material. By better understanding how these properties relate to the processing parameters, scientists can better contribute to nuclear forensics investigations by quantifying their results and ultimately shortening the forensic timeline. This paper aims to statistically analyze and quantify the relationships that exist between the processing conditions used in these experiments and the various properties of the nuclear end-product by invoking inverse methods. In particular, these methods make use of Bayesian Adaptive Spline Surface models in conjunction with Bayesian model calibration techniques to probabilistically determine processing conditions as an inverse function of morphological characteristics. Not only does the model presented in this paper allow for providing point estimates of a sample of special nuclear material, but it also incorporates uncertainty into these predictions. This model proves sufficient for predicting processing conditions within a standard deviation of the observed processing conditions, on average, provides a solid foundation for future work in predicting processing conditions of particles of special nuclear material using only their observed morphological characteristics, and is generalizable to the field of chemometrics for applicability across different materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Transfer learning driven design optimization for inertial confinement fusion

Transfer learning is a promising approach to create predictive models that incorporate simulation and experimental data into a common framework. In this technique, a neural network is first trained on a large database of simulations and then partially retrained on sparse sets of experimental data to adjust predictions to be more consistent with reality. Previously, this technique has been used to create predictive models of Omega [Humbird et al., IEEE Trans. Plasma Sci. 48, 61–70 (2019)] and NIF [Humbird et al., Phys. Plasmas 28, 042709 (2021); Kustowski et al., Mach. Learn. 3, 015035 (2022)] inertial confinement fusion (ICF) experiments that are more accurate than simulations alone. Here, in this work, we conduct a transfer learning driven hypothetical ICF campaign in which the goal is to maximize experimental neutron yield via Bayesian optimization. The transfer learning model achieves yields within 5% of the maximum achievable yield in a modest-sized design space in fewer than 20 experiments. Furthermore, we demonstrate that this method is more efficient at optimizing designs than traditional model calibration techniques commonly employed in ICF design. Such an approach to ICF design could enable robust optimization of experimental performance under uncertainty.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2019

Bayesian modeling of inconsistent plastic response due to material variability

The advent of fabrication techniques such as additive manufacturing has focused attention on the considerable variability of material response due to defects and other microstructural aspects. This variability motivates the development of an enhanced design methodology that incorporates inherent material variability to provide robust predictions of performance. In this work, we develop plasticity models capable of representing the distribution of mechanical responses observed in experiments using traditional plasticity models of the mean response and recently developed uncertainty quantification (UQ) techniques. To account for material response variability through variations in physical parameters, we adapt a recent Bayesian embedded modeling error calibration technique. We use Bayesian model selection to determine the most plausible of a variety of plasticity models and the optimal embedding of parameter variability. To expedite model selection, we develop an adaptive importance-sampling-based numerical integration scheme to compute the Bayesian model evidence. In conclusion, we demonstrate that the new framework provides predictive realizations that are superior to more traditional ones, and how these UQ techniques can be used in model selection and assessing the quality of calibrated physical parameters.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Expanded Use of ISOCS Characterization Techniques for WIPP Certification at the Idaho Clean-up Project - 19623

The Advanced Mixed Waste Treatment Project (AMWTP) has been retrieving, treating, characterizing, and shipping legacy Transuranic (TRU) waste for disposal since 2003 as part of the overall Idaho Cleanup Project (ICP) in support of the US Department of Energy. As the ICP has progressed, over 700 containers have been identified that cannot be successfully assayed using the current suite of non-destructive assay (NDA) instruments. To meet this challenge, Fluor Idaho, LLC, and Mirion Technologies (formerly Canberra Industries) have teamed to deploy the In-Situ Object Counting System (ISOCS) to supplement the current NDA capabilities. ISOCS has long been used in various radioactive waste management applications, but never has the ISOCS ability to perform intrinsic efficiency modeling of discrete waste containers been employed to characterize and certify TRU waste for disposal at the Waste Isolation Pilot Plant (WIPP), near Carlsbad, New Mexico. Since the primary disposal facility for this waste is the WIPP, the characterization processes for determining the quantity of radioactive material entrained in the waste are subject to WIPP Waste Acceptance Criteria (WAC) quality requirements and associated performance criteria. Until now, the Carlsbad Field Office (CBFO) WIPP-certified NDA equipment has utilized pre-defined efficiency calibrations for fixed geometries. However, due to the radioactive material content, activity levels, waste stream matrix, and/or the geometries of various size drums, boxes and other-odd-shaped containers or container integrity issues, it may not be suitable to characterize these containers with any of the existing WIPP-certified NDA equipment located at the AMWTP. Therefore, advanced technologies are needed to complete characterization of these problematic waste containers. The July 5, 2016 release of the WIPP WAC, DOE/WIPP-02-3122, Revision 8.0, Appendix A, 'Radioassay Requirements for Transuranic Waste,' was expanded to include several newer concepts such as American Society for Testing and Materials (ASTM) approved methods for efficiency-based calibrations and the use of mathematical computer modeling techniques for calibration. This change prompted AMWTP to pursue obtaining WIPP certification authority for expanded ISOCS techniques to deal with the remaining challenging waste containers and the development and implementation of Mirion's Figures of Merit (FOM) evaluations. These vital FOM evaluations enhance the ISOCS's modeling capabilities by optimizing the dynamic efficiency calibration for each object and reducing the assay's Total Measurement Uncertainty (TMU) budget. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

Development of Upscaling Techniques and Construction of Calibrated Models for Fractured Rocks Using Discrete Fracture Network Approaches

The Pahute Mesa Corrective Action Unit on the Nevada National Security Site (NNSS) contains several fractured aquifers that can potentially provide high-permeability pathways for radionuclides to migrate away from underground nuclear testing locations. Although the geometric properties of fractures, such as length and orientation, can be found using geophysical methods and borehole image analyses, the hydraulic property of fractures (which are primarily influenced by apertures) are often unknown or have a high degree of uncertainty attached to their values. The aperture values have a profound impact on groundwater velocity and are critical to understanding transport scales at Pahute Mesa. Fracture aperture values and their distributions also have dominant control over radionuclide transport with potential for long-range correlations or scale-invariant dynamics. Understanding of the small-scale transport variability in fractures could lead to identification of distinct characteristics on larger scales. Furthermore, upscaling techniques need to be developed to adequately predict transport behavior at field scales by capturing the transport trends of smaller scale networks. This report explores these vital modeling needs to understand the role of fractures in Pahute Mesa. Discrete fracture network (DFN) models are the basis for constructing a well-calibrated model to ascertain aperture values of fractures in lava-flow aquifers. These models are also used to develop and compare the usefulness of several random-walk-based models to perform transport upscaling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Remote Distributed Vibration Sensing Through Opaque Media Using Permanent Magnets

Vibration sensing is critical for a variety of applications from structural fatigue monitoring to understanding the modes of airplane wings. In particular, remote sensing techniques are needed for measuring the vibrations of multiple points simultaneously, assessing vibrations inside opaque metal vessels, and sensing through smoke clouds and other optically challenging environments. Here, in this paper, we propose a method which measures high-frequency displacements remotely using changes in the magnetic field generated by permanent magnets. We leverage the unique nature of vibration tracking and use a calibrated local model technique developed specifically to improve the frequency-domain estimation accuracy. The results show that two-dimensional local models surpass the dipole model in tracking high-frequency motions. A theoretical basis for understanding the effects of electronic noise and error due to correlated variables is generated in order to predict the performance of experiments prior to implementation. Simultaneous measurements of up to three independent vibrating components are shown. The relative accuracy of the magnet-based displacement tracking with respect to the video tracking ranges from 40 to 190 μm when the maximum displacements approach ±5 mm and when sensor-to-magnet distances vary from 25 to 36 mm. Finally, vibration sensing inside an opaque metal vessel and mode shape changes due to damage on an aluminum beam are also studied using the wireless permanent-magnet vibration sensing scheme.

42 ENGINEERING↗
DOE OSTI2022

Application and evaluation of a pattern-based building energy model calibration method using public building datasets

Building performance simulation has been adopted to support decision making in the building life cycle. An essential issue is to ensure a building energy simulation model can capture the reality and complexity of buildings and their systems in both the static characteristics and dynamic operations. Building energy model calibration is a technique that takes various types of measured performance data (e.g., energy use) and tunes key model parameters to match the simulated results with the actual measurements. This study performed an application and evaluation of an automated pattern-based calibration method on commercial building models that were generated based on characteristics of real buildings. A public building dataset that includes high-level building attributes (e.g., building type, vintage, total floor area, number of stories, zip code) of 111 buildings in San Francisco, California, USA, was used to generate building models in EnergyPlus. Monthly level energy use calibrations were then conducted by comparing building model results against the actual buildings' monthly electricity and natural gas consumption. The results showed 57 out of 111 buildings were successfully calibrated against actual buildings, while the remaining buildings showed opportunities for future calibration improvements. Enhancements to the pattern-based model calibration method are identified to expand its use for: (1) central heating, ventilation and air conditioning (HVAC) systems with chillers, (2) space heating and hot water heating with electricity sources, (3) mixed-use building types, and (4) partially occupied buildings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

IBM Open Science Price - SWAP Gate Challenge

On November 30, 2020, IBM announced an open science price competition aimed at improving the fidelity of a SWAP gate on their 7 qubit Quantum system named ”Casablanca”. The details of the SWAP gate problem was outlined in a Jupyter notebook, which utilizes the IBM developed open source package Qiskit. The participants were allowed to work in teams with up to five people and restricted to only use open source software in solving the problem. Their results were due on April 16, 2021. Our approach to solving the SWAP gate challenge is based on the quantum optimal control techniques implemented in our open source packages Juqbox.jl and Quandary. The results from the optimal control approach is only as good as the accuracy in the description of the quantum system dynamics, characterized by a Hamiltonian model that was provided by IBM. Based on the calibrated control pulses IBM provide for the standard gate set, we developed a reverse engineering approach to calibrate our computational model. Techniques were developed to translate between Qiskit’s pulse representation and the B-spline formulation used in Juqbox and Quandary. The fidelity of the optimized pulse sequences were estimated using Qiskit’s randomized bench marking techniques.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2020

Strength of porous α-SiO 2 in a shock loaded environment: Calibration via Richtmyer–Meshkov instability and validation via Mach lens

The strength of brittle porous media is of concern in numerous applications, for example, earth penetration, crater formation, and blast loading. Thus, it is of importance to possess techniques that allow for constitutive model calibration within the laboratory setting. The goal of the current work is to demonstrate an experimental technique allowing for strength assessment of porous media subjected to shock loading, which can be implemented into pressure-dependent yield surfaces within numerical simulation schemes. As a case study, the deviatoric response of distended α-SiO 2 has been captured in a tamped Richtmyer–Meshkov instability (RMI) environment at a pressure regime of 4–10 GPa. Hydrocode simulations were used to interpret RMI experimental data, and a resulting pressure-dependent yield surface akin to the often employed modified Drucker–Prager model was calibrated. Simulations indicate that the resulting jet length generated by the RMI is sensitive to the porous media strength, thereby providing a feasible experimental platform capable of capturing the pressurized granular deviatoric response. Furthermore, in efforts to validate the RMI-calibrated strength model, a set of Mach-lens experiments was performed and simulated with the calibrated pressure-dependent yield surface. Excellent agreement between the resulting Mach-lens length in experiment and simulation provides additional confidence to the RMI yield-surface calibration scheme.

36 MATERIALS SCIENCE↗
DOE OSTI2019

Pilot Point Optimization of Mining Boundaries for Lateritic Metal Deposits: Finding the Trade-off Between Dilution and Ore Loss

Geological contacts in lateritic metal deposits (footwall topographies) often delineate the orebody boundaries. Spatial variations seen in such contacts are frequently higher than those for the metal grades of the deposit. Therefore, borehole spacing chosen based on the grade variations cannot adequately capture the geological contact variability. Consequently, models created using such boreholes cause high volumetric uncertainties in the actual and targeted ore extraction volumes, which, in turn, lead to high unplanned dilution and ore losses. In this paper, a method to design optimum ore/mining boundaries for lateritic metal deposits is presented. The proposed approach minimizes the dilution/ore losses and comprises two main steps. First, the uncertainty on the orebody boundary is represented using a set of stochastic realizations generated with a multiple-point statistics algorithm. Then, the optimal orebody boundary is determined using an optimization technique inspired by a model calibration method called Pilot Points. The pilot points represent synthetic elevation values, and they are used to construct smooth mining boundaries using the multilevel B-spline technique. The performance of a generated surface is evaluated using the expected sum of losses in each of the stochastic realizations. The simulated annealing algorithm is used to iteratively determine the pilot point values which minimize the expected losses. The results show a significant reduction in the dilution volume as compared to those obtained from the actual mining operation.

58 GEOSCIENCES↗
DOE OSTI2019

Strength of porous α-SiO 2 in a shock loaded environment

The strength of brittle porous media is of concern in numerous applications, for example, earth penetration, crater formation, and blast loading; thus it is of importance to possess techniques that allow for constitutive model calibration within the laboratory setting. It is the goal of the immediate work to demonstrate an experimental technique allowing for strength assessment, which can be implemented into pressure dependent yield surfaces within numerical simulation schemes. As a case study, the deviatoric strength of distended α-SiO 2 has been captured in a tamped Richtmyer- Meshkov instability environment at a pressure regime of 4-10 GPa. In contrast to traditional RMI studies used to infer strength in solids, the described approach herein is implemented to probe the behavior of the porous tamp media backing the corrugated solid surface. Hydrocode simulation has been used to interpret the experiment, and a resulting pressure-dependent yield surface akin to the often employed Modified Drucker-Prager model has been calibrated via the coupled experiment and simulation. The simulations indicate that the resulting jet length generated by the RMI is highly sensitive to the porous media strength, thereby providing a feasible experimental platform capable of capturing pressurized granular deviatoric response. Additionally, a Mach lens loading environment has also been implemented as a validation case study, demonstrating good agreement between experiment and simulation within an alternative loading environment. Calibration and validation of the pressure-dependent yield surface gives confidence to the model form, thereby providing a framework for future porous media strength studies.

36 MATERIALS SCIENCE↗