Multiple Model Inference: Calibration Selection and Prediction with Multiple Models.
Abstract not provided.
Swiler, Laura Painton↗
SEARCH · Search NASA
Results for “MODEL CALIBRATION”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
ADVANCES IN CALIBRATION OF BUILDING ENERGY MODELS TO TIME SERIES DATA
Advanced building analytics and control applications, such as fault detection and diagnostics and model predictive control, benefit from building energy models calibrated to time series data. This paper recommends best practices for aligning EnergyPlus™ model time series output with measured building performance. These include the use of subcalibration procedures to fine-tune envelope, heat transfer, and mechanical system parameters; initialization of zone temperatures to match observed conditions at the beginning of each calibration period; and calculation of calibration metrics across multiple run periods using a new OpenStudio reporting measure.
Goldwasser, David↗
Advances in Calibration of Building Energy Models to Time Series Data: Preprint
Advanced building analytics and control applications such as fault detection and diagnostics and model predictive control benefit from building energy models calibrated to time series data. In this paper, we present best practices for aligning EnergyPlus (TM) model time series output with measured building performance. These include the use of subcalibration procedures to fine-tune envelope, heat transfer, and mechanical system parameters; initialization of zone temperatures to match observed conditions at the beginning of each calibration period; and calculation of calibration metrics across multiple run periods using a new OpenStudio reporting measure.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
Empirically-calibrated H100 node power models for accurate AI training energy estimation
Accurately quantifying the energy use of artificial intelligence (AI) training is critical for infrastructure planning, carbon accounting, and sustainable data center operation, but few studies have directly measured the power consumption of production workloads on contemporary hardware. By combining empirical measurements from Brookhaven National Laboratory during AI training on 8-graphics-processing-unit H100 systems with open-source benchmarking data, we develop statistical models relating computational intensity to node-level power consumption. We measure the gap between manufacturer-rated thermal design power (TDP) and actual power demand during AI training. Our analysis reveals that even computationally intensive workloads operate at only 76% of the 10.2 kW TDP rating. Our architecture-specific model, calibrated to floating-point operations, predicts energy consumption with 11.4% mean absolute percentage error, significantly outperforming TDP-based approaches (27%–37% error). We identified distinct power signatures between transformer and convolutional neural network architectures, with transformers showing characteristic fluctuations that may impact grid stability. These results provide a measurement-grounded basis for improving AI training energy estimates, enabling more reliable infrastructure sizing, cost projections, and environmental impact assessments.
Newkirk, Alex C↗
Prime VI
SAND2025-03757O Prime VI is a distribution-of-disease outbreak model calibration code based on variational inference. It accompanies a publication for submission to Statistics in Medicine journal, and the code will be maintained for open-source use on Sandia's GitLab. The software provides methods for calibrating an epidemiological model to measured case-count data for a multitude of correlated spatial regions. The code solves a Bayesian inverse problem for model calibration where the posterior over-model parameters are approximated through a custom implementation of variational inference. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.
Safta, Cosmin↗
Lidar aerosol backscatter measurements - Systematic, modeling, and calibration error considerations
Sources of systematic, modeling, and calibration errors that affect the interpretation and calibration of lidar aerosol backscatter data are discussed. The treatment pertains primarily to ground-based pulsed CO2 lidars that probe the troposphere and are calibrated using hard calibration targets. However, a large part of the analysis is relevant to other types of lidar system such as lidars operating at other wavelengths; CW focused lidars; airborne or earth-orbiting lidars; lidars measuring other regions of the atmosphere; lidars measuring nonaerosol elastic or inelastic backscatter; and lidars employing other calibration techniques.
Kavaya, M. J.↗
Radiometric Modeling and Calibration of the Geostationary Imaging Fourier Transform Spectrometer (GIFTS)Ground Based Measurement Experiment
The ultimate remote sensing benefits of the high resolution Infrared radiance spectrometers will be realized with their geostationary satellite implementation in the form of imaging spectrometers. This will enable dynamic features of the atmosphere s thermodynamic fields and pollutant and greenhouse gas constituents to be observed for revolutionary improvements in weather forecasts and more accurate air quality and climate predictions. As an important step toward realizing this application objective, the Geostationary Imaging Fourier Transform Spectrometer (GIFTS) Engineering Demonstration Unit (EDU) was successfully developed under the NASA New Millennium Program, 2000-2006. The GIFTS-EDU instrument employs three focal plane arrays (FPAs), which gather measurements across the long-wave IR (LWIR), short/mid-wave IR (SMWIR), and visible spectral bands. The GIFTS calibration is achieved using internal blackbody calibration references at ambient (260 K) and hot (286 K) temperatures. In this paper, we introduce a refined calibration technique that utilizes Principle Component (PC) analysis to compensate for instrument distortions and artifacts, therefore, enhancing the absolute calibration accuracy. This method is applied to data collected during the GIFTS Ground Based Measurement (GBM) experiment, together with simultaneous observations by the accurately calibrated AERI (Atmospheric Emitted Radiance Interferometer), both simultaneously zenith viewing the sky through the same external scene mirror at ten-minute intervals throughout a cloudless day at Logan Utah on September 13, 2006. The accurately calibrated GIFTS radiances are produced using the first four PC scores in the GIFTS-AERI regression model. Temperature and moisture profiles retrieved from the PC-calibrated GIFTS radiances are verified against radiosonde measurements collected throughout the GIFTS sky measurement period. Using the GIFTS GBM calibration model, we compute the calibrated radiances from data collected during the moon tracking and viewing experiment events. From which, we derive the lunar surface temperature and emissivity associated with the moon viewing measurements.
Tian, Jialin↗
Estimating and Calibrating DER Model Parameters Using Levenberg–Marquardt Algorithm in Renewable Rich Power Grid
The proliferation of inverter-based distributed energy resources (IBDERs) has increased the number of control variables and dynamic interactions, leading to new grid control challenges. For stability analysis and designing appropriate protection controls, it is important that IBDER models are accurate. This paper focuses on the accurate estimation and parameter calibration of DER_A, a recently proposed aggregated IBDER model. In particular, we focus on the parameters of the reactive power–voltage regulation module. We formulate the problem of parameter tuning as a non-linear least square minimization problem and solve it using the Levenberg–Marquardt (LM) method. The LM method is primarily chosen due to its flexibility in adaptively selecting between the steepest descent and Gauss–Newton methods through a damping parameter. The LM approach is used to minimize the error between the actual measurements and the estimated response of the model. Further, the computational challenges posed by the numerical calculation of the Jacobian are tackled using a quasi-Newton root-finding approach. The proposed method is validated on a real feeder model in the northeastern part of the United States. The feeder is modeled in OpenDSS and the measurements thus obtained are fed to the DER_A model for calibration. The simulation results indicate that our approach is able to successfully calibrate the relevant model parameters quickly and with high accuracy, with a total sum of square error of 3.57 × 10 –7 .
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Hydrologic Model Analyses for Decision Support at the Los Alamos National Laboratory Site - 18363
Modeling hydrologic flow and transport in the subsurface presents a number of challenges including large datasets that contain limited information about the properties of the subsurface and models with a large number of parameters characterizing the properties of the subsurface and the ambient hydrologic conditions (e.g., groundwater recharge). This, in turn, leads to substantial uncertainty in predictions about quantities of interest (e.g., the concentration of a contaminant at points of compliance). We present a number of methods and tools that have recently been developed to address these problems. The model calibration tools are capable of assimilating large datasets (for example, on the order of 1,000,000 model calibration targets) into numerical models, calibrating models with a large number of model parameters (on the order of 1,000,000), or both. These tools leverage recently developed methods in numerical linear algebra such as matrix-free methods and randomized matrix sketching. The uncertainty quantification tools are highly-parallel and enable us to robustly quantify the uncertainties in model parameters (and therefore uncertainty in quantities of interest). Having these capabilities in model analysis tools enables more informed decision making related to remediation of groundwater contaminants. The model analyses that we present are related to the Los Alamos National Laboratory (LANL) chromium site. The analyses are performed by MADS (Model Analysis and Decision Support; http://mads.lanl.gov). (authors)
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
Model Analysis ToolKit
MATK provides basic functionality to facilitate model analysis within the Python computational environment. Model analysis setup within MATK includes: - define parameters - define observations - define model (python function) - define samplesets (sets of parameter combinations) Currently supported functionality includes: - forward model runs - Latin-Hypercube sampling of parameters - multi-dimensional parameter studies - parallel execution of parameter samples - model calibration using internal Levenberg-Marquardt algorithm - model calibration using lmfit package - model calibration using levmar package - Markov Chain Monte Carlo using pymc package MATK facilitates model analysis using: - scipy - calibration (scipy.optimize) - rpy2 - Python interface to R
Harp, DylanR.↗
Model Analysis ToolKit
MATK provides basic functionality to facilitate model analysis within the Python computational environment. Model analysis setup within MATK includes: - define parameters - define observations - define model (python function) - define samplesets (sets of parameter combinations) Currently supported functionality includes: - forward model runs - Latin-Hypercube sampling of parameters - multi-dimensional parameter studies - parallel execution of parameter samples - model calibration using internal Levenberg-Marquardt algorithm - model calibration using lmfit package - model calibration using levmar package - Markov Chain Monte Carlo using pymc package MATK facilitates model analysis using: - scipy - calibration (scipy.optimize) - rpy2 - Python interface to R
Harp, Dylan R.↗
Load Modeling and Calibration Techniques for Power System Studies
Load modeling is the most uncertain area in power system simulations. Having an accurate load model is important for power system planning and operation. Here, a review of load modeling and calibration techniques is given. This paper is not comprehensive, but covers some of the techniques most commonly found in the literature. The advantages and disadvantages of each technique are outlined.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Phase identification using co‐association matrix ensemble clustering
Calibrating distribution system models to aid in the accuracy of simulations such as hosting capacity analysis is increasingly important in the pursuit of the goal of integrating more distributed energy resources. The recent availability of smart meter data is enabling the use of machine learning tools to automatically achieve model calibration tasks. This research focuses on applying machine learning to the phase identification task, using a co‐association matrix‐based, ensemble spectral clustering approach. The proposed method leverages voltage time series from smart meters and does not require existing or accurate phase labels. This work demonstrates the success of the proposed method on both synthetic and real data, surpassing the accuracy of other phase identification research.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Derivation and Validation of Supraglacial Lake Volumes on the Greenland Ice Sheet from High-Resolution Satellite Imagery
Supraglacial meltwater lakes on the western Greenland Ice Sheet (GrIS) are critical components of its surface hydrology and surface mass balance, and they also affect its ice dynamics. Estimates of lake volume, however, are limited by the availability of in situ measurements of water depth,which in turn also limits the assessment of remotely sensed lake depths. Given the logistical difficulty of collecting physical bathymetric measurements, methods relying upon in situ data are generally restricted to small areas and thus their application to largescale studies is difficult to validate. Here, we produce and validate spaceborne estimates of supraglacial lake volumes across a relatively large area (1250 km(exp 2) of west Greenland's ablation region using data acquired by the WorldView-2 (WV-2) sensor, making use of both its stereo-imaging capability and its meter-scale resolution. We employ spectrally-derived depth retrieval models, which are either based on absolute reflectance (single-channel model) or a ratio of spectral reflectances in two bands (dual-channel model). These models are calibrated by usingWV-2multispectral imagery acquired early in the melt season and depth measurements from a high resolutionWV-2 DEM over the same lake basins when devoid of water. The calibrated models are then validated with different lakes in the area, for which we determined depths. Lake depth estimates based on measurements recorded in WV-2's blue (450-510 nm), green (510-580 nm), and red (630-690 nm) bands and dual-channel modes (blue/green, blue/red, and green/red band combinations) had near-zero bias, an average root-mean-squared deviation of 0.4 m (relative to post-drainage DEMs), and an average volumetric error of b1%. The approach outlined in this study - image-based calibration of depth-retrieval models - significantly improves spaceborne supraglacial bathymetry retrievals, which are completely independent from in situ measurements.
Spectrally-based depth-retrieval models↗
Calibration verification for stochastic agent-based disease spread models
Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.
60 APPLIED LIFE SCIENCES↗
High-Throughput Material Characterization using the Virtual Fields Method
Modeling material and component behavior using finite element analysis (FEA) is critical for modern engineering. One key to a credible model is having an accurate material model, with calibrated model parameters, which describes the constitutive relationship between the deformation and the resulting stress in the material. As such, identifying material model parameters is critical to accurate and predictive FEA. Traditional calibration approaches use only global data (e.g. extensometers and resultant force) and simplified geometries to find the parameters. However, the utilization of rapidly maturing full-field characterization techniques (e.g. Digital Image Correlation (DIC)) with inverse techniques (e.g. the Virtual Feilds Method (VFM)) provide a new, novel and improved method for parameter identification. This LDRD tested that idea: in particular, whether more parameters could be identified per test when using full-field data. The research described in this report successfully proves this hypothesis by comparing the VFM results with traditional calibration methods. Important products of the research include: verified VFM codes for identifying model parameters, a new look at parameter covariance in material model parameter estimation, new validation techniques to better utilize full-field measurements, and an exploration of optimized specimen design for improved data richness.
36 MATERIALS SCIENCE↗
Can MODIS Data Calibrate and Validate Coastal Sediment Transport Models? Rapid Prototyping Using 250 m Data and the ECOMSED Model for Lake Pontchartrain, LA USA
Field measurements from small boats and sparse arrays of instrumented buoys often do not provide sufficient data to capture the dynamic nature of biogeophysical parameters in may coastal aquatic environments. Several investigators have shown the MODIS 250 m images can provide daily synoptic views of suspended sediment concentration in coastal waters to determine sediment transport and fate. However, the use of MODIS for coastal environments can be limited due to a lack of cloud-free images. Sediment transport models are not constrained by sky conditions but often suffer from a lack of in situ observations for model calibration or validation. We demonstrate here the utility of MODIS 250 m to calibrate (set model parameters), validate output, and set or reset initial conditions of a hydrodynamic and sediment transport model (ECOMSED) developed for Lake Pontchartrain, LA USA. We present our approach in the context of how to quickly assess of 'prototype' an application of NASA data to support environmental managers and decision makers. The combination of daily MODIS imagery and model simulations offer a more robust monitoring and prediction system of suspended sediments than available from either system alone.
Miller, Richard L.↗
Waste Control Specialists Technical Review Team Report
1. Modeling of Drum 68660 and the WCS Drums: A calibrated model of Los Alamos National Laboratory (LANL) Drum 68660 indicates that pressurization of the drum by restriction of drum venting could have led to the thermal runaway reaction at the Waste Isolation Pilot Plant (WIPP) in 2014, supporting the hypothesis that the contents of the drum were not fundamentally different from the overall remediated nitrate salt (RNS) waste stream. 2. Nitric Acid Reactions and Aging of the Waste: The stability of the WCS RNS waste with respect to autocatalytic thermal runaway due to nitric acid chemistry should increase over time as the nitric acid is depleted from chemical reactions in the drum. However, this cannot be confirmed because of the lack of long-term experimental data on the impact of aging on the reactivity of RNS waste. The calibrated model indicates that the waste drums retain most of their reactive components, metal nitrate salts and sWheat Scoop ® , even after eight years. 3. Pressure Effects and Runaway Reactions: The calibrated model indicates that if the drums and standard waste boxes (SWBs) are not allowed to pressurize during transport or storage and they are stored at historical WIPP repository temperatures, then an autocatalytic thermal runaway event is not expected to occur. Since the cause of Drum 68660 pressurization is not known, decision makers are not able to tailor mitigating strategies to the initiating event. Consequently, mitigating strategies must consider all feasible internal and external events that could lead to the pressurization of the drums. 4. Temperature Effects and Runaway Reactions: Temperature also has a strong influence on the stability of the waste. The calibrated model indicates that cooling the drums or SWBs can reduce the possibility of autocatalytic thermal runaway reactions. Simulations suggest that for a drum with a plugged vent, the probability of thermal runaway may be reduced or eliminated if wastes are maintained at or below 43 °F through active cooling measures from the initiation of transport until emplacement at WIPP.
12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗