Search NASASearch

SEARCH · Search NASA

Results for “simulation calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Automated Calibration of Parallel and Distributed Computing Simulators: A Case Study

Many parallel and distributed computing research results are obtained in simulation, using simulators that mimic real-world executions on some target system. Each such simulator is configured by picking values for parameters that define the behavior of the underlying simulation models it implements. The main concern for a simulator is accuracy: simulated behaviors should be as close as possible to those observed in the real-world target system. This requires that values for each of the simulator's parameters be carefully picked, or “calibrated,” based on ground-truth real-world executions. Examining the current state of the art shows that simulator calibration, at least in the field of parallel and distributed computing, is often undocumented (and thus perhaps often not performed) and, when documented, is described as a labor-intensive, manual process. In this work we evaluate the benefit of automating simulation calibration using simple algorithms. Specifically, we use a real-world case study from the field of High Energy Physics and compare automated calibration to calibration performed by a domain scientist. Our main finding is that automated calibration is on par with or significantly outperforms the calibration performed by the domain scientist. Furthermore, automated calibration makes it straightforward to operate desirable tradeoffs between simulation accuracy and simulation speed.

Mc donald, Jesse

Station to instrumented aircraft L-band telemetry system and RF signal controller for spacecraft simulations and station calibration

An L-band telemetry system designed to provide the capability of near-real-time processing of calibration data is described. The system also provides the capability of performing computerized spacecraft simulations, with the aircraft as a data source, and evaluating the network response. The salient characteristics of a telemetry analysis and simulation program (TASP) are discussed, together with the results of TASP testing. The results of the L-band system testing have successfully demonstrated the capability of near-real-time processing of telemetry test data, the control of the ground-received signal to within + or - 0.5 db, and the computer generation of test signals.

Scaffidi, C. A.

Calibration verification for stochastic agent-based disease spread models

Accurate disease spread modeling is crucial for identifying the severity of outbreaks and planning effective mitigation efforts. To be reliable when applied to new outbreaks, model calibration techniques must be robust. However, current methods frequently forgo calibration verification (a stand-alone process evaluating the calibration procedure) and instead use overall model validation (a process comparing calibrated model results to data) to check calibration processes, which may conceal errors in calibration. In this work, we develop a stochastic agent-based disease spread model to act as a testing environment as we test two calibration methods using simulation-based calibration, which is a synthetic data calibration verification method. The first calibration method is a Bayesian inference approach using an empirically-constructed likelihood and Markov chain Monte Carlo (MCMC) sampling, while the second method is a likelihood-free approach using approximate Bayesian computation (ABC). Simulation-based calibration suggests that there are challenges with the empirical likelihood calculation used in the first calibration method in this context. These issues are alleviated in the ABC approach. Despite these challenges, we note that the first calibration method performs well in a synthetic data model validation test similar to those common in disease spread modeling literature. We conclude that stand-alone calibration verification using synthetic data may benefit epidemiological researchers in identifying model calibration challenges that may be difficult to identify with other commonly used model validation techniques.

60 APPLIED LIFE SCIENCES

Nozzle performance calibration and turbomachinery operational analysis of Turbo-Powered Simulators (TPS) for the NASA-Langley EET propulsion airframe integration investigation

The Boeing flight simulator chamber facility energy efficient transport (EET) propulsion/airframe integration investigation was tested. Two turbopowered simulators (TPS) were calibrated with four different nacelle configurations. Two nacelle configurations were calibrated on each TPS, each calibration simulating the full nozzle pressure ratio range encountered in a one atmosphere total pressure wind tunnel operating over a Mach number range from 0.70 to 0.90 Mach. The results of the calibration test are in the form of velocity and discharge coefficient which is used in determining the simulator thrust while the TPS is operating in the wind tunnel.

Rowe, R. K.

A Comparison of Two Balance Calibration Model Building Methods

Simulated strain-gage balance calibration data is used to compare the accuracy of two balance calibration model building methods for different noise environments and calibration experiment designs. The first building method obtains a math model for the analysis of balance calibration data after applying a candidate math model search algorithm to the calibration data set. The second building method uses stepwise regression analysis in order to construct a model for the analysis. Four balance calibration data sets were simulated in order to compare the accuracy of the two math model building methods. The simulated data sets were prepared using the traditional One Factor At a Time (OFAT) technique and the Modern Design of Experiments (MDOE) approach. Random and systematic errors were introduced in the simulated calibration data sets in order to study their influence on the math model building methods. Residuals of the fitted calibration responses and other statistical metrics were compared in order to evaluate the calibration models developed with different combinations of noise environment, experiment design, and model building method. Overall, predicted math models and residuals of both math model building methods show very good agreement. Significant differences in model quality were attributable to noise environment, experiment design, and their interaction. Generally, the addition of systematic error significantly degraded the quality of calibration models developed from OFAT data by either method, but MDOE experiment designs were more robust with respect to the introduction of a systematic component of the unexplained variance.

DeLoach, Richard

SMMR Simulator radiative transfer calibration model. 2: Algorithm development

Passive microwave measurements performed from Earth orbit can be used to provide global data on a wide range of geophysical and meteorological phenomena. A Scanning Multichannel Microwave Radiometer (SMMR) is being flown on the Nimbus-G satellite. The SMMR Simulator duplicates the frequency bands utilized in the spacecraft instruments through an amalgamate of radiometer systems. The algorithm developed utilizes data from the fall 1978 NASA CV-990 Nimbus-G underflight test series and subsequent laboratory testing.

Link, S.

The utility of calibration - Landsat 4 TM simulator data, Patrick Draw, Wyoming

A novel calibration approach was used for Landsat 4 TM simulator data acquired at the Patrick Draw test site, Wyoming, where the 'true' reflectance spectrum for any pixel area cannot be practically determined because of mixing of spectral components. An empirically derived function was first applied to the scanner data to remove the brightness gradient due to directional scattering and surface geometry. Based on the observation that the distribution of scanner brightness values (DN) were Gaussian, the minimum, mean, and maximum DN for each band were extracted and plotted versus the similar percent reflectance values determined from a large representative collection of field reflectance data for the area. These plots provided linear transformations relating DN value to reflectance in each band.

Lang, H. R.

Constraints on f ( R ) gravity from thermal-Sunyaev-Zel’dovich-effect-selected SPT galaxy clusters and weak lensing mass calibration from DES and HST

We present constraints on the f ( R ) gravity model using a sample of 1005 galaxy clusters in the redshift range 0.25–1.78 that have been selected through the thermal Sunyaev-Zel’dovich effect from South Pole Telescope data and subjected to optical and near-infrared confirmation with the multicomponent matched filter algorithm. We employ weak gravitational lensing mass calibration from the Dark Energy Survey Year 3 data for 688 clusters at z < 0.95 and from the Hubble Space Telescope for 39 clusters with 0.6 < z < 1.7 . Our cluster sample is a powerful probe of f ( R ) gravity, because this model predicts a scale-dependent enhancement in the growth of structure, which impacts the halo mass function (HMF) at cluster mass scales. To account for these modified gravity effects on the HMF, our analysis employs a semianalytical approach calibrated with numerical simulations. Combining calibrated cluster counts with primary cosmic microwave background temperature and polarization anisotropy measurements from the Planck 2018 release, we derive robust constraints on the f ( R ) parameter f R 0 . Our results, log 10 | f R 0 | < − 5.32 at the 95% credible level, are the tightest current constraints on f ( R ) gravity from cosmological scales. This upper limit rules out f ( R ) -like deviations from general relativity that result in more than a ∼ 20 % enhancement of the cluster population on mass scales M 200 c > 3 × 10 14 M ⊙ . Published by the American Physical Society 2025

79 ASTRONOMY AND ASTROPHYSICS

DayCent MUVP model calibrated for the simulation of bioenergy crops grown on set-aside land in the US

DayCent MUVP version (Methanogenesis, UV litter degradation and Photosynthesis). DAYCENT is the daily time-step version of the CENTURY biogeochemical model (Parton et al., 1994). DAYCENT simulates fluxes of C and N among the atmosphere, vegetation, and soil (Del Grosso et al., 2001a; Parton et al., 1998). Key submodels include soil water content and temperature by layer, plant production and allocation of net primary production (NPP), decomposition of litter and soil organic matter, mineralization of nutrients, N gas emissions from nitrification and denitrification, and CH4 oxidation in non-saturated soils.

biogeochemical model

Calibration of propulsion simulation nozzles for space shuttle booster and orbiter models for the abort/separation staging experimental program

An experimental program to determine the power-on aerodynamic flight characteristics of the booster and orbiter vehicles during the abort separation maneuver is reported. An essential contribution to such a test program is the gas dynamic simulation of the size and shape of the plumes emitting from the full-scale orbiter and booster main propulsion systems. The two major effects of the plume which must be simulated are: the interaction of the plume with the external flow field, and the direct impingement of the plumes on surfaces which are enveloped by the plume. To accomplish the objective of correct plume simulation, the similarity parameters developed by Herron and the requirement to match momentum flux per unit area between the model and the full-scale systems, were applied to the orbiter and booster propulsion systems.

Baker, L. R., Jr.

Coolant-Flow Calibrations of Three Simulated Porous Gas-Turbine Blades

An investigation was conducted at the NACA Lewis laboratory to determine whether simulated porous gas-turbine blades fabricated by the Eaton Manufacturing Company of Cleveland, Ohio would be satisfactory with respect to coolant flow for application in gas-turbine engines. These blades simulated porous turbine blades by forcing the cooling air onto the blade surface through a large number of chordwise openings or slits between laminations of sheet metal or wire. This type of surface has a finite number of openings, whereas a porous surface has an almost infinite number of smaller openings for the coolant flow. The investigation showed that a blade made of sheet-metal laminations stacked on a support member that passed up through the coolant passage was completely unsatisfactory because of extremely poor coolant flow distribution over the blade surface. The flow distribution for two wire-wound blades was more uniform, but the pressure drop between the coolant supply pressure and the local pressure on the outside of the blades was too low by a factor ranging from 3 to 3.5 for the required coolant flow rates. The pressure drop could be increased by forcing the wires closer together during blade fabrication.

Esger, Jack B.

Determining Levels of Detail for Simulators of Parallel and Distributed Computing Systems via Automated Calibration

There are two sources of inaccuracy when simulating parallel and distributed computing systems: (i) a simulator implemented at an insufficient level of detail; and (ii) incorrectly calibrated simulation parameter values. Increasing the simulator’s level of detail can improve accuracy, but at the cost of higher space, time, and/or software complexity. Furthermore, evaluating the intrinsic accuracy of a simulator requires that its parameters be well-calibrated. Making decisions regarding the level of detail is thus challenging. We propose a methodology for instantiating the simulation calibration process and a framework for automating this process, which makes it possible to pick appropriate levels of detail for any simulator. We demonstrate the usefulness of our approach via two case studies for two different domains.

McDonald, Jessie [University of Hawaii at Manoa, H

Air mass 1.5 global and direct solar simulation and secondary reference cell calibration using a filtered large area pulsed solar simulator

Spectral mismatch between a solar simulator and a desired spectrum can result in nearly 20 percent measurement error in the output of photovoltaic devices. This occurs when a crystalline silicon cell monitors the intensity of an unfiltered large area pulsed solar simulator (LAPSS) simulating the ASTM air mass 1.5 direct spectrum and the test device is amorphous silicon. The LAPSS spectral irradiance is modified with readily available glass UV filters to closely match either the ASTM air mass 1.5 direct or global spectrum. Measurement error is reduced to about 1 percent when using either filter if the reference cell and test device are the same general type.

Mueller, Robert L.

Interlaced Characterization and Calibration (ICC) for Improved Computational Simulation Credibility

Accurate material characterization and model calibration are pivotal for simulations used for high-consequence engineering decisions. Current characterization and calibration methods (1) use simplified test specimen geometries and global data, (2) cannot guarantee that sufficient characterization data is collected for a specific model of interest, (3) provide only mean parameter values with no uncertainty quantification, and (4) are sequential, inflexible, and time-consuming. This work developed a new paradigm—coined Interlaced Characterization and Calibration (ICC)—which drives forward the state-of-the-art in model calibration by bringing together recent advancements into one improved workflow. The ICC paradigm (1) employs tools to efficiently use full-field data to calibrate high-fidelity material models, (2) aligns the data needed with the data collected by adopting an optimal experimental design protocol, (3) provides uncertainty metrics on the calibrated model parameters, and (4) incorporates these advances into a quasi real-time feedback loop. The ICC framework was validated synthetically with both low-fidelity and high-fidelity simulations paired with several different elastoplastic material models, and was also demonstrated experimentally with an aluminum 6061 cruciform exemplar specimen. Results showed that the ICC framework—in which Bayesian optimal experimental design actively guided the experiment— resulted in calibrations with similar or better accuracy than predetermined experiments based on subject matter expertise. Moreover, the ICC framework produced a complete model calibration— with quantified uncertainties on model parameters—in 1 week, a 5 - 10× increase in efficiency over traditional approaches. Thus, the ICC paradigm improves both the calibration process and quality, by (1) improving efficiency, which increases agility of solid mechanics modeling and enables utilization of computational simulation (CompSim) at earlier stages of the design cycle and (2) providing quantified, and in some cases reduced, parameter uncertainties, which increases confidence in model predictions and supports credible decision making.

97 MATHEMATICS AND COMPUTING

DECAL MDN Resolution Calibration

The simulated pixelated calorimeter uses 0.1 mm × 0.1 mm silicon pixels (0.0001 cm²) silicon pixels as active layers — far finer than current concepts like HGCAL (~0.5 cm²) — improving energy resolution through much finer segmentation. While the standard resolution formalism fits three numbers to a handful of discrete test-beam energies, this work is a first try at a more data-efficient alternative: learning the full response shape continuously in energy with a mixture density network. This continuous, differentiable surrogate is a natural building block for fast simulation of extremely complex calorimeters.

Wang, Peter [U. Chicago (main)]