Search NASA⌕ Search

SEARCH · Search NASA

Results for “model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

High-Resolution Regional Wave Hindcast for Hawaii

This report summarizes modeling efforts for hindcasting of wave climate within the exclusive economic zone (EEZ) around the state of Hawaii. Specifically, the report provides detailed description of model mesh development, sensitivity analysis of the configuration of model parameters, data used for model forcing and validation, model skill assessment, and model outputs for resource characterization. The unstructured, nested-grid modeling approach incorporates a regional high-resolution SWAN (Simulating WAves Nearshore) model within the global-regional WAVEWATCH III® (WW3) wave model. The models were configured to comply with the International Electrotechnical Commission (IEC) Technical Standards for wave energy resource characterization. The SWAN model domain covers the entire EEZ with a spatial resolution of approximately 300 m in the nearshore region. Two levels of WW3 nested grids, from 0.5 arc-degree at global to 7.5 arc-minute at regional scale, were used to provide boundary conditions that drive the high-resolution nearshore SWAN model. The WW3 and SWAN models were forced by 0.5 arc-degree Climate Forecast System Reanalysis wind and 5 km regional Weather Research and Forecasting wind, respectively. Wave resource and bulk wave parameters were simulated for a 32-year period from 1979 to 2010, and were subsequently validated using wave buoy data within the model domain. Model performance was evaluated using a set of error statistics. Overall, the model shows good skills in reproducing the wave climate in the Hawaii EEZ in both spatial and temporal domains. Comparisons of time series and scatter plots for the six IEC resource parameters and the associated error statistics tables, and horizontal two-dimensional plots of annually averaged and monthly averaged IEC parameters are provided.

16 TIDAL AND WAVE POWER↗

Mitigative Strategies for Recovering From Large Language Model Trust Violations

In this study, we investigated strategies to address trust issues arising from errors in large language models (LLMs). The study examined the impact of confidence scores, system capability explanations, and user feedback on trust restoration post-error. 68 participants viewed the responses of an LLM to 20 general trivia questions, with an error introduced on the third trial. Each participant was presented with one mitigation strategy. Participants rated their overall trust in the model and the reliability of the answer. Results showed an immediate drop in trust after the error; however, there were no differences across the three strategies in trust recovery. All conditions had a logarithmic trend in trust recovery following error. Differences in overall trust were predicted by perceived reliability of the answer, suggesting that participants were evaluating results critically and using that to inform their trust in the model. Qualitative data supported this finding; participants expressed lasting distrust despite the LLM’s later accuracy. Results showcase the need to prioritize accuracy in LLM deployment, because early errors may irrevocably damage user trust calibration and later adoption.

97 MATHEMATICS AND COMPUTING↗

Real-Time Target Position Estimation Using Stereoscopic Kilovoltage/Megavoltage Imaging and External Respiratory Monitoring for Dynamic Multileaf Collimator Tracking

Purpose: To develop a real-time target position estimation method using stereoscopic kilovoltage (kV)/megavoltage (MV) imaging and external respiratory monitoring, and to investigate the performance of a dynamic multileaf collimator tracking system using this method. Methods and Materials: The real-time three-dimensional internal target position estimation was established by creating a time-varying correlation model that connected the external respiratory signals with the internal target motion measured intermittently using kV/MV imaging. The method was integrated into a dynamic multileaf collimator tracking system. Tracking experiments were performed for 10 thoracic/abdominal traces. A three-dimensional motion platform carrying a gold marker and a separate one-dimensional motion platform were used to reproduce the target and external respiratory motion, respectively. The target positions were detected by kV (1 Hz) and MV (5.2 Hz) imaging, and external respiratory motion was captured by an optical system (30 Hz). The beam-target alignment error was quantified as the positional difference between the target and circular beam center on the MV images acquired during tracking. The correlation model error was quantified by comparing a model estimate and measured target positions. Results: The root-mean-square errors in the beam-target alignment that had ranged from 3.1 to 7.6 mm without tracking were reduced to <1.5 mm with tracking, except during the model building period (6 s). The root-mean-square error in the correlation model was submillimeters in all directions. Conclusion: A novel real-time target position estimation method was developed and integrated into a dynamic multileaf collimator tracking system and demonstrated an average submillimeter geometric accuracy after initializing the internal/external correlation model. The method used hardware tools available on linear accelerators and therefore shows promise for clinical implementation.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

RDPM: An Extensible Tool for Resilience Design Patterns Modelling

Resilience to faults, errors, and failures in extreme-scale high-performance computing (HPC) systems is a critical challenge. Resilience design patterns offer a new, structured hardware and software design approach for improving resilience. While prior work focused on developing performance, reliability, and availability models for resilience design patterns, this paper extends it by providing a Resilience Design Patterns Modeling (RDPM) tool which allows (1) exploring performance, reliability, and availability of each resilience design pattern, (2) offering customization of parameters to optimize performance, reliability, and availability, and (3) allowing investigation of trade-off models for combining multiple patterns for practical resilience solutions.

Kumar, Mohit↗

Evaluation of an Automatic Registration-Based Algorithm for Direct Measurement of Volume Change in Tumors

Purpose: Assuming that early tumor volume change is a biomarker for response to therapy, accurate quantification of early volume changes could aid in adapting an individual patient's therapy and lead to shorter clinical trials. We investigated an image registration-based approach for tumor volume change quantification that may more reliably detect smaller changes that occur in shorter intervals than can be detected by existing algorithms. Methods and Materials: Variance and bias of the registration-based approach were evaluated using retrospective, in vivo, very-short-interval diffusion magnetic resonance imaging scans where true zero tumor volume change is unequivocally known and synthetic data, respectively. The interval scans were nonlinearly registered using two similarity measures: mutual information (MI) and normalized cross-correlation (NCC). Results: The 95% confidence interval of the percentage volume change error was (-8.93% to 10.49%) for MI-based and (-7.69%, 8.83%) for NCC-based registrations. Linear mixed-effects models demonstrated that error in measuring volume change increased with increase in tumor volume and decreased with the increase in the tumor's normalized mutual information, even when NCC was the similarity measure being optimized during registration. The 95% confidence interval of the relative volume change error for the synthetic examinations with known changes over {+-}80% of reference tumor volume was (-3.02% to 3.86%). Statistically significant bias was not demonstrated. Conclusion: A low-noise, low-bias tumor volume change measurement algorithm using nonlinear registration is described. Errors in change measurement were a function of tumor volume and the normalized mutual information content of the tumor.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

POPULATION EFFECTS ON THE METALLICITY DISTRIBUTION FUNCTION DERIVED FROM THE RED GIANT BRANCH

We have tested the reliability of the red giant branch (RGB) as a metallicity indicator accounting for observational errors as well as the complexity of star formation histories and chemical evolution histories observed in various stellar systems. We generate model color–magnitude diagrams (CMDs) produced with a variety of evolutionary histories and compare the resultant metallicity estimates from the colors and magnitudes of RGB stars to the true input metallicities. We include realistic models for photometric errors and completeness in our synthetic CMDs. As expected, for simple simple stellar populations dominated by old stars, the RGB provides a very accurate estimate of the modular metallicity value for a population. An error in the age of a system targeted for this type of study may produce metallicity errors of a few tenths of a dex. The size of this metallicity error depends linearly on the age error, and we find this dependence to be stronger with more precise photometry. If the population has experienced any significant star formation within the last ∼6 Gyr, the metallicity estimates, [M/H], derived from the RGB may be in error by up to ∼0.5 dex. Perhaps the most important consideration for this technique is an accurate, independent estimate of the average age for the target stellar system, especially if it is probable that a significant fraction of the population formed less than ∼6 Gyr ago.

79 ASTRONOMY AND ASTROPHYSICS↗

Spatially resolved X-ray emission measurements of the residual velocity during the stagnation phase of inertial confinement fusion implosion experiments

A technique for measuring residual motion during the stagnation phase of an indirectly driven inertial confinement experiment has been implemented. This method infers a velocity from spatially and temporally resolved images of the X-ray emission from two orthogonal lines of sight. This work investigates the accuracy of recovering spatially resolved velocities from the X-ray emission data. A detailed analytical and numerical modeling of the X-ray emission measurement shows that the accuracy of this method increases as the displacement that results from a residual velocity increase. For the typical experimental configuration, signal-to-noise ratios, and duration of X-ray emission, it is estimated that the fractional error in the inferred velocity rises above 50% as the velocity of emission falls below 24 μm/ns. By inputting measured parameters into this model, error estimates of the residual velocity as inferred from the X-ray emission measurements are now able to be generated for experimental data. Details of this analysis are presented for an implosion experiment conducted with an unintentional radiation flux asymmetry. The analysis shows a bright localized region of emission that moves through the larger emitting volume at a relatively higher velocity towards the location of the imposed flux deficit. This technique allows for the possibility of spatially resolving velocity flows within the so-called central hot spot of an implosion. This information would help to refine our interpretation of the thermal temperature inferred from the neutron time of flight detectors and the effect of localized hydrodynamic instabilities during the stagnation phase. Across several experiments, along a single line of sight, the average difference in magnitude and direction of the measured residual velocity as inferred from the X-ray and neutron time of flight detectors was found to be ∼13 μm/ns and ∼14°, respectively.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Challenge Problem 1: Preliminary Model Development and Assessment of Flexible Heat Transfer Modeling Approaches

This report presents the modeling progress of a university consortium studying flexible modeling for turbulent heat transfer. In the context of advanced nuclear reactor design, where challenges include non-unity Prandtl fluids, free and mixed convection, and transitional flow, computational fluid dynamics methods are underutilized due to low confidence in modeling approaches and high computational cost. This report evaluates the performance of engineering CFD models in diabatic, buoyant turbulent flow. It finds that all turbulence models including several variants of the k-ε and k-ω models struggle to predict accurate turbulent momentum and heat transfer in such flows. The Nusselt numbers have been compared between the models and the DNS data, where calculations have been performed for each case and trends have shown a good agreement between DNS estimated Nusselt numbers and available correlations as well as experimental data. A novel DNS correlation for high Pr cases as they are transitioning from mixed convection to natural convection has been proposed. While Nusselt number errors relative to DNS range from 20% to 50%, the models capture similar trends to DNS with respect to Nusselt suppression and amplification under varying levels of buoyancy effect. This report also highlights model form error as a significant contributor to CFD predictions and proposes a framework for quantifying model error and improving confidence in CFD calculations. To improve the predictive capability of engineering CFD models, data-driven approaches for turbulence models are investigated. Theoretical frameworks based on the invariant tensor / vector basis neural networks for prediction of Reynolds stresses and turbulent heat fluxes are employed. The models are developed using direct numerical simulations data for forced convection flows of different fluids in vertical planar channel domain. The framework is implemented in spectral element solvers Nek5000 / nekRS and has shown a potential for future development and consideration of mixed convection flows.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Hydrodynamic Modeling Analysis of Tidal Wetland Restoration in Snohomish River, Washington

To re-establish the intertidal wetlands with full tidal interaction and improve salmonid rearing habitat in the Lower Snohomish River estuary, a diked wetland along Union Slough of the Snohomish River was restored by breaching the existing dike and constructing bridges across the breaches. However, post-restoration monitoring indicated that the restored project site could not drain as efficiently as desired. To improve the drainage conditions at the restoration site during low tides, a modeling study was conducted to evaluate additional restoration scenarios and to provide recommendations for finish-grade ground elevations to achieve the desired drainage. To accurately simulate the drainage of the project site, an unstructured-grid hydrodynamic model with fine-grid resolution down to a few meters was used in this study. The model was first validated with observed water level data collected in the project site and then applied to assess the feasibility of different proposed restoration scenarios. A spatial varying bottom roughness option in the model is also implemented to better represent the high roughness due to the presence of dense vegetation in the project site. The methodology, error statistics of model validation and uncertainty of the modeling analysis are presented and discussed.

Yang, Zhaoqing↗

Systematic study of the uncertainties in fitting the cosmic positron data by AMS-02

The operation of AMS-02 opens a new era for the study of cosmic ray physics with unprecedentedly precise data which are comparable with the laboratory measurements. The high precision data allow a quantitative study on the cosmic ray physics and give strict constraints on the nature of cosmic ray sources. However, the intrinsic errors from the theoretical models to interpret the data become dominant over the errors in the data. In the present work we try to give a systematic study on the uncertainties of the models to explain the AMS-02 positron fraction data, which shows the cosmic ray e{sup +}e{sup −} excesses together with the PAMELA and Fermi-LAT measurements. The excesses can be attributed to contributions from the extra e{sup +}e{sup −} sources, such as pulsars or the dark matter annihilation. The possible systematic uncertainties of the theoretical models considered include the cosmic ray propagation, the treatment of the low energy data, the solar modulation, the pp interaction models, the nuclei injection spectrum and so on. We find that in general a spectral hardening of the primary electron injection spectrum above ∼50–100 GeV is favored by the data. Furthermore, the present model uncertainties may lead to a factor of ∼2 enlargement in the determination of the parameter regions of the extra source, such as the dark matter mass, annihilation rate and so on.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluating Climate Models’ Cloud Feedbacks Against Expert Judgment

Abstract The persistent and growing spread in effective climate sensitivity (ECS) across global climate models necessitates rigorous evaluation of their cloud feedbacks. Here we evaluate several cloud feedback components simulated in 19 climate models against benchmark values determined via an expert synthesis of observational, theoretical, and high‐resolution modeling studies. We find that models with smallest feedback errors relative to these benchmark values generally have moderate total cloud feedbacks (0.4–0.6 W m −2 K −1 ) and ECS (3–4 K). Those with largest errors generally have total cloud feedback and ECS values that are too large or too small. Models tend to achieve large positive total cloud feedbacks by having several cloud feedback components that are systematically biased high rather than by having a single anomalously large component, and vice versa. In general, better simulation of mean‐state cloud properties leads to stronger but not necessarily better cloud feedbacks. The Python code base provided herein could be applied to developmental versions of models to assess cloud feedbacks and cloud errors and place them in the context of other models and of expert judgment in real‐time during model development.

58 GEOSCIENCES↗

Joint Non-Parametric Correction Estimator for Excess Relative Risk Regression in Survival Analysis with Exposure Measurement Error

Summary Observational epidemiological studies often confront the problem of estimating exposure–disease relationships when the exposure is not measured exactly. We investigate exposure measurement error in excess relative risk regression, which is a widely used model in radiation exposure effect research. In the study cohort, a surrogate variable is available for the true unobserved exposure variable. The surrogate variable satisfies a generalized version of the classical additive measurement error model, but it may or may not have repeated measurements. In addition, an instrumental variable is available for individuals in a subset of the whole cohort. We develop a non-parametric correction estimator by using data from the subcohort and further propose a joint non-parametric correction estimator using all observed data to adjust for exposure measurement error. An optimal linear combination estimator of the joint non-parametric correction and non-parametric correction is further developed. The estimators proposed are non-parametric, which are consistent without imposing a covariate or error distribution, and are robust to heteroscedastic errors. Finite sample performance is examined via a simulation study. We apply the developed methods to data from the Radiation Effects Research Foundation, in which chromosome aberration is used to adjust for the effects of radiation dose measurement error on the estimation of radiation dose responses.

Wang, Ching-Yun↗

Robust constrained tension control for high-precision roll-to-roll processes

Tension control is critical for maintaining good product quality in most roll-to-roll (R2R) production systems. Previous work has primarily focused on improving the disturbance rejection performance of tension controllers. Here, a robust linear parameter-varying model predictive control (LPV-MPC) scheme is designed to enhance the tension tracking performance of a pilot R2R system for deposition of materials used in flexible thin film applications. The performance of a tension controller may degrade due to disturbances associated with model uncertainties and the slowly-changing dynamics in R2R systems. We introduce a method that separately treats these two sources of disturbance. The controller utilizes an incremental model to eliminate the errors caused by the mismatch between the nominal model and the actual system. A tube-based MPC formulation combined with scheduled parameters adequately updates models and corrects for the time-varying dynamics. Constraints on the rated motor torque are incorporated in the MPC to maintain the controller reliability and avoid machine failures. We illustrate the operation of our control algorithm through simulation of an actual R2R system. The controller outperforms the benchmarks in terms of fast transient response and offset-free tension tracking. Furthermore, it also demonstrates immunity from variations due to parametric uncertainties.

42 ENGINEERING↗

Experimental demonstration of a quantum annealing algorithm for the traveling salesman problem in a nuclear-magnetic-resonance quantum simulator

The method of quantum annealing (QA) is a promising way for solving many optimization problems in both classical and quantum information theory. The main advantage of this approach, compared with the gate model, is the robustness of the operations against errors originated from both external controls and the environment. In this work, we succeed in demonstrating experimentally an application of the method of QA to a simplified version of the traveling salesman problem by simulating the corresponding Schroedinger evolution with a NMR quantum simulator. The experimental results unambiguously yielded the optimal traveling route, in good agreement with the theoretical prediction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Bias correcting regional scale Earth system model projections: novel approach using empirical mode decomposition

Bias correction is a crucial step in using Earth system model outputs for assessments, as it adjusts systematic errors by comparing the model to observations. However, standard methods – ranging from mean-based linear scaling to distribution-based quantile mapping typically treat bias correction as a single-scale process, overlooking the fact that biases can manifest differently across daily, seasonal, and annual timescales. In this study, we propose a novel, timescale-aware bias-correction approach built on Empirical Mode Decomposition. By decomposing the meteorological signal into multiple oscillatory components and aggregating them to represent distinct timescales, we apply targeted corrections to each component, thereby preserving both short- and long-term structure in the data. Experimental illustrations show that the timescale-aware EMDBC framework matches the performance of conventional quantile-delta mapping (QDM) at the native daily scale and achieves progressively larger bias reductions at bi-weekly, seasonal, and annual scales. As a result, the proposed approach offers a more robust path to accurate and reliable Earth system projections, strengthening their utility for resilience and adaptation planning.

Ganguli, Arkaprabha [Argonne National Laboratory (↗

A reduced order sulfuric acid decomposition model for a nuclear-powered hybrid sulfur cycle

A reduced order model of sulfuric acid decomposition within a bayonet chemical reactor was developed to support the U. S. Department of Energy Integrated Energy System program, and address the lack of knowledge in scaling and integration for joint chemical and nuclear processes. Sulfuric acid decomposition within a bayonet reactor was modeled to provide chemical and thermodynamic data relevant to advanced nuclear reactor-driven integrated energy systems based on desired operational scale and operational conditions. The temperature range required for high-temperature advanced nuclear reactor integrated energy systems, 750-850 °C, was shown to produce reasonable agreement (within a few percent relative error) with past models and experimental data, and yielded good efficiency results for bayonet reactor operations. The results of the reduced order model agreed with previous work from Savannah River National Labs within a maximum of 3.4% error on the decomposition of sulfur trioxide, and on previous Hybrid Sulfur flowsheets from Gorensek and Summers that showed operational temperature, pressure, and composition ranges for efficiency which made the Hybrid Sulfur cycle competitive with water electrolysis. Here, the agreement with previous high-fidelity models provided a framework for future Integrated Energy System grid evaluations with an advanced nuclear reactor and large-scale hydrogen production using a mathematical model to represent chemical operations.

08 HYDROGEN↗

Benchmark calculations of radiative forcing by greenhouse gases

Changes in concentrations of greenhouse gases lead to changes in radiative fluxes throughout the atmosphere. The value of this change, the instantaneous radiative forcing, varies across climate models, due partly to differences in the distribution of clouds, humidity, and temperature across models, and partly due to errors introduced by approximate treatments of radiative transfer. This paper describes an experiment within the Radiative Forcing Model Intercomparision Project that uses benchmark calculations made with line–by–line models to identify parameterization error in the representation of absorption and emission by greenhouse gases. Clear–sky instantaneous forcing by greenhouse gases is computed using a set of 100 profiles, selected from a re–analysis of present–day conditions, that represent the global annual mean forcing from pre–industrial times to the present–day with sampling errors of less than 0.01 W m –2 . Six contributing line–by–line models agree in their estimate of this forcing to within 0.025 W m –2 while even recently–developed parameterizations have typical errors four or more times larger, suggesting both that the samples reveal true differences among line–by–line models and that parameterization error will be readily identifiable. Agreement among line–by–line models is better in the longwave than in the shortwave where differing treatments of the water vapor vapor continuum affect estimates of forcing by carbon dioxide and methane. The impacts of clouds on instantaneous radiative forcing are estimated from climate model simulations. Here, the adjustment due to stratospheric temperature change by assuming fixed dynamical heating. Adjustments are large only for ozone and for carbon dioxide, for which stratospheric cooling introduces modest non–linearity.

54 ENVIRONMENTAL SCIENCES↗