Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37

Bio-energy feedstock yields and their water quality benefits in Mississippi

Cellulosic and agricultural bio-energy crops can, under careful management, be harvested as feedstock for bio-fuels production and provide environmental benefits. However, it is required to quantify their relative advantages in feedstock production and water quality. The primary objective of this research was to evaluate potential feedstock yield and water quality benefit scenarios of bioenergy crops: Miscanthus (Miscanthus-giganteus), Switchgrass (Panicum virgatum), Johnsongrass (Sorghum halepense), Alfalfa (Medicago sativa L.), Soybean {Glycine max (L.) Merr.}, and Corn (Lea mays) in the Upper Pearl River watershed (UPRW), Mississippi using a Soil and Water Assessment Tool (SWAT). The SWAT model was calibrated (January 1981 to December 1994) and validated (January 1995 to September 2008) using monthly measured stream flow data. The calibrated and validated model determined good to very good performance for stream flow prediction (R2 and E from 0.60 to 0.86). The RMSE values (from 14 m3 s-1 to 37 m3 s-1) were estimated at similar levels of errors during model calibration and validation. The long-term average annual potential feedstock yield as an alternative energy source was determined the greatest when growing Miscanthus grass (373,849 Mg) as followed by Alfalfa (206,077 Mg), Switchgrass (132,077 Mg), Johnsongrass (47,576 Mg), Soybean (37,814 Mg), and Corn (22,069 Mg) in the pastureland and cropland of the watershed. Model results determined that average annual sediment yield from the Miscanthus grass scenario determined the least (1.16 Mg/ha) and corn scenario the greatest (12.04 Mg/ha). The SWAT model simulated results suggested that growing Miscanthus grass in the UPRW would have the greatest potential feedstock yield and water quality benefits.

Biofuels↗

Uncertainty-Guided Prediction Horizon of Phase-Resolved Ocean Wave Forecasting Under Data Sparsity: Experimental and Numerical Evaluation

Accurate short-term wave forecasting is critical for the safe and efficient operation of marine structures that rely on real-time, phase-resolved ocean wave information for control and monitoring purposes (e.g., digital twins). These systems often depend on environmental sensors (e.g., waverider buoys, wave-sensing LIDAR). Challenges arise when upstream sensor data are missing, sparse, or phase-shifted due to drift. This study investigates the performance of two machine learning models, time-series dense encoder (TiDE) and long short-term memory (LSTM), for forecasting phase-resolved ocean surface elevations under varying degrees of data degradation. We introduce the τ-trimming algorithm, which adapts the prediction horizon based on uncertainty thresholds derived from historical forecasts. Numerical wave tank (NWT) and wave basin experiments are used to benchmark model performance under short- and long-term data masking, spatially coarse sensor grids, and upstream phase shifts. Results show under a 50% probability of upstream data loss, the τ-trimmed TiDE model achieves a 46% reduction in error at the most upstream target, compared to 22% for LSTM. Furthermore, phase misalignment in upstream data introduces a near-linear increase in forecast error. Under moderate model settings, a ±3 s misalignment increases the mean absolute error by approximately 0.5 m, while the same error is accumulated at ±4 s using the more conservative approach. These findings inform the design of resilient, uncertainty-aware wave forecasting systems suited for realistic offshore sensing environments.

42 ENGINEERING↗

Scaling open-weight large language models for hydropower regulatory information extraction: A systematic analysis

Information extraction from regulatory and technical documents using large language models (LLMs) involves practical trade-offs between extraction quality and computational cost. We evaluate eight open-weight LLMs spanning 0.6B–70B parameters on hydropower licensing documents and report deployment-oriented evidence under a unified extraction schema and evaluation protocol. Across the model set, we observe clear scale-dependent trends in both baseline extraction quality and the effectiveness of reflective reasoning (self-checking) under our fixed-prompt, no-augmentation setting. Mid-scale models often provide a favorable balance of accuracy and efficiency, whereas the smallest models show limited or inconsistent gains from the reasoning variants tested. Larger models achieve the highest overall F1 scores but incur substantially greater compute and infrastructure requirements. We further find that reliability failure modes can distort conventional metrics in this domain: in particular, high recall can coincide with systematic extraction errors when models fabricate values for fields that are absent from the source text, underscoring the importance of conservative null handling and evidence-grounded evaluation. Overall, our study provides a reproducible resource–performance comparison for open-weight LLM-based extraction in hydropower regulatory documentation and offers practical guidance for model selection under different deployment constraints.

Evaluation protocol↗

Bayesian model-data comparison incorporating theoretical uncertainties

Accurate comparisons between theoretical models and experimental data are critical for scientific progress. However, inferred physical model parameters can vary significantly with the chosen physics model, highlighting the importance of properly accounting for theoretical uncertainties. In this Letter, we present a Bayesian framework that explicitly quantifies these uncertainties by statistically modeling theory errors, guided by qualitative knowledge of a theory’s varying reliability across the input domain. We demonstrate the effectiveness of this approach using two systems: a simple ball drop experiment and multi-stage heavy-ion simulations. In both cases incorporating model discrepancy leads to improved parameter estimates, with systematic improvements observed as additional experimental observables are integrated.

Bayesian methods↗

Exploring Hydrologic Model Process Connectivity at the Continental Scale Through an Information Theory Approach

Exploring water fluxes between hydrological model (HM) components is essential to assess and improve model realism. Many classical metrics for HM diagnosis rely solely on streamflow and hence provide limited insights into model performance across processes. This study applies an information theory measure known as “transfer entropy” (TE) to systematically quantify the transfer of information among major HM components. To test and demonstrate the benefits of TE, we use the Framework for Understanding Structural Errors (FUSE) model to mimic and compare four commonly used HM structures, VIC, PRMS, SACRAMENTO, and TOPMODEL, across 671 catchments spanning a variety of hydrologic regimes in the conterminous United States. We explore connections between HM components and catchment landscape characteristics (e.g., climate, topography, soil, and vegetation) and characterize their nonlinear associations using distance correlation and Spearman correlation coefficients. Our results indicate that while the information transferred from precipitation to runoff is similar across model structures (likely as a result of calibration), the information transferred among other components can vary significantly from a FUSE structure to another. We find that aridity, precipitation duration and frequency, snow fraction, mean elevation, forest area, and leaf area index are often significantly associated with TE between the main HM components. Here, we propose that the presence of meaningful nonlinear associations can be used to diagnose process representation in HMs. Our results highlight the necessity to enhance the conventional streamflow-only calibration approach for a more realistic representation of water dynamics in the models.

large-sample hydrology↗

Matching post-Newtonian and numerical relativity waveforms: Systematic errors and a new phenomenological model for nonprecessing black hole binaries

We present a new phenomenological gravitational waveform model for the inspiral and coalescence of nonprecessing spinning black hole binaries. Our approach is based on a frequency-domain matching of post-Newtonian inspiral waveforms with numerical relativity based binary black hole coalescence waveforms. We quantify the various possible sources of systematic errors that arise in matching post-Newtonian and numerical relativity waveforms, and we use a matching criteria based on minimizing these errors; we find that the dominant source of errors are those in the post-Newtonian waveforms near the merger. An analytical formula for the dominant mode of the gravitational radiation of nonprecessing black hole binaries is presented that captures the phenomenology of the hybrid waveforms. Its implementation in the current searches for gravitational waves should allow cross-checks of other inspiral-merger-ringdown waveform families and improve the reach of gravitational-wave searches.

79 ASTRONOMY AND ASTROPHYSICS↗

Decision Science for Machine Learning (DeSciML)

The increasing use of machine learning (ML) models to support high-consequence decision making drives a need to increase the rigor of ML-based decision making. Critical problems ranging from climate change to nonproliferation monitoring rely on machine learning for aspects of their analyses. Likewise, future technologies, such as incorporation of data-driven methods into the stockpile surveillance and predictive failure analysis for weapons components, will all rely on decision-making that incorporates the output of machine learning models. In this project, our main focus was the development of decision scientific methods that combine uncertainty estimates for machine learning predictions, with a domain-specific model of error costs. Other focus areas include uncertainty measurement in ML predictions, designing decision rules using multiobjecive optimization, the value of uncertainty reduction, and decision-tailored uncertainty quantification for probability estimates. By laying foundations for rigorous decision making based on the predictions of machine learning models, these approaches are directly relevant to every national security mission that applies, or will apply, machine learning to data, most of which entail some decision context.

97 MATHEMATICS AND COMPUTING↗

A data-driven multiscale model for reactive wetting simulations

Here, we describe a data-driven, multiscale technique to model reactive wetting of a silver–aluminum alloy on a Kovar™ (Fe-Ni-Co alloy) surface. We employ molecular dynamics simulations to elucidate the dependence of surface tension and wetting angle on the drop’s composition and temperature. A design of computational experiments is used to efficiently generate training data of surface tension and wetting angle from a limited number of molecular dynamics simulations. The simulation results are used to parameterize models of the material’s wetting properties and compute the uncertainty in the models due to limited data. The data-driven models are incorporated into an engineering-scale (continuum) model of a silver–aluminum sessile drop on a Kovar™ substrate. Model predictions of the wetting angle are compared with experiments of pure silver spreading on Kovar™ to quantify the model-form errors introduced by the limited training data versus the simplifications inherent in the molecular dynamics simulations. The paper presents innovations in the determination of “convergence” of noisy MD simulations before they are used to extract the wetting angle and surface tension, and the construction of their models which approximate physio-chemical processes that are left unresolved by the engineering-scale model. Together, these constitute a multiscale approach that integrates molecular-scale information into continuum scale models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Calibrating hypersonic turbulence flow models with the HIFiRE-1 experiment using data-driven machine-learned models.

In this paper we study the efficacy of combining machine-learning methods with projection-based model reduction techniques for creating data-driven surrogate models of computationally expensive, high-fidelity physics models. Such surrogate models are essential for many-query applications e.g., engineering design optimization and parameter estimation, where it is necessary to invoke the high-fidelity model sequentially, many times. Surrogate models are usually constructed for individual scalar quantities. However there are scenarios where a spatially varying field needs to be modeled as a function of the model’s input parameters. Here we develop a method to do so, using projections to represent spatial variability while a machine-learned model captures the dependence of the model’s response on the inputs. The method is demonstrated on modeling the heat flux and pressure on the surface of the HIFiRE-1 geometry in a Mach 7.16 turbulent flow. The surrogate model is then used to perform Bayesian estimation of freestream conditions and parameters of the SST (Shear Stress Transport) turbulence model embedded in the high-fidelity (Reynolds-Averaged Navier–Stokes) flow simulator, using shock-tunnel data. The paper provides the first-ever Bayesian calibration of a turbulence model for complex hypersonic turbulent flows. We find that the primary issues in estimating the SST model parameters are the limited information content of the heat flux and pressure measurements and the large model-form error encountered in a certain part of the flow.

42 ENGINEERING↗

Revenue prediction for integrated renewable energy and energy storage system using machine learning techniques

Revenue estimation for integrated renewable energy and energy storage systems is important to support plant owners or operators’ decisions in battery sizing selection that leads to maximized financial performances. A common approach to optimizing revenues of a hybrid hydro and energy storage system is using mixed-integer linear programming (MILP). Although MILP models can provide accurate production cost estimations, they are typically very computationally expensive. To provide a fast yet accurate first-step information to hydropower plant owners or operators who consider integrating energy storage systems, we propose an innovative approach to predicting optimal revenues of an integrated energy generation and storage system. In this study, we examined the performance of two prediction techniques: Generalized Additive Models (GAMs) and machine learning (ML) models developed based on artificial neural networks (ANN). Predictive equations and models are generated based on optimized solutions from a market participation optimization model, the Conventional Hydropower Energy and Environmental Resource System (CHEERS) model. The two predicting techniques reduce the computational time to evaluate annual revenue for one set of battery configurations from 3 h to 1 to 4 min per run while also being implementable with significantly less data. The model validation prediction errors of developed GAMs and ML models are generally below 5%; for model testing predictions, the ML models consistently outperform the regression equations in terms of root mean square errors. This new approach allows plant owners, operators, or potential investors to quickly access multiple battery configurations under different energy generation and market scenarios. This new revenue prediction method will therefore help reduce the barriers, and thereby promoting the deployment of battery hybridization with existing renewable energy sources.

13 HYDRO ENERGY↗

Using regime analysis to identify the contribution of clouds to surface temperature errors in weather and climate models

Many global circulation models (GCMs) exhibit a persistent bias in the 2 m temperature over the midlatitude continents, present in short-range forecasts as well as long-term climate simulations. A number of hypotheses have been proposed, revolving around deficiencies in the soil–vegetation–atmosphere energy exchange, poorly resolved low-level boundary-layer clouds or misrepresentations of deep-convective storms. A common approach to evaluating model biases focuses on the model-mean state. However, this makes difficult an unambiguous interpretation of the origins of a bias, given that biases are the result of the superposition of impacts of clouds and land-surface deficiencies over multiple time steps. This article presents a new methodology to objectively detect the role of clouds in the creation of a surface warm bias. A unique feature of this study is its focus on temperature-error growth at the time-step level. It is shown that compositing the temperature-error growth by the coinciding bias in total downwelling radiation provides unambiguous evidence for the role that clouds play in the creation of the surface warm bias during certain portions of the day. Furthermore, the application of an objective cloud-regime classification allows for the detection of the specific cloud regimes that matter most for the creation of the bias. We applied this method to two state-of-the-art GCMs that exhibit a distinct warm bias over the Southern Great Plains of the USA. Our analysis highlights that, in one GCM, biases in deep-convective and low-level clouds contribute most to the temperature-error growth in the afternoon and evening respectively. In the second GCM, deep clouds persist too long in the evening, leading to a growth of the temperature bias. In conclusion, the reduction of the temperature bias in both models in the morning and the growth of the bias in the second GCM in the afternoon could not be assigned to a cloud issue, but are more likely caused by a land-surface deficiency.

54 ENVIRONMENTAL SCIENCES↗

Impact of non-Maxwellian electron velocity distribution functions on inferred plasma parameters in collective Thomson scattering

Optical collective Thomson scattering provides precise density and temperature measurements in numerous plasma-physics experiments. The accuracy of such measurements depends on the core assumption that the underlying electron distribution functions in under-dense laser-produced plasmas are Maxwellian. A statistically based, quantitative analysis of the errors in the measured electron density and temperature is presented when synthetic data calculated using a non-Maxwellian electron distribution function is fit assuming a Maxwellian electron distribution. Such analysis can lead to errors of up to 50% in temperature and 30% in density, in the specific case of super-Gaussian distributions characteristic of inverse bremsstrahlung heating. Furthermore including the proper family of non-Maxwellian electron distribution functions, as a fitting parameter, in Thomson-scattering analysis removes the model-dependent errors in the inferred parameters at a minimal cost to the statistical uncertainty.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Computer Modeling and Simulation

Verification and validation of computer codes and models used in simulation are two aspects of the scientific practice of high importance and have recently been discussed by philosophers of science. While verification is predominantly associated with the correctness of the way a model is represented by a computer code or algorithm, validation more often refers to model’s relation to the real world and its intended use. It has been argued that because complex simulations are generally not transparent to a practitioner, the Duhem problem can arise for verification and validation due to their entanglement; such an entanglement makes it impossible to distinguish whether a coding error or model’s general inadequacy to its target should be blamed in the case of the model failure. I argue that in order to disentangle verification and validation, a clear distinction between computer modeling (construction of mathematical computer models of elementary processes) and simulation (construction of models of composite objects and processes by means of numerical experimenting with them) needs to be made. Holding on to that distinction, I propose to relate verification (based on theoretical strategies such as inferences) to modeling and validation, which shares the common epistemology with experimentation, to simulation. To explain reasons of their intermittent entanglement I propose a weberian ideal-typical model of modeling and simulation as roles in practice. I suggest an approach to alleviate the Duhem problem for verification and validation generally applicable in practice and based on differences in epistemic strategies and scopes

Pronskikh, V. S.↗

The impact of capillary heterogeneity on CO 2 flow and trapping across scales

Capillary heterogeneity has been identified over the last decade as a key control on subsurface CO 2 flow behavior during geological CO 2 sequestration. These heterogeneities can be formed in all sedimentary rocks, ranging from slight variations in the sand grain sizes to extensive sequences of interbedded sands, shales, and limestones. Capillary heterogeneity has been largely, although not entirely, overlooked in subsurface flow modeling because it is assumed to only directly influence fluid redistribution over scales of centimeters to meters. However, even small-scale fluid movements can result in dramatic impacts on the mobility and trapping of the CO 2 over kilometers. Therefore, neglecting capillary heterogeneity at multiple scales could potentially lead to errors in modeling and predicting field-scale plume migration. In this review paper, we aim to provide a consistent overview to (1) establish that capillary heterogeneity can have a major impact on CO 2 plume migration, (2) establish the respective length scales at which capillary heterogeneity matters, and (3) provide guidance for numerical modeling. This review covers pertinent literature and extracts key observations from the core to the field scales. Experimental studies have shown that millimeter-decimeter scale capillary heterogeneity can cause the so-called capillary heterogeneity trapping in addition to pore-scale residual trapping. Even at such a small scale, capillary heterogeneity can already lead to complex upscaled constitutive relationships, such as flow-rate dependent and anisotropic relative permeability, which affects field-scale CO 2 migration even when field-scale heterogeneities are present. Under gravity-dominated flow regimes, centimeter-meter scale capillary heterogeneity can entrap a significant amount of CO 2 at field scale, not just after imbibition but also during drainage. In certain cases, the presence of capillary heterogeneity can even completely stop the vertical movement of the CO 2 plume, hence greatly reducing leakage risks. At meter-kilometer scale, the influence of capillary heterogeneity is more pronounced and can hinder or redirect CO 2 migration in both lateral and vertical directions. The impact of capillary heterogeneity across multiple spatial scales poses a great challenge in modeling CO 2 migration at field scale, because it is practically impossible to build a field-scale earth model with grid blocks at millimeter scale. We recommend a hierarchical modeling approach to address this challenge. At field scale, earth models are built to capture geological features and heterogeneities in high but still practical grid resolutions. For each facies or rock type of the field-scale model, high- resolution meter-scale “conceptual” models are built with millimeter-scale grid blocks to capture representative fine-scale bedding geometries and heterogeneities in various environments of deposition, bridging the gap from subcore scale to the size of a field-scale simulation grid block. Upscaling is then used to preserve the smaller-scale flow dynamics of various rock types in field-scale simulations. Here, future work is needed to (1) refine, improve, and validate the hierarchical modeling approach; (2) build libraries of fine-scale bedding models for facies in various environments of deposition; (3) quantify multiscale capillary heterogeneity effects under subsurface uncertainties; (4) gain learning from different storage formations; and (5) establish best practices that balance accuracy and computational speed.

Capillary heterogeneity↗

Investigation of Cody–Lorentz and Tauc–Lorentz Models in Characterizing Dielectric Function of (HfO{sub 2}){sub x}(ZrO{sub 2}){sub 1–x} Mixed Thin Film

In the present study, Tauc–Lorentz and Urbach tail assisted Cody–Lorentz models were intuitively derived, explained, and employed to simulate the imaginary dielectric function of the atomic layer deposited (HfO{sub 2}){sub x}(ZrO{sub 2}){sub 1–x} in the energy range of 0.7–9.3 eV. A fitting procedure is carried out using the Levenberg–Marquardt method for minimizing mean square errors. Both models support the experimental data derived by vacuum ultraviolet spectroscopic ellipsometry. For a zirconium content of 60 and 75%, a weak absorption profile is observed in the visible region and elaborately explained by the Lorentz oscillator model. In order to calculate the band gap of different compositions, Cody plots and Tauc plots are presented. The results show that the Cody–Lorentz model is more accuracy due to its exponential absorption below the band gap energy and modified density of states.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Quantification and prediction of error in MIMO tests

Dynamic testing of systems is most realistic of real-world conditions when multiple input and multiple output (MIMO) techniques are used. To replicate measured environmental conditions, a series of desired outputs (responses) on the system must be realized by inverting the frequency response functions (FRF) matrix for input estimation. System identification is dependent on the number of inputs and outputs, which affect the type of solutions. In input estimation, the auto spectra of the determined inputs are affected by both the auto spectra and cross spectra of the desired outputs. This research evaluates errors and investigates two sources in an experimental setting. The first significant error source is test-to-test variability in FRFs from system identification tests, quantified by magnitude variability from long-duration tests. The second significant error source is the realization of time histories from frequency domain inputs. The spectral content of the realized random process deviates from the desired content and is also quantified. The structure is a linear three-story frame fixed at the base; two inputs are provided uniaxially with the use of suspended electrodynamic shakers. The proposed model for error sources was found to be effective in predicting errors in a SISO (single-input single-output) and a square (2-input 2-output) MIMO test.

Yousef, Odey↗

A method for the characterization of intra-pixel response of infrared sensor

Due to the response variations within a pixel, response of sensor varies with the positions of the point target. The accurate measurement of intra-pixel response of the sensor is the key to high-precision centroid estimation and radiometric calibration. In this paper, we establish an intra-pixel response model based on the pixel structure and use Gauss function to describe the beam spot profile. We further calculate the full width at half maximum (FWHM) of the Gauss function and the fill factor of the infrared sensor using the grid search algorithm. Experimental results show that the Gauss function FWHM differences among different pixels using the same radius could be less than 6%. The fill factors are not constant in different pixels because of errors in the process of manufacture and assembly, and the error between model and measured values is less than 3.6%. This work could be useful for stellar calibration and centroid estimation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Systems Biology Platform for Characterizing Regulatory and Metabolic Pathways that Influence and Control Microbial Hydrogen Production

In this project, we created a novel systems biology technology platform and resources that can be used to reverse engineer and analyze gene regulatory networks and metabolic pathways that influence and control microbial hydrogen production. We constructed genome-scale transcriptional regulatory and metabolic models using automated model reconstruction methods, and subsequently integrated the regulatory and metabolic models for computational analysis. We devised novel algorithms for inferring putative regulatory architectures of metabolic pathways based on their topology, and for integrating gene expression information in flux balance analysis (FBA) models towards computing dynamical changes in metabolic objectives. From a metabolic engineering perspective, we improved and applied a method for predicting optimal environmental conditions and genetic modifications towards maximal productions of multiple desired metabolic outputs. We also developed and tested an improved flux balance approach for predicting the response of metabolic networks to genetic perturbations, proving that errors in model predictions are approaching the limit of experimental uncertainty. We also used the metabolic and regulatory models to identify relevant metabolic processes and pathways involved in hydrogen production. Below we provide a summary and details of our achievements.

Collins, James J.↗