Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Digital Twin Framework for PIP-II Linac: AI-Driven Multi-Scale Modeling from Ion Source to 800 MeV

The PIP-II linac will enable >1.2 MW beam power for DUNE, requiring unprecedented operational reliability across its warm front-end (RFQ, MEBT) and five distinct SRF sections operating at 162.5/325/650 MHz. We present a comprehensive digital twin framework uniquely combining a fully differentiable fast beam transport code with neural network surrogates trained on high-fidelity PIC simulations, capturing space charge and nonlinear dynamics beyond traditional envelope codes while achieving 10⁴× speedup at <1% accuracy. End-to-end differentiability enables gradient-based optimization across 500+ parameters simultaneously—previously impossible with conventional tools—while the model incorporates static/dynamic errors and serves as a virtual commissioning platform for diverse hardware integration. The framework facilitates reinforcement learning for pulsed/CW mode transitions, predictive maintenance through anomaly detection, and autonomous tuning algorithm development with real-time execution capability. Validation against physics simulations shows excellent agreement for the front-end, with initial results demonstrating potential for 30% commissioning time reduction and proactive fault mitigation, providing a scalable blueprint for operating next-generation high-intensity accelerators.

Pathak, Abhishek [Fermilab] (ORCID:000000021704208↗

DEMONSTRATION OF A HYBRID INTELLIGENT CONTROL STRATEGY FOR CRITICAL BUILDING HVAC SYSTEMS

Many industrial facilities utilize pressure control gradients to prevent migration of hazardous species from containment areas to occupied zones, often using Proportional-Integral-Derivative (PID) control. Within these facilities, PID control is often inadequate to maintain desired performance due to changing operating conditions. As the goal of the Heating, Ventilation and Air-Conditioning (HVAC) control system is to optimize the pressure gradients and associated flows for the plant, Linear Quadratic Tracking (LQT) provides a time-based approach to guiding plant interactions. However, LQT methods are susceptible to modeling and measurement errors, and therefore a hybrid design using the integration of soft control methods with hard control methods is developed and demonstrated to account for these errors and nonlinearities.

47 OTHER INSTRUMENTATION↗

Inferring Positions of Tumor and Nodes in Stage III Lung Cancer From Multiple Anatomical Surrogates Using Four-Dimensional Computed Tomography

Purpose: To investigate the feasibility of modeling Stage III lung cancer tumor and node positions from anatomical surrogates. Methods and Materials: To localize their centroids, the primary tumor and lymph nodes from 16 Stage III lung cancer patients were contoured in 10 equal-phase planning four-dimensional (4D) computed tomography (CT) image sets. The centroids of anatomical respiratory surrogates (carina, xyphoid, nipples, mid-sternum) in each image set were also localized. The correlations between target and surrogate positions were determined, and ordinary least-squares (OLS) and partial least-squares (PLS) regression models based on a subset of respiratory phases (three to eight randomly selected) were created to predict the target positions in the remaining images. The three-phase image sets that provided the best predictive information were used to create models based on either the carina alone or all surrogates. Results: The surrogate most correlated with target motion varied widely. Depending on the number of phases used to build the models, mean OLS and PLS errors were 1.0 to 1.4 mm and 0.8 to 1.0 mm, respectively. Models trained on the 0%, 40%, and 80% respiration phases had mean ({+-} standard deviation) PLS errors of 0.8 {+-} 0.5 mm and 1.1 {+-} 1.1 mm for models based on all surrogates and carina alone, respectively. For target coordinates with motion >5 mm, the mean three-phase PLS error based on all surrogates was 1.1 mm. Conclusions: Our results establish the feasibility of inferring primary tumor and nodal motion from anatomical surrogates in 4D CT scans of Stage III lung cancer. Using inferential modeling to decrease the processing time of 4D CT scans may facilitate incorporation of patient-specific treatment margins.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

A stochastic model of future extreme temperature events for infrastructure analysis

Applying extreme temperature events for future conditions is not straightforward for infrastructure resilience analyses. This work introduces a stochastic model that fills this gap. The model uses at least 50 years of daily extreme temperature records, climate normals with 10%-90% confidence intervals, and shifts/offsets for increased frequency and intensity of heat wave events. Intensity and frequency are shifted based on surface temperature anomaly from 1850-1900 for 32 models from CMIP6. A case study for Worcester, Massachusetts passed 85% of cases using the two-sided Kolmogorov-Smirnov -value test with 95% confidence for both temperature and duration. Future shifts for several climate scenarios to 2020, 2040, 2060, and 2080 had acceptable errors between the shifted model and 10- and 50-year extreme temperature event thresholds with the largest error being 2.67 degrees C. The model is likely to be flexible enough for other patterns of extreme weather such as extreme precipitation and hurricanes.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Catalytic resonance theory for parametric uncertainty of programmable catalysis

Microkinetic models are useful tools for screening catalytic materials; however, errors in their input parameters can lead to significant uncertainty in model predictions of catalyst performance. Here, in this work, we investigate the impact of linear scaling and Brønsted-Evans-Polanyi relation parametric uncertainty on microkinetic predictions of programmable-catalyst performance. Two case studies are considered: a generic A-to-B prototype reaction and the oxygen evolution reaction (OER). The results show that error-unaware models can accurately predict trends and, for the prototype reaction, values of optimal waveform parameters. The specific model parameters driving output uncertainty are identified via variance-based global sensitivity analysis. However, predictions of dynamic rate enhancement can decrease when uncertainty is propagated into the models. In both cases, we identify operating conditions where the programmable catalyst achieves a rate enhancement of at least one order of magnitude despite parametric uncertainty in the model, supporting programmable catalysis as a viable strategy for exceeding the Sabatier limit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

EPIsembleVis: A geo-visual analysis and comparison of the prediction ensembles of multiple COVID-19 models

In this work, we present EPIsembleVis, a web-based comparative visual analysis tool for evaluating the consistency of multiple COVID-19 prediction models. Our approach analyzes a collection of COVID-19 predictions from different epidemiological models as an ensemble and utilizes two metrics to quantify model performance. These metrics include (a) prediction uncertainty (represented as the dispersion of predictions in each ensemble) and (b) prediction error (calculated by comparing individual model predictions with the recorded data). Through an interactive visual interface, our approach provides a data-driven workflow for (a) selecting and constructing the COVID-19 model prediction ensemble based on the spatiotemporal overlap of available predictions of multiple epidemiological models, (b) quantifying the model performance using both the uncertainty of each model prediction ensemble, and the error of each ensemble member that represents individual model predictions, and (c) visualizing the spatiotemporal variability in the projection performance of individual models using a suite of novel ensemble visualization techniques, such as the data availability map, a spatiotemporal textured-tile calendar, multivariate rose chart, and time-series leaflet glyph. We demonstrate the capability of our ensemble visual interface through a case study that investigates the performance of weekly COVID-19 predictions, which are provided through the COVID-19 Forecast Hub UMass-Amherst Influenza Forecasting Center of Excellence [47] for the United States and United States Territories. The EPIsembleVis tool is implemented using open-source web technologies and adaptive system design, rendering it interoperable with Elasticsearch and Kibana for automatically ingesting COVID-19 predictions from online repositories, and it is generalizable for analyzing worldwide projections from more epidemiological models.

60 APPLIED LIFE SCIENCES↗

CALIBRATING STELLAR POPULATION MODELS WITH MAGELLANIC CLOUD STAR CLUSTERS

Stellar population models are commonly calculated using star clusters as calibrators for those evolutionary stages that depend on free parameters. However, discrepancies exist among different models, even if similar sets of calibration clusters are used. With the aim of understanding these discrepancies, and of improving the calibration procedure, we consider a set of 43 Magellanic Cloud (MC) clusters, taking age and photometric information from the literature. We carefully assign ages to each cluster based on up-to-date determinations, ensuring that these are as homogeneous as possible. To cope with statistical fluctuations, we stack the clusters in five age bins, deriving for each of them integrated luminosities and colors. We find that clusters become abruptly red in optical and optical-infrared colors as they age from {approx}0.6 to {approx}1 Gyr, which we interpret as due to the development of a well-populated thermally pulsing asymptotic giant branch (TP-AGB). We argue that other studies missed this detection because of coarser age binnings. Maraston and Girardi et al. models predict the presence of a populated TP-AGB at {approx}0.6 Gyr, with a correspondingly very red integrated color, at variance with the data; Bruzual and Charlot and Conroy models run within the error bars at all ages. The discrepancy between the synthetic colors of Maraston models and the average colors of MC clusters results from the now obsolete age scale adopted. Finally, our finding that the TP-AGB phase appears to develop between {approx}0.6 and 1 Gyr is dependent on the adopted age scale for the clusters and may have important implications for stellar evolution.

79 ASTRONOMY AND ASTROPHYSICS↗

Understanding Biases in Simulated Cloud Radiative Effects in E3SMv3

This study systematically investigates biases in cloud radiative effects (CREs) within the recently released Energy Exascale Earth System Model version 3 (E3SMv3). Compared to its previous version (E3SMv2), E3SMv3 shows excessively strong shortwave CRE over tropical and subtropical oceans, the Southern Ocean, and the Northern Hemisphere storm tracks, which is primarily caused by an overestimation of optically intermediate low clouds. The model also displays excessive longwave CRE over the Maritime Continent and other tropical deep convection regions, resulting from an overestimation of optically thick high clouds. Implementing the Predicted Particle Properties (P3) scheme for stratiform clouds played the most significant role in these cloud changes. In addition, using a double-moment scheme for convective clouds contributed to the increase in intermediate low clouds and optically thick clouds in tropical deep convection regions. Error metrics for total cloud amount (E TCA ), cloud properties (E ctp-τ ), and cloud properties weighted by their SW and LW radiative impacts (E SW and E LW ) indicate that E3SMv3's ability to reproduce observed cloud radiative effect of low, middle, and high clouds has not been improved compared to E3SMv2. Nevertheless, the performance of E3SMv3 remains well within the spread of CMIP6 models, with E SW and E LW values smaller than those in most CMIP6 models. This study underscores the importance of integrating diverse satellite observations for robust cloud evaluation and using cloud-radiation relationships as consistency check for model errors. It suggests that further model developments focus on improving cloud microphysics and their interactions with radiation.

Environmental sciences↗

Ch3MS-RF: a random forest model for chemical characterization and improved quantification of unidentified atmospheric organics detected by chromatography–mass spectrometry techniques

Abstract. The chemical composition of ambient organic aerosols plays a critical role in driving their climate and health-relevant properties and holds important clues to the sources and formation mechanisms of secondary aerosol material. In most ambient atmospheric environments, this composition remains incompletely characterized, with the number of identifiable species consistently outnumbered by those that have no mass spectral matches in the literature or the National Institute of Standards and Technology/National Institutes of Health/Environmental Protection Agency (NIST/NIH/EPA) mass spectral databases, making them nearly impossible to definitively identify. This creates significant challenges in utilizing the full analytical capabilities of techniques which separate and generate spectra for complex environmental samples. In this work, we develop the use of machine learning techniques to quantify and characterize novel, or unidentifiable, organic material. This work introduces Ch3MS-RF (Chemical Characterization by Chromatography–Mass Spectrometry Random Forest Modeling), an open-source, R-based software tool, for efficient machine-learning-enabled characterization of compounds separated in chromatography–mass spectrometry applications but not identifiable by comparison to mass spectral databases. A random forest model is trained and tested on a known 130 component representative external standard to predict the response factors of novel environmental organics based on position in volatility–polarity space and mass spectrum, enabling the reproducible, efficient, and optimized quantification of novel environmental species. Quantification accuracy on a reserved 20 % test set randomly split from the external standard compound list indicates that random forest modeling significantly outperforms the commonly used methods in both precision and accuracy, with a median response factor percent error of −2 %, for modeled response factors, compared to > 15 %, for typically used proxy assignment-based methods. Chemical properties modeling, evaluated on the same reserved 20 % test set and an extrapolation set of species identified in ambient organic aerosol samples collected in the Amazon rainforest, also demonstrate robust performance. Extrapolation set property prediction mean absolute errors for carbon number, oxygen to carbon ratio (O : C), average carbon oxidation state (OSc‾), and vapor pressure are 1.8, 0.15, 0.25, and 1.0 (log(atm)), respectively. Extrapolation set out-of-sample R2 for all properties modeled are above 0.75, with the exception of vapor pressure. While predictive performance for vapor pressure is less robust compared to the other chemical properties modeled, random-forest-based modeling was significantly more accurate than other commonly used methods of vapor pressure prediction, decreasing the mean vapor pressure prediction error to 0.24 (log(atm)) from 0.55 (log(atm)) (chromatography-based vapor pressure prediction) and 1.2 (log(atm)) (chemical formula-based vapor pressure prediction). The random forest model significantly advances an untargeted analysis of the full scope of chemical speciation yielded by two-dimensional gas chromatography (GCxGC-MS) techniques and can be applied to gas chromatography coupled with electron ionization mass spectrometry (GC-MS) as well. It enables the accurate estimation of key chemical properties commonly utilized in the atmospheric chemistry community, which may be used to more efficiently identify important tracers for further individual analysis and to characterize compound populations uniquely formed under specific ambient conditions.

54 ENVIRONMENTAL SCIENCES↗

Transfer learning for analysis of collective and non-collective Thomson scattering spectra

Thomson scattering (TS) diagnostics provide reliable, minimally perturbative measurements of fundamental plasma parameters, such as electron density (⁠n e ) and electron temperature (⁠T e ⁠). Deep neural networks can provide accurate estimates of ⁠n e and T e when conventional fitting algorithms may fail, such as when TS spectra are dominated by noise, or when fast analysis is required for real-time operation. Although deep neural networks typically require large training sets, transfer learning can improve model performance on a target task with limited data by leveraging pre-trained models from related source tasks, where select hidden layers are further trained using target data. We present five architecturally diverse deep neural networks, pre-trained on synthetic TS data and adapted for experimentally measured TS data, to evaluate the efficacy of transfer learning in estimating n e and T e in both the collective and non-collective scattering regimes. We evaluate errors in n e and T e estimates as a function of training set size for models trained with and without transfer learning, and we observe decreases in model error from transfer learning when the training set contains ≲ 200 experimentally measured spectra.

Artificial neural networks↗

A cross-dimensional analysis of data-driven short-term load forecasting methods with large-scale smart meter data

Electricity load forecasting is essential to utility operation and power grid stability. A wide spectrum of data-driven methods, ranging from linear regression models to more recent deep learning models have been adopted to forecast electric load over the years. However, there still lacks a holistic evaluation of the applicability of conventional statistical and machine learning based algorithms with respect to different temporal and spatial scopes, computational requirements, and sensitivity of model-tuning. Enabled by a large-scale electricity load profile dataset of over 40,000 residential customers in a utility region, we conducted a cross-dimensional analysis of data-driven load forecasting methods. Three regression-based and seven deep learning algorithms with different model configurations were evaluated in terms of their overall and peak load prediction accuracy, and training burdens, across spatial aggregation levels ranging from the transformer, feeder, substation, to neighborhood. We found, first, the load forecasting accuracy is constrained by a predictability boundary, influenced by the forecasting horizon and spatial aggregation level. Specifically, RandomForest, XGBoost, TFT, TSMixer, and TiDE models achieved less than 10 % prediction error for up to 96-h ahead forecasting for district, substation, and feeder levels, while other models struggle at long-horizon predictions; Second, for winter and summer peak load dates, most models were able to predict the peak demand timing within ± 1 h, but the prediction percentage error varied by models, with TFT and TiDE models being the top performers; Third, models with similar prediction accuracy can differ in training burden by an order of magnitude. Therefore, choosing model configurations that balance prediction performance and computational resource is an important practical consideration for large-scale deployment of the machine learning based load forecasting. The outcome of this study can guide researchers and practitioners to choose the proper load forecasting algorithms based on their problem scope, required accuracy, and available resources. The predictability boundary can serve as a benchmark for electricity load forecasting problems with new algorithms and datasets.

Li, Han↗

Experimental and modeling study on char combustion

In this study, on the basis of experimental verifications with an FTIR online measurement system, theoretical calculations by using the strict continuous-film model were first compared with those by the simple single-film model that is still widely used in mathematical modeling of pulverized coal flames. The results indicated that the single-film model has some significant errors in its predictions of the ignition temperature and the combustion following ignition and hence should have some restrictions on its application. Then an improved char combustion model has been presented, taking into consideration the influence of the finite-rate heterogeneous reduction and oxidation reactions. This model gives the explicit algebraic expressions for the overall rate of combustion, the surface temperature of the particle, and the gas temperature at the flame sheet. Compared with the single-film model, predictions by the present model were in much better agreement with those predicted by the continuous-film model and the experimental data. The novel model is also much easier to be integrated into the comprehensive computing codes for industrial pulverized coal flame than the continuous-film model. 21 refs., 14 figs.

01 COAL, LIGNITE, AND PEAT↗

Impact of Lateral Flow on Surface Water and Energy Budgets over the Southern Great Plains – A Modeling Study

As we see the horizontal grid spacing decrease, treatment of hydrologic processes in land surface models, such as the lateral flow of surface and subsurface flow, need to be explicitly represented. Unlike previous studies that mainly focused on the mountainous regions, in this study the offline WRF-Hydro model is employed to study the impact of lateral flow on soil moisture and energy fluxes over the relatively flat southern Great Plains (SGP). The vast amount of measurements over the SGP provide an unique opportunity to assess the model behavior. In addition, newly developed land surface properties and input forcing are ingested into the model, in an attempt to reduce uncertainties associated with the initial and boundary forcing and help to identify model deficiencies. Our results show that the more realistic inputs (parameters, soil types, forcing) lead to larger underestimation of latent heat flux and dry bias, indicating the existence of model structural uncertainty (embedded errors) in WRF-Hydro that need to be characterized to inform future model development efforts. Including lateral flow processes partly mitigates the model deficiencies in representing hydrologic processes and alleviates the dry bias. In particular, both surface and subsurface lateral flow increase soil moisture mainly over the lower elevations, except that subsurface flow also affects soil moisture over steeper terrains. Additional simulations are performed to assess the effect of routing resolution on model results. When LSM resolution is high, noticeable differences in soil moisture are produced between different routing resolutions especially over steep terrain. Whereas when LSM resolution is coarse, differences between routing resolutions become negligible, especially over flat terrain.

54 ENVIRONMENTAL SCIENCES↗

SAFIRE : Scalable and Accurate Fault Injection for Parallel Multi-threaded Applications

The software SAFIRE implements a fault injection tool to evaluate the impact of soft errors on parallel, multi-threaded applications. It implements instruction-level fault models that emulate soft errors by flipping bits in the register operands of executed machine instructions. SAFIRE is based on the LLVM compiler and utilizes novel techniques to optimize instruction instrumentation and fault injection. By detailed measurements, SAFIRE is multiple times faster than other state-of-the-art fault injection techniques, while having the same accuracy.

Georgakoudis, Giorgis↗

Synthetic method of analogues for emerging infectious disease forecasting

The Method of Analogues (MOA) has gained popularity in the past decade for infectious disease forecasting due to its non-parametric nature. In MOA, the local behavior observed in a time series is matched to the local behaviors of several historical time series. The known values that directly follow the historical time series that best match the observed time series are used to calculate a forecast. This non-parametric approach leverages historical trends to produce forecasts without extensive parameterization, making it highly adaptable. However, MOA is limited in scenarios where historical data is sparse. This limitation was particularly evident during the early stages of the COVID-19 pandemic, where the emerging global epidemic had little-to-no historical data. In this work, we propose a new method inspired by MOA, called the Synthetic Method of Analogues (sMOA). sMOA replaces historical disease data with a library of synthetic data that describe a broad range of possible disease trends. This model circumvents the need to estimate explicit parameter values by instead matching segments of ongoing time series data to a comprehensive library of synthetically generated segments of time series data. We demonstrate that sMOA has competitive performance with state-of-the-art infectious disease forecasting models, out-performing 78% of models from the COVID-19 Forecasting Hub in terms of averaged Mean Absolute Error and 76% of models from the COVID-19 Forecasting Hub in terms of averaged Weighted Interval Score. Additionally, we introduce a novel uncertainty quantification methodology designed for the onset of emerging epidemics. Developing versatile approaches that do not rely on historical data and can maintain high accuracy in the face of novel pandemics is critical for enhancing public health decision-making and strengthening preparedness for future outbreaks.

97 MATHEMATICS AND COMPUTING↗

Final Report Forensics City Transport 2012

This project was to demonstrate practical Monte Carlo transport calculational methods applied to city models in prompt forensics. Typically 1 source gamma ray in ~10 18 is physically detected in most real world scenarios for this class of problems. Major factors are detector solid angles at ~ km distances, building and air attenuation, as well as huge variations in source intensities. We used the world-wide standard for transport calculations, MCNP, developed at LANL. We used ARA supplied city models used in consequence management. One indication of the extreme difficulty of these problems is that the huge numbers were larger than the space allotted by the code developers and were output as “*********”. (LANL was very helpful in resolving multiple issues we encountered like this.) Hardware memory issues also needed to be resolved. Calculational success was achieved in the simpler WDC model by a combination of variance reduction, voxelized geometry eliminated the mcnp geometry errors in the NYC model, eliminating peripheral buildings, and convolution of the source terms.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Computer-Aided Construction of Chemical Kinetic Models

The combustion chemistry of even simple fuels can be extremely complex, involving hundreds or thousands of kinetically significant species. The most reasonable way to deal with this complexity is to use a computer not only to numerically solve the kinetic model, but also to construct the kinetic model in the first place. Because these large models contain so many numerical parameters (e.g. rate coefficients, thermochemistry) one never has sufficient data to uniquely determine them all experimentally. Instead one must work in “predictive” mode, using theoretical rather than experimental values for many of the numbers in the model, and as appropriate refining the most sensitive numbers through experiments. Predictive chemical kinetics is exactly what is needed for computer-aided design of combustion systems based on proposed alternative fuels, particularly for early assessment of the value and viability of proposed new fuels before those fuels are commercially available. This project was aimed at making accurate predictive chemical kinetics practical; this is a challenging goal which requires a range of science advances. The project spanned a wide range from quantum chemical calculations on individual molecules and elementary-step reactions, through the development of improved rate/thermo calculation procedures, the creation of algorithms and software for constructing and solving kinetic simulations, the invention of methods for model-reduction while maintaining error control, and finally comparisons with experiment. Many of the parameters in the models were derived from quantum chemistry calculations, and the models were compared with experimental data measured in our lab or in collaboration with others.

97 MATHEMATICS AND COMPUTING↗

Modeling a Miniature Voitenko-Like Explosively-Driven Shock Tube Using FLAG

Using the FLAG hydrocode, hypervelocity plasma jets observed in miniature explosively–driven shock tube experiments have been modeled with a relative error in velocity of less than 5% (a reduction from previous attempts which yielded errors of 37%). This suggests that FLAG may be well-suited to model HE systems involving the acceleration of gases through complex crack systems in HE devices: A phenomenon not accurately captured using current modeling capabilities. The Eulerian hydrocode model presented here leverages AMR to reduce computational cost and, importantly, it was found that mesh resolution and model geometry each significantly affected the average jet velocity. The model and the results are detailed here together with comments on challenges during its development and avenues for future work.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗