Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Impact of numerical choices on water conservation in the E3SM Atmosphere Model Version 1 (EAM V1)

The conservation of total water is an important numerical feature for global Earth system models. Even small conservation problems in the water budget can lead to systematic errors in century-long simulations for sea level rise projection. This study quantifies and reduces various sources of water conservation error in the atmosphere component of the Energy Exascale Earth System Model. Several sources of water conservation error have been identified during the development of the version 1 (V1) model. The largest errors result from the numerical coupling between the resolved dynamics and the parameterized sub-grid physics. A hybrid coupling using different methods for fluid dynamics and tracer transport provides a reduction of water conservation error by a factor of 50 at 1° horizontal resolution as well as consistent improvements at other resolutions. The second largest error source is the use of an overly simplified relationship between the surface moisture flux and latent heat flux at the interface between the host model and the turbulence parameterization. This error can be prevented by applying the same (correct) relationship throughout the entire model. Two additional types of conservation error that result from correcting the surface moisture flux and clipping negative water concentrations can be avoided by using mass-conserving fixers. With all four error sources addressed, the water conservation error in the V1 model is negligible and insensitive to the horizontal resolution. The associated changes in the long-term statistics of the main atmospheric features are small. A sensitivity analysis is carried out to show that the magnitudes of the conservation errors decrease strongly with temporal resolution but increase with horizontal resolution. The increased vertical resolution in the new model results in a very thin model layer at the Earth’s surface, which amplifies the conservation error associated with the surface moisture flux correction. We note that for some of the identified error sources, the proposed fixers are remedies rather than solutions to the problems at their roots. Future improvements in time integration would be beneficial for this model.

Zhang, Kai↗

Development of a video image-based QA system for the positional accuracy of dynamic tumor tracking irradiation in the Vero4DRT system

Purpose: To develop and evaluate a new video image-based QA system, including in-house software, that can display a tracking state visually and quantify the positional accuracy of dynamic tumor tracking irradiation in the Vero4DRT system. Methods: Sixteen trajectories in six patients with pulmonary cancer were obtained with the ExacTrac in the Vero4DRT system. Motion data in the cranio–caudal direction (Y direction) were used as the input for a programmable motion table (Quasar). A target phantom was placed on the motion table, which was placed on the 2D ionization chamber array (MatriXX). Then, the 4D modeling procedure was performed on the target phantom during a reproduction of the patient’s tumor motion. A substitute target with the patient’s tumor motion was irradiated with 6-MV x-rays under the surrogate infrared system. The 2D dose images obtained from the MatriXX (33 frames/s; 40 s) were exported to in-house video-image analyzing software. The absolute differences in the Y direction between the center of the exposed target and the center of the exposed field were calculated. Positional errors were observed. The authors’ QA results were compared to 4D modeling function errors and gimbal motion errors obtained from log analyses in the ExacTrac to verify the accuracy of their QA system. The patients’ tumor motions were evaluated in the wave forms, and the peak-to-peak distances were also measured to verify their reproducibility. Results: Thirteen of sixteen trajectories (81.3%) were successfully reproduced with Quasar. The peak-to-peak distances ranged from 2.7 to 29.0 mm. Three trajectories (18.7%) were not successfully reproduced due to the limited motions of the Quasar. Thus, 13 of 16 trajectories were summarized. The mean number of video images used for analysis was 1156. The positional errors (absolute mean difference + 2 standard deviation) ranged from 0.54 to 1.55 mm. The error values differed by less than 1 mm from 4D modeling function errors and gimbal motion errors in the ExacTrac log analyses (n = 13). Conclusions: The newly developed video image-based QA system, including in-house software, can analyze more than a thousand images (33 frames/s). Positional errors are approximately equivalent to those in ExacTrac log analyses. This system is useful for the visual illustration of the progress of the tracking state and for the quantification of positional accuracy during dynamic tumor tracking irradiation in the Vero4DRT system.

60 APPLIED LIFE SCIENCES↗

Machine Learning-Driven Conservative-to-Primitive Conversion in Hybrid Piecewise Polytropic and Tabulated Equations of State

We present a novel machine learning (ML)-based method to accelerate conservative-to-primitive inversion, focusing on hybrid piecewise polytropic and tabulated equations of state. Traditional root-finding techniques are computationally expensive, particularly for large-scale relativistic hydrodynamics simulations. To address this, we employ feedforward neural networks (NNC2PS and NNC2PL), trained in PyTorch (2.0+) and optimized for GPU inference using NVIDIA TensorRT (8.4.1), achieving significant speedups with minimal accuracy loss. The NNC2PS model achieves 𝐿 1 and 𝐿 ∞ errors of 4.54 × 10 −7 and 3.44 × 10−6, respectively, while the NNC2PL model exhibits even lower error values. TensorRT optimization with mixed-precision deployment substantially accelerates performance compared to traditional root-finding methods. Specifically, the mixed-precision TensorRT engine for NNC2PS achieves inference speeds approximately 400 times faster than a traditional single-threaded CPU implementation for a dataset size of 1,000,000 points. Ideal parallelization across an entire compute node in the Delta supercomputer (dual AMD 64-core 2.45 GHz Milan processors and 8 NVIDIA A100 GPUs with 40 GB HBM2 RAM and NVLink) predicts a 25-fold speedup for TensorRT over an optimally parallelized numerical method when processing 8 million data points. Moreover, the ML method exhibits sub-linear scaling with increasing dataset sizes. We release the scientific software developed, enabling further validation and extension of our findings. By exploiting the underlying symmetries within the equation of state, these findings highlight the potential of ML, combined with GPU optimization and model quantization, to accelerate conservative-to-primitive inversion in relativistic hydrodynamics simulations.

conservative-to-primitive conversion↗

NEON AOP foliar trait maps, maps of model uncertainty estimates, and conifer map, East River, CO 2018

This data package contains mapped trait estimates and their uncertainties, and conifer map, for the National Ecological Observatory Network's Airborne Observation Platform survey data acquired over the Upper East River, Colorado in 2018. For full details, please see associated reference. in brief, trait models were developed independently for needle and non-needle leaf species using partial least squares regression (PLSR) using ground data from additional datasets: doi:10.15485/1618130, doi:10.15485/1618132, and doi:10.15485/1631278, merged with extracted spectral data from doi:10.15485/1618131. We separated vegetated pixels into needle and non-needle classes in order to generate a classification map based on the spectral differences between these leaf types (conifer.tif). We trained a deep learning model with custom architecture, detailed in Chadwick et al. In Press. The model performed with 0.998 true positive rate and 0.982 true negative rate, with ‘positives’ being non-needle identification. We then utilized PLSR to generate models of foliar traits for each leaf type. So that we could also map uncertainty in these predictions, we generated ten different models for needle and non-needle leaf species using different testing holdout sets of discrete sites. Each of these models was developed with a 100-fold cross validation procedure that utilized a 70% training set and 30% validation set with each fold, and then assessed based on the 10% of testing sites that were not included in that model’s development. The mean predicted value across the 10 models is used for the trait estimate in each pixel across the study area. The models are applied according to the leaf type designation in the conifer.tif map. The errors are the standard deviation across the 10 different models developed, with high error suggesting instability in model prediction and areas where values may not be reliable for ecological inference. These maps are only applied to areas with a NDVI > 0.5 to exclude non-vegetated areas. Shade masks could be applied to these data (doi:10.15485/1618131), but have not been for this data package. These data are also available on Google Earth Engine: https://code.earthengine.google.com/?asset=users/kdc/ER_NEON

54 ENVIRONMENTAL SCIENCES↗

Impact of numerical choices on water conservation in the E3SM Atmosphere Model version 1 (EAMv1)

Abstract. The conservation of total water is an important numerical feature for global Earth system models. Even small conservation problems in the water budget can lead to systematic errors in century-long simulations. This study quantifies and reduces various sources of water conservation error in the atmosphere component of the Energy Exascale Earth System Model. Several sources of water conservation error have been identified during the development of the version 1 (V1) model. The largest errors result from the numerical coupling between the resolved dynamics and the parameterized sub-grid physics. A hybrid coupling using different methods for fluid dynamics and tracer transport provides a reduction of water conservation error by a factor of 50 at 1∘ horizontal resolution as well as consistent improvements at other resolutions. The second largest error source is the use of an overly simplified relationship between the surface moisture flux and latent heat flux at the interface between the host model and the turbulence parameterization. This error can be prevented by applying the same (correct) relationship throughout the entire model. Two additional types of conservation error that result from correcting the surface moisture flux and clipping negative water concentrations can be avoided by using mass-conserving fixers. With all four error sources addressed, the water conservation error in the V1 model becomes negligible and insensitive to the horizontal resolution. The associated changes in the long-term statistics of the main atmospheric features are small. A sensitivity analysis is carried out to show that the magnitudes of the conservation errors in early V1 versions decrease strongly with temporal resolution but increase with horizontal resolution. The increased vertical resolution in V1 results in a very thin model layer at the Earth's surface, which amplifies the conservation error associated with the surface moisture flux correction. We note that for some of the identified error sources, the proposed fixers are remedies rather than solutions to the problems at their roots. Future improvements in time integration would be beneficial for V1.

54 ENVIRONMENTAL SCIENCES↗

Automatic building energy model development and debugging using large language models agentic workflow

Building energy modeling (BEM) is a complex process that demands significant time and expertise, limiting its broader application in building design and operations. While Large Language Models (LLMs) agentic workflow have facilitated complex engineering processes, their application in BEM has not been specifically explored. This paper investigates the feasibility of automating BEM using LLM agentic workflow. Here, we developed a generic LLM-planning-based workflow that takes a building description as input and generates an error-free EnergyPlus building energy model. Our robust workflow includes four core agents: 1) Building Description Pre-Processing, 2) IDF Object Information Extraction, 3) Single IDF Object Generator Suite, and 4) IDF Debugging Agent. These agents divide the complex tasks into manageable sub-steps, enabling LLMs to generate accurate and reliable results at each stage. The case study demonstrates the successful translation of a building description into an error-free EnergyPlus model for the iUnit modular building at the National Renewable Energy Laboratory. The effectiveness of our workflow surpasses: 1) naive prompt engineering, 2) other LLM-based workflows, and 3) manual modeling, in terms of accuracy, reliability, and time efficiency. The paper concludes with a discussion on the interplay between foundational models and LLM agent planning design, advocating for the use of fine-tuned, specialized models to advance this field.

97 MATHEMATICS AND COMPUTING↗

A Reduced-Order Model of Transport Phenomena for Power Plant Simulation

A reduced-order model based on proper orthogonal decomposition (POD) has been developed to simulate transient two- and three-dimensional isothermal and non-isothermal flows in a fluidized bed. Reduced-order models of void fraction, gas and solids temperatures, granular energy, and z-direction gas and solids velocity have been added to the previous version of the code. These algorithms are presented and their implementation is discussed. Verification studies are presented for each algorithm. A number of methods to accelerate the computations performed by the reduced-order model are presented. The errors associated with each acceleration method are computed and discussed. Using a combination of acceleration methods, a two-dimensional isothermal simulation using the reduced-order model is shown to be 114 times faster than using the full-order model. In the pursue of achieving the objectives of the project and completing the tasks planned for this program, several unplanned and unforeseen results, methods and studies have been generated. These additional accomplishments are also presented and they include: (1) a study of the effect of snapshot sampling time on the computation of the POD basis functions, (2) an investigation of different strategies for generating the autocorrelation matrix used to find the POD basis functions, (3) the development and implementation of a bubble detection and tracking algorithm based on mathematical morphology, (4) a method for augmenting the proper orthogonal decomposition to better capture flows with discontinuities, such as bubbles, and (5) a mixed reduced-order/full-order model, called point-mode proper orthogonal decomposition, designed to avoid unphysical due to approximation errors. The limitations of the proper orthogonal decomposition method in simulating transient flows with moving discontinuities, such as bubbling flows, are discussed and several methods are proposed to adapt the method for future use.

01 COAL, LIGNITE, AND PEAT↗

Thermal Expansion Calculation of Silicate Glasses at 210°C, Based on the Systematic Analysis of Global Databases

Thermal expansion data for more than 5500 compositions of silicate glasses were analyzed statistically. These data were gathered from the scientific literature, summarized in SciGlass© 6.5, a new version of the well known glass property database and information system. The analysis resulted in a data reduction from 5500 glasses to a core of 900, where the majority of the published values is located within commercial glass composition ranges and obtained over the temperature range 20 to 500°C. A multiple regression model for the linear thermal expansivity at 210°C, including error formula and detailed application limits, was developed based on those 900 core data from over 100 publications. The accuracy of the model predictions is improved about twice compared to previous work because systematic errors from certain laboratories were investigated and corrected. The standard model error (precision) was 0.37 ppm/K, with R² = 0.985. The 95% confidence interval for individual predictions largely depends on the glass composition of interest and the composition uncertainty. The model is valid for commercial silicate glasses containing Na2O, CaO, Al2O3, K2O, MgO, B2O3, Li2O, BaO, ZrO2, TiO2, ZnO, PbO, SrO, Fe2O3, CeO2, fining agents, and coloring and de-coloring components. In addition, a special model for ultra-low expansion glasses in the system SiO2-TiO2 is presented. The calculations allow optimizing the time-temperature cooling schedule of glassware, the development of glass sealing materials, and the design of specialty glass products that are exposed to varying temperatures.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

PREDICTING CME EJECTA AND SHEATH FRONT ARRIVAL AT L1 WITH A DATA-CONSTRAINED PHYSICAL MODEL

We present a method for predicting the arrival of a coronal mass ejection (CME) flux rope in situ, as well as the sheath of solar wind plasma accumulated ahead of the driver. For faster CMEs, the front of this sheath will be a shock. The method is based upon geometrical separate measurement of the CME ejecta and sheath. These measurements are used to constrain a drag-based model, improved by including both a height dependence and accurate de-projected velocities. We also constrain the geometry of the model to determine the error introduced as a function of the deviation of the CME nose from the Sun–Earth line. The CME standoff-distance in the heliosphere fit is also calculated, fit, and combined with the ejecta model to determine sheath arrival. Combining these factors allows us to create predictions for both fronts at the L1 point and compare them against observations. We demonstrate an ability to predict the sheath arrival with an average error of under 3.5 hr, with an rms error of about 1.58 hr. For the ejecta the error is less than 1.5 hr, with an rms error within 0.76 hr. We also discuss the physical implications of our model for CME expansion and density evolution. We show the power of our method with ideal data and demonstrate the practical implications of having a permanent L5 observer with space weather forecasting capabilities, while also discussing the limitations of the method that will have to be addressed in order to create a real-time forecasting tool.

79 ASTRONOMY AND ASTROPHYSICS↗

Simplified calculation of the area specific impedance for solid-state battery design

Simplified algebraic area specific impedance (ASI) correlations have been developed for solid-state composite battery electrodes made of a single ion conducting electrolyte, conductive additive, and intercalation active material. Two ASI expressions were developed, one for short times ( i.e. , pulsed power operation) and another for the pseudo steady state operation (i.e., sustained discharge for energy estimation). A full electrochemical model based on porous electrode theory was developed to examine the accuracy of the simplified ASI expressions. The simplified expressions agree favorably with full model results over a wide range of parameters (i.e. , electrode thicknesses, electrolyte conductivities, solid-state diffusion coefficients, specific surface areas, etc.) and conditions (i.e. , C-rates, states of charge, and pulse times). Under most conditions, the error between the full model and the correlations is well below 7 %. Higher errors were observed for the pseudo steady state expression at high/ low states of charge where the assumption of uniform reaction distributions loses validity. Here, the short time ASI has higher error at low states of charge due to the nonlinearity of the open circuit voltage equation, which is assumed linear in the formulation of the simplified algebraic expression.

25 ENERGY STORAGE↗

Automatically generated model for light alkene combustion

Light alkenes are common combustion intermediates for a variety of fuels. Therefore, understanding their oxidation and pyrolysis chemistry is key to building detailed mechanisms for heavier fuels. This work was focused on the development and evaluation of a detailed kinetic mechanism suitable for the combustion of light alkenes up to C 4 without the use of tuned parameters, instead, the parameter values come from first principles or direct measurements. The generated mechanism accurately estimates the laminar burning velocity (S u ) and ignition delay time (IDT) of light alkenes available in the literature, which represent fundamental combustion properties at a wide range of conditions. Because each parameter is thought to have a physically realistic value, not tuned to these measurements, the new model could be used as a sub-mechanism in models for other applications. The reaction network was generated with the open-source Reaction Mechanism Generator (RMG) software. Sensitivity analyses were performed under wide ranges of temperatures and pressures, allowing for the identification of the most impactful species and reactions. Based on these, a comprehensive thermochemistry database, including calculations on 550 molecules performed in this work at the CBS-QB3 level of theory, and a kinetic library, including theoretically-derived reaction rates retrieved from the literature, were built and used in the mechanism generation. The developed mechanism was compared against several existing detailed kinetic mechanisms for ethene, propene, 1-butene, 2-butene, and isobutene. Here, the newly generated model is the most accurate among the ones analyzed, in terms of fractional bias and normalized mean square error. Hence, this new model was used to analyze the chemistry of alkene combustion. Key rate coefficients were compared, to identify the cause of deviations between the models and possible areas for further improvements.

09 BIOMASS FUELS↗

Multi-fidelity stochastic collocation method for computation of statistical moments

We present an efficient numerical algorithm to approximate the statistical moments of stochastic problems, in the presence of models with different fidelities. The method extends the multi-fidelity approximation method developed in . By combining the efficiency of low-fidelity models and the accuracy of high-fidelity models, our method exhibits fast convergence with a limited number of high-fidelity simulations. We establish an error bound of the method and present several numerical examples to demonstrate the efficiency and applicability of the multi-fidelity algorithm.

97 MATHEMATICS AND COMPUTING↗

A Hybrid Demand Response Simulator Version 1.0

A hybrid demand response simulator is developed to test different control algorithms for centralized and distributed demand response (DR) programs in a small distribution power grid. The HDRS is designed to model a wide variety of DR services such as peak having, load shifting, arbitrage, spinning reserves, load following, regulation, emergency load shedding, etc. The HDRS does not model the dynamic behaviors of the loads, rather, it simulates the load scheduling and dispatch process. The load models include TCAs (water heaters, air conditioners, refrigerators, freezers, etc) and non-TCAs (lighting, washer, dishwasher, etc.) The ambient temperature changes, thermal resistance, capacitance, and the unit control logics can be modeled for TCA loads. The use patterns of the non-TCA can be modeled by probability of use and probabilistic durations. Some of the communication network characteristics, such as delays and errors, can also be modeled. Most importantly, because the simulator is modular and greatly simplified the thermal models for TCA loads, it is very easy and fast to be used to test and validate different control algorithms in a simulated environment.

Lu, Ning↗

Evaluating Tropical Precipitation Relations in CMIP6 Models with ARM Data

Abstract A set of diagnostics based on simple, statistical relationships between precipitation and the thermodynamic environment in observations is implemented to assess phase 6 of the Coupled Model Intercomparison Project (CMIP6) model behavior with respect to precipitation. Observational data from the Atmospheric Radiation Measurement (ARM) permanent field observational sites are augmented with satellite observations of precipitation and temperature as an observational baseline. A robust relationship across observational datasets between column water vapor (CWV) and precipitation, in which conditionally averaged precipitation exhibits a sharp pickup at some critical CWV value, provides a useful convective onset diagnostic for climate model comparison. While a few models reproduce an appropriate precipitation pickup, most models begin their pickup at too low CWV and the increase in precipitation with increasing CWV is too weak. Convective transition statistics compiled in column relative humidity (CRH) partially compensate for model temperature biases—although imperfectly since the temperature dependence is more complex than that of column saturation. Significant errors remain in individual models and weak pickups are generally not improved. The conditional-average precipitation as a function of CRH can be decomposed into the product of the probability of raining and mean precipitation during raining times (conditional intensity). The pickup behavior is primarily dependent on the probability of raining near the transition and on the conditional intensity at higher CRH. Most models roughly capture the CRH dependence of these two factors. However, compensating biases often occur: model conditional intensity that is too low at a given CRH is compensated in part by excessive probability of precipitation.

54 ENVIRONMENTAL SCIENCES↗

Revisions to the SRCC Rating Process for Solar Water Heaters: Preprint

In the United States, annual performance ratings for solar water heaters are computed with component-based simulation models driven by typical meteorological year weather and specified water draw. Changes in the process are being implemented to enhance credibility through increased transparency and accuracy. Changes to the process include using a graphical rather than text-based model-buildingtool, performing analytical tests on all components and systems, checking energy balances on every component, loop, and system at every time step, comparing the results to detect outliers and potential errors, and documenting the modeling process in detail. Examples of changes in ratings are shown, along with analytical and comparative testing results.

14 SOLAR ENERGY↗

Three-parameter error analysis method based on rotating coordinates in rotating birefringent polarizer system

We propose error analysis using a rotating coordinate system with three parameters of linearly polarized light—incidence angle, azimuth angle on the front surface, and angle between the incidence and vibration planes—and demonstrate the method on a rotating birefringent prism system. The transmittance and angles are calculated plane-by-plane using a birefringence ellipsoid model and the final transmitted intensity equation is deduced. The effects of oblique incidence, light interference, beam convergence, and misalignment of the rotation and prism axes are discussed. We simulate the entire error model using MATLAB and conduct experiments based on a built polarimeter. The simulation and experimental results are consistent and demonstrate the rationality and validity of this method.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Global Horizontal Irradiance Clear Sky Models: Implementation and Analysis

Clear sky models estimate the terrestrial solar radiation under a cloudless sky as a function of the solar elevation angle, site altitude, aerosol concentration, water vapor, and various atmospheric conditions. This report provides an overview of a number of global horizontal irradiance (GHI) clear sky models from very simple to complex. Validation of clear-sky models requires comparison of model results to measured irradiance during clear-sky periods. To facilitate validation, we present a new algorithm for automatically identifying clear-sky periods in a time series of GHI measurements. We evaluate the performance of selected clear-sky models using measured data from 30 different sites, totaling about 300 site-years of data. We analyze the variation of these errors across time and location. In terms of error averaged over all locations and times, we found that complex models that correctly account for all the atmospheric parameters are slightly more accurate than other models, but, primarily at low elevations, comparable accuracy can be obtained from some simpler models. However, simpler models often exhibit errors that vary with time of day and season, whereas the errors for complex models vary less over time.

99 GENERAL AND MISCELLANEOUS↗