Search NASA⌕ Search

SEARCH · Search NASA

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Autonomous Correction of Sensor Data Applied to Building Technologies Utilizing Statistical Processing Methods

Autonomous detection and correction of potentially missing or corrupt sensor data is a essential concern in building technologies since data availability and correctness is necessary to develop accurate software models for instrumented experiments. Therefore, this paper aims to address this problem by using statistical processing methods including: (1) least squares; (2) maximum likelihood estimation; (3) segmentation averaging; and (4) threshold based techniques. Application of these validation schemes are applied to a subset of data collected from Oak Ridge National Laboratory s (ORNL) ZEBRAlliance research project, which is comprised of four single-family homes in Oak Ridge, TN outfitted with a total of 1,218 sensors. The focus of this paper is on three different types of sensor data: (1) temperature; (2) humidity; and (3) energy consumption. Simulations illustrate the threshold based statistical processing method performed best in predicting temperature, humidity, and energy data.

building technologies.↗

SWAT Ungauged: Hydrological Budget and Crop Yield Predictions in the Upper Mississippi River Basin

Physically based, distributed hydrologic models are increasingly used in assessments of water resources, best management practices, and climate and land use changes. Model performance evaluation in ungauged basins is an important research topic. In this study, we propose a framework for developing Soil and Water Assessment Tool (SWAT) input data, including hydrography, terrain, land use, soil, tile, weather, and management practices, for the Upper Mississippi River basin (UMRB). We also present a performance evaluation of SWAT hydrologic budget and crop yield simulations in the UMRB without calibration. The uncalibrated SWAT model ably predicts annual streamflow at 11 USGS gauges and crop yield at a four-digit hydrologic unit code (HUC) scale. For monthly streamflow simulation, the performance of SWAT is marginally poor compared with that of annual flow, which may be due to incomplete information about reservoirs and dams within the UMRB. Further validation shows that SWAT can predict base flow contribution ratio reasonably well. Compared with three calibrated SWAT models developed in previous studies of the entire UMRB, the uncalibrated SWAT model presented here can provide similar results. Overall, the SWAT model can provide satisfactory predictions on hydrologic budget and crop yield in the UMRB without calibration. The results emphasize the importance and prospects of using accurate spatial input data for the physically based SWAT model. This study also examines biofuel-biomass production by simulating all agricultural lands with switchgrass, producing satisfactory results in estimating biomass availability for biofuel production.

09 BIOMASS FUELS↗

Computationally efficient models for aqueous organic redox flow batteries

The rising usage of intermittent energy has garnered the need for large scale energy storage systems. Redox flow batteries (RFB) based energy storage system shows promising potential. Numerical simulations and machine learning approaches have been widely used to study RFB performance. The development of autonomous material discovery framework and digital twin of energy storage system usually needs to query cell performance through fast response models. In this study, two computationally efficient models are introduced: a physics-based analytical flow battery model (EZBattery), and a machine learning operator model (Deep Operator Network, denoted by DeepONet). Both models can provide cell performance near instantly, and prediction accuracy was systematically examined on an application of evaluating the performances of a 780 cm 2 aqueous organic redox flow battery (AORFB), using potential anolyte candidates in dihydroxyphenazine (DHP)-based family of organic materials. A validated computationally expansive 3-dimensional multi-physics finite element model by COMSOL was used as the ground truth and provided the training data set for the DeepONet. 1280 samples were generated with 10 properties to mimic the different possible anolyte candidates, and the cell performances were evaluated under 10 different combined operating conditions. The accuracy comparisons for the two computationally efficient models show that both models can provide comparable accuracy in predicting cell charging/discharging voltage curves. DeepONet can provide slightly higher overall accuracy than EZBattery with faster calculation speed, but highly relies on the training dataset. EZBattery does not need a training dataset and can provide interpretable physics-based explanations of the results, while being more flexible to adjust to adapt any different cell designs, flow battery architectures, and electrolyte materials.

Analytical model↗

Model-based economic analysis under uncertainty for PFAS treatment by granular activated carbon and ion exchange technologies

Recent drinking water regulations have imposed the need for per- and polyfluoroalkyl substances (PFAS) remediation. In response, treatment facilities may be required to retrofit existing treatment schemes to treat PFAS below maximum contaminant levels (MCLs). Adsorption technologies such as granular activated carbon (GAC) and ion exchange (IX) have been demonstrated to be effective; however, there are limited techno-economic metrics available which provide guidance on technology selection and design for diverse PFAS-containing source water conditions. Process systems engineering (PSE) tools which can traditionally perform these analyses are hindered by the data availability, model validity, and understanding of treatment phenomena for emerging contaminants. This work employs published data regressions, statistical models, process models, techno-economic analyses, and other process systems tools in a model-based uncertainty framework to consider the limitations of emerging contaminant research. Through this analysis framework, economic results are provided as probabilistic distributions based on the uncertainty of the models and diverse conditions that treatment facilities experience.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

SU-D-207B-07: Development of a CT-Radiomics Based Early Response Prediction Model During Delivery of Chemoradiation Therapy for Pancreatic Cancer

Purpose: Pilot study developing a CT-texture based model for early assessment of treatment response during the delivery of chemoradiation therapy (CRT) for pancreatic cancer. Methods: Daily CT data acquired for 24 pancreatic head cancer patients using CT-on-rails, during the routine CT-guided CRT delivery with a radiation dose of 50.4 Gy in 28 fractions, were analyzed. The pancreas head was contoured on each daily CT. Texture analysis was performed within the pancreas head contour using a research tool (IBEX). Over 1300 texture metrics including: grey level co-occurrence, run-length, histogram, neighborhood intensity difference, and geometrical shape features were calculated for each daily CT. Metric-trend information was established by finding the best fit of either a linear, quadratic, or exponential function for each metric value verses accumulated dose. Thus all the daily CT texture information was consolidated into a best-fit trend type for a given patient and texture metric. Linear correlation was performed between the patient histological response vector (good, medium, poor) and all combinations of 23 patient subgroups (statistical jackknife) determining which metrics were most correlated to response and repeatedly reliable across most patients. Control correlations against CT scanner, reconstruction kernel, and gated/nongated CT images were also calculated. Euclidean distance measure was used to group/sort patient vectors based on the data of these trend-response metrics. Results: We found four specific trend-metrics (Gray Level Coocurence Matrix311-1InverseDiffMomentNorm, Gray Level Coocurence Matrix311-1InverseDiffNorm, Gray Level Coocurence Matrix311-1 Homogeneity2, and Intensity Direct Local StdMean) that were highly correlated with patient response and repeatedly reliable. Our four trend-metric model successfully ordered our pilot response dataset (p=0.00070). We found no significant correlation to our control parameters: gating (p=0.7717), scanner (p=0.9741), and kernel (p=0.8586). Conclusion: We have successfully created a CT-texture based early treatment response prediction model using the CTs acquired during the delivery of chemoradiation therapy for pancreatic cancer. Future testing is required to validate the model with more patient data.

60 APPLIED LIFE SCIENCES↗

Machine learning elastic constants of multi-component alloys

The present manuscript explores application of machine learning methods for determining elastic constants and other derived mechanical properties of multi-component alloys. Here, a number of machine learning models, including linear regression, neural network and random forest based models, are trained and tested on a dataset of binary alloys generated using density functional theory (DFT) calculations and spanning over a large number of elemental species in the periodic table. Starting with a wide range of simple and easily accessible compositionally-averaged elemental features, a correlation-based feature selection strategy was used to systematically down-select a set of most relevant features towards the prediction of the elasticity tensor components. The true predictive performance and the associated uncertainties of the models were established by testing on unseen data and bootstrapping, respectively. A single and pair-wise feature partial dependence analysis was performed to visualize the average property trends in the multi-dimensional feature space in order to further understand the achieved predictive performance. The utility of the trained model is further demonstrated by obtaining sufficiently accurate yet highly efficient approximations for bulk modulus, Young’s modulus, shear modulus and Poisson’s ratio for alloys beyond the binary space (i.e., two-component alloys) on which the model was originally trained. More importantly, we test and validate the predictive performance of the developed model directly against the experimentally measured elastic constants of technologically relevant multi-component alloys (such as, Ni- and Ti-based alloys). Finally, utility of such a data-enabled route is demonstrated by predicting the possible range of various elastic properties for vast composition space available within the five component Ni-Cr-Fe-Mo-W alloy system in a high-throughput manner.

36 MATERIALS SCIENCE↗

Model-Based Characterization of High Temperature Oxy-Coal Combustion Systems

Reaction Engineering International (REI) is leading a DOE-funded program focused on characterization of the impacts of high temperatures and pressures in oxy-coal combustion systems. The objective is to produce data and validate mechanisms to describe and predict flame behavior, heat transfer, ash deposition and ash chemistry to enable application of these advanced combustion technologies in full-scale systems. This presentation will provide an overview of accomplishments achieved to date on this project and present modeling results of high temperature oxy-coal combustion using undiluted directed oxygen with minimal flue gas recirculation at atmospheric pressure. Comparisons of model results and experimental data from 100 kW and 1.5 MW test furnaces will be provided for gas and wall temperatures, wall heat flux, carbon on ash, ash deposition rates and ash chemistry.

high temperature, modeling↗

CERES : a cryo-EM re-refinement system for continuous improvement of deposited models

The field of electron cryomicroscopy (cryo-EM) has advanced quickly in recent years as the result of numerous technological and methodological developments. This has led to an increase in the number of atomic structures determined using this method. Recently, several tools for the analysis of cryo-EM data and models have been developed within the Phenix software package, such as phenix.real_space_refine for the refinement of atomic models against real-space maps. Also, new validation metrics have been developed for low-resolution cryo-EM models. To understand the quality of deposited cryo-EM structures and how they might be improved, models deposited in the Protein Data Bank that have map resolutions of better than 5 Å were automatically re-refined using current versions of Phenix tools. The results are available on a publicly accessible web page (https://cci.lbl.gov/ceres). The implementation of a Cryo-EM Re-refinement System ( CERES ) for the improvement of models deposited in the wwPDB, and the results of the re-refinements, are described. Based on these results, contents are proposed for a `cryo-EM Table 1', which summarizes experimental details and validation metrics in a similar way to `Table 1' in crystallography. The consistent use of robust metrics for the evaluation of cryo-EM models and data should accompany every structure deposition and be reported in scientific publications.

59 BASIC BIOLOGICAL SCIENCES↗

Fission Product Yields from 232Th, 238U, and 235U Using 14 MeV Neutrons

Neutron-induced fission yield studies using deuterium-tritium fusion-produced 14 MeV neutrons have not yet directly measured fission yields from fission products with half-lives on the order of seconds (far from the line of nuclear stability). Fundamental data of this nature are important for improving and validating the current models of the nuclear fission process. Cyclic neutron activation analysis (CNAA) was performed on three actinide targets–thorium-oxide, depleted uranium metal, and highly enriched uranium metal–at the University of Michigan's Neutron Science Laboratory (UM-NSL) using a pneumatic system and Thermo-Scientific D711 accelerator-based fusion neutron generator. This was done to measure the fission yields of short-lived fission products and to examine the differences between the delayed fission product signatures of the three actinides. The measured data were compared against previously published results for 89Kr, -90, and -92 and 138Xe, -139, and -140. The average percent deviation of the measured values from the Evaluated Nuclear Data Files VII.1 (ENDF/B-VII.1) for thorium, depleted-uranium, and highly-enriched uranium were -10.2%, 4.5%, and -12.9%, respectively. In addition to the measurements of the six known fission products, 23 new fission yield measurements from 84As to 146La are presented.

Pierson, Bruce D.↗

Validation and Parametric Investigations Using a Lumped Thermal Parameter Model of an Internal Permanent Magnet Motor

One of the key challenges for the electric vehicle industry is to develop high-power-density electric motors. Achieving higher power density requires efficient heat removal from inside the motor. In order to improve thermal management, a multi-physics modeling framework that is able to accurately predict the behavior of the motor, while being computationally efficient, is essential. This paper first presents a detailed validation of a Lumped Parameter Thermal Network (LPTN) model of an Internal Permanent Magnet (IPM) synchronous motor within the commercially available Motor-CAD® modeling environment. The IPM motor’s stator is studied at steady state, and winding losses are generated by a constant DC current. The validation is based on temperature comparison with experimental data and with more detailed Finite Element Analysis (FEA). All critical input parameters of the LPTN are considered in detail for each layer of the stator, especially the contact resistances between the impregnation, liner, laminations and housing. Finally, a sensitivity analysis for each of the critical input parameters is provided. A maximum difference of 4% — for the highest temperature in the slot windings and the end windings — was found between the LPTN and the experimental data. Comparing the results from the LPTN and the FEA model, the maximum difference was 2% for the highest temperature in the slot windings and end windings. As for the LTPN sensitivity analysis, the thermal parameter with the highest sensitivity was found to be the liner-to-lamination contact resistance. The latter is often ignored in the literature, whereas its impact on temperature rise was found to be more significant than any other contact resistance within the stator.

47 OTHER INSTRUMENTATION↗

Assessing and benchmarking the fidelity of posterior inference methods for astrophysics data analysis

In this era of large and complex astronomical survey data, interpreting, validating, and comparing inference techniques becomes increasingly difficult. This is particularly critical for emerging inference methods like Simulation-Based Inference (SBI), which offer significant speedup potential and posterior modeling flexibility, especially when deep learning is incorporated. We present a study to assess and compare the performance and uncertainty prediction capability of Bayesian inference algorithms – from traditional MCMC sampling of analytic functions to deep learning-enabled SBI. We focus on testing the capacity of hierarchical inference modeling in those scenarios. Before we extend this study to cosmology, we first use astrophysical simulation data to ensure interpretability. We demonstrate a probabilistic programming implementation of hierarchical and non-hierarchical Bayesian inference using simulations derived from the DeepBench software library, a benchmarking tool developed by our group that generates simple and controllable astrophysical objects from first principles. This study will enable astronomers and physicists to harness the inference potential of these methods with confidence.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Validation and Parametric Investigations Using a Lumped Thermal Parameter Model of an Internal Permanent Magnet Motor: Preprint

One of the key challenges for the electric vehicle industry is to develop high-power-density electric motors. Achieving higher power density requires efficient heat removal from inside the motor. In order to improve thermal management, a multi-physics modeling framework that is able to accurately predict the behavior of the motor, while being computationally efficient, is essential. This paper first presents a detailed validation of a Lumped Parameter Thermal Network (LPTN) model of an Internal Permanent Magnet (IPM) synchronous motor within the commercially available Motor-CAD® modeling environment. The IPM motor’s stator is studied at steady state, and winding losses are generated by a constant DC current. The validation is based on temperature comparison with experimental data and with more detailed Finite Element Analysis (FEA). All critical input parameters of the LPTN are considered in detail for each layer of the stator, especially the contact resistances between the impregnation, liner, laminations and housing. Finally, a sensitivity analysis for each of the critical input parameters is provided. A maximum difference of 4% - for the highest temperature in the slot windings and the end windings - was found between the LPTN and the experimental data. Comparing the results from the LPTN and the FEA model, the maximum difference was 2% for the highest temperature in the slot windings and end windings. As for the LTPN sensitivity analysis, the thermal parameter with the highest sensitivity was found to be the liner-to-lamination contact resistance. The latter is often ignored in the literature, whereas its impact on temperature rise was found to be more significant than any other contact resistance within the stator.

ADVANCED PROPULSION SYSTEMS↗

Numerical solution of 2D wet steam flow with non-equilibrium condensation and real thermodynamics

An approach to modeling of wet steam flow with non-equilibrium condensation phenomenon is presented. The first part of our flow model is homogeneous Euler system of transport equations for mass, momentum and total energy of wet steam (mixture). The additional second part describes liquid phase via non-homogeneous system of transport equations for moments of droplets number distribution function and relies on corrected classical nucleation theory. Moment equations are closed by linearization of droplet growth rate model. All necessary relations for thermodynamic properties of steam are provided by IAPWS set of equations. However, properties of condensate are simply modeled by liquid saturation data. Two real equations of state are implemented. Recently developed CFD formulation for entropy (does not require iteration process) and so-called IAPWS special gas equation for Helmholtz energy (one iteration loop is necessary). Flow model is validated on converging-diverging supersonic nozzle with Barschdorff geometry. Simulations were performed by in-house CFD code based on finite volume method and stiff character of equations was solved by symmetrical time operator splitting. Achieved results satisfactorily agreed with experimental data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Measurement‐Model Fusion Approach for Improved Wet Deposition Maps and Trends

Abstract Air quality models provide spatial fields of wet deposition (WD) and dry deposition that explicitly account for the transport and transformation of emissions from thousands of sources. However, many sources of uncertainty in the air quality model including errors in emissions and meteorological inputs (particularly precipitation) and incomplete descriptions of the chemical and physical processes governing deposition can lead to bias and error in the simulation of WD. We present an approach to bias correct Community Multiscale Air Quality model output over the contiguous United States using observation‐based gridded precipitation data generated by the Parameter‐elevation Regressions on Independent Slopes Model and WD observations at the National Atmospheric Deposition Program National Trends Network sites. A cross‐validation analysis shows that the adjusted annual accumulated WD for NO 3 − , NH 4 + , and SO 4 2− from 2002 to 2012 has less bias and higher correlation with observed values than the base model output without adjustment. Temporal trends in observed WD are captured well by the adjusted model simulations across the entire contiguous United States. Consistent with previous trend analyses, WD NO 3 − and SO 4 2− are shown to decrease during this period in the eastern half of the United States, particularly in the Northeast, while remaining nearly constant in the West. Trends in WD of NH 4 + are more spatially and temporally heterogeneous, with some positive trends in the Great Plains and Central Valley of CA and slightly negative trends in the south.

54 ENVIRONMENTAL SCIENCES↗

Influence of sky radiance measurement errors on inversion-retrieved aerosol properties

Remote sensing of the atmospheric aerosol is a well-established technique that is currently used for routine monitoring of this atmospheric component, both from ground-based and satellite. The AERONET program, initiated in the 90's, is the most extended network and the data provided are currently used by a wide community of users for aerosol characterization, satellite and model validation and synergetic use with other instrumentation (lidar, in-situ, etc.). Aerosol properties are derived within the network from measurements made by ground-based Sun-sky scanning radiometers. Sky radiances are acquired in two geometries: almucantar and principal plane. Discrepancies in the products obtained following both geometries have been observed and the main aim of this work is to determine if they could be justified by measurement errors. Three systematic errors have been analyzed in order to quantify the effects on the inversion-derived aerosol properties: calibration, pointing accuracy and finite field of view. Simulations have shown that typical uncertainty in the analyzed quantities (5% in calibration, 0.2 Degree-Sign in pointing and 1.2 Degree-Sign field of view) yields to errors in the retrieved parameters that vary depending on the aerosol type and geometry. While calibration and pointing errors have relevant impact on the products, the finite field of view does not produce notable differences.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

HDSense: An efficient method for ranking observable sensitivity

Identifying which observables most effectively constrain model parameters can be computationally prohibitive when considering full likelihoods of many correlated observables. This is especially important for, e.g., hadronization models, where high precision is required to interpret the results of collider experiments. We introduce the High-Dimensional Sensitivity (HDSense) score, a computationally efficient metric for ranking observable sets using only one-dimensional histograms. Derived by profiling over unknown correlations in the Fisher information framework, the score balances total information content against redundancy between observables. We apply HDSense to rank a set observables in terms of their constraining power with respect to five parameters of the Lund string model of hadronization implemented in Pythia using simulated leptonic collider events at the $Z$ pole. Validation against machine-learning--based full-likelihood approximations demonstrates that HDSense successfully identifies near-optimal observable subsets. The framework naturally handles data from multiple experiments with different acceptances and incorporates detector effects. While demonstrated on hadronization models, the methodology applies broadly to generic parameter estimation problems where correlations are unknown or difficult to model.

Assi, Benoît [Cincinnati U.] (ORCID:00000003092433↗

Scalable deep learning for watershed model calibration

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R 2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.

54 ENVIRONMENTAL SCIENCES↗

PyOECP: A flexible open-source software library for estimating and modeling the complex permittivity based on the open-ended coaxial probe (OECP) technique

Here, we present PyOECP, a Python-based flexible open-source software for estimating and modeling the complex permittivity obtained from the open-ended coaxial probe (OECP) technique. The transformation of the measured reflection coefficient to complex permittivity is performed based on three different methods. The software library contains the dielectric spectra of common reference liquids, which can be used to transform the reflection coefficient into the dielectric spectra. Several Python routines that are commonly employed (e.g., SciPy and NumPy) in the field of science and engineering are required only so that the users can alter the software structure depending on their needs. The modeling algorithm exploits the Markov Chain Monte Carlo method for the data regression. The discrete relaxation models can be built by a proper combination of well-known relaxation models. In addition to these models, electrode polarization, a typical measurement artifact for interpreting dielectric spectra, can be incorporated into the modeling algorithm. A continuous relaxation model, which solves the Fredholm integral equation of the first kind (a mathematically ill-posed problem), is also included. This open-source software enables users to freely adjust the physical parameters to obtain physical insight into their materials under test and will be consistently updated for more accurate measurement and interpretation of dielectric spectra in an automated manner. This work describes the theoretical and mathematical background of the software, lays out the workflow, and validates the software functionality based on both synthetic and empirical data included in the software.

97 MATHEMATICS AND COMPUTING↗