Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Multi-configuration Membrane Distillation Model (MCMD)

Many membrane distillation models have been created to simulate the heat and mass exchange process involved but most of the literature only validates models to a couple of cases with minor configuration changes. Tools are needed that allow tradeoffs between many configurations. The multiconfiguration membrane distillation model handles many configurations. This report introduces membrane distillation, provides theory, and presents the work to verify and validate the model against experimental data from Colorado School of Mines and a lower resolution model created at the National Renewable Energy Laboratory. Though more data analysis and testing are needed, an initial look at the model to experimental comparisons indicates that the model correlates to the data well but that design comparisons are likely to be incorrect across a broad range of configurations. More accurate quantification of heat and mass transfer through computational fluid mechanics is suggested.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Offshore Wind Energy Validation Experiment Hierarchy

This paper provides a summary of planning work for experiments that will be necessary to address the long-term model validation needs required to meet offshore wind energy deployment goals. Conceptual experiments are identified and laid out in a validation hierarchy for both wind turbine and wind plant applications. Instrumentation needs that will be required for the offshore validation experiments to be impactful are then listed. The document concludes with a nominal vision for how these experiments can be accomplished.

17 WIND ENERGY↗
DOE OSTI2022

Evaluating Class 6 Delivery Truck Fuel Economy and Emissions Using Vehicle System Simulations for Conventional and Hybrid Powertrains and Co-Optima Fuel Blends

The US Department of Energy’s Co-Optimization of Engine and Fuels Initiative (Co-Optima) investigated how unique properties of bio-blendstocks considered within Co-Optima help address emissions challenges with mixing controlled compression ignition (i.e., conventional diesel combustion) and enable advanced compression ignition modes suitable for implementation in a diesel engine. Additionally, the potential synergies of these Co-Optima technologies in hybrid vehicle applications in the medium- and heavy-duty sector was also investigated. In this work, vehicles system were simulated using the Autonomie software tool for quantifying the benefits of Co-Optima engine technologies for medium-duty trucks. A Class 6 delivery truck with a 6.7 L diesel engine was used for simulations over representative real-world and certification drive cycles with four different powertrains to investigate fuel economy, criteria emissions, and performance. Comparisons were made between ultralow-sulfur diesel and a blend of 25% hexyl hexanoate with diesel. Model validation data were informed by 2019 model year Cummins ISB 6.7 L diesel engine maps and transient validation data in a pre-production hybrid configuration and a direct dyno coupled configuration with diesel fuel and a blend of 25% hexyl hexanoate with diesel.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Multimodel validation of single wakes in neutral and stratified atmospheric conditions

Previous research has revealed the need for a validation study that considers several wake quantities and code types so that decisions on the trade-off between accuracy and computational cost can be well informed and appropriate to the intended application. In addition to guiding code choice and setup, rigorous model validation exercises are needed to identify weaknesses and strengths of specific models and guide future improvements. Here, we consider 13 approaches to simulating wakes observed with a nacelle-mounted lidar at the Scaled Wind Technology Facility (SWiFT) under varying atmospheric conditions. We find that some of the main challenges in wind turbine wake modeling are related to simulating the inflow. In the neutral benchmark, model performance tracked as expected with model fidelity, with large-eddy simulations performing the best. In the more challenging stable case, steady-state Reynolds-averaged Navier–Stokes simulations were found to outperform other model alternatives because they provide the ability to more easily prescribe noncanonical inflows and their low cost allows for simulations to be repeated as needed. Dynamic measurements were only available for the unstable benchmark at a single downstream distance. These dynamic analyses revealed that differences in the performance of time-stepping models come largely from differences in wake meandering. This highlights the need for more validation exercises that take into account wake dynamics and are able to identify where these differences come from: mesh setup, inflow, turbulence models, or wake-meandering parameterizations. In addition to model validation findings, we summarize lessons learned and provide recommendations for future benchmark exercises.

17 WIND ENERGY↗
NASA NTRS2014

A Formal Approach to Empirical Dynamic Model Optimization and Validation

A framework was developed for the optimization and validation of empirical dynamic models subject to an arbitrary set of validation criteria. The validation requirements imposed upon the model, which may involve several sets of input-output data and arbitrary specifications in time and frequency domains, are used to determine if model predictions are within admissible error limits. The parameters of the empirical model are estimated by finding the parameter realization for which the smallest of the margins of requirement compliance is as large as possible. The uncertainty in the value of this estimate is characterized by studying the set of model parameters yielding predictions that comply with all the requirements. Strategies are presented for bounding this set, studying its dependence on admissible prediction error set by the analyst, and evaluating the sensitivity of the model predictions to parameter variations. This information is instrumental in characterizing uncertainty models used for evaluating the dynamic model at operating conditions differing from those used for its identification and validation. A practical example based on the short period dynamics of the F-16 is used for illustration.

Crespo, Luis G↗
DOE OSTI2024

Wave-powered water pump for upwelling in aquaculture: Numerical model and ocean test

Wave-powered upwelling can increase the productivity and survivability of several aquaculture species. This enhancement is due to transporting cold, nutrient-rich ocean water, typically found lower in the water column, to the surface. Macroalgaes, like kelp, exhibit increased growth from these altered conditions. The University of New Hampshire’s (UNH) wave-powered water pump (wave pump) is a point absorber wave energy converter (WEC) that uses ocean waves to create relative motion between a spar buoy and a concentric float which drives an internal pump. A numerical model of the wave pump was developed using WEC-Sim to predict device performance in the ocean. Wave pump performance was evaluated during a five day ocean test near Appledore Island in Maine in March 2023, where volumetric flow rate, relative distance between spar and float, and wave conditions were measured. These data were then used for numerical model validation. The ocean deployment recorded the device’s performance in a variety of sea states, with average significant wave heights up to 0.7 m. The ocean test data were compared to the WEC-Sim numerical model of the device with favorable results. Average values of device stroke period, stroke height, and flow rate agreed between the ocean test and model data to within approximately 16 to 22%. Furthermore, the validated numerical model provides a valuable tool for improving the design and developing a commercial-scale, wave-powered water pump for use in aquaculture.

16 TIDAL AND WAVE POWER↗
DOE OSTI2017

Light Water Reactor Sustainability Program Status of Adaptive Surrogates within the RAVEN framework

The RAVEN code has been under development at the Idaho National Laboratory since 2012. Its main goal is to create a multi-purpose platform for the deploying of all the capabilities needed for Probabilistic Risk Assessment, uncertainty quantification, data mining analysis and optimization studies. RAVEN has demonstrated a good level of maturity in terms of state-of-art and advanced analysis methodologies. Indeed, in the past year the RAVEN code has been released as open-source project and is available to download (raven.inl.gov) free of charge. The main subject of this report is to show the activities that have been recently accomplished with respect the adaptive surrogate modeling: Implementation of the metric system for the assessment of surrogate model validity; Implementation of cross-validation techniques for the global assessment of surrogate models; Implementation of an automatic infrastructure for switching between a high-fidelity model (e.g. physical code) and a surrogate or set of surrogates; Implementation of a scheme for automatic optimization of surrogate model parameters. The aim of this document is to report the status of the development of methods, within the RAVEN framework, to assess the validity of the predictive capabilities of surrogate models. Indeed, after the construction of a surrogate tight to a certain physical model, it is crucial to assess the goodness of its representation, in order to be confident with its prediction. A cross-validation technique has been employed. This report will highlight the implementation details and proof its correct implementation by an application example. The implementation of a way to assess the predictive capabilities of a surrogate allowed the construction of a RAVEN new entity named “HybridModel” that is aimed to switch between an high-fidelity code and its linked surrogate. In addition, leveraging the optimization algorithms that have been implemented in RAVEN last fiscal year, a new scheme has been developed for automatic tuning of the surrogates’ parameters (e.g. penalty factors in support vector machines).

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2010

Improving a Spectral Bin Microphysical Scheme Using TRMM Satellite Observations

Comparisons between cloud model simulations and observations are crucial in validating model performance and improving physical processes represented in the mod Tel.hese modeled physical processes are idealized representations and almost always have large rooms for improvements. In this study, we use data from two different sensors onboard TRMM (Tropical Rainfall Measurement Mission) satellite to improve the microphysical scheme in the Goddard Cumulus Ensemble (GCE) model. TRMM observed mature-stage squall lines during late spring, early summer in central US over a 9-year period are compiled and compared with a case simulation by GCE model. A unique aspect of the GCE model is that it has a state-of-the-art spectral bin microphysical scheme, which uses 33 different bins to represent particle size distribution of each of the seven hydrometeor species. A forward radiative transfer model calculates TRMM Precipitation Radar (PR) reflectivity and TRMM Microwave Imager (TMI) 85 GHz brightness temperatures from simulated particle size distributions. Comparisons between model outputs and observations reveal that the model overestimates sizes of snow/aggregates in the stratiform region of the squall line. After adjusting temperature-dependent collection coefficients among ice-phase particles, PR comparisons become good while TMI comparisons worsen. Further investigations show that the partitioning between graupel (a high-density form of aggregate), and snow (a low-density form of aggregate) needs to be adjusted in order to have good comparisons in both PR reflectivity and TMI brightness temperature. This study shows that long-term satellite observations, especially those with multiple sensors, can be very useful in constraining model microphysics. It is also the first study in validating and improving a sophisticated spectral bin microphysical scheme according to long-term satellite observations.

Li, Xiaowen↗
DOE OSTI2018

Photochemical Kinetic Modeling of Degradation of Aqueous Polyvinyl Alcohol in a UV/H{sub 2}O{sub 2} Photoreactor

This study presents a photochemical kinetics model to describe the degradation of water-soluble PVA (Polyvinyl Alcohol) polymer in a UV/H{sub 2}O{sub 2} batch reactor. Under the effect of UV light, the photolysis of hydrogen peroxide into hydroxyl radicals can generate a series of polymer scission reactions. For a better understanding and analysis of the UV/H{sub 2}O{sub 2} process in the cracking of the PVA macromolecules, a chemical reaction mechanism of the degradation process and a relevant photochemical kinetics model are developed to describe the disintegration of the polymer chains. Taking into account the probabilistic fragmentation of the polymer, the statistical moment approach is used to model the molar population balance of live and dead polymer chains. The model predicts the PVA molecular weight reduction, the acidity of the solution, and hydrogen peroxide residual. In addition to previously published data collected in this laboratory, a new set of experiments were conducted using a 500 mg/L PVA aqueous for different hydrogen peroxide/PVA ratios for model validation. Measurements of average molecular weights of the polymer, hydrogen peroxide concentrations and pH of the PVA solution were determinant factors in constructing a reliable photochemical model of the UV/H{sub 2}O{sub 2} process. Experimental data showed a decrease in the PVA molecular weight and a buildup of the solution acidity. The experimental data also served to determine the kinetics rate constants of the PVA photochemical degradation and validate the model whose predictions are in good agreement with data. The model can provide a comprehensive understanding of the impact of the design and operational variables.

36 MATERIALS SCIENCE↗
DOE OSTI2018

A detailed reaction mechanism for oxidative coupling of methane over Mn/Na 2 WO 4 /SiO 2 catalyst for non-isothermal conditions

Direct production of ethylene from natural gas or other methane sources has proven to be challenging from catalytic, process design and economic perspectives, with no reports of a commercially viable process to date. Understanding of the underlying non-ideal homogeneous and heterogeneous reactions involved could lead to success, enabling utilization of vast natural gas resources as a replacement for petrochemicals. In this regards, an improved reaction mechanism and computational model, validated experimentally, for oxidative coupling of methane (OCM) over a Mn/Na 2 WO 4 /SiO 2 catalyst is developed, taking into account the non-isothermal behavior exhibited by the gas and surface reactions. The reaction mechanism involves detailed gas-phase and surface elementary steps to describe the OCM chemistry and employing a reduced model for computational efficiency. Our model uses laboratory-scale packed-bed reactor experiments for kinetic mechanism development. The modeling and simulation is particularly focused on a one-dimensional packed-bed reactor. The kinetic model is validated over a wide range of experimental conditions. The model-predicted results and their comparisons with the experimental data are presented wide temperature ranges and methane-to-oxygen feed ratios under adiabatic reactor conditions. The kinetic model is first of its kind in which non-isothermal OCM kinetic behavior is captured using detailed gas-phase and heterogeneous reaction kinetics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2018

An Evaluation of Semiempirical Models for Partitioning Photosynthetically Active Radiation Into Diffuse and Direct Beam Components

Photosynthesis is more efficient under diffuse than direct beam photosynthetically active radiation (PAR) per unit PAR, but diffuse PAR is infrequently measured at research sites. We examine four commonly used semiempirical models (Erbs et al., 1982, https://doi.org/10.1016/0038-092X(82)90302-4; Gu et al., 1999, https://doi.org/10.1029/1999JD901068; Roderick, 1999, https://doi.org/10.1016/S0168- 1923(99)00028-3; Weiss & Norman, 1985, https://doi.org/10.1016/0168-1923(85)90020-6) that partition PAR into diffuse and direct beam components based on the negative relationship between atmospheric transparency and scattering of PAR. Radiation observations at 58 sites (140 site years) from the La Thuille FLUXNET data set were used for model validation and coefficient testing. All four models did a reasonable job of predicting the diffuse fraction of PAR (Φ) at the 30 min timescale, with site median r2 values ranging between 0.85 and 0.87, model efficiency coefficients (MECs) between 0.62 and 0.69, and regression slopes within 10% of unity. Model residuals were not strongly correlated with astronomical or standard meteorological variables. We conclude that the Roderick (1999, https://doi.org/10.1016/S0168- 1923(99)00028-3) and Gu et al. (1999, https://doi.org/10.1029/1999JD901068) models performed better overall than the two older models. Using the basic form of these models, the data set was used to find both individual site and universal model coefficients that optimized predictive accuracy. A new universal form of the model is presented in section 5 that increased site median MEC to 0.73. Site-specific model coefficients increased median MEC further to 0.78, indicating usefulness of local/regional training of coefficients to capture the local distributions of aerosols and cloud types.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Hydrate failure in ITZ governs concrete strength: A micro-to-macro validated engineering mechanics model

Ever since the early days of Féret (1892) and Abrams (1919), concrete research has targeted at relating concrete composition to uniaxial compressive strength. While these activities were mainly characterized by empirical fitting functions, we here take a more fundamental approach based on continuum micromechanics. The loading applied at the concrete level, is first concentrated (''downscaled'') to maximum stresses related to cement paste volumes which are directly adjacent to the aggregates, i.e. to the interfacial transition zones (ITZ). These maximum stresses are further ''downscaled'' to the micron-sized hydrates, in terms of higher-order stress averages. The latter enter a Drucker-Prager failure criterion with material constants derived from nanoindentation tests. The model is successfully validated across the hydrate-to-concrete scales. Strength magnitude is governed by ITZ stress concentrations, and the water-to-cement ratio is its dominant mixture design parameter.

36 MATERIALS SCIENCE↗
DOE OSTI2020

An improved detailed chemical kinetic model for C3-C4 linear and iso-alcohols and their blends with gasoline at engine-relevant conditions

Propanol and butanol isomers have received significant research attention as promising fuel additives or neat biofuels. Robust chemical kinetic models are needed that can provide accurate and efficient predictions of combustion performance across a wide range of engine relevant conditions. Herein, this study seeks to improve the understanding of ignition and combustion behavior of pure C3-C4 linear and iso-alcohols, and their blends with gasoline at engine-relevant conditions. In this work, a kinetic model with improved thermochemistry and reaction kinetics was developed based on recent theoretical calculations of H-atom abstraction and peroxy radical reaction rates. Kinetic model validations are reported, and the current model reproduces the ignition delay times of the C3 and C4 alcohols well. Variations in reactivity over a wide range of temperatures and other operating conditions are also well predicted by the current model. Recent ignition delay time measurements from a rapid compression machine of neat iso-propanol and iso-butanol [Cheng et al., Proc. Combust Inst. (2020)] and blends with a research grade gasoline [Goldsborough et al., Proc. Combust Inst. (2020)] at elevated pressure (20–40 bar) and intermediate temperatures (780–950 K) were used to demonstrate the accuracy of the current kinetic model at conditions relevant to boosted spark-ignition engines. The effects of alcohol blending with gasoline on the autoignition behavior are discussed. The current model captures the suppression of reactivity in the low-temperature and negative-temperature-coefficient (NTC) region when either isopropanol and isobutanol are added to a research grade gasoline. Sensitivity and reaction flux analysis were performed to provide insights into the relevant fuel chemistry of the C3-C4 alcohols.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Robust Machine Learning Inference from X-ray Absorption Near Edge Spectra through Featurization

X-ray absorption spectroscopy (XAS) is a commonly employed technique for characterizing functional materials. In particular, X-ray absorption near edge spectra (XANES) encode local coordination and electronic information, and machine learning approaches to extract this information are of significant interest. To date, most ML approaches for XANES have primarily focused on using the raw spectral intensities as input, overlooking the potential benefits of incorporating spectral transformations and dimensionality reduction techniques into ML predictions. Here, in this work, we focused on systematically comparing the impact of different featurization methods on the performance of ML models for XAS analysis. We evaluated the classification and regression capabilities of these models on computed data sets and validated their performance on previously unseen experimental data sets. Our analysis revealed an intriguing discovery: the cumulative distribution function feature achieves both high prediction accuracy and exceptional transferability. This remarkably robust performance can be attributed to its tolerance to horizontal shifts in the spectra, which is crucial when validating models using experimental data. While this work exclusively focuses on XANES analysis, we anticipate that the methodology presented here will hold promise as a versatile asset to the broader spectroscopy community.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Modeling and experimental validation of dynamical effects in Bragg coherent x-ray diffractive imaging of finite crystals

Bragg coherent diffractive imaging (BCDI) is a noninvasive microscopy technique that can visualize the shape and internal lattice deviations of crystals with nanoscale spatial resolution and picometer deformation sensitivity. Its strain imaging capability relies on Fourier transform–based iterative phase retrieval algorithms, which are mostly developed under the kinematical approximation. Such approximation prohibits the application of BCDI on larger crystals, which are commonly seen in most emerging functional materials. Understanding the dynamical effect in BCDI, as well as developing a validated method for modeling BCDI at the dynamical diffraction limit, is crucial for applying BCDI to hierarchical systems that contain micron-sized crystals and grains. Thus we report a comparative study on the impact of dynamical diffraction effects by comparing the reconstruction results from two measurements of the same crystal. Forward simulation is implemented to show subtle changes of interference fringes in the diffraction pattern due to the dynamical diffraction, and is compared directly with the experimental data.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Six Machine-Learning Methods for Predicting Hospital-Stay Duration for Patients with Sepsis: A Comparative Study

Sepsis is a life-threatening medical condition that, if not treated promptly, can result in tissue damage, organ failure, and death. According to the Centers for Disease Control, about 270,000 individuals die of sepsis in the US each year. Further, sepsis expenditures accounted for 13% of total US hospital costs in 2013, totaling more than $24 billion. Our project objectives were to determine if Machine Learning algorithms could reliably predict hospital stay duration for patients with sepsis. The data set we used has been de-identified and is freely available through the BupaR package. The data includes 1050 cases, 15214 events, and 16 types of actions related to sepsis patient care. First, we used process mining to determine how long each patient was in the hospital. Using BupaR’s functions, we created several process model graphs. These process models depict the movement of patients at a hospital and provide duration data for each patent case. Second, we identified outlier data and created two dataset versions: one with and one without outliers. We then applied the following analysis methods: Linear Regression, Random Forest, K-Nearest Neighbors, Neural Networks, XGBoost, and lightGBM. We compared the model validations for the six machine learning models using the same data-splitting method. We found that the XGBoost model had the best prediction accuracy of 73.9 percent for cases with outliers, and 79 percent for cases without outliers. We also found that the lightGBM model had the lowest mean absolute error between prediction and actual duration in days with 3.66 days for the case with outliers, and 2.4 days for the case without outliers. These two models outperformed the other four models. This work will be enhanced in the future by exploring new prediction algorithms and comparing them with the results of this study.

Chen, Lingtao↗
DOE OSTI2021

TRANSIENT THERMAL MODELING OF THE HIGH BURNUP DEMONSTRATION RESEARCH PROJECT CASK USING STAR-CCM+ AND COBRA-SFS

The Department of Energy in collaboration with the Electric Power Research Institute is in the process of conducting the High Burnup Demonstration Project. Where the objective is to characterize the performance of high-burnup fuel in long term storage. As part of this demonstration, a TN-32B dry storage cask was instrumented and loaded with spent nuclear fuel at North Anna Nuclear Generating Station in November 2017. The project cask provides a unique opportunity to gain information on spent fuel and cask performance from an in-service operational system. The cask was instrumented with thermocouples inside of the fuel assemblies, then loaded and dried using normal procedures. After the drying process a thermal soak period where the cask was left indoors was used to obtain steady temperatures for model comparison along with surface temperatures. This paper details thermal modeling validation work that was done to model both the steady state and transient cases. Two modeling tools were used to predict temperatures in the cask. The general purpose CFD and heat transfer code STAR-CCM+ was used with both a detailed pin-by-pin model was used along with a more efficient k-effective simplification. The other code is COBRA-SFS, a purpose-built detailed thermal modeling tool developed and maintained at PNNL. Results from all the modeling tools were compared blind to the test data. Each model utilized general design information and compared reasonably well to the blind steady state data using convection and surface temperature boundary conditions. Post-test adjustments were later made to better reflect the “as built” conditions of the cask. Based on lessons learned from the steady state analysis the vacuum drying process was modeled in both codes. Utilizing the measured loading conditions the transient models were able to compare very well with the measured data. Overall the project showed an ability to model spent fuel storage conditions very well and future work is planned to generalize the methodology used for vacuum drying.

Thermal Analysis, Spent Fuel, Dry Storage↗
DOE OSTI2018

Research and Development in Fire Science

FM Global Technologies LLC and the Fire Science and Technology Department at Sandia National Laboratories have undertaken a Cooperative Research and Development Agreement (CRADA) to perform joint research and development in fire science. The objective of this work is to provide significant technical advances for the prevention and mitigation of high consequence fires. These advances will be accomplished through the acquisition of new, high-quality data for discovery of controlling mechanisms and model validation, formulation of new theories to describe fire behavior, and the development and validation of analytical and numerical fire models to predict fire hazard and mitigation system performance. These advances are expected to provide measurable improvements in fire safety by decreasing fire-related losses of life and property.

Childress, Amy↗