Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Predicting Sintering Window of Binder Jet Additively Manufactured Parts Using a Coupled Data Analytics and CALPHAD Approach

Batch-to-batch variation in powder compositions for binder jet additive manufacturing (BJAM) can significantly deter defining an “ideal” sintering window for a given alloy. One way to overcome the problem is by running sintering experiments at various temperatures for each batch of the powder. However, such an approach increases the time required to achieve large-scale production of parts. The predictive capabilities of computational thermodynamic tools like CALPHAD can be leveraged to overcome the challenge, especially for binder jet additive manufacturing, since the process occurs under near-equilibrium conditions. However, calculating the sintering window using CALPHAD can be computationally expensive, considering many possible feedstock compositions within “specification”. Here, we generate high throughput CALPHAD data for nickel-based superalloys to develop machine learning models to predict the sintering window rapidly. The predictive capability of the models has been validated using published results on BJAM of Inconel 718 and 625. Further, validated models are lightweight and can be deployed in an industrial setting to get sintering window in an accelerated manner.

36 MATERIALS SCIENCE↗

Vacuum-assisted carbon molecular sieve membrane reactor for non-oxidative ethane dehydrogenation

Non-oxidative ethane dehydrogenation (EDH) is equilibrium-limited and endothermic. Selective hydrogen removal using a gas-permeable membrane within the EDH reaction zone can overcome the thermodynamic equilibrium, enabling higher ethane conversions. Employing vacuum as the permeation driving force, rather than a sweep gas, enhances the industrial viability of membrane reactors by eliminating additional post-reaction separation units. This study presents a membrane reactor that integrates H 2 -permeable carbon molecular sieve (CMS) hollow fiber membranes embedded in a fixed bed of cobalt in a dealuminated beta zeolite (Co@DeAl-BEA) catalyst, utilizing a vacuum to remove hydrogen efficiently. The CMS membrane exhibits high hydrogen permeance and an excellent H 2 /C 2 H 6 separation factor. The membrane reactor significantly enhanced the ethane conversion under reaction conditions comparable to those reported in the literature. A Langmuir-Hinshelwood kinetic rate expression was developed and incorporated into a one-dimensional steady-state reactor model. The experimentally validated model indicates that increasing the number of hollow fibers improves ethane conversion, although ethane loss to the permeate limits the benefit. The contact area between the catalyst and the membrane limits the reactor performance more than the catalytic throughput. Furthermore, we find that the location of the catalyst packing relative to the hollow fiber membranes influences ethane loss and conversion. Higher reactor pressures and inlet ethane flow rates improve space-time yield at the expense of lower ethane conversion. Increasing reactor temperature or packing length promotes both performance metrics. The EDH membrane reactor demonstrated durability over 200 h of continuous operation, maintaining record-low deactivation rates and high ethylene selectivity. Protocols for catalyst regeneration were developed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Analysis of contact conditions and microstructure evolution in shear assisted processing and extrusion using smoothed particle hydrodynamics method

Shear assisted processing and extrusion (ShAPE) is a solid-phase processing technique that adds an additional shear force as compared with a conventional extrusion approach. Recently, ShAPE has demonstrated the capability of extruding high-performance aluminum alloy 7075 (AA7075) tubes at speeds up to 12.2 m/min without surface tearing. However, the relationship among the ShAPE processing parameters, thermomechanical conditions, contact conditions, heat generation, and microstructure evolution remains primarily empirical because an insightful understanding of the associated physics is still lacking. To help elucidate these relationships, this work proposes a thermomechanical meshfree model for the first time for ShAPE processing of AA7075 using the smoothed particle hydrodynamics (SPH) method. The meshfree model is first validated thoroughly by experimental data in terms of material flow, die face temperature, and extrusion force with various processing parameters. The validated model is then used to analyze the steady-state contact conditions and heat generation rates during ShAPE processing. Distributions of the average grain size of AA7075 being extruded are calculated using the SPH model output. The meshfree model results reveal that extrusions conducted at lower temperatures and higher strain rates yield more refined grains and possibly higher material strength, which is also consistent with the experimental observations.

36 MATERIALS SCIENCE↗

Machine Learning Force Field Parameters from Ab Initio Data

Machine learning (ML) techniques with the genetic algorithm (GA) have been applied to determine a polarizable force field parameters using only ab initio data from quantum mechanics (QM) calculations of molecular clusters at the MP2/6-31G(d,p), DFMP2(fc)/jul-cc-pVDZ, and DFMP2(fc)/jul-cc-pVTZ levels to predict experimental condensed phase properties (i.e., density and heat of vaporization). The performance of this ML/GA approach is demonstrated on 4943 dimer electrostatic potentials and 1250 cluster interaction energies for methanol. Excellent agreement between the training data set from QM calculations and the optimized force field model was achieved. Our results were further improved by introducing an offset factor during the machine learning process to compensate for the discrepancy between the QM calculated energy and the energy reproduced by optimized force field, while maintaining the local “shape” of the QM energy surface. Throughout the machine learning process, experimental observables were not involved in the objective function, but were only used for model validation. The best model, optimized from the QM data at the DFMP2(fc)/jul-cc-pVTZ level, appears to perform even better than the original AMOEBA force field (amoeba09.prm), which was optimized empirically to match liquid properties. The present effort shows the possibility of using machine learning techniques to develop descriptive polarizable force field using only QM data. The ML/GA strategy to optimize force fields parameters described here could easily be extended to other molecular systems.

97 MATHEMATICS AND COMPUTING↗

Challenges and Opportunities in Magnetospheric Space Weather Prediction

Abstract Space Weather is the study of the dynamics of the coupled Solar‐Terrestrial environment, as these dynamics impact technological systems and human activity. This paper reviews a selection of the advances, challenges, and new opportunities for magnetospheric space weather, and while the focus is on specific phenomena, many other aspects of space weather will have similar challenges and needs. As a scientific field with direct applications, the field of space weather is partly driven by imperatives from both policy and operations. We provide an introduction to some of the context in which the field exists and discuss how this might shape future developments and norms within the space weather enterprise. We briefly examine benchmarking, as a policy and operationally driven activity, as it provides immediate societal relevance and an opportunity to stretch scientific understanding. As numerical space weather prediction now becomes routine, and exascale computing is in the near future, we identify challenges relating to computational expense and big data, capturing and accounting for uncertainties, and specification of boundary conditions. Here, as with the observations supporting numerical space weather prediction, the key challenge lies in extending the lead time of predictions. We also discuss the role of data, particularly in regard to model validation and empirical modeling. Due to the growing societal impact of space weather, we also examine the relationships between space weather and its terrestrial counterpart and look at the importance of continuous evaluation, monitoring progress in predictive capability, and communication with researchers, forecasters, and end users.

79 ASTRONOMY AND ASTROPHYSICS↗

Development and Validation of Accident Models for FeCrAl Cladding

The purpose of this milestone report is to present the work completed in regards to material model development for FeCrAl cladding and highlight the results of applying these models to Loss of Coolant Accidents (LOCA) and Station Blackouts (SBO). With the limited experimental data available (essentially only the data used to create the models) true validation is not possible. In the absence of another alternative, qualitative comparisons during postulated accident scenarios between FeCrAl and Zircaloy-4 cladded rods have been completed demonstrating the superior performance of FeCrAl.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Bifacial Vertical Testbed and Ground Irradiance Data in Golden, Colorado

This data was collected for Tonita et al., “Vertical bifacial photovoltaic system model validation: study with field data, various orientations, and latitudes,” for validation of optical models for vertically-oriented photovoltaics under high albedo. Ground irradiance data for vertical PV arrays modeling in agrivoltaics is also provided. The dataset is provided for further use or study as open source. For any questions on the dataset, email silvana.ovaitt@nlr.gov.

14 SOLAR ENERGY↗

Validating a Model for Welding Induced Residual Stress Using High-Energy X-ray Diffraction

Integrated computational materials engineering (ICME) provides a pathway to advance performance in structures through the use of physically-based models to better understand how manufacturing processes influence product performance. As one particular challenge, consider that residual stresses induced in fabrication are pervasive and directly impact the life of structures. For ICME to be an effective strategy, it is essential that predictive capability be developed in conjunction with critical experiments. In the present paper, simulation results from a multi-physics model for gas metal arc welding are evaluated through x-ray diffraction using synchrotron radiation. A test component was designed with intent to develop significant gradients in residual stress, be representative of real-world engineering application, yet remain tractable for finely spaced strain measurements with positioning equipment available at synchrotron facilities. Finally, the experimental validation lends confidence to model predictions, facilitating the explicit consideration of residual stress distribution in prediction of fatigue life.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Modeling and Validation of Irradiation Damage in Ni-based Alloys for Long-Term LWR Applications (Final Report)

As light water reactor (LWR) plant lives are extended, the need for predictive modeling tools for materials degradation increase in order to ensure safe operation and plan for component replacements. The Grizzly code, which is built on the MOOSE multi-physics simulation environment, is being developed for exactly this purpose. To extend Grizzly to include capabilities for modeling Ni-based alloys, we propose a US/UK integrated program to address thermal and irradiation-induced transformations mechanisms of Alloys 690 and 625. Alloy 690 is widely used in existing LWR plants due to its superior stress corrosion cracking (SCC) resistance compared to Alloy 600. Alloy 625 is used in more limited applications but offers the benefits of both high strength (in the aged condition) and corrosion/SCC resistance. Research has shown that both alloys can undergo phase changes due to thermal or irradiation exposure. In the precipitation-hardened condition, Alloy 625 “softens” during neutron irradiation as the strengthening precipitates decompose and metastable precipitates form. However, the nature and rates of these transformations as a function of exposure conditions are not well understood. Similarly, the effects of these thermal and irradiation-induced microstructural changes on mechanical properties require evaluation. The proposed program combines thermal and irradiation experiments, mechanical testing, microstructural characterization using state-of-the art analytical techniques, atomistic modeling, micro-and macro-scale modeling via Grizzly. This multi-pronged approach yields several benefits: 1) atomistic scale models capture the physics of the mechanisms of phase transformations, which can be generalized to other systems, 2) the modeling results (from atomistic to continuum) will be validated experimentally to ensure the predictive aspect, 3) the microstructure/property relationships captured with mechanical testing provides information at the engineering scale that is needed to validate the integration of the proposed new capability into Grizzly

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

PyForecastTools

This package provides a basic toolkit for model validation and forecast verification, implemented in Python. The code is designed to aid model validation tasks for users of the standard scientific python stack. Functions and classes are provided to calculate a broad range of metrics for continuous and categorical predictions.

Morley, Steven↗

Modeling and validation of single-chamber microbial fuel cell cathode biofilm growth and response to oxidant gas composition

This work describes experiments and computational simulations to analyze single-chamber, air-cathode microbial fuel cell (MFC) performance and cathodic limitations in terms of current generation, power output, mass transport, biomass competition, and biofilm growth. Steady-state and transient cathode models were developed and experimentally validated. Two cathode gas mixtures were used to explore oxygen transport in the cathode: the MFCs exposed to a helium-oxygen mixture (heliox) produced higher current and power output than the group of MFCs exposed to air or a nitrogen-oxygen mixture (nitrox), indicating a dependence on gas-phase transport in the cathode. Multi-substance transport, biological reactions, and electrochemical reactions in a multi-layer and multi-biomass cathode biofilm were also simulated in a transient model. The transient model described biofilm growth over 15 days while providing insight into mass transport and cathodic dissolved species concentration profiles during biofilm growth. Lastly, simulation results predict that the dissolved oxygen content and diffusion in the cathode are key parameters affecting the power output of the air-cathode MFC system, with greater oxygen content in the cathode resulting in increased power output and fully-matured biomass.

59 BASIC BIOLOGICAL SCIENCES↗

Initial Verification and Validation Assessment for VERA

The Virtual Environment for Reactor Applications (VERA) code suite is assessed in terms of capability and credibility against the Consortium for Advanced Simulation of Light Water Reactors (CASL) Verification and Validation Plan (presented herein) in the context of three selected challenge problems: CRUD-Induced Power Shift (CIPS), Departure from Nucleate Boiling (DNB), and Pellet-Clad Interaction (PCI). Capability refers to evidence of required functionality for capturing phenomena of interest while capability refers to the evidence that provides confidence in the calculated results. For this assessment, each challenge problem defines a set of phenomenological requirements against which the VERA software is assessed. This approach, in turn, enables the focused assessment of only those capabilities relevant to the challenge problem. The evaluation of VERA against the challenge problem requirements represents a capability assessment. The mechanism for assessment is the Sandia-developed Predictive Capability Maturity Model (PCMM) that, for this assessment, evaluates VERA on 8 major criteria: (1) Representation and Geometric Fidelity, (2) Physics and Material Model Fidelity, (3) Software Quality Assurance and Engineering, (4) Code Verification, (5) Solution Verification, (6) Separate Effects Model Validation, (7) Integral Effects Model Validation, and (8) Uncertainty Quantification. For each attribute, a maturity score from zero to three is assigned in the context of each challenge problem. The evaluation of these eight elements constitutes the credibility assessment for VERA.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Updated Verification and Validation Assessment for VERA

The Virtual Environment for Reactor Applications (VERA) code suite is assessed in terms of capability and credibility against the Consortium for Advanced Simulation of Light Water Reactors (CASL) Verification and Validation Plan (presented herein) in the context of three selected challenge problems: CRUD-Induced Power Shift (CIPS), Departure from Nucleate Boiling (DNB), and Pellet-Clad Interaction (PCI). Capability refers to evidence of required functionality for capturing phenomena of interest while credibility refers to the evidence that provides confidence in the calculated results. For this assessment, each challenge problem defines a set of phenomenological requirements against which the VERA software is assessed. This approach, in turn, enables the focused assessment of only those capabilities relevant to the challenge problem. The evaluation of VERA against the challenge problem requirements represents a capability assessment. The mechanism for assessment is the Sandia-developed Predictive Capability Maturity Model (PCMM) that, for this assessment, evaluates VERA on 8 major criteria: (1) Representation and Geometric Fidelity, (2) Physics and Material Model Fidelity, (3) Software Quality Assurance and Engineering, (4) Code Verification, (5) Solution Verification, (6) Separate Effects Model Validation, (7) Integral Effects Model Validation, and (8) Uncertainty Quantification. For each attribute, a maturity score from zero to three is assigned in the context of each challenge problem. The evaluation of these eight elements constitutes the credibility assessment for VERA.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Updated Verification and Validation Assessment for VERA

The Virtual Environment for Reactor Applications (VERA) code suite is assessed in terms of capability and credibility against the Consortium for Advanced Simulation of Light Water Reactors (CASL) Verification and Validation Plan (presented herein) in the context of three selected challenge problems: CRUD-Induced Power Shift (CIPS), Departure from Nucleate Boiling (DNB), and Pellet-Clad Interaction (PCI). Capability refers to evidence of required functionality for capturing phenomena of interest while credibility refers to the evidence that provides confidence in the calculated results. For this assessment, each challenge problem defines a set of phenomenological requirements against which the VERA software is assessed. This approach, in turn, enables the focused assessment of only those capabilities relevant to the challenge problem. The evaluation of VERA against the challenge problem requirements represents a capability assessment. The mechanism for assessment is the Sandia-developed Predictive Capability Maturity Model (PCMM) that, for this assessment, evaluates VERA on 8 major criteria: (1) Representation and Geometric Fidelity, (2) Physics and Material Model Fidelity, (3) Software Quality Assurance and Engineering, (4) Code Verification, (5) Solution Verification, (6) Separate Effects Model Validation, (7) Integral Effects Model Validation, and (8) Uncertainty Quantification. For each attribute, a maturity score from zero to three is assigned in the context of each challenge problem. The evaluation of these eight elements constitutes the credibility assessment for VERA.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Dispersive shell pellet injection modeling and validation for DIII-D disruption mitigation

Dispersive shell pellet injection for disruption mitigation on the DIII-D tokamak is modeled with the 3D MHD code NIMROD. The simulations attempt to reproduce as closely as possible a pellet velocity scan that was performed on the DIII-D tokamak [Hollmann, et al., Phys. Rev. Lett. 122, 65001 (2019)]. This scan involved injecting a hollow diamond shell filled with boron dust that is released in the core of the plasma. Trends that are reproduced in the simulation include improved mitigation, reduced plasma current spike amplitude, and increased likelihood of hot-tail runaway electron production with increased pellet speed. The simulations provide additional physics insight into these findings. Limitations of the present model and requirements for a predictive model are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Large Language Model for Validation, Optical Calibration, and Learning (VOCAL) Distributed Temperature Sensing Interface

Distributed temperature sensing (DTS) using fiber optic sensors (FOS) offers a promising method for temperature measurements in advanced reactors, such as sodium fast reactors and molten salt cooled reactors. To support the calibration and validation of DTS measurements, Argonne National Laboratory developed the Validation, Optical Calibration, and Learning (VOCAL) software package. This report describes the integration of a local large language model (LLM) with a retrieval-augmented generation (RAG) system into the VOCAL interface to serve as an interactive user assistant. The LLM framework enhances the VOCAL platform’s accessibility to users by explaining interface components, clarifying inputs and outputs, and answering user queries dynamically in real-time. The accuracy of the LLM assistant performance was evaluated with 20 queries regarding the interface and its parameters using experimental data from the Thermal Hydraulic Experimental Test Article (THETA) facility. Results demonstrate that the LLM achieved a 95% accuracy rate, with a BERTScore of 0.8816 and SBERT value of 0.7417. Furthermore, validation of the RAG system within the LLM framework showed optimal accuracy with k-values between 1 and 2 using the k-refinement convergence test. The prompt perturbation analysis demonstrated good initial consistency for the RAG system, exhibiting the highest accuracy under punctuation variations and the greatest sensitivity under query reordering. Notably, the model’s errors were limited to data retrieval failures rather than factual hallucinations, reinforcing its baseline reliability. The integration of LLM provides a highly accurate, userfriendly enhancement to the VOCAL platform without disrupting its core computational capabilities for FOS calibration and validation.

Hong, Evan↗