Search NASASearch

SEARCH · Search NASA

Results for “predictive model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

1,059 records · Page 26

Mathematical Model of a Regenerative Fuel Cell for System Optimization

This thesis developed a system-level optimization model of a regenerative fuel cell (RFC) system for long-duration, off-world energy storage applications. Prior RFC design studies have typically been limited to reduced parameter sets and simplified constraints due to computational limitations relative to the number of relevant degrees of freedom. As a result, important nonlinear interactions between subsystems have not been fully captured. This work began to address that gap by developing a higher-fidelity, nonlinear optimization framework that incorporates a broader set of design variables and coupled constraints, enabling a multidimensional model that captures the coupled behavior of RFC subsystems and demonstrates the feasibility of applying optimization to such systems. An expanded system-level optimization approach was established that captures interactions between electrochemical performance, structural requirements, and storage design. This enabled a more comprehensive evaluation of trade-offs than conventional formulations. The model integrates four coupled subsystems: a fuel cell, an electrolyzer, reactant gas, and high-pressure storage tanks, and was formulated to accommodate a wide range of mission parameters, including operational time and required output power. It incorporates constraints on available solar array power, reactant mass balance between production and consumption, and pressure-dependent storage requirements. To enable reliable convergence, the optimization problem was reformulated to reduce dimensionality and improve numerical stability, with subsystem models organized for efficient evaluation. Problem dimensionality was reduced by consolidating lower-level design variables into higher-level representative quantities, and subsystem behavior was evaluated within the optimization loop. A multi-start initialization strategy was employed to mitigate sensitivity to local minima and improve solution quality, while nonlinear relationships were solved using robust numerical methods. The results showed that convergence was achieved across a range of required output power values. Specific energy reached a maximum at a critical mission power level, where the electrolyzer power matched the available solar input and operated near its voltage and current density limits. Beyond this point, further increases in required power resulted in less mass-efficient operation, increasing total system mass and reducing overall performance. The developed model represents an advancement in RFC system-level optimization by enabling analysis of a broader and more tightly coupled design space than previous considerations. While convergence behavior and computational cost remain challenges, the methods introduced improve solvability and allow inclusion of additional design variables with minimal loss of physical fidelity. However, the numerical results should not be interpreted as definitive design recommendations, as the model includes simplifying assumptions and omits several higher-order effects. Future work should extend this framework by incorporating additional subsystems and loss mechanisms, such as thermal management, parasitic power consumption, and reactant losses, to improve fidelity and ensure more representative design conclusions.

Electrochemistry

Characterizing the subglacial environment of lower Thwaites Glacier using radar modeling

Understanding the spatial heterogeneity beneath Thwaites Glacier, West Antarctica, is vital to projecting its impact on future sea levels. Radar-echo sounding (RES) is commonly used to infer subglacial conditions, but these data can be challenging to interpret. We assess basal heterogeneity across Thwaites Glacier by comparing RES returns to a radar backscattering simulator for over 400 km of RES data. The modeled variations in bed returned power exhibited a strong correlation with actual RES data in 40% of our simulated flight segments, which we consider evidence for a relatively homogeneous glacier bed. Other sites (40%) demonstrated improved fit quality when hydrology or substrate transitions were introduced in the bed material model. The remaining simulated segments (20%) were diagnosed as having more complex basal heterogeneity. The spatial distribution of complex heterogeneity appears to coincide with asymmetric patterns in the RES specularity content, which has been interpreted in previous studies as a signature for channelized hydrology. Conversely, the homogeneous substrate locations coincide with areas of fast-moving ice in western Thwaites. Our simulation method can isolate power variations induced by material heterogeneity vs topography, which is an important limitation of existing RES analysis methods.

Antarctic glaciology

Precise Modeling of a Complex Solenoidal Magnetic Field Using a Combination of Analytic Functions and a PINN

We demonstrate an iterative approach to modeling a sparsely measured magnetic field in a large-bore solenoid. This approach uses a hybrid of traditional and machine learning techniques. The traditional technique is a linear least-squares fit using a series solution to Laplace's equation, while the machine learning technique involves the training of a physics-informed neural network (PINN) on the least-squares fit residuals. We use a newly defined activation function "DELTAsnake," a modification to the snake activation function proposed by Ziyin et al. that allows for stronger curvature and non-monotonicity. The combined model approximately obeys Maxwell's equations to a level sufficient for producing high quality physics simulations and analysis. Our approach is applied to a highly realistic calculation of the expected magnetic field in the Mu2e experiment's Detector Solenoid which includes a simple model for the expected statistical measurement uncertainties. Using ten toy measurement simulations, we demonstrate the capabilities of our model in comparison to the least-squares method alone; the least-squares method alone results in a reduced chi-squared statistic of ${2.15 \pm 0.01}$, while our approach improves the reduced chi-square to ${1.034 \pm 0.005}$. Furthermore, for an average toy simulation, we show that the range of the RMS of the three field component residuals reduces from ${0.07-0.37}$ Gauss to ${0.05-0.07}$ Gauss. We find that this novel method is robust against a realistic systematic uncertainty deriving from Hall probe calibration bias and can be used to significantly reduce the number of measurements required to achieve an accurate model.

Kampa, Cole [Caltech] (ORCID:0000000192972920)

A SIMULINK Environment for Flight Dynamics and Control Analysis - Application to the DHC-2 'Beaver', Part 1. Implementation of a Model Library in SIMULINK

The design of advanced Automatic Aircraft Control Systems (AACS's) can be improved upon considerably if the designer can access all models and tools required for control system design and analysis through a graphical user-interface, from within one software environment. This MSc-thesis presents the first step in the development of such an environment, which is currently being done at the Section for Stability and Control of Delft University of Technology, Faculty of Aerospace Engineering. The environment is implemented within the commercially available software package MATLAB/SIMULINK. The report consists of two parts. Part I gives a detailed description of the AACS design environment. The heart of this environment is formed by the SIMULINK implementation of a nonlinear aircraft model in block-diagram format. The model has been worked out for the old laboratory aircraft of the Faculty, the De Havilland DHC-2 'Beaver', but due to its modular structure, it can easily be adapted for other aircraft. Part I also describes MATLAB programs which can be applied for finding steady-state trimmed-flight conditions and for linearization of the aircraft model, and it shows how the built-in simulation routines of SIMULINK have been used for open-loop analysis of the aircraft dynamics. Apart from the implementation of the models and tools, a thorough treatment of the theoretical backgrounds is presented. Part II of this report presents a part of an autopilot design process for the 'Beaver' aircraft, which clearly demonstrates the power and flexibility of the AACS design environment from part I. Evaluations of all longitudinal and lateral control laws by means of nonlinear simulations are treated in detail. The AACS design environment from part I proved to be a very useful tool for designing the control laws of the 'Beaver' autopilot within a very tight time-schedule. The autopilot design process itself will be used as a guideline for future AACS research at the Faculty of Aerospace Engineering. Flight tests of the 'Beaver' autopilot, done after evaluating the control laws in the SIMULINK package, proved to be quite successful. In the future, the AACS design package will evolve into a standardized, integrated design environment which can be applied to virtually any type of aircraft. The AACS design cycle will be shortened further by developing tools for automatically porting control laws from the MATLAB/SIMULINK environment to a piloted real-time flight simulator and the Flight Control Computers of the aircraft.

Aircraft Modelling

Computing the Critical Temperature of the Affine-Transformed $D=3$ Ising Model Using Masked Autoregressive Flow

The simple Ising model provides a rich environment to build and study lattice field theories. As part of an ongoing project to construct a conformal field theory (CFT) on an arbitrarily curved manifold, in this work we develop methods to measure the critical temperature $β_c$ of the affine-transformed Ising model on the face-centered cubic (FCC) lattice. The main challenge in this endeavor is finding a computationally efficient and accurate method of interpolating and extrapolating Monte Carlo observables with respect to coupling coefficients and temperature. Herein, we compare two such methods. A traditional statistical approach uses the multiple histogram (MH) method, while a newer machine learning approach uses a masked autoregressive flow (MAF) to estimate the underlying probability density function of a set of observables. While the MH method is specifically designed to interpolate and extrapolate Monte Carlo observables, we find that MAF is a viable alternative for measuring $β_c$ with a computational cost that scales more favorably. Furthermore, we comment on additional advantages of MAF relevant to our work, such as extrapolating in system volume.

Svenson, Kai [Texas U.]

A Transient Hydrodynamic Model of Screen Channel Liquid Acquisition Devices for In-Space Cryogenic Propellant Management

Screen channel liquid acquisition devices (LADs) will play a crucial role in future deep space travel. It is essential that vapor-free delivery of propellants during tank-to-tank transfer is ensured to maximize yield from storage tanks and prevent potential combustion instabilities. The screen channel LAD utilizes a fine screen wire mesh that can separate phases in a low Bond number (i.e. microgravity) environment using surface tension forces. This study presents the development and verification of a new model for transient screen compliance, one of the influential factors for screen channel LAD design. Screen compliance is crucial during LAD channel outflow transients because the slight deflection of the screen can provide needed mass to satisfy rapid outflow demands and reduce the pressure difference across the screen. The model is successfully verified against CFD simulations. In addition, the characteristic speed for the governing screen compliance equations is derived which allows for numerical stability criteria to be established. As shown in this study, the transient maximum pressure difference across the screen can greatly exceed the steady state maximum pressure difference across the screen in many cases.

Hydrodynamics Simulations

Modeling the Potential Impact of Storage on the US Power Sector in a Multisector Dynamic Context

The electric power sector is expected to grow in size, importance, and complexity around the world as economies expand and electric supply technologies and demand patterns evolve in significant ways. At the same time the electric power sector may see substantial increases in VRE generating technologies which can add variability and uncertainty to the diurnal and seasonal profile of electric supply. With these forces in play, the emergence of modular, flexible electricity storage technologies may have profound impacts on the operation of electric power systems. Here we reduce a storage modeling gap in MSD models by incorporating grid-based electricity storage into the electric sector dynamics of the Global Change Analysis Model-USA (GCAM-USA) with improved power sector representation. We find a potentially significant role for storage technologies in the future of the U.S. power system, with storage capacity ranging from 7.7 to 14.7 GW in 2050 and 13.9 to 31.6 GW in 2100 across several techno-economic scenarios. We also find that storage can help to smooth variability in residual load arising from evolving electricity demands and the introduction of high shares of VRE to the electric grid. This reduces reliance on high-cost peaking generators, improves system-wide capacity factors, and limits curtailment of VRE.

Patel, Pralit L.

Earth Observations and Integrative Models in Support of Food and Water Security

Global food production depends upon many factors that Earth observing satellites routinely measure about water, energy, weather, and ecosystems. Increasingly sophisticated, publicly-available satellite data products can improve efficiencies in resource management and provide earlier indication of environmental disruption. Satellite remote sensing provides a consistent, long-term record that can be used effectively to detect large-scale features over time, such as a developing drought. Accuracy and capabilities have increased along with the range of Earth observations and derived products that can support food security decisions with actionable information. This paper highlights major capabilities facilitated by satellite observations and physical models that have been developed and validated using remotely-sensed observations. Although we primarily focus on variables relevant to agriculture, we also include a brief description of the growing use of Earth observations in support of aquaculture and fisheries.

Water Resources

Energy-Optimal Vehicle Longitudinal Motion Control via Pontryagin’s Minimum Principle and Ultra-Local Model

Longitudinal vehicle motion control is essential for enhancing performance and optimizing a vehicle’s energy usage. However, it remains a challenging task due to the nonlinear and uncertain nature of vehicle dynamics, along with varying driving conditions. This paper presents a novel ultra-local optimal control approach based on Pontryagin’s Minimum Principle (PMP) that circumvents the need for detailed system identification by employing an ultra-local model. The control objective is to minimize the total energy consumption under boundary conditions while ensuring smooth traction force generation. The proposed approach is evaluated using a high-fidelity vehicle model in three representative scenarios: (i) nominal driving, (ii) a change in tire road friction coefficient (TRFC) from 0.5 to 0.65 and road slope from 0% to 5% during the maneuver, with target velocity unchanged, and (iii) a change in target velocity from 20 m/s to 0 m/s during the maneuver, while maintaining nominal TRFC and slope conditions. The simulation results demonstrate that the proposed method delivers robust performance, effectively balancing consumption and tracking accuracy in all tested scenarios.

Waleed khan, Muhammad [The University of Texas at

Integrated Process-Structure-Property Simulations for Additive Manufacturing Using the Open-Source Materialite Package

The microstructure and properties of additively manufactured (AM) metals are strongly dependent on process conditions. Therefore, process-structure-property (PSP) simulations are a useful tool for exploring process parameter space, studying process variations, and quantifying uncertainty in material properties. However, integrating process-structure and structure-property simulations often involves connecting multiple software packages. Each package may use unique data structures and require substantial domain knowledge. This presentation demonstrates PSP simulation capabilities of Materialite, an open-source package developed at NASA Langley Research Center. Materialite simplifies model linkages by using a common data structure and model interface, enabling straightforward simulation across a PSP model chain. Physics-based models, including kinetic Monte Carlo and crystal plasticity, are implemented within the package. The model interface is also intended to simplify implementation of new models and enable integration with external simulation tools. Example use cases include uncertainty quantification with PSP models and GPU-accelerated powder bed fusion AM process models.

additive manufacturing

CFD Modeling of Bi-Directional PMD inside Cryogenic Propellant Tanks Onboard Parabolic Flights

Future cryogenic propulsion systems will require efficient methods with which to transfer cryogenic propellants from a depot storage tank to a customer receiver tank to minimize cost and maximize reusability. The Reduced Gravity Cryogenic Transfer project is currently developing advanced cryogenic fluid management technology and developing and validating new numerical models for three phases of transfer: line chilldown, tank chilldown, and tank fill. Additionally, multiple liquid nitrogen (LN 2 ) parabolic flight transfer rigs are being designed by universities and NASA to investigate the gravitational sensitivities that exist in these three technologies. In order to maximize the collection of low-g data during flights, it is required to extract as much (LN 2 as possible from the supply tank, despite variable gravity levels. The purpose of this paper is to present computational fluid dynamics (CFD) volume of fluid simulations of (LN 2 behavior in the supply tank onboard parabolic flights to validate the optimal design of a bi-directional propellant management device (PMD) using the commercial software FLOW-3D. A parametric study is conducted on the effects of gravity level, fill level, pore size, open area, thickness, and type of baffle on PMD performance. Based on results, the PMD as designed exceeds the targeted expulsion efficiency.

Jason Hartwig

Tidal Tomography Reveals a Thermal Anomaly Beneath Mars’s Crustal Dichotomy

Mars undergoes seasonal tidal forcing as a result of its eccentric orbit and the tilt of its rotation axis relative to the Sun1. Response to this forcing produces temporal variations in the Martian gravity field and is sensitive to the internal structure of the planet2,3,4. Using tracking data from the Mars Global Surveyor (MGS), Mars Odyssey (ODY) and Mars Reconnaissance Orbiter (MRO) spacecraft5,6,7, we demonstrate that degree-3 components of the time-variable gravity field of Mars differ by up to 300% from predictions for a spherically symmetric planet8,9,10. These deviations can be explained if the effective shear modulus of the mantle varies by >20% over a roughly north–south pattern that closely aligns with the surface expression of the Martian crustal dichotomy11. On the basis of this correlation, we infer preservation of a 200–400 °C thermal anomaly in the present-day mantle below the southern highlands of Mars. This temperature variation could reflect regional mantle convection12,13 or insulation by the thick southern highlands crust of Mars that has persisted over several billion years14,15.

Mars

Four Years of Type Ia Supernovae Observed by TESS: Early-time Light-curve Shapes and Constraints on Companion Interaction Models

Abstract We present 307 type Ia supernova (SN) light curves from the first 4 yr of the Transiting Exoplanet Survey Satellite mission. We use this sample to characterize the shapes of the early-time light curves, measure the rise times from first light to peak, and search for companion star interactions. Using simulations, we show that light curves must have noise <10% of the peak flux to avoid biases in the early-time light-curve shape, restricting our quantitative analysis to 74 light curves. We find that the mean power-law index t β 1 of the early-time light curves isβ 1 = 1.93 ± 0.57, and the mean rise time to peak is 15.7 ± 3.5 days. The underlying population distribution forβ 1 may instead consist of a Gaussian component with mean 2.29, width 0.34, and a long tail extending to values less than 1.0. We find that the data can rarely distinguish between models with and without companion interaction models. Nevertheless, we find three high-quality light curves that tentatively prefer the addition of a companion interaction model, but the statistical evidence for the companion interactions is not robust. We also find two SNe that disfavor the addition of a companion interaction model to a curved power-law model. Taking the 74 SNe together, we calculate 3σupper limits on the presence of companion signatures to control for orientation effects that can hide companions in individual light curves. Our results rule out common progenitor systems with companions having Roche lobe radii >31R ⊙ (separations >5.7 × 10 12 cm, 99.9% confidence level) and disfavor companions having Roche lobe radii >10R ⊙ (separations >1.9 × 10 12 cm, 95% confidence level). Lastly, we discuss the implications of our results for the intrinsic fraction of single degenerate progenitor systems.

Astronomy & Astrophysics

Chiral kinematic theory and converse vortical effects

Response theories in condensed matter typically describe the response of an electron fluid to external electromagnetic fields, while perturbations on neutral particles are often designed to mimic such fields. Here, we study the response of fermions to a space-time-dependent velocity field, thereby sidestepping the issue of gauge charge. First, we use a semiclassical chiral kinematic theory to obtain the local density of current and extract the orbital magnetization. The theory immediately predicts a "converse vortical effect," defined as an orbital magnetization driven by linear velocity. It receives contributions from magnetic moments on the Fermi surface and the Berry curvature of the occupied bands. Then, transcending semiclassics via a complementary Kubo formalism reveals that the uniform limit of a clean system receives only the Berry curvature contribution while other limits sense the Fermi surface magnetic moments too. We propose CoSi as a candidate material and suggest magnetometry of a sample under a thermal gradient to detect the effect. Overall, our study sheds light on the effects of a space-time-dependent velocity field on electron fluids and paves the way for exploring quantum materials using new probes and perturbations.

Chen, Kai [University of Houston]

Analytical Model for Atomic Relaxation in Twisted Moiré Materials

By virtue of being atomically thin, the electronic properties of heterostructures built from two-dimensional materials are strongly influenced by atomic relaxation. The atomic layers behave as flexible membranes rather than rigid crystals. Here we develop an analytical theory of lattice relaxation in twisted moiré materials. We obtain analytical results for the lattice displacements and corresponding pseudo gauge fields, as a function of twist angle. We benchmark our results for twisted bilayer graphene and twisted WSe 2 bilayers using large-scale molecular dynamics simulations. Our single-parameter theory is valid in graphene bilayers for twist angles 𝜃 ≳ 0.7°, and in twisted WSe 2 for 𝜃 ≳ 1.6°. Furthermore, we also investigate how relaxation alters the electronic structure in twisted bilayer graphene, providing a simple extension to the continuum model to account for lattice relaxation.

36 MATERIALS SCIENCE

Material Properties and Modeling of Room Temperature Vulcanizing Silicone

Room Temperature Vulcanizing silicone (RTV) is a high-temperature adhesive that has successfully been used as a gap-filler between Thermal Protection System (TPS) tiles for heatshields on numerous missions. It is also used to bond instrumentation plugs such as temperature and pressure sensors into the heatshields. While RTV has been traditionally assumed to be a non-porous and non-ablating material, numerous experiments have shown that RTV pyrolyzes and becomes highly porous as it is heated. Heating RTV has also shown swelling, or intumescence, which can pose unique problems that lead to roughness induced boundary-layer transition, surface oxide formation and contamination of heat shield sensors. Therefore, it is crucial to understand and model the intumescence phenomenon of RTV. As data for RTV material properties is limited, the first step in modeling RTV is to collect material properties such as pyrolysis mass-loss, microstructure change, virgin and char porosity, etc. which was performed in our initial study. Additionally, thermomechanical properties such as Young’s modulus and Poisson ratio are required for modeling the intumescence of RTV, which were taken from literature and the coefficient of thermal expansion was collected using in-situ heating and Micro Computed Tomography (µ-CT) in previous studies. Finally, numerous other properties such as pyrolysis gas properties, virgin and char thermal conductivity and specific heat were compiled from previous experiments and literature into a material database that can be used for simulations. In Porous Material Analysis Toolbox based on OpenFOAM (PATO) [4], structural mechanics coupled with material response was used for simulating the intumescence of RTV as it is heated. However, since the permeability of the material is very low, the pyrolysis gas creates an internal pressure build-up as the material is being heated, significantly contributing to the deformation of the material. To correctly characterize this phenomenon, additional physics models were implemented into PATO's stress analysis solver, and results were compared with RTV dilatometry test data as a preliminary verification case. Future work will include experiments of RTV at the Plasmatron X facility and the in-situ heating cell with µ-CT, and improvement of simulation tools to more accurately model RTV intumescence.

PATO

Advances in Design Capabilities for Planetary Missions from the NASA Entry Systems Modeling and Instrumentation Portfolio

The Entry Systems Modeling project (ESM) is supported by both the NASA Space Technology and the Science Mission Directorates and focuses on developing simulation tools and validated models for characterizing the performance of entry systems tailored to planetary destinations across the Solar System. ESM is organized into six technical capability areas that together address all relevant factors related to spacecraft entry, as well as some aspects of descent: Thermal Protection System (TPS) Materials; Aerothermodynamics; Entry & Descent Vehicle Dynamics; Guidance, Navigation, and Control; Vehicle Systems Analysis; and Advanced Tools and Numerical Methods. Development within the capability areas is undertaken explicitly with a focus on transition and infusion to science missions, human exploration missions, and commercial space activities. The present talk details developments that specifically impact science missions, including simulation tool capabilities that aid in mission design and model development to understand entry system performance at a given destination. Examples of the successful infusion and transition of such project outcomes to science missions also are provided. Several simulation tool development efforts within ESM have resulted in new design capabilities for missions. One such outcome is improved toolsets for mission trajectory and concept of operations design. Specifically, an initiative to couple a leading tool for entry, ascent/descent, and orbital trajectory optimization (Program to Optimize Simulated Trajectories II or POST2) to those used within the Agency for interplanetary trajectory optimization (Copernicus and Monte) has made substantial progress, with the outcomes to date promising to allow efficient trajectory optimization across mission phases. Additionally, toolchains for the evaluation of vehicle performance during entry and descent have been developed that allow assessment of multi-dimensional aeroheating on detailed vehicle geometries, characterization of deployment and inflation of parachutes, and assessment of vehicle dynamic stability during descent. These capabilities are achieved by coupling diverse sets of physics together – material response, computational fluid dynamics, radiation, and vehicle dynamics – to suitably describe complex entry and descent phenomena. Several model development and validation efforts for specific destinations and entry regimes also are underway within the ESM project. For instance, new experimental capabilities to validate radiation models at low densities/high altitudes recently have been established with project support, specifically the Low-Density Shock Tube (LDST) at the NASA Ames Research Center Electric Arc Shock Tube (EAST) facility. The LDST is being leveraged to develop improved models of shock layer kinetics and radiation in Titan atmospheres, while future studies will be conducted in the LDST and the existing high velocity shock tube to provide validation data for radiation models of Venus, Ice Giants, and Mars atmospheres. Models describing the aerothermal and thermo-structural performance of Thermal Protection System (TPS) materials has been another focus, with multiscale modeling activities on-going for the two leading TPS materials applicable to a range of entry conditions and science missions: the Phenolic-Impregnated Carbon Ablator (PICA) and woven materials like 3D Mid-Density Carbon Phenolic (3MDCP). A continual effort is made to infuse and transition outcomes from ESM simulation tool and model development activities into relevant science missions. Significant progress has been made on this front, with missions such as Dragonfly, DAVINCI, and Mars Missions benefitting from project outcomes. The groundwork also is being laid to provide insights into forward looking missions to Gas/Ice Giants as well as for potential sample returns.

Justin Haskins

Large Language Model for Validation, Optical Calibration, and Learning (VOCAL) Distributed Temperature Sensing Interface

Distributed temperature sensing (DTS) using fiber optic sensors (FOS) offers a promising method for temperature measurements in advanced reactors, such as sodium fast reactors and molten salt cooled reactors. To support the calibration and validation of DTS measurements, Argonne National Laboratory developed the Validation, Optical Calibration, and Learning (VOCAL) software package. This report describes the integration of a local large language model (LLM) with a retrieval-augmented generation (RAG) system into the VOCAL interface to serve as an interactive user assistant. The LLM framework enhances the VOCAL platform’s accessibility to users by explaining interface components, clarifying inputs and outputs, and answering user queries dynamically in real-time. The accuracy of the LLM assistant performance was evaluated with 20 queries regarding the interface and its parameters using experimental data from the Thermal Hydraulic Experimental Test Article (THETA) facility. Results demonstrate that the LLM achieved a 95% accuracy rate, with a BERTScore of 0.8816 and SBERT value of 0.7417. Furthermore, validation of the RAG system within the LLM framework showed optimal accuracy with k-values between 1 and 2 using the k-refinement convergence test. The prompt perturbation analysis demonstrated good initial consistency for the RAG system, exhibiting the highest accuracy under punctuation variations and the greatest sensitivity under query reordering. Notably, the model’s errors were limited to data retrieval failures rather than factual hallucinations, reinforcing its baseline reliability. The integration of LLM provides a highly accurate, userfriendly enhancement to the VOCAL platform without disrupting its core computational capabilities for FOS calibration and validation.

Hong, Evan