Search NASA⌕ Search

SEARCH · Search NASA

Results for “fine tuning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

ChatPORT: Fine-Tuned LLM for Easy Code {PORT}ing

Fine-tuning existing LLMs for specialized tasks has become a very attractive alternative due to its low cost and quick development cycle. With many pre-trained LLMs available, it is an increasingly complex task to choose the correct model as the starting point or base model. In this work we discuss ChatPORT - a specialized fine-tuned LLM geared towards providing correctly translated codes from one programming model to another. We evaluate a number of base models and compare and contrast their features and characteristics that make them a viable starting point. In this paper, we focus on the OpenMP offload porting capabilities of ChatPORT. We build our training data using kernels from the Heterogeneous Computing Benchmarks (HeCBench) [12] and the OpenMP Validation and Verification suite [5] to fine-tune the base models. We then test the model using unseen kernels extracted from the HeCBench benchmark suite. Our results show that: (1) not all open LLMs geared towards HPC are aware of programming models like OpenMP, (2) although all base models benefit from fine-tuning they learn differently and produce different correctness rates, (3) depending on the memory size and compute resource available, different base models can be used for fine-tuning without significantly affecting the quality of transpiled code they generate, (4) fine-tuning improved the correctness rate of the LLM by an average of 43.2%, and (5) feedback-based training data further increased the correctness rate by an average of 6% over the LLMs tested.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗
DOE OSTI2024

Assessment of fine-tuned large language models for real-world chemistry and material science applications

The current generation of large language models (LLMs) has limited chemical knowledge. Recently, it has been shown that these LLMs can learn and predict chemical properties through fine-tuning. Using natural language to train machine learning models opens doors to a wider chemical audience, as field-specific featurization techniques can be omitted. In this work, we explore the potential and limitations of this approach. We studied the performance of fine-tuning three open-source LLMs (GPT-J-6B, Llama-3.1-8B, and Mistral-7B) for a range of different chemical questions. We benchmark their performances against “traditional” machine learning models and find that, in most cases, the fine-tuning approach is superior for a simple classification problem. Depending on the size of the dataset and the type of questions, we also successfully address more sophisticated problems. The most important conclusions of this work are that, for all datasets considered, their conversion into an LLM fine-tuning training set is straightforward and that fine-tuning with even relatively small datasets leads to predictive models. These results suggest that the systematic use of LLMs to guide experiments and simulations will be a powerful technique in any research study, significantly reducing unnecessary experiments or computations.

Van Herck, Joren↗
DOE OSTI2025

Fine-tuning machine-learned particle-flow reconstruction for new detector geometries in future colliders

We demonstrate transfer learning capabilities in a machine-learned algorithm trained for particle-flow reconstruction in high energy particle colliders. This paper presents a cross-detector fine-tuning study, where we initially pretrain the model on a large full simulation dataset from one detector design, and subsequently fine-tune the model on a sample with a different collider and detector design. Specifically, we use the Compact Linear Collider detector (CLICdet) model for the initial training set and demonstrate successful knowledge transfer to the CLIC-like detector (CLD) proposed for the Future Circular Collider in electron-positron mode. We show that with an order of magnitude less samples from the second dataset, we can achieve the same performance as a costly training from scratch, across particle-level and event-level performance metrics, including jet and missing transverse momentum resolution. Furthermore, we find that the fine-tuned model achieves comparable performance to the traditional rule-based particle-flow approach on event-level metrics after training on 100,000 CLD events, whereas a model trained from scratch requires at least 1 million CLD events to achieve similar reconstruction performance. To our knowledge, this represents the first full-simulation cross-detector transfer learning study for particle-flow reconstruction. These findings offer valuable insights towards building large foundation models that can be fine-tuned across different detector designs and geometries, helping to accelerate the development cycle for new detectors and opening the door to rapid detector design and optimization using machine learning.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Enhancing generative molecular design via uncertainty-guided fine-tuning of variational autoencoders

In recent years, deep generative models have been successfully applied to various molecular design tasks, particularly in the life and materials sciences. One critical challenge for pre-trained generative molecular design (GMD) models is to fine-tune them to be better suited for downstream design tasks that aim at optimizing specific molecular properties. However, redesigning and training an existing effective generative model from scratch for each new design task are impractical. Furthermore, the black-box nature of typical downstream tasks that involve property prediction makes it nontrivial to optimize the generative model in a task-specific manner. In this work, we propose an uncertainty-guided fine-tuning strategy that can effectively enhance a pre-trained variational autoencoder (VAE) for GMD through performance feedback in an active learning setting. The strategy begins by quantifying the model uncertainty of the generative model using an efficient active subspace-based UQ (uncertainty quantification) scheme. Next, the decoder diversity within the characterized model uncertainty class is explored to expand the viable space of molecular generation. The low-dimensionality of the active subspace makes this exploration tractable using a black-box optimization scheme, which in turn enables us to identify and leverage a diverse set of high-performing models to generate enhanced molecules. Empirical results across six target molecular properties using multiple VAE-based generative models demonstrate that our uncertainty-guided fine-tuning strategy consistently leads to improved models that outperform the original pre-trained models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

GeoLoRA: Geometric integration for parameter efficient fine-tuning

Low-Rank Adaptation (LoRA) has become a widely used method for parameter-efficient fine-tuning of large-scale, pre-trained neural networks. However, LoRA and its extensions face several challenges, including the need for rank adaptivity, robustness, and computational efficiency during the fine-tuning process. We introduce GeoLoRA, a novel approach that addresses these limitations by leveraging dynamical low-rank approximation theory. GeoLoRA requires only a single backpropagation pass over the small-rank adapters, significantly reducing computational cost as compared to similar dynamical low-rank training methods and making it faster than popular baselines such as AdaLoRA. This allows GeoLoRA to efficiently adapt the allocated parameter budget across the model, achieving smaller low-rank adapters compared to heuristic methods like AdaLoRA and LoRA, while maintaining critical convergence, descent, and error-bound theoretical guarantees. The resulting method is not only more efficient but also more robust to varying hyperparameter settings. We demonstrate the effectiveness of GeoLoRA on several state-of-the-art benchmarks, showing that it outperforms existing methods in both accuracy and computational efficiency.

Schotthoefer, Steffen [ORNL] (ORCID:00000002156965↗
DOE OSTI2026

Agentic framework for programmatic crystal structure generation using a fine-tuned worker–supervisor large language model

Platinum group metals (PGMs) underpin many catalytic technologies but face severe supply constraints, motivating the search for alternative materials and computational methods to accelerate discovery. While atomistic simulation tools such as Pymatgen and ASE have streamlined structure manipulation, they require detailed inputs, limiting accessibility for experimentalists and slowing early-stage exploration. Here, in this study, we present an AI-driven agentic framework that orchestrates worker–supervisor large language models (LLMs). The worker translates natural-language prompts of varying abstraction into valid crystallographic structures using a compact LLM fine-tuned with low-rank adaptation on a curated text–code–CIF dataset, emphasizing energy-efficient training. Benchmarking against the baseline CodeGen-350M-mono model shows that fine-tuning reduces hallucination rates from 100% to as low as 5% and improves structural match accuracy to up to 82% for fully specified inputs. Accuracy declines with decreasing prompt detail but remains nontrivial even when only stoichiometry and space group are provided, underscoring the LLM’s capacity for crystallographic inference. The supervisor Claude LLM evaluates the outputs and triggers iterative refinement through the worker’s built-in structure manipulation capabilities (e.g., supercell scaling, strain, vacancy, and substitution operations). We further demonstrate use cases for technologically relevant catalysts, including IrO 2 , pyrochlore Pb 2 Ir 2 O 7 , Ni 2 FeO 4 , and Ni 3 Mo, where the framework generates physically consistent structures that can be refined via geometry optimization. This work introduces a low-energy, language-driven pathway for integrating human and machine intelligence in materials design, paving the way for AI-assisted synthesis planning and high-throughput screening of complex oxides.

AI agent↗
DOE OSTI2025

Precise interpretations of traditional fine-tuning measures

We uncover two precise interpretations of traditional electroweak fine-tuning (FT) measures that were historically missed. (i) a statistical interpretation : the traditional FT measure shows the change in plausibility of a model in which a parameter was exchanged for the 𝑍 boson mass relative to an untuned model in light of the 𝑍 boson mass measurement. (ii) an information-theoretic interpretation : the traditional FT measure shows the exponential of the extra information, measured in nats, relative to an untuned model that you must supply about a parameter in order to fit the 𝑍 mass. We derive the mathematical results underlying these interpretations, and explain them using examples from weak scale supersymmetry. These new interpretations allow us to rigorously define FT in particle physics and beyond, shed fresh light on the status of extensions to the Standard Model and, lastly, allow us to precisely reinterpret historical and recent studies using traditional FT measures.

electroweak symmetry breaking↗
DOE OSTI2026

Data‐Efficient Generation of Synthetic Microstructures of Polymer‐Bonded Energetic Material With Fine‐Tuned Stable Diffusion

Among current deep learning approaches for synthetic image generation, diffusion-based models stand out in terms of algorithmic stability and ability to retain high-fidelity image features with detailed resolution. Here, in this work, we employ Dreambooth, a method for fine-tuning Stable Diffusion, on X-ray CT images of microstructure of the polymer-bonded form (PBX) of a commonly used high explosive, Pentaerythritol tetranitrate (PETN), which yields generative models for creating synthetic PBX images. The models developed here represent five classes (or ‘lots’) of microstructures and demonstrate successful generation of images of each class with high fidelity, as verified by computed classification accuracy of ∼ 94% or higher. Data augmentation afforded by such image synthesis can be used to more reliably decipher underlying statistics, build processing-structure correlations, recognize off-normal structural anomalies, and identify age-related changes. Ideas related to converting image data into appropriate density mapping and performing mesoscale simulation or surrogate modeling of detonation are also discussed.

Dreambooth↗
DOE OSTI2025

Fine‐Tuning Li‐Ion Solvation Structure by Enhanced Solvent‐Diluent Interactions for Long‐Cycling Lithium Metal Batteries

Achieving durable lithium (Li) metal anodes in liquid electrolytes remains challenging, primarily due to the instability of the formed solid-electrolyte interphases (SEIs). Modulating the Li-ion solvation structures is pivotal in forming a stable SEI for stabilizing Li metal anodes. Here a strategy is developed to fine-tune the Li-ion solvation structures through enhanced dipole–dipole interactions between the Li-ion-coordinated solvent and the non-Li-ion-coordinating diluent, for creating a stable SEI in the developed binary salt electrolyte. The enhanced dipole–dipole interactions weaken the coordination between Li-ions and the solvents while strengthening the interaction between Li-ions and dual anions, thereby facilitating the Li-ion transport and a robust anion-derived SEI with a distinct bilayer structure. Consequently, the developed electrolyte exhibited exceptional electrochemical performance in high energy-density Li||LiNi 0.8 Mn 0.1 Co 0.1 O 2 (NMC811) cells, with long calendar life, stable cyclability at 1 C, and reliable operation between 25 and −20 °C, and it also demonstrat remarkable cycling stability for a Li||NMC811 pouch cell with projected energy density of 402 Wh kg −1 , maintaining 80% capacity retention over 606 cycles under practical conditions.

25 ENERGY STORAGE↗
DOE OSTI2024

Fine-Tuning Microporosity of Crystalline Vanadomolybdate Frameworks for Selective Adsorptive Separation of Kr from Xe

Selective adsorptive capture and separation of chemically inert krypton (Kr) and xenon (Xe) noble gases with very low ppmv concentrations in air and industrial off-gases constitute an important technological challenge. Here, using a synergistic combination of experiment and theory, the microporous crystalline vanadomolybdates (MoVO x ) as highly selective Kr sorbents are studied in detail. By varying the Mo/V ratios, we show for the first time that their one-dimensional (1D) pores can be fine-tuned for the size-selective adsorption of Kr over the larger Xe with selectivities reaching >100. Using extensive electronic structure calculations and grand canonical Monte Carlo simulations, the competition between Kr uptake with CO 2 and N 2 was also investigated. As most materials reported so far are selective toward the larger, more polarizable Xe than Kr, this work constitutes an important step toward robust Kr-selective sorbent materials. Furthermore this work highlights the potential use of porous crystalline transition metal oxides as energy-efficient and selective noble gas capture sorbents for industrial applications.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Atomically Fine-Tuning Organic–Inorganic Carbon Molecular Sieve Membranes for Hydrogen Production

Polymeric membranes with great processability are attractive for the H 2 /CO 2 separation required for hydrogen production from renewable biomass with carbon capture for utilization and sequestration. However, it remains elusive to engineer polymer architectures to obtain desired sub-3.3 Å ultramicropores to efficiently sieve H 2 from CO 2 . Herein, we demonstrate a scalable way of carbonizing polybenzimidazole (PBI) at low temperatures, followed by vapor phase infiltration (VPI) to atomically narrow ultramicropores throughout the films, forming hybrid organic–inorganic carbon molecular sieves (CMSs). One VPI cycle (100 s) for the PBI carbonized at 500 °C remarkably increases H 2 /CO 2 selectivity from 9.6 to 83 at 100 °C, surpassing Robeson’s upper bound. The CMS demonstrates a stable H 2 /CO 2 separation performance when challenged with simulated syngas streams and can be fabricated into thin-film composite membranes, outperforming state-of-the-art membranes. Finally, the scalable approach can be ubiquitous to molecularly fine-tune ultramicropores of leading polymeric membranes to further improve their size-sieving ability and thus separation efficiency.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Theory Guided Fine‐Tune of Strain Effects in Pt Ternary Alloy via Rare Earth Templating: Achieving High Performance PEMFCs Catalysts

The sluggish kinetics and insufficient durability of platinum-based catalysts remain crucial barriers limiting proton-exchange-membrane fuel cells (PEMFCs) deployment. Here, we report a theory-guided synthesis combined with rare-earth templating to realize a previously inaccessible Pt 5 Co-like phase with tailored atomic-scale strain. Guided by density functional theory (DFT) calculations, we identified that a Pt 5 Co-like sublayer can induce a unique mild compressive strain (−1.24%) to the Pt(111) shell and an optimal *OH binding energy shift (ΔE ≈ 0.11 eV). This shift positions the alloy catalyst near the apex of the oxygen reduction reaction activity volcano. This prediction guided the synthesis of ternary alloy Pt 5 (Ce)Co@Pt multilayer nanoparticles, featuring a Ce-stabilized core, a Pt 5 Co-like sublayer, and a Pt-rich shell. This catalyst demonstrates both exceptionally high activity and durability, achieving a mass activity of 2.6 A∙mg Pt −1 in rotating disk electrode testing. In fuel cell membrane electrode assembly tests, Pt 5 (Ce)Co@Pt achieves a current density of 1.9 A∙cm −2 at 0.7 V under heavy-duty vehicle conditions. Remarkably, it maintains 1.2 A∙cm −2 after 1 80 000 AST cycles, doubling the U.S. DOE 2025 target. This work demonstrates a rational design strategy that DFT-guided strain engineering integrates with rare-earth templating to advance Pt-based catalysts for fuel cell applications.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Enhancing ChatPORT with CUDA-to-SYCL Kernel Translation Capability

Large Language Models (LLMs) have shown strong capabilities in general code translation. However, code translation involving parallel programming models remains largely unexplored. This work enhances the capabilities of code LLMs in CUDA-to-SYCL kernel translation with parameter-efficient fine-tuning. The resultant fine-tuned LLM, called ChatPORT, is an effort to provide high-fidelity translations from one programming model to another. We describe the preparation of datasets from heterogeneous computing benchmarks for model fine-tuning and testing, the parameter-efficient fine-tuning of 19 open-source code models ranging in size from 0.5 to 34 billion parameters and evaluate the correctness rates of the SYCL kernels by the fine-tuned models. The experimental results show that most code models fail to translate CUDA codes to SYCL correctly. However, fine-tuning these models using a small set of CUDA and SYCL kernels can enhance the capabilities of these models in kernel translation. Depending on the sizes of the models, the correctness rate ranges from 19.9% to 81.7% for a test dataset of 62 CUDA kernels.

Jin, Zheming [ORNL] (ORCID:000000027197780X)↗
DOE OSTI2026

HydraGNN_OPF_GFM_2026 - Ensemble of predictive graph foundation models for power grid applications

This dataset supports research on graph foundation models for optimal power flow (OPF) on electric grids using HydraGNN. It contains heterogeneous graph representations of PGLib-OPF cases spanning systems from 14 to 13,659 buses, together with packed HDF5 datasets for pretraining, feasibility classification, and N-1 contingency analysis. The release includes OPF solution data, downstream fine-tuning datasets, pretrained HeteroSAGE and HeteroHEAT model checkpoints, hyperparameter-optimization summaries across multiple heterogeneous GNN architectures, and aggregated fine-tuning results for sample-efficiency studies. The dataset is designed to enable scalable training, evaluation, and transfer-learning studies for OPF surrogate modeling, including node-level AC-OPF solution prediction, graph-level prediction, feasibility classification, operating-condition generalization, and contingency-response tasks.

24 POWER TRANSMISSION AND DISTRIBUTION↗