Search NASA⌕ Search

SEARCH · Search NASA

Results for “Foundation models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Development of New Reactor Core Configuration for Power Uprate - Fuel Reload & Heat Processing Analyses, Core Design, System Safety Assessments, and Fuel Performance Analyses

With the passage of the Infrastructure Investment and Jobs Act in 2021 and the Inflation Reduction Act (IRA) in 2022, the United States stands at a critical juncture for the future of nuclear power. These landmark policies provide significant support for clean energy initiatives, positioning nuclear power as a key component of the nation’s strategy to reduce carbon emissions and achieve energy security. This growing emphasis on nuclear energy is driven by the need for reliable, low-carbon power sources as the country transitions away from fossil fuels. Federal policy, along with increasing state-level support, is encouraging investment in nuclear technology advancements to meet these demands. Building new nuclear power plants (NPPs), however, presents significant challenges due to high costs and long construction timelines. As a result, increasing the power output of existing NPPs through power uprates has emerged as a more feasible and cost-effective strategy. One key area of advancement is the development of accident-tolerant fuel (ATF), such as chromium-coated zirconium alloy cladding, which offers enhanced material performance, enabling power uprates in light water reactors (LWRs). Given the growing demand for nuclear energy fueled by federal policies and state initiatives, it is essential to evaluate the feasibility and benefits of significant power uprates in existing pressurized water reactors (PWRs) using advanced fuel technologies. The introduction of ATF concepts opens new opportunities for safely and economically achieving these power increases. Assessing whether these innovations can support substantial power uprates while maintaining operational safety is crucial to maximizing the potential of the nation’s existing nuclear infrastructure. This project aims to explore how power uprates can be achieved by boosting reactor thermal power output and optimizing reactor core design, while ensuring the safety and economic viability of NPPs. Specifically, it will focus on demonstrating the technical and economic feasibility of power uprates in a PWR using low 5-10% enrichment uranium (LEU+) high burnup (HBU) fuel combined with ATF concepts. In fiscal year 2024 (FY24), the research and development focus on building foundational models and conducting multi-physics performance and safety analyses to support the power uprate. The findings of the study would be shared through LWRS Seasonal Meetings, conferences and workshops with utility companies and researchers. These also serve as a basis for further study of fuel reloading optimization with ATF claddings.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics

AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.

Lu, Dan↗
DOE OSTI2025

Electron-Proton Scattering Event Generation using Structured Tokenization

Recent work such as Omnijet-$\alpha$ has demonstrated that effective tokenization combined with transformer-based architectures can produce effective foundation models for jet physics. While tokenization may help models capture generalizable event characteristics, it also introduces discretization errors that may compromise the precision required for downstream physics analyses. As the number and complexity of the particle features grow, these errors are likely to grow proportionally. In this study, we investigate new tokenization strategies to improve the application of generative transformer models to \textsc{Pythia8} simulations of electron-proton scattering at the Electron-Ion Collider. Specifically, we propose a feature-based structured tokenization approach that utilizes multiple tokens per particle, improving expressivity, while reducing the total number of unique tokens needed. We evaluate this method against grid-based binning, K-means clustering, and vector-quantized variational auto-encoders on the event simulations. Our results show that feature-based structured tokenization reduces discretization error, leading to more accurate generative modeling of particle-level events.

Goldenberg, Steven [Thomas Jefferson National Acce↗
DOE OSTI2024

Early Career Researcher Support for Foundations of Molecular Modeling and Simulation Conference

This project enabled 14 early career researchers, including graduate students and postdocs, to attend the 8th triennial conference on Foundations of Molecular Modeling and Simulation (FOMMS 2022), which took place in Delavan, WI (Lake Geneva area), from July 17 to 21, 2022. Molecular-level modeling and simulation, which serve as critical tools for advancing science and engineering in a myriad of applications, were at the forefront of discussions. These ranged from the design of new materials for various energy applications to insights into the interaction between drug molecules and protein receptors within the body.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1986

Theoretical Foundation for Weld Modeling

Differential equations describe physics of tungsten/inert-gas and plasma-arc welding in aluminum. Report collects and describes necessary theoretical foundation upon which numerical welding model is constructed for tungsten/inert gas or plasma-arc welding in aluminum without keyhole. Governing partial differential equations for flow of heat, metal, and current given, together with boundary conditions relevant to welding process. Numerical estimates for relative importance of various phenomena and required properties of 2219 aluminum included

Traugott, S.↗
DOE OSTI2025

Leveraging AI and Spatial Data to Unlock Pipeline Integrity Insights: NETL’s Advanced Infrastructure Integrity Model (AIIM)

Maintaining the integrity of natural gas infrastructure plays a critical role in ensuring energy security. Robust, data-driven foundational AI models for pipeline integrity can help address risk management and mitigation issues. Trusted foundational models can help with industry adoption and accelerate innovation by enhancing integrity predictions, reduce costs, and informing infrastructure build-out. The AIIM dashboard was released in 2022 and utilizes multi-ML models for ensemble-type insights. It was expanded to include analytics on reported incidents. It was developed as an ESRI Dashboard to support data visualization & interrogation and contains pipeline data and model results.

Advanced Infrastructure Integrity Model (AIIM)↗
NASA NTRS2024

Out of Plane Stresses Using a Beam-Based Elastic Foundation Bonded Joint Model

Efficient, semi-analytical models of bonded joints are utilized for initial joint design and sizing due to their convenience and speed. Many of these models are based on beam and plate theories, which are most applicable when in-plane stresses/strains dominate. While this can be a sensible assumption for obtaining the deformations of the joint, out of plane (transverse) stresses are often of critical importance for failure in bonded joints composed of fiber reinforced composite materials. Since through-thickness strains are neglected in these semi-analytical theories, the present study shows a method to back-calculate the out of plane stresses based on stress balance equations, which use the in-plane stresses and displacements that have already been obtained. The method was implemented within the Joint Element Designer (JED) software, and verification and validation examples have been shown. As is typical for these types of models, corner stress singularities are not captured by the JED model, but the general trends of the stress and deformation fields agreed with a higher fidelity finite element model. As such, this method for obtaining out of plane stresses, when coupled with the JED code, is very useful for the complete stress analysis of bonded composite joints.

composites↗
DOE OSTI2024

Evaluating the Use of Foundational Chemical Language Models in Multimodal Graph Fusion

Rapid and accurate prediction of the physicochemical properties of molecules given their structures remains a key challenge in cheminformatics. Machine learning approaches offer high-throughput options, but the optimality of inductive biases and data representations are up for debate. For example, BERT-based masked language models (MLMs) can be trained in a self-supervised way on hundreds of millions to billions of readily available SMILES strings. Another option is graph neural networks (GNNs), which can operate directly on molecular structures. Yet, generating accurate molecular geometry is computationally expensive, leading to a relative scarcity in data compared to SMILES strings. It is attractive to combine these two paradigms by pre-training an LM on a large corpus of SMILES strings and embedding these representation into a geometric graph neural network. Despite the promise of such an approach, and contrary to previous studies, we find mixed results with the combination of the LMs and GNNs on several molecule datasets. In particular, we found evidence for improvement on the FreeSolv and QM7 benchmarks, but degraded performance on the ESOL, LIPO and QM9 datasets compared to a GNN baseline.

Francel, Collin [University of Alabama]↗
DOE OSTI2025

Utilizing AI and Spatial Data to Identify & Rapidly Disseminate Energy Infrastructure Insights

GeoGov Summit Final Presentation entitled "Utilizing AI and Spatial Data to Identify & Rapidly Disseminate Energy Infrastructure Insights". Maintaining the integrity of energy infrastructure plays a critical role in ensuring energy security. Robust foundational AI models using data from federal, state, industry, and other sources can help address integrity risk management & mitigation issues as well as evaluate extended use strategies. Trusted foundational models can help with industry adoption and accelerate innovation by enhancing integrity predictions, reduce costs, and informing infrastructure build-out. Coordination, collaboration & data sharing to develop robust models to aid in: Optimizing operations; Minimizing costs; Ensuring energy security.

Advanced Infrastructure Integrity Model (AIIM)↗
DOE OSTI2026

Fidelity-preserving enhancement of ptychography with foundational text-to-image models

Ptychographic phase retrieval enables high-resolution imaging of complex samples but often suffers from artifacts such as grid pathology and multislice crosstalk, which degrade reconstructed images. We propose a plug-and-play (PnP) framework that integrates physics model-based phase retrieval with text-guided image editing using foundational diffusion models. By employing the alternating direction method of multipliers, our approach ensures consensus between data fidelity and artifact removal subproblems, maintaining physical consistency while enhancing image quality. Artifact removal is achieved using a text-guided diffusion image editing method (LEDITS++) with a pre-trained foundational diffusion model, allowing users to specify artifacts for removal in natural language. Demonstrations on simulated and experimental datasets show significant improvements in artifact suppression and structural fidelity, validated by metrics such as peak signal-to-noise ratio and diffraction pattern consistency. This work highlights the combination of text-guided generative models and model-based phase retrieval algorithms as a transferable and fidelity-preserving method for high-quality diffraction imaging.

image editing↗
DOE OSTI2026

Neural Scaling Laws for Jet Generation

Recently observed empirical scaling laws describe the performance of foundation-type models as three independent key quantities -- dataset size, compute, and model parameters -- are modified. Extracting these scaling laws informs the training of large complex models for which the tuning of hyperparameters in traditional ways is not feasible. This work for the first time explores if scaling laws can also be observed for the task of particle jet generation -- both relevant as a pre-training objective for foundation models and as in-situ simulation by itself. We indeed replicate the key logarithmic scaling law behavior for model-size scaling. Beyond studying the next token prediction validation loss of the generative model, we also study the sliced Wasserstein distance of five physical quantities that are not immediately available to the model during training. Our study shows that this quantity is monotonically related to the next token prediction validation loss, meaning that this loss is indeed a good proxy for the physics performance. For the scaling with dataset size and compute, we observe substantially weaker scaling behavior of both the loss and the sliced Wasserstein distance. We analyze this behavior by introducing the concept of a learnable window, and argue that autoregressive next token prediction on jet constituents exhibits comparatively rapid saturation relative to language-model studies. We discuss possible origins of this behavior, including the stochastic nature of QCD radiation and differences between generative and supervised learning tasks in collider physics.

Amram, Oz [Fermilab]↗
DOE OSTI2026

Improving Process Level Understanding of Boundary Layer Winds over the Northeast U.S. Shelf: The Third Wind Forecast Improvement Project (WFIP3)

The third Wind Forecast Improvement Project (WFIP3), a U.S. Department of Energy and National Oceanic and Atmospheric Administration sponsored investigation, sought to improve understanding of the physical phenomena in the atmosphere and ocean that dictate the structure and variability of wind and thermodynamic fields within the marine atmospheric boundary layer. WFIP3 focused on mesoscale and submesoscale flows -- including sea breezes, low-level jets, low-level clouds, and coastal storms -- and the ability of advanced numerical model parameterizations to represent them within fully coupled oceanic and atmospheric modeling systems and foundational weather forecast models. WFIP3 conducted a comprehensive 18-month observational study over the Northeast U.S. outer continental shelf, a high-use coastal zone, using a 3D multiscale sensor array to highly resolve the temporal, vertical, and horizontal structure of the coupled atmospheric and oceanic boundary layers. Multiple land-based study sites adjacent to the coastal ocean observed surface meteorology and vertical profiles of atmospheric properties via passive infrared and microwave radiometers, active lidars and radars, and radiosondes. At sea, an array of surface flux buoys and two vertical profiling lidar buoys observed both atmospheric and oceanic properties, augmented by land-based oceanographic radar systems and routine ship-based surveys. Intensive observations of the marine atmospheric boundary layer over the ocean was done from an air-sea interaction flux tower and extended deployments of a large autonomous barge platform. Numerous critical forecasting phenomena were observed that are being evaluated within regional coupled and uncoupled modeling systems, including the National Oceanic and Atmospheric Administration's foundational High-Resolution Rapid Refresh forecast model.

Kirincich, Anthony↗
DOE OSTI2024

CryoSegNet: accurate cryo-EM protein particle picking by integrating the foundational AI image segmentation model and attention-gated U-Net

Picking protein particles in cryo-electron microscopy (cryo-EM) micrographs is a crucial step in the cryo-EM-based structure determination. However, existing methods trained on a limited amount of cryo-EM data still cannot accurately pick protein particles from noisy cryo-EM images. The general foundational artificial intelligence–based image segmentation model such as Meta’s Segment Anything Model (SAM) cannot segment protein particles well because their training data do not include cryo-EM images. Here, we present a novel approach (CryoSegNet) of integrating an attention-gated U-shape network (U-Net) specially designed and trained for cryo-EM particle picking and the SAM. The U-Net is first trained on a large cryo-EM image dataset and then used to generate input from original cryo-EM images for SAM to make particle pickings. CryoSegNet shows both high precision and recall in segmenting protein particles from cryo-EM micrographs, irrespective of protein type, shape and size. On several independent datasets of various protein types, CryoSegNet outperforms two top machine learning particle pickers crYOLO and Topaz as well as SAM itself. The average resolution of density maps reconstructed from the particles picked by CryoSegNet is 3.33 Å, 7% better than 3.58 Å of Topaz and 14% better than 3.87 Å of crYOLO. It is publicly available at https://github.com/jianlin-cheng/CryoSegNet

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1991

System monitoring and diagnosis with qualitative models

A substantial foundation of tools for model-based reasoning with incomplete knowledge was developed: QSIM (a qualitative simulation program) and its extensions for qualitative simulation; Q2, Q3 and their successors for quantitative reasoning on a qualitative framework; and the CC (component-connection) and QPC (Qualitative Process Theory) model compilers for building QSIM QDE (qualitative differential equation) models starting from different ontological assumptions. Other model-compilers for QDE's, e.g., using bond graphs or compartmental models, have been developed elsewhere. These model-building tools will support automatic construction of qualitative models from physical specifications, and further research into selection of appropriate modeling viewpoints. For monitoring and diagnosis, plausible hypotheses are unified against observations to strengthen or refute the predicted behaviors. In MIMIC (Model Integration via Mesh Interpolation Coefficients), multiple hypothesized models of the system are tracked in parallel in order to reduce the 'missing model' problem. Each model begins as a qualitative model, and is unified with a priori quantitative knowledge and with the stream of incoming observational data. When the model/data unification yields a contradiction, the model is refuted. When there is no contradiction, the predictions of the model are progressively strengthened, for use in procedure planning and differential diagnosis. Only under a qualitative level of description can a finite set of models guarantee the complete coverage necessary for this performance. The results of this research are presented in several publications. Abstracts of these published papers are presented along with abtracts of papers representing work that was synergistic with the NASA grant but funded otherwise. These 28 papers include but are not limited to: 'Combined qualitative and numerical simulation with Q3'; 'Comparative analysis and qualitative integral representations'; 'Model-based monitoring of dynamic systems'; 'Numerical behavior envelopes for qualitative models'; 'Higher-order derivative constraints in qualitative simulation'; and 'Non-intersection of trajectories in qualitative phase space: a global constraint for qualitative simulation.'

Kuipers, Benjamin↗
DOE OSTI2026

Improving High Resolution Offshore Wind Resource Assessments and Forecasts using Observations in the MA/RI Lease Areas

The third Wind Forecast Improvement Project (WFIP3) sought to improve understanding of the physical phenomena in the atmosphere and ocean that dictate the structure and variability of wind and thermodynamic fields within the Marine Atmospheric Boundary Layer (MABL). WFIP3 conducted a comprehensive 18-month observational study over the Northeast U.S. outer continental shelf, a high use coastal zone, using a 3-D multiscale sensor array to highly resolve the temporal, vertical, and horizontal structure of the coupled atmospheric and oceanic boundary layers. Multiple land-based study sites adjacent to the coastal ocean observed surface meteorology and vertical profiles of atmospheric properties via passive infrared and microwave radiometers, active lidars and radars, and radiosondes. At sea, an array of surface flux buoys and two vertical profiling lidar buoys observed both atmospheric and oceanic properties, augmented by land-based oceanographic radar systems and routine ship-based surveys. Intensive observations of the MABL over the ocean was done from an air-sea interaction flux tower and extended deployments of a large barge platform. WFIP3 focused on mesoscale and sub-mesoscale flows -- including sea breezes, low-level jets, low-level clouds, and coastal storms -- and the ability of advanced numerical model parameterizations to represent them within fully coupled oceanic and atmospheric modeling systems and foundational weather forecast models. Numerous critical forecasting phenomena were observed, however the project was terminated prior to the completion of the field observational period and the analysis period.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Long Duration Medical System Foundation for Lunar Orbital and Lunar Surface Exploration Missions

For long-duration lunar orbital and lunar surface (LDLOS) exploration missions, the NASA Human Research Program (HRP) Exploration Medical Capability (ExMC) Element has developed a medical system foundation through which clinical considerations may be represented via a systems engineering-based model. Components of the Long Duration Medical System Foundation model include a concept of operations (ConOps), functional decomposition, medical conditions to be addressed, clinical capabilities and resources, technical requirements, and traces of requirements to NASA standards documents and parent-level (Program- and Vehicle habitat system-level) requirements. The Foundation model offers the means to present information in a readily accessible format that is understandable across all clinical, engineering, scientific, and managerial disciplines. Collectively, these components constitute a foundation that serves future programs with similar long duration mission profiles as a starting point for medical system design. The Foundation was developed by a multidisciplinary team of systems engineers, scientists, and clinicians across NASA. The process started with ConOps development, subsequently decomposed into the functionalities needed to diagnose, treat, and prevent medical conditions. The clinical team identified medical conditions most likely needed to be diagnosed and treated during a long-duration lunar exploration mission. Through these approaches, requirements were codified for the LDLOS medical system. These requirements were then traced to NASA standards, medical conditions, medical capabilities, and medical resources, facilitating stakeholders’ use of the Foundation model to analyze traces and to identify medical system interfaces with other vehicle systems or subsystems. In addition, the Foundation may be used as a basis for performing risk trades on medical system mass and volume allocation. This discussion will focus on the processes through which the LDLOS Medical System Foundation was developed, how the Foundation builds a bridge between the medical and engineering domains, and how these processes may be applied more broadly to a crew health and performance system and other system domains.

Jay Lemery↗
DOE OSTI2024

Calibration and validation of the foundation for a multiphase strength model for tin

In this work, the Common Model of Multi-phase Strength and Equation of State (CMMP) model was applied to tin. Specifically, calibrations of the strength-specific elements of the CMMP foundation were developed with a combination of experiments and theory, and then the model was validated experimentally. The first element of the foundation is a multi-phase analytic treatment of the melt temperature and the shear modulus for the solid phases. These models were parameterized for each phase based on ab initio calculations using the software VASP (Vienna Ab initio Simulations Package) based on density functional theory. The shear modulus model for the ambient phase was validated with ultrasonic sound speed measurements as a function of pressure and temperature. The second element of the foundation is a viscoplastic strength model for the phase, upon which strength for inaccessible higher-pressure phases can be scaled as necessary. The stress–strain response of tin was measured at strain rates of 10 -3 to 3 x 10 3 s -1 and temperatures ranging from 87 to 373 K. The Preston–Tonks–Wallace (PTW) strength model was fit to that data using Bayesian model calibration. For validation, six forward and two reverse Taylor impact experiments were performed at different velocities to measure large plastic deformation of tin at strain rates up to ⁠10 5 s -1 . The PTW model accurately predicted the deformed shapes of the cylinders, with modest discrepancies attributed to the inability of PTW to capture the effects of twinning and dynamic recrystallization. Some material in the simulations of higher velocity Taylor cylinders reached the melting temperature, thus testing the multiphase model because of the presence of a second phase, the liquid. In simulations using a traditional modeling approach, the abrupt reduction of strength upon melt resulted in poor predictions of the deformed shape and non-physical temperatures. With CMMP, the most deformed material points evolved gradually to a mixed solid–liquid but never a fully liquid state, never fully lost strength, stayed at the melt temperature as the latent heat of fusion was absorbed, and predicted the deformed shape well.

36 MATERIALS SCIENCE↗