Search NASA⌕ Search

SEARCH · Search NASA

Results for “foundation model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Theoretical Foundation for Weld Modeling

Differential equations describe physics of tungsten/inert-gas and plasma-arc welding in aluminum. Report collects and describes necessary theoretical foundation upon which numerical welding model is constructed for tungsten/inert gas or plasma-arc welding in aluminum without keyhole. Governing partial differential equations for flow of heat, metal, and current given, together with boundary conditions relevant to welding process. Numerical estimates for relative importance of various phenomena and required properties of 2219 aluminum included

Traugott, S.↗

Leveraging AI and Spatial Data to Unlock Pipeline Integrity Insights: NETL’s Advanced Infrastructure Integrity Model (AIIM)

Maintaining the integrity of natural gas infrastructure plays a critical role in ensuring energy security. Robust, data-driven foundational AI models for pipeline integrity can help address risk management and mitigation issues. Trusted foundational models can help with industry adoption and accelerate innovation by enhancing integrity predictions, reduce costs, and informing infrastructure build-out. The AIIM dashboard was released in 2022 and utilizes multi-ML models for ensemble-type insights. It was expanded to include analytics on reported incidents. It was developed as an ESRI Dashboard to support data visualization & interrogation and contains pipeline data and model results.

Advanced Infrastructure Integrity Model (AIIM)↗

Out of Plane Stresses Using a Beam-Based Elastic Foundation Bonded Joint Model

Efficient, semi-analytical models of bonded joints are utilized for initial joint design and sizing due to their convenience and speed. Many of these models are based on beam and plate theories, which are most applicable when in-plane stresses/strains dominate. While this can be a sensible assumption for obtaining the deformations of the joint, out of plane (transverse) stresses are often of critical importance for failure in bonded joints composed of fiber reinforced composite materials. Since through-thickness strains are neglected in these semi-analytical theories, the present study shows a method to back-calculate the out of plane stresses based on stress balance equations, which use the in-plane stresses and displacements that have already been obtained. The method was implemented within the Joint Element Designer (JED) software, and verification and validation examples have been shown. As is typical for these types of models, corner stress singularities are not captured by the JED model, but the general trends of the stress and deformation fields agreed with a higher fidelity finite element model. As such, this method for obtaining out of plane stresses, when coupled with the JED code, is very useful for the complete stress analysis of bonded composite joints.

composites↗

Evaluating the Use of Foundational Chemical Language Models in Multimodal Graph Fusion

Rapid and accurate prediction of the physicochemical properties of molecules given their structures remains a key challenge in cheminformatics. Machine learning approaches offer high-throughput options, but the optimality of inductive biases and data representations are up for debate. For example, BERT-based masked language models (MLMs) can be trained in a self-supervised way on hundreds of millions to billions of readily available SMILES strings. Another option is graph neural networks (GNNs), which can operate directly on molecular structures. Yet, generating accurate molecular geometry is computationally expensive, leading to a relative scarcity in data compared to SMILES strings. It is attractive to combine these two paradigms by pre-training an LM on a large corpus of SMILES strings and embedding these representation into a geometric graph neural network. Despite the promise of such an approach, and contrary to previous studies, we find mixed results with the combination of the LMs and GNNs on several molecule datasets. In particular, we found evidence for improvement on the FreeSolv and QM7 benchmarks, but degraded performance on the ESOL, LIPO and QM9 datasets compared to a GNN baseline.

Francel, Collin [University of Alabama]↗

Utilizing AI and Spatial Data to Identify & Rapidly Disseminate Energy Infrastructure Insights

GeoGov Summit Final Presentation entitled "Utilizing AI and Spatial Data to Identify & Rapidly Disseminate Energy Infrastructure Insights". Maintaining the integrity of energy infrastructure plays a critical role in ensuring energy security. Robust foundational AI models using data from federal, state, industry, and other sources can help address integrity risk management & mitigation issues as well as evaluate extended use strategies. Trusted foundational models can help with industry adoption and accelerate innovation by enhancing integrity predictions, reduce costs, and informing infrastructure build-out. Coordination, collaboration & data sharing to develop robust models to aid in: Optimizing operations; Minimizing costs; Ensuring energy security.

Advanced Infrastructure Integrity Model (AIIM)↗

Fidelity-preserving enhancement of ptychography with foundational text-to-image models

Ptychographic phase retrieval enables high-resolution imaging of complex samples but often suffers from artifacts such as grid pathology and multislice crosstalk, which degrade reconstructed images. We propose a plug-and-play (PnP) framework that integrates physics model-based phase retrieval with text-guided image editing using foundational diffusion models. By employing the alternating direction method of multipliers, our approach ensures consensus between data fidelity and artifact removal subproblems, maintaining physical consistency while enhancing image quality. Artifact removal is achieved using a text-guided diffusion image editing method (LEDITS++) with a pre-trained foundational diffusion model, allowing users to specify artifacts for removal in natural language. Demonstrations on simulated and experimental datasets show significant improvements in artifact suppression and structural fidelity, validated by metrics such as peak signal-to-noise ratio and diffraction pattern consistency. This work highlights the combination of text-guided generative models and model-based phase retrieval algorithms as a transferable and fidelity-preserving method for high-quality diffraction imaging.

image editing↗

Neural Scaling Laws for Jet Generation

Recently observed empirical scaling laws describe the performance of foundation-type models as three independent key quantities -- dataset size, compute, and model parameters -- are modified. Extracting these scaling laws informs the training of large complex models for which the tuning of hyperparameters in traditional ways is not feasible. This work for the first time explores if scaling laws can also be observed for the task of particle jet generation -- both relevant as a pre-training objective for foundation models and as in-situ simulation by itself. We indeed replicate the key logarithmic scaling law behavior for model-size scaling. Beyond studying the next token prediction validation loss of the generative model, we also study the sliced Wasserstein distance of five physical quantities that are not immediately available to the model during training. Our study shows that this quantity is monotonically related to the next token prediction validation loss, meaning that this loss is indeed a good proxy for the physics performance. For the scaling with dataset size and compute, we observe substantially weaker scaling behavior of both the loss and the sliced Wasserstein distance. We analyze this behavior by introducing the concept of a learnable window, and argue that autoregressive next token prediction on jet constituents exhibits comparatively rapid saturation relative to language-model studies. We discuss possible origins of this behavior, including the stochastic nature of QCD radiation and differences between generative and supervised learning tasks in collider physics.

Amram, Oz [Fermilab]↗

Improving Process Level Understanding of Boundary Layer Winds over the Northeast U.S. Shelf: The Third Wind Forecast Improvement Project (WFIP3)

The third Wind Forecast Improvement Project (WFIP3), a U.S. Department of Energy and National Oceanic and Atmospheric Administration sponsored investigation, sought to improve understanding of the physical phenomena in the atmosphere and ocean that dictate the structure and variability of wind and thermodynamic fields within the marine atmospheric boundary layer. WFIP3 focused on mesoscale and submesoscale flows -- including sea breezes, low-level jets, low-level clouds, and coastal storms -- and the ability of advanced numerical model parameterizations to represent them within fully coupled oceanic and atmospheric modeling systems and foundational weather forecast models. WFIP3 conducted a comprehensive 18-month observational study over the Northeast U.S. outer continental shelf, a high-use coastal zone, using a 3D multiscale sensor array to highly resolve the temporal, vertical, and horizontal structure of the coupled atmospheric and oceanic boundary layers. Multiple land-based study sites adjacent to the coastal ocean observed surface meteorology and vertical profiles of atmospheric properties via passive infrared and microwave radiometers, active lidars and radars, and radiosondes. At sea, an array of surface flux buoys and two vertical profiling lidar buoys observed both atmospheric and oceanic properties, augmented by land-based oceanographic radar systems and routine ship-based surveys. Intensive observations of the marine atmospheric boundary layer over the ocean was done from an air-sea interaction flux tower and extended deployments of a large autonomous barge platform. Numerous critical forecasting phenomena were observed that are being evaluated within regional coupled and uncoupled modeling systems, including the National Oceanic and Atmospheric Administration's foundational High-Resolution Rapid Refresh forecast model.

Kirincich, Anthony↗

CryoSegNet: accurate cryo-EM protein particle picking by integrating the foundational AI image segmentation model and attention-gated U-Net

Picking protein particles in cryo-electron microscopy (cryo-EM) micrographs is a crucial step in the cryo-EM-based structure determination. However, existing methods trained on a limited amount of cryo-EM data still cannot accurately pick protein particles from noisy cryo-EM images. The general foundational artificial intelligence–based image segmentation model such as Meta’s Segment Anything Model (SAM) cannot segment protein particles well because their training data do not include cryo-EM images. Here, we present a novel approach (CryoSegNet) of integrating an attention-gated U-shape network (U-Net) specially designed and trained for cryo-EM particle picking and the SAM. The U-Net is first trained on a large cryo-EM image dataset and then used to generate input from original cryo-EM images for SAM to make particle pickings. CryoSegNet shows both high precision and recall in segmenting protein particles from cryo-EM micrographs, irrespective of protein type, shape and size. On several independent datasets of various protein types, CryoSegNet outperforms two top machine learning particle pickers crYOLO and Topaz as well as SAM itself. The average resolution of density maps reconstructed from the particles picked by CryoSegNet is 3.33 Å, 7% better than 3.58 Å of Topaz and 14% better than 3.87 Å of crYOLO. It is publicly available at https://github.com/jianlin-cheng/CryoSegNet

59 BASIC BIOLOGICAL SCIENCES↗

System monitoring and diagnosis with qualitative models

A substantial foundation of tools for model-based reasoning with incomplete knowledge was developed: QSIM (a qualitative simulation program) and its extensions for qualitative simulation; Q2, Q3 and their successors for quantitative reasoning on a qualitative framework; and the CC (component-connection) and QPC (Qualitative Process Theory) model compilers for building QSIM QDE (qualitative differential equation) models starting from different ontological assumptions. Other model-compilers for QDE's, e.g., using bond graphs or compartmental models, have been developed elsewhere. These model-building tools will support automatic construction of qualitative models from physical specifications, and further research into selection of appropriate modeling viewpoints. For monitoring and diagnosis, plausible hypotheses are unified against observations to strengthen or refute the predicted behaviors. In MIMIC (Model Integration via Mesh Interpolation Coefficients), multiple hypothesized models of the system are tracked in parallel in order to reduce the 'missing model' problem. Each model begins as a qualitative model, and is unified with a priori quantitative knowledge and with the stream of incoming observational data. When the model/data unification yields a contradiction, the model is refuted. When there is no contradiction, the predictions of the model are progressively strengthened, for use in procedure planning and differential diagnosis. Only under a qualitative level of description can a finite set of models guarantee the complete coverage necessary for this performance. The results of this research are presented in several publications. Abstracts of these published papers are presented along with abtracts of papers representing work that was synergistic with the NASA grant but funded otherwise. These 28 papers include but are not limited to: 'Combined qualitative and numerical simulation with Q3'; 'Comparative analysis and qualitative integral representations'; 'Model-based monitoring of dynamic systems'; 'Numerical behavior envelopes for qualitative models'; 'Higher-order derivative constraints in qualitative simulation'; and 'Non-intersection of trajectories in qualitative phase space: a global constraint for qualitative simulation.'

Kuipers, Benjamin↗

Improving High Resolution Offshore Wind Resource Assessments and Forecasts using Observations in the MA/RI Lease Areas

The third Wind Forecast Improvement Project (WFIP3) sought to improve understanding of the physical phenomena in the atmosphere and ocean that dictate the structure and variability of wind and thermodynamic fields within the Marine Atmospheric Boundary Layer (MABL). WFIP3 conducted a comprehensive 18-month observational study over the Northeast U.S. outer continental shelf, a high use coastal zone, using a 3-D multiscale sensor array to highly resolve the temporal, vertical, and horizontal structure of the coupled atmospheric and oceanic boundary layers. Multiple land-based study sites adjacent to the coastal ocean observed surface meteorology and vertical profiles of atmospheric properties via passive infrared and microwave radiometers, active lidars and radars, and radiosondes. At sea, an array of surface flux buoys and two vertical profiling lidar buoys observed both atmospheric and oceanic properties, augmented by land-based oceanographic radar systems and routine ship-based surveys. Intensive observations of the MABL over the ocean was done from an air-sea interaction flux tower and extended deployments of a large barge platform. WFIP3 focused on mesoscale and sub-mesoscale flows -- including sea breezes, low-level jets, low-level clouds, and coastal storms -- and the ability of advanced numerical model parameterizations to represent them within fully coupled oceanic and atmospheric modeling systems and foundational weather forecast models. Numerous critical forecasting phenomena were observed, however the project was terminated prior to the completion of the field observational period and the analysis period.

54 ENVIRONMENTAL SCIENCES↗

Long Duration Medical System Foundation for Lunar Orbital and Lunar Surface Exploration Missions

For long-duration lunar orbital and lunar surface (LDLOS) exploration missions, the NASA Human Research Program (HRP) Exploration Medical Capability (ExMC) Element has developed a medical system foundation through which clinical considerations may be represented via a systems engineering-based model. Components of the Long Duration Medical System Foundation model include a concept of operations (ConOps), functional decomposition, medical conditions to be addressed, clinical capabilities and resources, technical requirements, and traces of requirements to NASA standards documents and parent-level (Program- and Vehicle habitat system-level) requirements. The Foundation model offers the means to present information in a readily accessible format that is understandable across all clinical, engineering, scientific, and managerial disciplines. Collectively, these components constitute a foundation that serves future programs with similar long duration mission profiles as a starting point for medical system design. The Foundation was developed by a multidisciplinary team of systems engineers, scientists, and clinicians across NASA. The process started with ConOps development, subsequently decomposed into the functionalities needed to diagnose, treat, and prevent medical conditions. The clinical team identified medical conditions most likely needed to be diagnosed and treated during a long-duration lunar exploration mission. Through these approaches, requirements were codified for the LDLOS medical system. These requirements were then traced to NASA standards, medical conditions, medical capabilities, and medical resources, facilitating stakeholders’ use of the Foundation model to analyze traces and to identify medical system interfaces with other vehicle systems or subsystems. In addition, the Foundation may be used as a basis for performing risk trades on medical system mass and volume allocation. This discussion will focus on the processes through which the LDLOS Medical System Foundation was developed, how the Foundation builds a bridge between the medical and engineering domains, and how these processes may be applied more broadly to a crew health and performance system and other system domains.

Jay Lemery↗

Calibration and validation of the foundation for a multiphase strength model for tin

In this work, the Common Model of Multi-phase Strength and Equation of State (CMMP) model was applied to tin. Specifically, calibrations of the strength-specific elements of the CMMP foundation were developed with a combination of experiments and theory, and then the model was validated experimentally. The first element of the foundation is a multi-phase analytic treatment of the melt temperature and the shear modulus for the solid phases. These models were parameterized for each phase based on ab initio calculations using the software VASP (Vienna Ab initio Simulations Package) based on density functional theory. The shear modulus model for the ambient phase was validated with ultrasonic sound speed measurements as a function of pressure and temperature. The second element of the foundation is a viscoplastic strength model for the phase, upon which strength for inaccessible higher-pressure phases can be scaled as necessary. The stress–strain response of tin was measured at strain rates of 10 -3 to 3 x 10 3 s -1 and temperatures ranging from 87 to 373 K. The Preston–Tonks–Wallace (PTW) strength model was fit to that data using Bayesian model calibration. For validation, six forward and two reverse Taylor impact experiments were performed at different velocities to measure large plastic deformation of tin at strain rates up to ⁠10 5 s -1 . The PTW model accurately predicted the deformed shapes of the cylinders, with modest discrepancies attributed to the inability of PTW to capture the effects of twinning and dynamic recrystallization. Some material in the simulations of higher velocity Taylor cylinders reached the melting temperature, thus testing the multiphase model because of the presence of a second phase, the liquid. In simulations using a traditional modeling approach, the abrupt reduction of strength upon melt resulted in poor predictions of the deformed shape and non-physical temperatures. With CMMP, the most deformed material points evolved gradually to a mixed solid–liquid but never a fully liquid state, never fully lost strength, stayed at the melt temperature as the latent heat of fusion was absorbed, and predicted the deformed shape well.

36 MATERIALS SCIENCE↗

Calibration and validation of the foundation for a multiphase strength model for tin

In this work, the Common Model of Multi-phase Strength and Equation of State (CMMP) model was applied to tin. Specifically, calibrations of the strength-specific elements of the CMMP foundation were developed with a combination of experiments and theory, and then the model was validated experimentally. The first element of the foundation is a 10 multi-phase analytic treatment of the melt temperature and the shear modulus for the solid phases. These models were parameterized for each phase based on ab initio calculations using the software VASP (Vienna Ab initio Simulations Package) based on density functional theory (DFT). The shear modulus model for the ambient β phase was validated with ultrasonic sound speed measurements as a function of pressure and temperature. The second element of the foundation is a viscoplastic strength model for the β phase, upon which strength for inaccessible higher-pressure phases can be scaled as necessary. The stress-strain response of tin was measured at strain rates of 10 -3 to 3 x 10 3 s -1 and temperatures ranging from 87 to 373 K. The Preston-Tonks-Wallace (PTW) strength model was fit to that data using Bayesian model calibration. For validation, six forward and two reverse Taylor impact experiments were performed at different velocities to measure large plastic deformation of tin at strain rates up to 10 5 s -1 . The PTW model accurately predicted the deformed shapes of the cylinders, with modest discrepancies attributed to the inability 20 of PTW to capture the effects of twinning and dynamic recrystallization. Some material in the simulations of higher velocity Taylor cylinders reached the melting temperature, thus testing the multiphase model because of the presence of a second phase, the liquid. In simulations using a traditional modeling approach, the abrupt reduction of strength upon melt resulted in poor predictions of the deformed shape and non-physical temperatures. With CMMP, the most deformed material points evolved gradually to a mixed solid-liquid but never fully liquid state, never fully lost strength, 25 stayed at the melt temperature as the latent heat of fusion was absorbed, and predicted the deformed shape well.

36 MATERIALS SCIENCE↗

Evaluation and Improvement of Liquid Propellant Rocket Chugging Analysis Techniques. Part 1: A One-Dimensional Analysis of Low Frequency Combustion Instability in the Fuel Preburner of the Space Shuttle Main Engine

Low frequency combustion instability, known as chugging, is consistently experienced during shutdown in the fuel and oxidizer preburners of the Space Shuttle Main Engines. Such problems always occur during the helium purge of the residual oxidizer from the preburner manifolds during the shutdown sequence. Possible causes and triggering mechanisms are analyzed and details in modeling the fuel preburner chug are presented. A linearized chugging model, based on the foundation of previous models, capable of predicting the chug occurrence is discussed and the predicted results are presented and compared to experimental work performed by NASA. Sensitivity parameters such as chamber pressure, fuel and oxidizer temperatures, and the effective bulk modulus of the liquid oxidizer are considered in analyzing the fuel preburner chug. The computer program CHUGTEST is utilized to generate the stability boundary for each sensitivity study and the region for stable operation is identified.

Lim, Kair Chuan↗

The Underpinnings of Workload in Unmanned Vehicle Systems

This paper identifies and characterizes factors that contribute to operator workload in unmanned vehicle systems. Our objective is to provide a basis for developing models of workload for use in design and operation of complex human-machine systems. In 1986, Hart developed a foundational conceptual model of workload, which formed the basis for arguably the most widely used workload measurement technique—the NASA Task Load Index. Since that time, however, there have been many advances in models and factor identification as well as workload control measures. Additionally, there is a need to further inventory and describe factors that contribute to human workload in light of technological advances, including automation and autonomy. Thus, we propose a conceptual framework for the workload construct and present a taxonomy of factors that can contribute to operator workload. These factors, referred to as workload drivers, are associated with a variety of system elements including the environment, task, equipment and operator. In addition, we discuss how workload moderators, such as automation and interface design, can be manipulated in order to influence operator workload. We contend that workload drivers, workload moderators, and the interactions among drivers and moderators all need to be accounted for when building complex, human-machine systems.

Hooey, Becky L.↗

Analytic Modeling of the Hydrodynamic, Thermal, and Structural Behavior of Foil Thrust Bearings

A simulation and modeling effort is conducted on gas foil thrust bearings. A foil bearing is a self acting hydrodynamic device capable of separating stationary and rotating components of rotating machinery by a film of air or other gaseous lubricant. Although simple in appearance these bearings have proven to be complicated devices in analysis. They are sensitive to fluid structure interaction, use a compressible gas as a lubricant, may not be in the fully continuum range of fluid mechanics, and operate in the range where viscous heat generation is significant. These factors provide a challenge to the simulation and modeling task. The Reynolds equation with the addition of Knudsen number effects due to thin film thicknesses is used to simulate the hydrodynamics. The energy equation is manipulated to simulate the temperature field of the lubricant film and combined with the ideal gas relationship, provides density field input to the Reynolds equation. Heat transfer between the lubricant and the surroundings is also modeled. The structural deformations of the bearing are modeled with a single partial differential equation. The equation models the top foil as a thin, bending dominated membrane whose deflections are governed by the biharmonic equation. A linear superposition of hydrodynamic load and compliant foundation reaction is included. The stiffness of the compliant foundation is modeled as a distributed stiffness that supports the top foil. The system of governing equations is solved numerically by a computer program written in the Mathematica computing environment. Representative calculations and comparisons with experimental results are included for a generation I gas foil thrust bearing.

Bruckner, Robert J.↗

Modeling active nematics via the nematic locking principle

Active nematic systems consist of rod-like internally driven subunits that interact with one another to form large-scale coherent flows. They are important examples of far-from-equilibrium fluids, which exhibit a wealth of nonlinear behavior. This includes active turbulence, in which topological defects in the nematic order braid around one another in a chaotic fashion. One of the most studied examples of active nematics consists of a dense two-dimensional layer of microtubules, crosslinked by kinesin molecular motors that inject extensile deformations into the fluid. Though numerous theoretical studies have modeled microtubule-based active nematics, no consensus has emerged on how to fully and quantitatively capture the features of the experimental system. Here, to better understand the theoretical foundations for modeling this system, we propose a fundamental principle we call the nematic locking principle—individual microtubules cannot rotate without all neighboring microtubules also rotating. Physically, this is justified by the high density of the microtubules, their elongated nature, and their corresponding steric interactions. We assert that the nematic locking principle holds throughout the majority of the material, but breaks down in the neighborhood of topological defects and other regions of low density. We derive the most general nematic transport equation consistent with this principle and also derive the most general term that violates it, introducing fracturing into the material. We then examine the standard Beris–Edwards approach, commonly used to model this system, and show that it violates the nematic locking principle throughout the majority of the material due to fracturing. We then propose a modification to the Beris–Edwards model that enforces nematic locking nearly everywhere. This modification shuts off fracturing except in regions where the order parameter (a proxy for density) is reduced. In these regions fracturing is turned on. The resulting simulations in turn show strong nematic locking throughout the bulk of the material, with narrow bands of fracturing, consistent with experimental observation. One additional advantage of enforcing nematic locking is that nontrivial stationary state solutions, common in Beris–Edwards simulations but not seen in experiments, are eliminated.

Mitchell, Kevin A. [Univ. of California, Merced, C↗