Search NASA⌕ Search

SEARCH · Search NASA

Results for “Foundation models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS2009

Developing a Model-based Capability to Analyze Requirements for the Climate Observing System

Models are foundational for estimating states of the earth's climate system, both as tools to extrapolate information in time and space, and as observation 'operators' used to relate what is analyzed and predicted to what is observed. Expanding the simulation approach further, observing system simulation experiments (OSSEs) are designed to mimic the complete process of analyzing the climate state by replacing real observations with entirely simulated ones determined from a model-based depiction of nature. OSSEs provide a framework to 'fly' simulated satellite instruments through a synthetic atmosphere and investigate the trade-spaces of measurements for various satellite configurations and sampling strategies, and assess their measurement impact on modeling and forecasting capabilities. Such a tool is a crucial but as yet unfulfilled need for future mission selection and design. The components of a state-of-the-art OSSE system are being assembled at the Global Modeling and Assimilation Office (GMAO, Code 610.1) at NASA/GSFC, leveraging on the GMAO's existing modeling and data assimilation infrastructure for numerical weather prediction (NWP). The OSSE framework is based on the GMAO's Goddard Earth Observing System atmospheric general circulation model, version 5 (GEOS-5) and the Gridpoint Statistical Interpolation (GSI) observational analysis scheme, combined with the Goddard Chemistry, Aerosol, Radiation, and Transport (GOCART) model developed by the Atmospheric Chemistry and Dynamics Branch (Code 613.3). This system is an evolving, key component of Goddard's planned development of an Integrated Earth System Analysis (IESA) capability, which will bring together into a single, fully interactive system Goddard's modeling and assimilation efforts in atmosphere, ocean and chemistry and aerosols to provide a comprehensive analysis and prediction system for weather and climate In addition to providing a state-of-the-art capability for assimilating current observation types, GEOS-5, and the future IESA, provide the capability to identify the need for, and assess the potential impact of, future observing systems under consideration for improving weather and climate prediction.

Gelaro, Ronald↗
DOE OSTI2026

AnisONet: A deep neural operator-based anisotropic permeability upscaler from pore to Darcy scale

Directional permeability variations, which govern directional fluid flow in porous media with anisotropy, are important to accurately predict flow behavior, reactive transport, and fluid–solid interactions for various processes such as enhanced geothermal systems, energy storage devices, and biological systems. However, the intricate architecture of porous media makes it difficult to predict directional permeabilities. In this work, we present a novel machine learning (ML) framework, AnisONet, built upon an integration of a convolutional neural network, Swin transformer, and the deep operator network architecture, designed to predict anisotropic permeability and upscale predictions to larger spatial domains. First, AnisONet was evaluated with three classes of two-dimensional (2D) porous media, including synthetic circular and elliptical grains and natural sandstone grains from micro-computed tomography images. A lattice Boltzmann model (LBM) was used to calculate directional permeabilities at every 10° angle, producing 19 data points per image of porous media. AnisONet is then trained to predict permeability as a function of rotation angle. AnisONet showed strong predictive capability of directional permeability. Second, we tested our model for five upscaling cases with a large image size in the finite-element method (FEM) for 2D Darcy flow with various permeability tensor construction methods. Overall, upscaled permeability tensors in FEM simulations produce a reasonably good match with LBM results, highlighting the importance of selecting appropriate tensor formation strategies for accurate permeability upscaling. AnisONet, as a directional permeability estimator, could be further developed for more complex geometries, with the potential to develop a foundational ML model for various applications in porous media.

42 ENGINEERING↗
NASA NTRS2011

Remote Sensing of Urban Land Cover/Land Use Change, Surface Thermal Responses, and Potential Meteorological and Climate Change Impacts

City growth influences the development of the urban heat island (UHI), but the effect that local meteorology has on the UHI is less well known. This paper presents some preliminary findings from a study that uses multitemporal Landsat TM and ASTER data to evaluate land cover/land use change (LULCC) over the NASA Marshall Space Flight Center (MFSC) and its Huntsville, AL metropolitan area. Landsat NLCD data for 1992 and 2001 have been used to evaluate LULCC for MSFC and the surrounding urban area. Land surface temperature (LST) and emissivity derived from NLCD data have also been analyzed to assess changes in these parameters in relation to LULCC. Additionally, LULCC, LST, and emissivity have been identified from ASTER data from 2001 and 2011 to provide a comparison with the 2001 NLCD and as a measure of current conditions within the study area. As anticipated, the multi-temporal NLCD and ASTER data show that significant changes have occurred in land covers, LST, and emissivity within and around MSFC. The patterns and arrangement of these changes, however, is significant because the juxtaposition of urban land covers within and outside of MSFC provides insight on what impacts at a local to regional scale, the inter-linkage of these changes potentially have on meteorology. To further analyze these interactions between LULCC, LST, and emissivity with the lower atmosphere, a network of eleven weather stations has been established across the MSFC property. These weather stations provide data at a 10 minute interval, and these data are uplinked for use by MSFC facilities operations and the National Weather Service. The weather data are also integrated within a larger network of meteorological stations across north Alabama. Given that the MSFC weather stations will operate for an extended period of time, they can be used to evaluate how the building of new structures, and changes in roadways, and green spaces as identified in the MSFC master plan for the future, will potentially affect land cover LSTs across the Center. Moreover, the weather stations will also provide baseline data for developing a better understanding of how localized weather factors, such as extreme rainfall and heat events, affect micrometeorology. These data can also be used to model the interrelationships between LSTs and meteorology on a longer term basis to help evaluate how changes in these parameters can be quantified from satellite data collected in the future. In turn, the overall integration of multi-temporal meteorological information with LULCC, and LST data for MSFC proper and the surrounding Huntsville urbanized area can provide a perspective on how urban land surface types affect the meteorology in the boundary layer and ultimately, the UHI. Additionally, data such as this can be used as a foundation for modeling how climate change will potentially impact local and regional meteorology and conversely, how urban LULCC can or will influence changes on climate over the north Alabama area.

Quattrochi, Dale A.↗
NASA NTRS2011

Remote Sensing of Urban Land Cover/Land Use Change, Surface Thermal Responses, and Potential Meteorological and Climate Change Impacts

City growth influences the development of the urban heat island (UHI), but the effect that local meteorology has on the UHI is less well known. This paper presents some preliminary findings from a study that uses multitemporal Landsat TM and ASTER data to evaluate land cover/land use change (LULCC) over the NASA Marshall Space Flight Center (MFSC) and its Huntsville, AL metropolitan area. Landsat NLCD data for 1992 and 2001 have been used to evaluate LULCC for MSFC and the surrounding urban area. Land surface temperature (LST) and emissivity derived from NLCD data have also been analyzed to assess changes in these parameters in relation to LULCC. Additionally, LULCC, LST, and emissivity have been identified from ASTER data from 2001 and 2011 to provide a comparison with the 2001 NLCD and as a measure of current conditions within the study area. As anticipated, the multi-temporal NLCD and ASTER data show that significant changes have occurred in land covers, LST, and emissivity within and around MSFC. The patterns and arrangement of these changes, however, is significant because the juxtaposition of urban land covers within and outside of MSFC provides insight on what impacts at a local to regional scale, the inter-linkage of these changes potentially have on meteorology. To further analyze these interactions between LULCC, LST, and emissivity with the lower atmosphere, a network of eleven weather stations has been established across the MSFC property. These weather stations provide data at a 10 minute interval, and these data are uplinked for use by MSFC facilities operations and the National Weather Service. The weather data are also integrated within a larger network of meteorological stations across north Alabama. Given that the MSFC weather stations will operate for an extended period of time, they can be used to evaluate how the building of new structures, and changes in roadways, and green spaces as identified in the MSFC master plan for the future, will potentially affect land cover LSTs across the Center. Moreover, the weather stations will also provide baseline data for developing a better understanding of how localized weather factors, such as extreme rainfall and heat events, affect micrometeorology. These data can also be used to model the interrelationships between LSTs and meteorology on a longer term basis to help evaluate how changes in these parameters can be quantified from satellite data collected in the future. In turn, the overall integration of multi-temporal meteorological information with LULCC, and LST data for MSFC proper and the surrounding Huntsville urbanized area can provide a perspective on how urban land surface types affect the meteorology in the boundary layer and ultimately, the UHI. Additionally, data such as this can be used as a foundation for modeling how climate change will potentially impact local and regional meteorology and conversely, how urban LULCC can or will influence changes on climate over the north Alabama area.

Quattrochi, Dale A.↗
DOE OSTI2023

Language Model Inventory v1.0 [Slides]

This presentation is an inventory of the latest large language model (LLM) offerings. It lists some of the most prominent open- and closed-source LLMs. Given the rapid pace of progress in this space, it is not guaranteed to be a comprehensive list. This resource is intended to help inform decision-making about LLM capabilities at NREL.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Dynamic Temporal Graph Sequence Data for Resilience-Oriented Distribution Network Reconfiguration

This dataset comprises temporal dynamic graph sequences generated from power grid simulations focused on grid reconfiguration to enhance resilience. The simulations model failure propagation under varying conditions, with nodes assigned distinct failure probabilities. For each time step, the dataset captures the evolution of node states (functional or failed) and features critical to grid operations, such as pv_output, load_profile, load_dispatch, dg_output, loss, and voltage. Node types include sources, normal loads, and nodes with specific equipment like PVs, micro turbines, or shunt capacitors. The dataset is structured to support the training of dynamic graph neural networks, facilitating research on node feature prediction and edge dynamics under failure scenarios. Three distinct configurations are included, providing a robust foundation for modeling power grid resilience.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

MATEY: multiscale adaptive transformer models for spatiotemporal physical systems

Accurate representation of the multiscale features in spatiotemporal physical systems using vision transformer architectures requires extremely long, computationally prohibitive token sequences. To address this issue, we propose two novel adaptive tokenization schemes that dynamically adjust patch sizes based on local features: one ensures convergent behavior to uniform patch refinement, while the other offers better computational efficiency. Moreover, we present a set of spatiotemporal attention schemes, where the temporal or axial spatial dimensions are decoupled, to evaluate their baseline computational and data efficiencies and to determine whether adaptive tokenization can improve this performance. We assess the performance of the proposed multiscale adaptive model, MATEY, in a sequence of experiments. Compared to a full spatiotemporal attention scheme or a scheme that decouples only the temporal dimension, we find that fully decoupled axial attention is less efficient and expressive, requiring more training time and model parameters to achieve the same accuracy. The experiments on the adaptive tokenization schemes show that, compared to a uniformly refined model, the proposed schemes achieve comparable or improved accuracy at a much lower cost in the tested two-dimensional settings. While the asymptotic analysis suggests the potential for favorable scaling, empirical validation at substantially longer sequence lengths remains to be performed in future work. Finally, we demonstrate in two fine-tuning tasks featuring different physics that models pretrained on PDEBench data outperform the ones trained from scratch, especially in the low data regime with frozen attention.

adaptive tokenization↗
DOE OSTI2024

The melt memory effects in polymer crystallization

This paper presents a systematic review of the literature on the melt memory effects observed in polymers, an area that has engendered considerable debate for over 50 years. Recent advances in experimental techniques have provided fresh insights into how a polymer's thermal history influences its recrystallization behavior. It has been observed that given other conditions unchanged, the crystallization temperature during recrystallization decreases with an increase in the melt temperature T s above the melting point T m until a critical melt temperature is attained. This phenomenon also extends to the half-time of crystallization and the secondary structures, such as lamellar thickness, of semi-crystalline polymers. Despite these findings, a comprehensive constitutive model that encapsulates polymer melt memory effects remains elusive. Cutting-edge instrumentation, including in situ small and wide-angle X-ray scattering, temperature-controlled Fourier transform infrared spectroscopy, and flash differential scanning calorimetry, have posed significant challenges to the traditional nucleation and growth models established in the 1970s. These models are foundational to our understanding of polymer crystallization, which is an integral part of polymer processing and production. In this review, the historical contours of this discourse are traced, with an examination of both the recent experimental breakthroughs and theoretical advancements pertinent to polymer melt memory effects. In conclusion, this paper delves into the prevailing theories of polymer nucleation and crystallization and engages with theoretical discussions and numerical simulations that attempt to elucidate and rationalize these melt memory phenomena.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Impacts of turbine and plant upsizing on the levelized cost of energy for offshore wind

Turbine and plant upsizing are major trends in offshore wind deployment, although the quantitative impact on project costs has not been well-characterized. The uncertain value of continued wind turbine and project growth limits the ability of the supply chain to prepare for future technology trends, leading to challenges in the realization of larger projects. This analysis explores the levelized cost of energy impacts of turbine ratings between 6 and 20 MW and plant capacities between 250 and 2,500 MW for fixed-bottom offshore wind using techno-economic cost models for foundation, electrical, installation, and operation and maintenance costs, along with annual energy production. We consider a nominal set of technology assumptions for all scenarios to isolate economies of size and scale without additional benefits from decreasing turbine capital costs, quantity discounts for larger projects, or optimized technology solutions. These results indicate that using a 20-MW wind turbine in a 2,500-MW power plant array can reduce the levelized cost of energy by over 23% relative to the global average turbine and plant size installed in 2019; primarily because of reductions in the balance-of-system and operation and maintenance costs. We also identify improved installation vessels, optimized export systems, and novel operation and maintenance strategies as additional cost reduction opportunities. These results suggest that upsizing represents a significant cost reduction opportunity for offshore wind energy and will continue to be a main factor in shaping the future of the sector.

17 WIND ENERGY↗
DOE OSTI2024

Skeletal reaction models for methane combustion

A local-sensitivity-analysis technique is employed to generate new skeletal reaction models for methane combustion from the foundational fuel chemistry model (FFCM-1). Here, the sensitivities of the thermo-chemical variables with respect to the reaction rates are computed via the forced-optimally time dependent (f-OTD) methodology. In this methodology, the large sensitivity matrix containing all local sensitivities is modeled as a product of two low-rank time-dependent matrices. The evolution equations of these matrices are derived from the governing equations of the system. The modeled sensitivities are computed for the auto-ignition of methane at atmospheric and high pressures with different sets of initial temperatures, and equivalence ratios. These sensitivities are then analyzed to rank the most important (sensitive) species. A series of skeletal models with different number of species and levels of accuracy in reproducing the FFCM-1 results are suggested. The performances of the generated models are compared against FFCM-1 in predicting the ignition delay, the laminar flame speed, and the flame extinction. The results of this comparative assessment suggest the skeletal models with 24 and more species generate the FFCM-1 results with an excellent accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

El Agente: An autonomous agent for quantum chemistry

Computational chemistry tools are widely used to study the behavior of chemical phenomena. Yet, the complexity of these tools can make them inaccessible to non-specialists and challenging even for experts. In this work, we introduce El Agente Q, an LLM-based multi-agent system that dynamically generates and executes quantum chemistry workflows from natural language user prompts. The system is built on a novel cognitive architecture featuring a hierarchical memory framework that enables flexible task decomposition, adaptive tool selection, post-analysis, and autonomous file handling and submission. El Agente Q is benchmarked on six university-level course exercises and two case studies, demonstrating robust problem-solving performance (averaging >87% task success) and adaptive error handling through in situ debugging. It also supports longer-term, multi-step task execution for more complex workflows, while maintaining transparency through detailed action trace logs. Together, these capabilities lay the foundation for increasingly autonomous and accessible quantum chemistry.

agentic systems↗
DOE OSTI2025

Machine learned potential for high-throughput phonon calculations of metal—organic frameworks

Metal–organic frameworks (MOFs) are highly porous and versatile materials studied extensively for applications such as carbon capture and water harvesting. However, computing phonon-mediated properties in MOFs, like thermal expansion and mechanical stability, remains challenging due to the large number of atoms per unit cell, making traditional Density Functional Theory (DFT) methods impractical for high-throughput screening. Recent advances in machine learning potentials have led to foundation atomistic models, such as MACE-MP-0, that accurately predict equilibrium structures but struggle with phonon properties of MOFs. In this work, we developed a workflow for computing phonons in MOFs within the quasi-harmonic approximation with a fine-tuned MACE model, MACE-MP-MOF0. The model was trained on a curated dataset of 127 representative and diverse MOFs. The fine-tuned MACE-MP-MOF0 improves the accuracy of phonon density of states and corrects the imaginary phonon modes of MACE-MP-0, enabling high-throughput phonon calculations with state-of-the-art precision. The model successfully predicts thermal expansion and bulk moduli in agreement with DFT and experimental data for several well-known MOFs. These results highlight the potential of MACE-MP-MOF0 in guiding MOF design for applications in energy storage and thermoelectrics.

Elena, Alin Marin↗
DOE OSTI2021

Computational investigations of Dienes defect- and vacancy-induced changes in the electronic and vibrational properties of carbon fiber structural units

Carbon fiber (CF) is a promising lightweight alternative to steel and is of significant interest for energy applications. As CF continues to find new uses and is exposed to new external conditions, a noninvasive method of monitoring its structural integrity is critical. Raman spectroscopy is a commonly used method for this monitoring; however, it is highly inferential, and the interpretation of the data is not always straightforward. In this work, we perform density functional theory (DFT) calculations to investigate changes in the vibrational properties of CF structural units (i.e., graphene and graphite) caused by monovacancy and Dienes defects as a foundation for modeling more complex defects that move our model toward that of realistic CF. Using large computational supercells, we can understand how these defects change the electronic structure and vibrational properties of graphene and graphite for interdefect distances near those of the lower experimental limit. The monovacancy opens an electronic bandgap at the K point. Although no such electronic gap is opened by the Dienes defect, both defects introduce flat defect bands near the Fermi energy. The Dienes defect creates long-range deviations of the phonons, leading to substantial broadening of the highest frequency optical modes in the band structure compared to that of the pristine material. In contrast, the phonon changes caused by the monovacancy are short range, and only minor changes in the band structure or phonon density of states were observed. These findings can assist in the interpretation of experimental results by providing atomic-scale insight into key electronic and vibrational features.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Overlooked cooling effects of albedo in terrestrial ecosystems

Radiative forcing (RF) resulting from changes in surface albedo is increasingly recognized as a significant driver of global climate change but has not been adequately estimated, including by Intergovernmental Panel on Climate Change (IPCC) assessment reports, compared with other warming agents. Here, we first present the physical foundation for modeling albedo-induced RF and the consequent global warming impact (GWI Δα ). We then highlight the shortcomings of available current databases and methodologies for calculating GWI Δα at multiple temporal scales. There is a clear lack of comprehensive in situ measurements of albedo due to sparse geographic coverage of ground-based stations, whereas estimates from satellites suffer from biases due to the limited frequency of image collection, and estimates from earth system models (ESMs) suffer from very coarse spatial resolution land cover maps and associated albedo values in pre-determined lookup tables. Field measurements of albedo show large differences by ecosystem type and large diurnal and seasonal changes. As indicated from our findings in southwest Michigan, GWI Δα is substantial, exceeding the RF Δα values of IPCC reports. Inclusion of GWI Δα to landowners and carbon credit markets for specific management practices are needed in future policies. We further identify four pressing research priorities: developing a comprehensive albedo database, pinpointing accurate reference sites within managed landscapes, refining algorithms for remote sensing of albedo by integrating geostationary and other orbital satellites, and integrating the GWI Δα component into future ESMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

State of Knowledge on Aerosols and Bubble Transport for Mechanistic Source Term Analysis of Molten Salt Reactors

A comprehensive review of the current state of knowledge surrounding molten salt aerosol behavior and bubble transport in molten salt systems relevant to mechanistic source term (MST) analyses of molten salt reactors (MSR) and fluoride high temperature reactors (FHR) was provided. Although relatively little experimental work has been carried out on investigating these phenomena in molten salts compared to that for other nuclear fluids of interest (e.g., aqueous, sodium), the amount of work that has been reported still provides a baseline understanding to inform and design future experimental campaigns on these topics. The bulk of this data is derived from the Molten Salt Reactor Program (MSRP) which was carried out at Oak Ridge National Laboratory (ORNL) nearly 50 years ago, leading to the successful operation of the Molten Salt Reactor Experiment (MSRE). Many other related research efforts are also highlighted in this review, such as recent efforts under the DOE:NE Advanced Reactor Technology (ART) MSR Campaign. The goal of this report is to provide a foundation for modelers to base assumptions on, as well as to make recommendations to experimentalists attempting to close information gaps. As such, Section 4 contains recommendations for future experimental work that may be needed to close current information gaps related to MST modeling of MSRs. Additionally, given the flowing fuel nature of MSRs, the relevance of aerosol and bubble transport behavior in molten salts goes beyond just MST modeling, evidenced by experiences with the pump bowl and off-gas system of the MSRE.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

Determining the biogeochemical transformations of organic matter composition in rivers using molecular signatures

Inland waters are hotspots for biogeochemical activity, but the environmental and biological factors that govern the transformation of organic matter (OM) flowing through them are still poorly constrained. Here we evaluate data from a crowdsourced sampling campaign led by the Worldwide Hydrobiogeochemistry Observation Network for Dynamic River Systems (WHONDRS) consortium to investigate broad continental-scale trends in OM composition compared to localized events that influence biogeochemical transformations. Samples from two different OM compartments, sediments and surface water, were collected from 97 streams throughout the Northern Hemisphere and analyzed to identify differences in biogeochemical processes involved in OM transformations. By using dimensional reduction techniques, we identified that putative biogeochemical transformations and microbial respiration rates vary across sediment and surface water along river continua independent of latitude (18°N–68°N). In contrast, we reveal small- and large-scale patterns in OM composition related to local (sediment vs. water column) and reach (stream order, latitude) characteristics. These patterns lay the foundation to modeling the linkage between ecological processes and biogeochemical signals. We further showed how spatial, physical, and biogeochemical factors influence the reactivity of the two OM pools in local reaches yet find emergent broad-scale patterns between OM concentrations and stream order. OM processing will likely change as hydrologic flow regimes shift and vertical mixing occurs on different spatial and temporal scales. As our planet continues to warm and the timing and magnitude of surface and subsurface flows shift, understanding changes in OM cycling across hydrologic systems is critical, given the unknown broad-scale responses and consequences for riverine OM.

rivers↗