Search NASA⌕ Search

SEARCH · Search NASA

Results for “foundation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Exploring Capability of Multimodal Foundation Model for Image-based Fault Detection of Photovoltaic Modules

Multimodal Foundation Model (MFM), like ChatGPT and Gemini, have emerged as powerful tools for their exceptional natural language processing capabilities and their emerging potential in image analysis. This paper investigates the application of MFMs for photovoltaic (PV) fault detection through image analysis, focusing on ChatGPT 4.0 and Gemini 1.5 Pro. Three types of PV images and the corresponding common PV faults are detected: bird droppings using visible images, cell cracks via electroluminescence (EL) images, and hotspots using infrared (IR) images. Among the two models, Gemini 1.5 Pro demonstrated superior performance, achieving near-perfect results with an average F1 score of 0.97, consistently outperforming ChatGPT 4.0 in accuracy and reliability. Unlike traditional machine learning (ML) models, MFMs can operate in a zero shot manner that does not require additional training by the user, and the input images are not limited by size, angle, scope, or PV technology. The strong adaptability and user-friendliness make MFM a promising tool for analyzing PV images and advancing health monitoring for PV modules.

Li, Baojie↗
DOE OSTI2024

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗
DOE OSTI2025

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2025

ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling

Sparse observations and coarse-resolution climate models limit effective regional decision-making, underscoring the need for robust downscaling. However, existing AI methods struggle with generalization across variables and geographies and are constrained by the quadratic complexity of Vision Transformer (ViT) self-attention. We introduce ORBIT-2, a scalable foundation model for global, hyper-resolution climate downscaling. ORBIT-2 incorporates two key innovations: (1) Residual Slim ViT (Reslim), a lightweight architecture with residual learning and Bayesian regularization for efficient, robust prediction; and (2) TILES, a tile-wise sequence scaling algorithm that reduces self-attention complexity from quadratic to linear, enabling long-sequence processing and massive parallelism. ORBIT-2 scales to 10 billion parameters across 65,536 GPUs, achieving up to 4.1 ExaFLOPS sustained throughput and 74–98% strong scaling efficiency. It supports downscaling to 0.9 km global resolution and processes sequences up to 4.2 billion tokens. On 7 km resolution benchmarks, ORBIT-2 achieves high accuracy with R2 scores in range of 0.98–0.99 against observation data.

Wang, Xiao [ORNL] (ORCID:0000000165451943)↗
DOE OSTI2026

Scalable Federated Learning for Scientific Foundation Models on Leadership-Class Systems

Federated learning (FL) at leadership-class HPC systems remains largely unexplored, despite growing interest in deploying federated workflows on modern HPC systems. This paper provides the first system-level empirical characterization of federated fine-tuning of pretrained foundation models on an exascale supercomputer under a multi-node deployment. Using up to 96 concurrent FL clients deployed across Frontier nodes, we study the impact of client scale, model size, data heterogeneity, partial participation, and differential privacy on runtime, communication overhead, and convergence stability. Our results show that pretrained transformer models remain robust to heterogeneity, client dropout, and privacy noise, while system efficiency degrades rapidly with scale as synchronizat and orchestration dominate runtime. We further demonstrate that system-aware execution strategies, including intra-node aggregation and early aggregation, significantly reduce wall-clock time without degrading model quality. These findings establish a practical performance baseline and inform the design of communication-efficient FL systems on leadership-class HPC platforms.

Kotevska, Olivera [ORNL] (ORCID:0000000316772243)↗
DOE OSTI2025

genomeocean: a pretrained microbial genome foundational model (genomeoceanLLM) v1.0

We present Genomeocean, a foundational genome language model that represents the microbial genome sequences from complex environmental samples. By training on a large, diverse metagenomic dataset, Genomeocean learns species-specific sequence composition and can generate long, realistic open reading frames (ORFs). Our model employs a Byte-pair-encoding (BPE) tokenization strategy, allowing it to efficiently process large genomic datasets and generate long sequences up to 50kb. We demonstrate that fine-tuning Genomeocean can generate novel gene clusters encoding biosynthetic pathways, showcasing its ability to model both fundamental and complex biological processes. Our work establishes Genomeocean as a powerful tool for understanding microbial genome biology and paves the way for its application in a range of fields, from synthetic biology to microbiome research.

Wang, Zhong [Lawrence Berkeley National Laboratory↗
DOE OSTI2021

Scaling trends for balance-of-system costs at land-based wind power plants: Opportunities for innovations in foundation and erection

Wind power plant sizes, hub heights, and turbine ratings have increased since 2008 to optimize the cost and performance of wind power; however, the limits of these economies of scale remain unclear. Here, we explore how the costs incurred to install turbines at a wind power plant—the balance-of-system (BOS) costs—scale with turbine rating, hub height, and plant size. We also investigate how these changes in BOS costs influence the levelized cost of energy (LCOE). We show that increasing the plant size from 150 to 400 MW could reduce the BOS costs by 21%. We also show that if the foundation costs decreased by 50%, building a wind power plant with 5-MW turbines (having rotor diameters of 166 m and hub heights of 120 m) could decrease the LCOE by 5%. These results could help inform future BOS cost-reduction opportunities and thereby reduce future capital costs for land-based wind power.

17 WIND ENERGY↗
DOE OSTI2021

A vision of immuno-oncology: the Siena think tank of the Italian Network for Tumor Biotherapy (NIBIT) foundation

The yearly Think Tank Meeting of the Italian Network for Tumor Biotherapy (NIBIT) Foundation, brings together in Siena, Tuscany (Italy), experts in immuno-oncology to review the learnings from current immunotherapy treatments, and to propose new pre-clinical and clinical investigations in selected research areas. While immunotherapies in non-small cell lung cancer and melanoma led to practice changing therapies, the same therapies had only modest benefit for patients with other malignancies, such as mesothelioma and glioblastoma. One way to improve on current immunotherapies is to alter the sequence of each combination agent. Matching the immunotherapy to the host’s immune response may thus improve the activity of the current treatments. A second approach is to combine current immunotherapies with novel agents targeting complementary mechanisms. Identifying the appropriate novel agents may require different approaches than the traditional laboratory-based discovery work. For example, artificial intelligence-based research may help focusing the search for innovative and most promising combination partners. Novel immunotherapies are needed in cancer patients with resistance to or relapse after current immunotherapeutic drugs. Such new treatments may include targeted agents or monoclonal antibodies to overcome the immune-suppressive tumor microenvironment. The mode of combining the novel treatments, including vaccines, needs to be matched to the patient’s immune status for achieving the maximum benefit. In this scenario, specific attention should be also paid nowadays to the immune intersection between COVID-19 and cancer.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Chapter 11: Renewable Microgrids as a Foundation of the Future Sustainable Electrical Energy System

Renewable microgrids are an integral part of the future sustainable energy system. This chapter focuses on the role of renewable energy-based microgrids in the electricity system transformation. It is seen as a foundation that complements large-scale generation plants and high-voltage transmission lines by providing additional flexibility and resilience. This flexibility and resilience are crucial for balancing the energy system and ensuring its long-term sustainability, given the changing supply and demand patterns due to rooftop solar photovoltaics (PV), battery storage, electric mobility, and heat pumps. It is also an opportunity for residential and commercial consumers to become active participants in the energy market. Innovation, new technologies and business models will act as the key enabler for this transformation. The regulatory restructuring of the energy market will be crucial for successful integration of prosumers and aggregated energy communities. The chapter presents the vision of a sustainable, decentralized, and digitized energy future including market potential, most innovative case study projects and start-up companies, and the shifts needed in the regulatory landscape.

battery storage↗
DOE OSTI2022

Perceived Costs and Benefits of ICON Science and Foundational Documents associated with “Integrated, Coordinated, Open, and Networked (ICON) Science to Advance the Geosciences: Introduction and Synthesis of a Special Collection of Commentary Articles"

This data package is associated with the publication "Integrated, Coordinated, Open, and Networked (ICON) Science to Advance the Geosciences: Introduction and Synthesis of a Special Collection of Commentary Articles" in Earth and Space Science (Goldman et al. 2022; https://doi.org/10.1029/2021EA002099). The manuscript is an introductory article for a special collection of commentary articles across 19 geoscience disciplines that explore the challenges and opportunities associated with the use of ICON science principles. These principles focus on research intentionally designed to be Integrated, Coordinated, Open, and Networked (ICON) with the goal of maximizing mutual benefit (among stakeholders) and cross-system transferability of science outcomes. This data package contains data, figures, and R scripts associated with the cost/benefit analysis presented in the manuscript. The writing teams involved in the special collection placed each letter of ICON on a plot with perceived cost on one axis and perceived benefit on the other to summarize their perceptions of pursuing each principle of ICON science. These data were subsequently quantified and analyzed. Files are saved as .csv, .R, and .pdf. This data package also contains (1) the public foundational and instructional documents that enabled the crowdsourced creation of the special collection; (2) file-level metadata (flmd) that lists each file in the data package with a description; (3) data dictionary (dd) that defines column headers that appear in csv files. Files are saved as .pdf and .csv.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The progeria research foundation 10 th international scientific workshop; researching possibilities, ExTENding lives – webinar version scientific summary

Progeria is an ultra-rare (prevalence 1 in 20 million), fatal, pediatric autosomal dominant premature aging disease caused by a mutation in the LMNA gene. This mutation results in accumulation of a high level of an aberrant form of the nuclear membrane protein, Lamin A. This aberrant protein, termed progerin, accumulates in many tissues and is responsible for the diverse array of disease phenotypes. Children die predominantly from premature atherosclerotic cardiovascular disease. The Progeria Research Foundation’s 10th International Scientific Workshop took place via webinar on November 2 and 3, 2020. Participants from 30 countries joined in this new, virtual meeting format. Patient family presentations led the program, followed by updates on Progeria’s first-ever application for FDA drug approval as well as initial results from the only current Progeria clinical trial. This was followed by presentations of unpublished preclinical data on drugs in development targeting the disease-causing DNA mutation, the aberrant mRNA, progerin protein, and its downstream effector proteins. Tying bench to bedside, clinicians presented new discoveries on the natural history of disease to inform future clinical trial development and new Progeria aortic valve replacement procedures. The program engaged the Progeria research community as a single unit with a common goal – to treat and cure children with Progeria worldwide.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Conceptual and Mathematical Foundation for the FE/NETL CO 2 Prophet Model for Simulating CO 2 Enhanced Oil Recovery, Version 2

The United States (U.S.) Department of Energy (DOE) Office of Fossil Energy (FE) at the National Energy Technology Laboratory (NETL) has developed the FE/NETL CO 2 Prophet Model, which is Version 2 of CO 2 Prophet. This document describes the mathematical foundation for the FE/NETL CO 2 Prophet Model. CO 2 Prophet was originally developed in the 1990s by Texaco Exploration and Production and Technology Department for DOE. The FE/NETL CO 2 Prophet Model is an oil reservoir simulator that is suitable for simulating water floods and supercritical carbon dioxide (CO 2 ) enhanced oil recovery (EOR). The FE/NETL CO 2 Prophet Model uses a number of assumptions to simplify the equations describing the flow of oil, water (or brine), and CO 2 in the oil reservoir.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Foundations of an Electric Mobility Strategy for the City of Mexicali

The Foundations of an Electric Mobility Strategy for the city of Mexicali aligns with numerous energy, environmental, and transport plans and will help Mexicali meet multiple related goals. Mexicali’s energy mix, with 28% renewables, already enables plugin electric vehicles (PEVs) to reduce the mass of greenhouse gases (GHGs) per km driven 2/3 below that of their conventional counterparts. This GHG benefit will increase should Mexicali take steps to further increase their share of renewables in their electricity supply. Beyond increasing renewables, Mexicali could possibly deploy PEVs so that electric load is added in the right location (depending on further analysis of substations and feeders) and at the right time (between 21:00 and 11:00) in order to minimize grid upgrade costs. There are a handful of charge timing control mechanisms –at various stages of development– that Mexicali could implement. Transport electrification can facilitate mass transit by powering buses, trains, and small vehicles that get people from their homes or work to the transit stations and vice versa. Mexicali could utilize fleets as early PEV adopters in order to gain acceptance and add electric vehicle supply equipment (EVSE). Recommended prioritization of different types of fleets are suggested in this report: transit buses, school buses, airport ground support equipment (GSE), refuse trucks, taxis, shuttle buses, campus vehicles, delivery trucks, utility trucks, and finally semitrailers. There are a handful of policy options that Mexicali could use to incentivize fleets to purchase PEVs, including mandates, economic incentives, energy performance contracts, waivers to access restrictions, electricity discounts, and EVSE requirements in building codes. Mexicali’s taxi fleet was an early adopter of PEVs and had experienced some challenges—mostly related to the insufficient range of the taxis due to hot weather. In this report, we strategize ways to extend the range of the current electric taxis, including ways to make charging more convenient to the drivers, and more suggestions for appropriate vehicles to purchase in the future. This report also includes the groundwork of geotracking Mexicali’s taxi fleet so that more detailed recommendations can be made in the future. Once fleets have increased PEV acceptance and EVSE installations, the market will be ready to expand to private vehicle owners. In order to do this, more EVSE needs to be installed in the right locations. This mobility strategy lays out general local areas where EVSE could be well utilized, based on traffic patterns, land use, and demographic data. Mexicali could approach businesses within these areas that would likely make suitable hosts, based on how well they can profit from the additional business that EVSE would bring. Mexicali could then adopt a series of purchase incentives (including sales tax waivers or access to high-occupancy vehicles [HOV] lanes) that would encourage private vehicle owners to purchase PEVs. Purchase incentives run the risk of creating equity issues, which can be countered by promoting electrification in mass transit, creating more HOV lanes that have PEV exemptions, and installing EVSEs in underserved communities. Private PEV ownership will require a set of experts that Mexicali can help train, including PEV repair technicians, EVSE installation electricians, and first responders.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Finding of Adverse Effect and Mitigation Documentation for the Stormwater Drainage and Street Systems, Substation Foundations, and the Bus Parking Lot in Mercury, Area 23, Nevada National Security Site, Nye County, Nevada

The U.S. Department of Energy, National Nuclear Security Administration Nevada Field Office (NNSA/NFO) proposes to grade the block on the southeast corner of Mercury Highway and Ranger Avenue and demolish an adjacent street segment in the town of Mercury at the Nevada National Security Site (NNSS) in Nye County, Nevada. The purpose of this letter report is to submit documentation related to the finding of effect for the undertaking and mitigation of four resources on and adjacent to the block that will be affected by planned activities to modernize parking and infrastructure in central Mercury. Two of these resources are portions of the street system and the stormwater drainage system, which are elements of the town’s infrastructure. The foundations of an old electrical substation and the bus parking lot will also be replaced by new parking or landscaping. This submission is intended to comply with the stipulations in the Programmatic Agreement between the National Nuclear Security Administration Nevada Field Office and the Nevada State Historic Preservation Officer Regarding Modernization and Operational Maintenance of the Nevada National Security Site, at Mercury in Nye County, Nevada, hereafter referred to as the Mercury PA. The town of Mercury and the immediate surrounding area have been designated the Mercury Historic District (SHPO Resource #D230), which is a property eligible to the National Register of Historic Places under Criteria A and C for its importance in supporting nuclear testing and scientific research from 1951 through 1992. During the initial architectural survey (Reno et al. 2018), all four resources were identified as contributing to the eligibility of the district.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Building the Foundation for Assessing GOM Offshore CO 2 EOR and CO 2 Storage [Slides]

This PowerPoint Presentation was used in a seminar given to headquarters personnel as well as other stakeholders. The seminar took place on August 7, 2020. The presentation introduces three offshore oil field case studies: Cognac, Petronius, and Horn Mountain. The NETL/ARI Gulf of Mexico (GOM) offshore large oil fields data base provides a strong foundation for the upcoming offshore GOM CO 2 storage and enhanced oil recovery (EOR) assessment. The three Case Studies show that significant volumes of CO 2 can be securely stored in the offshore GOM and that notable volumes of addition oil can be recovered from this area with CO 2 EOR. The Case Studies also show that the CO 2 Prophet Model can serve as an excellent assessment tool. The “next steps” include building the cost and economics models for offshore CO 2 transportation and particularly for conducting seafloor CO 2 EOR and CO 2 storage.

02 PETROLEUM↗
DOE OSTI2021

Land-Based Wind Energy Siting: A Foundational and Technical Resource

This land-based wind energy siting resource was created by the U.S. Department of Energy Wind Energy Technologies Office’s WINDExchange initiative and presents foundational information about land-based utility-scale wind energy that local decision makers can use when making community decisions about wind energy development. Consolidated, accessible, and easy to understand, this information resource focuses on land-based wind energy from the community perspective and examines siting-related impacts and mitigation strategies. Other impacts and strategies exist, such as those related to economics, climate, health, water, emissions, and waste; however, they are not covered in this resource. For more information on economic considerations, see the “Land-Based Wind: Economic Development Guide” and “Advancing the Growth of the U.S. Wind Industry: Federal Incentives, Funding, and Partnership Opportunities.” The intended audience for this guide is county-level decision officials, as they are often responsible for approving both wind energy ordinances and applicable permits needed for wind energy development. This guide may also provide relevant information to decision makers from other government jurisdictions and interested community members.

17 WIND ENERGY↗
DOE OSTI2021

ASCEND: Asymptotically compatible strong form foundations for nonlocal discretization

Nonlocal models naturally handle a range of physics of interest to SNL, but discretization of their underlying integral operators poses mathematical challenges to realize the accuracy and robustness commonplace in discretization of local counterparts. This project focuses on the concept of asymptotic compatibility, namely preservation of the limit of the discrete nonlocal model to a corresponding well-understood local solution. We address challenges that have traditionally troubled nonlocal mechanics models primarily related to consistency guarantees and boundary conditions. For simple problems such as diffusion and linear elasticity we have developed complete error analysis theory providing consistency guarantees. We then take these foundational tools to develop new state-of-the-art capabilities for: lithiation-induced failure in batteries, ductile failure of problems driven by contact, blast-on-structure induced failure, brittle/ductile failure of thin structures. We also summarize ongoing efforts using these frameworks in data-driven modeling contexts. This report provides a high-level summary of all publications which followed from these efforts.

97 MATHEMATICS AND COMPUTING↗