Search NASA⌕ Search

SEARCH · Search NASA

Results for “Foundation models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A Foundational Study for Normal F8 -Containing Mouse Models for the miRNA Regulation of Hemophilia A: Identification and Analysis of Mouse miRNAs that Downregulate the Murine F8 Gene

Hemophilia A (HA) is associated with defects in the F8 gene, encoding coagulation factor VIII (FVIII). Our previous studies show that F8-targeting micro RNAs (miRNAs), a group of small RNAs involved in gene regulation, can downregulate F8 expression causing HA in individuals with normal F8-genotypes and increased HA severity in patients with mutations in F8. Understanding the mechanistic underpinnings of human genetic diseases caused or modulated by miRNAs require a small animal model, such as a mouse model. Here, we report a foundational study to develop such a model system. We identified the mouse 3'untranslated region (3'UTR) on murine F8-mRNA (muF8-mRNA) that can bind to murine miRNAs. We then selected three miRNAs for evaluation: miR-208a, miR-351 and miR-125a. We first demonstrate that these three miRNAs directly target the 3'UTR of muF8-mRNA and reduce the expression of a reporter gene (luciferase) mRNA fused to the muF8-3' UTR in mammalian cells. Furthermore, in mouse cells that endogenously express the F8 gene and produce FVIII protein, the ectopic expression of these miRNAs downregulated F8-mRNA and FVIII protein. These results provide proof-of-concept and reagents as a foundation for using a normal F8-containing mouse as a model for the miRNA regulation of normal F8 in causing or aggravating the genetic disease HA.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

What is (quantitative) system dynamics modeling? Defining characteristics and the opportunities they create

A clear definition of system dynamics modeling can provide shared understanding and clarify the impact of the field. We introduce a set of characteristics that define quantitative system dynamics, selected to capture core philosophy, describe theoretical and practical principles, and apply to historical work but be flexible enough to remain relevant as the field progresses. The defining characteristics are: (1) models are based on causal feedback structure, (2) accumulations and delays are foundational, (3) models are equation-based, (4) concept of time is continuous, and (5) analysis focuses on feedback dynamics. We discuss the implications of these principles and use them to identify research opportunities in which the system dynamics field can advance. These research opportunities include causality, disaggregation, data science and AI, and contributing to scientific advancement. Progress in these areas has the potential to improve both the science and practice of system dynamics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Foundational Open Source Solar System Modeling Through Improvement and Validation of the System Advisor Model and PVWatts (FY19-FY21 Final Technical Report)

Accelerating intelligent deployment of solar energy technologies demands accurate system modeling every step of the way. From project development to policy research, grid integration studies to development of novel technologies, industry and researchers alike need validated, transparent, easy-to-use, extensible, cutting-edge, and accurate models of both the performance and financing of solar systems. The System Advisor Model (SAM) and PVWatts tools provide a platform to fill that need. The overarching goal of this set of software tools is to enable accurate PV system modeling across the industry, and our usage metrics indicate that we continue to succeed in that endeavor, with a user starting SAM every 2 minutes globally, and over 17 million PVWatts hits per month. This project leveraged DOEs past investment in the SAM and PVWatts platforms to continue to provide valuable and extensible PV, battery, and financial modeling resources to the larger solar community. We pursued multiple avenues in parallel: software maintenance and technical support that are foundational to the continued usability of the SAM and PVWatts platforms; platform and PV model improvements and stakeholder engagement activities that are core to the continued relevance of the platforms; and open source activities to foster the continued creation of a vibrant open-source community around the SAM and PVWatts tools, which opens up exciting new opportunities for industry interaction.

14 SOLAR ENERGY↗
DOE OSTI2022

SAM Code Development for Transient Safety Analyses of Fluoride-salt-cooled High-temperature Reactors

The System Analysis Module (SAM) is under development at Argonne National Laboratory as a modern system-level modeling and simulation tool for advanced non-light water reactor safety analyses. It utilizes the object-oriented application framework MOOSE to leverage the modern software environment and advanced numerical methods. The capabilities of SAM are being extended to enable the transient modeling, analysis, and design of various advanced nuclear reactor systems. The molten-salt-cooled pebble-bed reactor, or pebble-bed FHR (PB-FHR) is a promising candidate among advanced nuclear reactor concepts with its improved passive safety characteristics and high thermal efficiency. To support the development and utilization of the SAM code for PB-FHR safety analysis, activities on SAM code enhancements, reference plant model developments, and code validations have been performed in the past a few years to support near-term industry and NRC needs. This report summarizes recent progress under DOE-NE’s Nuclear Energy Advanced Modeling and Simulation program in SAM code development and demonstration for transient safety analysis of Fluoride-salt-cooled High-temperature Reactors. SAM capabilities has been significantly enhanced over the years to add FHR specific modeling features, including salt freezing and thawing, spherical core channel and pebble bed core modeling, solid-fluid thermal radiation, tritium transport and general species transport in fluids and solids, and the general code enhancements on solver schemes of point kinetics module and reactivity feedback models. A reference PB-FHR model is developed, based on publicly available information from Kairos Power’s generic FHR design and the University of California, Berkeley (UCB) Mk1 design. A reference reactor model is foundational to the methodologies employed by NRC to verify the adequacy of computer codes and evaluation models. The reference FHR model was utilized for a number of selected FHR design basis accidents, including station blackout, loss of heat sink, loss of flow, transient overpower, and overcooling events.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Modeling active nematics via the nematic locking principle

Active nematic systems consist of rod-like internally driven subunits that interact with one another to form large-scale coherent flows. They are important examples of far-from-equilibrium fluids, which exhibit a wealth of nonlinear behavior. This includes active turbulence, in which topological defects in the nematic order braid around one another in a chaotic fashion. One of the most studied examples of active nematics consists of a dense two-dimensional layer of microtubules, crosslinked by kinesin molecular motors that inject extensile deformations into the fluid. Though numerous theoretical studies have modeled microtubule-based active nematics, no consensus has emerged on how to fully and quantitatively capture the features of the experimental system. Here, to better understand the theoretical foundations for modeling this system, we propose a fundamental principle we call the nematic locking principle—individual microtubules cannot rotate without all neighboring microtubules also rotating. Physically, this is justified by the high density of the microtubules, their elongated nature, and their corresponding steric interactions. We assert that the nematic locking principle holds throughout the majority of the material, but breaks down in the neighborhood of topological defects and other regions of low density. We derive the most general nematic transport equation consistent with this principle and also derive the most general term that violates it, introducing fracturing into the material. We then examine the standard Beris–Edwards approach, commonly used to model this system, and show that it violates the nematic locking principle throughout the majority of the material due to fracturing. We then propose a modification to the Beris–Edwards model that enforces nematic locking nearly everywhere. This modification shuts off fracturing except in regions where the order parameter (a proxy for density) is reduced. In these regions fracturing is turned on. The resulting simulations in turn show strong nematic locking throughout the bulk of the material, with narrow bands of fracturing, consistent with experimental observation. One additional advantage of enforcing nematic locking is that nontrivial stationary state solutions, common in Beris–Edwards simulations but not seen in experiments, are eliminated.

Mitchell, Kevin A. [Univ. of California, Merced, C↗
DOE OSTI2025

Nonmonotonic Band Flattening near the Magic Angle of Twisted Bilayer MoTe 2

Twisted bilayer MoTe 2 (tMoTe 2 ) is an emergent platform for exploring exotic quantum phases driven by the interplay between nontrivial band topology and strong electron correlations. Direct experimental access to its momentum-resolved electronic structure is essential for uncovering the microscopic origins of the correlated topological phases therein. Here, we report angle-resolved photoemission spectroscopy measurements of tMoTe 2 , revealing pronounced twist-angle-dependent band reconstruction shaped by orbital character, interlayer coupling, and moiré potential modulation. Density functional theory captures the qualitative evolution, yet underestimates key energy scales across twist angles, highlighting the importance of electronic correlations. Notably, the hole effective mass at the 𝐾 point exhibits a nonmonotonic dependence on twist angle, peaking near 2°, consistent with band flattening at the magic angle predicted by continuum models. Via electrostatic gating and surface dosing, we further visualize the evolution of electronic structure versus doping, enabling direct observation of the conduction band minimum and confirm tMoTe 2 as a direct band gap semiconductor. These results establish a spectroscopic foundation for modeling and engineering emergent quantum phases in this moiré platform.

2D materials↗
DOE OSTI2025

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗
DOE OSTI2020

Sensor Recommendations for Long Term Monitoring of the F-Area Seepage Basins

In mid-2018, a new paradigm for long-term monitoring was developed after of decade of applied research projects funded by the Department of Energy’s office of Environmental Management Technology Development program. The program at SRNL was focused on transitioning complex environmental waste sites from active to passive remediations strategies. A key result of these studies was that the use of enhanced attenuation approaches at radiologically contaminated sites will result in the creation of secondary source areas in the subsurface that will require monitoring for decades. Alternative monitoring approaches are being developed and tested at the Savannah River Site’s F-Area Hazardous Waste Management Facility, the new paradigm provides innovative solutions that will significantly lower costs of monitoring through the coupling of data collection, machine learning and deterministic groundwater modeling. The foundation of this approach is a well-optimized network of sensors for measuring hydrogeochemical master variables that control, and therefore act as indicators of groundwater contaminant transport. By monitoring changes in the controlling master variables over time arising from geological and environmental shifts, predictive modelling can assist with identifying new strategies for ensuring regulatory requirements are met if trends toward conditions for potential remobilization of attenuated contaminants are detected. In this report, we evaluated commercially available single parameter sensor platforms (e.g., temperature/depth) and configurable multi-parameter sensor platforms (e.g., pH, oxidation-reduction potential, temperature, depth, dissolved oxygen, and conductivity). Each was scored using an optimization function based on how well the system supports the proposed long-term monitoring paradigm, in general, and the site-specific conditions at F-Area, in particular. Several viable sensor systems were identified. Of these, a combined platform including the In-Situ Aqua TROLL 500 multi-parameter sensor platform and the In-Situ temperature/depth sensor had the highest rating and was identified as the most suitable candidate for installation and monitoring of the master variables and potentiometric surface that control groundwater contaminant plumes emanating from the F-Area Seepage Basins. The discussion of recommended potential deployment locations builds upon recommendations made by Denham et al (2019).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Synthetic Scientific Image Generation with VAE, GAN, and Diffusion Model Architectures

Generative AI (genAI) has emerged as a powerful tool for synthesizing diverse and complex image data, offering new possibilities for scientific imaging applications. This review presents a comprehensive comparative analysis of leading generative architectures, ranging from Variational Autoencoders (VAEs) to Generative Adversarial Networks (GANs) on through to Diffusion Models, in the context of scientific image synthesis. We examine each model's foundational principles, recent architectural advancements, and practical trade-offs. Our evaluation, conducted on domain-specific datasets including microCT scans of rocks and composite fibers, as well as high-resolution images of plant roots, integrates both quantitative metrics (SSIM, LPIPS, FID, CLIPScore) and expert-driven qualitative assessments. Results show that GANs, particularly StyleGAN, produce images with high perceptual quality and structural coherence. Diffusion-based models for inpainting and image variation, such as DALL-E 2, delivered high realism and semantic alignment but generally struggled in balancing visual fidelity with scientific accuracy. Importantly, our findings reveal limitations of standard quantitative metrics in capturing scientific relevance, underscoring the need for domain-expert validation. We conclude by discussing key challenges such as model interpretability, computational cost, and verification protocols, and discuss future directions where generative AI can drive innovation in data augmentation, simulation, and hypothesis generation in scientific research.

Generative Adversarial Networks↗
DOE OSTI2024

Theoretical modeling of a bottom-raised oscillating surge wave energy converter structural loadings and power performances

Here, this study presents theoretical formulations to evaluate the fundamental parameters and performance characteristics of a bottom-raised oscillating surge wave energy converter (OSWEC) device. Employing a flat plate assumption and potential flow formulation in elliptical coordinates, closed-form equations for the added mass, radiation damping, and excitation forces/torques in the relevant pitch-pitch and surge-pitch directions of motion are developed and used to calculate the system's response amplitude operator and the forces and moments acting on the foundation. The model is benchmarked against numerical simulations using WAMIT and WEC-Sim, showcasing excellent agreement. The sensitivity of plate thickness on the analytical hydrodynamic solutions is investigated over several thickness-to-width ratios ranging from 1:80 to 1:10. The results show that as the thickness of the benchmark OSWEC increases, the deviation of the analytical hydrodynamic coefficients from the numerical solutions grows from 3% to 25%. Differences in the excitation forces and torques, however, are contained within 12%. While the flat plate assumption is a limitation of the proposed analytical model, the error is within a reasonable margin for use in the design space exploration phase before a higher-fidelity (and thus more computationally expensive) model is employed. A parametric study demonstrates the ability of the analytical model to quickly sweep over a domain of OSWEC dimensions, illustrating the analytical model's utility in the early phases of design.

13 HYDRO ENERGY↗
DOE OSTI2026

AnisONet: A deep neural operator-based anisotropic permeability upscaler from pore to Darcy scale

Directional permeability variations, which govern directional fluid flow in porous media with anisotropy, are important to accurately predict flow behavior, reactive transport, and fluid–solid interactions for various processes such as enhanced geothermal systems, energy storage devices, and biological systems. However, the intricate architecture of porous media makes it difficult to predict directional permeabilities. In this work, we present a novel machine learning (ML) framework, AnisONet, built upon an integration of a convolutional neural network, Swin transformer, and the deep operator network architecture, designed to predict anisotropic permeability and upscale predictions to larger spatial domains. First, AnisONet was evaluated with three classes of two-dimensional (2D) porous media, including synthetic circular and elliptical grains and natural sandstone grains from micro-computed tomography images. A lattice Boltzmann model (LBM) was used to calculate directional permeabilities at every 10° angle, producing 19 data points per image of porous media. AnisONet is then trained to predict permeability as a function of rotation angle. AnisONet showed strong predictive capability of directional permeability. Second, we tested our model for five upscaling cases with a large image size in the finite-element method (FEM) for 2D Darcy flow with various permeability tensor construction methods. Overall, upscaled permeability tensors in FEM simulations produce a reasonably good match with LBM results, highlighting the importance of selecting appropriate tensor formation strategies for accurate permeability upscaling. AnisONet, as a directional permeability estimator, could be further developed for more complex geometries, with the potential to develop a foundational ML model for various applications in porous media.

42 ENGINEERING↗
DOE OSTI2023

Language Model Inventory v1.0 [Slides]

This presentation is an inventory of the latest large language model (LLM) offerings. It lists some of the most prominent open- and closed-source LLMs. Given the rapid pace of progress in this space, it is not guaranteed to be a comprehensive list. This resource is intended to help inform decision-making about LLM capabilities at NREL.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Dynamic Temporal Graph Sequence Data for Resilience-Oriented Distribution Network Reconfiguration

This dataset comprises temporal dynamic graph sequences generated from power grid simulations focused on grid reconfiguration to enhance resilience. The simulations model failure propagation under varying conditions, with nodes assigned distinct failure probabilities. For each time step, the dataset captures the evolution of node states (functional or failed) and features critical to grid operations, such as pv_output, load_profile, load_dispatch, dg_output, loss, and voltage. Node types include sources, normal loads, and nodes with specific equipment like PVs, micro turbines, or shunt capacitors. The dataset is structured to support the training of dynamic graph neural networks, facilitating research on node feature prediction and edge dynamics under failure scenarios. Three distinct configurations are included, providing a robust foundation for modeling power grid resilience.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

MATEY: multiscale adaptive transformer models for spatiotemporal physical systems

Accurate representation of the multiscale features in spatiotemporal physical systems using vision transformer architectures requires extremely long, computationally prohibitive token sequences. To address this issue, we propose two novel adaptive tokenization schemes that dynamically adjust patch sizes based on local features: one ensures convergent behavior to uniform patch refinement, while the other offers better computational efficiency. Moreover, we present a set of spatiotemporal attention schemes, where the temporal or axial spatial dimensions are decoupled, to evaluate their baseline computational and data efficiencies and to determine whether adaptive tokenization can improve this performance. We assess the performance of the proposed multiscale adaptive model, MATEY, in a sequence of experiments. Compared to a full spatiotemporal attention scheme or a scheme that decouples only the temporal dimension, we find that fully decoupled axial attention is less efficient and expressive, requiring more training time and model parameters to achieve the same accuracy. The experiments on the adaptive tokenization schemes show that, compared to a uniformly refined model, the proposed schemes achieve comparable or improved accuracy at a much lower cost in the tested two-dimensional settings. While the asymptotic analysis suggests the potential for favorable scaling, empirical validation at substantially longer sequence lengths remains to be performed in future work. Finally, we demonstrate in two fine-tuning tasks featuring different physics that models pretrained on PDEBench data outperform the ones trained from scratch, especially in the low data regime with frozen attention.

adaptive tokenization↗
DOE OSTI2024

The melt memory effects in polymer crystallization

This paper presents a systematic review of the literature on the melt memory effects observed in polymers, an area that has engendered considerable debate for over 50 years. Recent advances in experimental techniques have provided fresh insights into how a polymer's thermal history influences its recrystallization behavior. It has been observed that given other conditions unchanged, the crystallization temperature during recrystallization decreases with an increase in the melt temperature T s above the melting point T m until a critical melt temperature is attained. This phenomenon also extends to the half-time of crystallization and the secondary structures, such as lamellar thickness, of semi-crystalline polymers. Despite these findings, a comprehensive constitutive model that encapsulates polymer melt memory effects remains elusive. Cutting-edge instrumentation, including in situ small and wide-angle X-ray scattering, temperature-controlled Fourier transform infrared spectroscopy, and flash differential scanning calorimetry, have posed significant challenges to the traditional nucleation and growth models established in the 1970s. These models are foundational to our understanding of polymer crystallization, which is an integral part of polymer processing and production. In this review, the historical contours of this discourse are traced, with an examination of both the recent experimental breakthroughs and theoretical advancements pertinent to polymer melt memory effects. In conclusion, this paper delves into the prevailing theories of polymer nucleation and crystallization and engages with theoretical discussions and numerical simulations that attempt to elucidate and rationalize these melt memory phenomena.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Impacts of turbine and plant upsizing on the levelized cost of energy for offshore wind

Turbine and plant upsizing are major trends in offshore wind deployment, although the quantitative impact on project costs has not been well-characterized. The uncertain value of continued wind turbine and project growth limits the ability of the supply chain to prepare for future technology trends, leading to challenges in the realization of larger projects. This analysis explores the levelized cost of energy impacts of turbine ratings between 6 and 20 MW and plant capacities between 250 and 2,500 MW for fixed-bottom offshore wind using techno-economic cost models for foundation, electrical, installation, and operation and maintenance costs, along with annual energy production. We consider a nominal set of technology assumptions for all scenarios to isolate economies of size and scale without additional benefits from decreasing turbine capital costs, quantity discounts for larger projects, or optimized technology solutions. These results indicate that using a 20-MW wind turbine in a 2,500-MW power plant array can reduce the levelized cost of energy by over 23% relative to the global average turbine and plant size installed in 2019; primarily because of reductions in the balance-of-system and operation and maintenance costs. We also identify improved installation vessels, optimized export systems, and novel operation and maintenance strategies as additional cost reduction opportunities. These results suggest that upsizing represents a significant cost reduction opportunity for offshore wind energy and will continue to be a main factor in shaping the future of the sector.

17 WIND ENERGY↗