Search NASA⌕ Search

SEARCH · Search NASA

Results for “Language model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

Modeling and Optimization of a Nuclear Integrated Energy System for the Remote Microgrid on El Hierro

Nuclear microreactors are a potential technology to provide heat and electricity for remote microgrids. There is potential for the microgrid on the island of El Hierro to use a microreactor, within an integrated energy system (IES), to generate electricity and provide desalinated water. This work proposes a workflow for optimizing and analyzing IESs for microgrids. In this study, an IES incorporating a microreactor, thermal energy storage (TES) system, combined heat and power plant, and a thermal desalination plant was designed, optimized, and analyzed using Idaho National Laboratory’s Framework for Optimization of Resources and Economics (FORCE) toolset. The optimization tool, Holistic Energy Resource Optimization Network (HERON), was used to determine the optimal capacity sizes and dispatch for the reactor and thermal energy storage systems to meet demand. The optimized reactor and TES sizes were found to be 11.61 MWth and 58.47 MWhth, respectively, when optimizing the IES to replace 95% of the island’s existing diesel generation needs. A dynamic model of the system was created in the Modelica language, using models from the HYBRID repository, to analyze and verify the dispatch from the optimizer. The dynamic model was able to meet the ramp rates while maintaining reactor power with minimal control adjustments.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Aspen-based performance and energy modeling frameworks

Now with the anticipation of exascale architectures, energy consumption is becoming one of the critical design parameters, especially in light of the energy budget of 20-30 Megawatts set by the U.S. Department of Energy. Understanding an application’s execution pattern and its energy footprint is critical to improving application operation on a diverse heterogeneous architecture. Applying application-specific performance optimization can consequently improve energy consumption. However, this approach is only applicable to current systems. As we enter a new era of exascale architectures that is projected to contain more complex memory hierarchies, increased levels of parallelism, heterogeneity in hardware, and complex programming models and techniques, energy and performance management is getting more cumbersome. We therefore propose techniques that predict the energy consumption beforehand or at runtime to enable proactive tuning. Such energy prediction approaches must be generic and adapt themselves at runtime to changing application and hardware configurations. Most existing energy estimation and prediction approaches are empirical in nature and thus tied to current systems. To overcome this limitation, we propose two energy estimation techniques: ACEE (Algorithmic and Categorical Energy Estimation), which uses a combination of analytical and empirical modeling techniques; and AEEM (Aspen’s Embedded Energy Estimation), a system-level analytical energy estimation technique. Both of these models incorporate the Aspen domain specific language for performance modeling. We present the methodologies of these two models and test their accuracy using five proxy applications. We also describe three use cases.

79 ASTRONOMY AND ASTROPHYSICS↗

De novo design of protein structure and function with RFdiffusion

Abstract There has been considerable recent progress in designing new proteins using deep-learning methods 1–9 . Despite this progress, a general deep-learning framework for protein design that enables solution of a wide range of design challenges, including de novo binder design and design of higher-order symmetric architectures, has yet to be described. Diffusion models 10,11 have had considerable success in image and language generative modelling but limited success when applied to protein modelling, probably due to the complexity of protein backbone geometry and sequence–structure relationships. Here we show that by fine-tuning the RoseTTAFold structure prediction network on protein structure denoising tasks, we obtain a generative model of protein backbones that achieves outstanding performance on unconditional and topology-constrained protein monomer design, protein binder design, symmetric oligomer design, enzyme active site scaffolding and symmetric motif scaffolding for therapeutic and metal-binding protein design. We demonstrate the power and generality of the method, called RoseTTAFold diffusion (RFdiffusion), by experimentally characterizing the structures and functions of hundreds of designed symmetric assemblies, metal-binding proteins and protein binders. The accuracy of RFdiffusion is confirmed by the cryogenic electron microscopy structure of a designed binder in complex with influenza haemagglutinin that is nearly identical to the design model. In a manner analogous to networks that produce images from user-specified inputs, RFdiffusion enables the design of diverse functional proteins from simple molecular specifications.

Science & Technology - Other Topics↗

Solving key challenges in collider physics with foundation models

Foundation models are neural networks that are capable of simultaneously solving many problems. Large language foundation models like ChatGPT have revolutionized many aspects of daily life, but their impact for science is not yet clear. In this paper, we use a new foundation model for hadronic jets to solve three key challenges in collider physics. In particular, we show how experiments can (1) save significant computing power when developing reconstruction algorithms, (2) perform a complete uncertainty quantification for high-dimensional measurements, and (3) search for new physics with model agnostic methods using low-level inputs. In each case, there are significant computational or methodological challenges with current methods that limit the science potential of deep learning algorithms. By solving each problem, we take jet foundation models beyond proof-of-principle studies and into the toolkit of practitioners.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Integration of a constraint-based metabolic model of Brassica napus developing seeds with 13 C-metabolic flux analysis

The use of large-scale or genome-scale metabolic reconstructions for modeling and simulation of plant metabolism and integration of those models with large-scale omics and experimental flux data is becoming increasingly important in plant metabolic research. Here we report an updated version of bna572, a bottom-up reconstruction of oilseed rape (Brassica napus L.; Brassicaceae) developing seeds with emphasis on representation of biomass-component biosynthesis. New features include additional seed-relevant pathways for isoprenoid, sterol, phenylpropanoid, flavonoid, and choline biosynthesis. Being now based on standardized data formats and procedures for model reconstruction, bna572+ is available as a COBRA-compliant Systems Biology Markup Language (SBML) model and conforms to the Minimum Information Requested in the Annotation of Biochemical Models (MIRIAM) standards for annotation of external data resources. Bna572+ contains 966 genes, 671 reactions, and 666 metabolites distributed among 11 subcellular compartments. It is referenced to the Arabidopsis thaliana genome, with gene-protein-reaction (GPR) associations resolving subcellular localization. Detailed mass and charge balancing and confidence scoring were applied to all reactions. Using B. napus seed specific transcriptome data, expression was verified for 78% of bna572+ genes and 97% of reactions. Alongside bna572+ we also present a revised carbon centric model for 13 C-Metabolic Flux Analysis ( 13 C-MFA) with all its reactions being referenced to bna572+ based on linear projections. By integration of flux ratio constraints obtained from 13 C-MFA and by elimination of infinite flux bounds around thermodynamically infeasible loops based on COBRA loopless methods, we demonstrate improvements in predictive power of Flux Variability Analysis (FVA). In conclusion, using this combined approach we characterize the difference in metabolic flux of developing seeds of two B. napus genotypes contrasting in starch and oil content.

13C-metabolic flux analysis↗

Specifying structural constraints of architectural patterns in the ARCHERY language

ARCHERY is an architectural description language for modelling and reasoning about distributed, heterogeneous and dynamically reconfigurable systems in terms of architectural patterns. The language supports the specification of architectures and their reconfiguration. This paper introduces a language extension for precisely describing the structural design decisions that pattern instances must respect in their (re)configurations. The extension is a propositional modal logic with recursion and nominals referencing components, i.e., a hybrid µ-calculus. Its expressiveness allows specifying safety and liveness constraints, as well as paths and cycles over structures. Refinements of classic architectural patterns are specified.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

MPS++

The MPS++ computer code simulates models of strongly correlated quantum lattice systems. The algorithm used is the density-matrix renormalization method formulated in the matrix product states language. These models and methods are used to obtain ground state, dynamic, finite temperature and time evolution properties of the underlying materials that are simulated. These materials are usually one- and quasi-one dimensional strongly correlated electronic systems, such as high temperature superconductors, manganites, and other transition metal oxides. This code is (mostly) an implementation of the paper “The density-matrix renormalization group in the age of matrix product states” by U. Schollwoeck, and references therein, found at http://arxiv.org/abs/1008.3477v2 , and that was also published in Annals of Physics 326,96 (2011).

Source record↗

MPS++

The MPS++ computer code simulates models of strongly correlated quantum lattice systems. The algorithm used is the density-matrix renormalization method formulated in the matrix product states language. These models and methods are used to obtain ground state, dynamic, finite temperature and time evolution properties of the underlying materials that are simulated. These materials are usually one- and quasi-one dimensional strongly correlated electronic systems, such as high temperature superconductors, manganites, and other transition metal oxides. This code is (mostly) an implementation of the paper "The density-matrix renormalization group in the age of matrix product states" by U. Schollwoeck, and references therein, found at http://arxiv.org/abs/1008.3477v2 , and that was also published in Annals of Physics 326,96 (2011).

Source record↗

Towards a Techno-Economic Analysis of PCM Integrated Hybrid HVAC Systems

Thermal end uses dominate building energy consumption and are a major driver of peak demand. As heating is electrified, peak electrical power required will surge, prompting a need for innovative HVAC system designs and controls.These designs must incorporate novel technologies at the component level and new integration techniques at the system level. One such possibility involves the addition of thermal energy storage (TES) in heating and cooling equipment using a phase change material (PCM) heat exchanger. Here, thermal energy storage via phase change can be used to shift the HVAC system loads to times of lower electricity cost, reduced carbon intensity, and greater energy efficiency. Most of the current utilization of PCM in buildings involves passive components. By actively controlling when heat is stored and released from PCM, we can optimize the building HVAC system to cost-effectively meet consumer needs with the flexibility to draw on renewable energy resources when they are abundant and available. While this combination of technologies is promising in theory, simulation-based evaluation of a prototype can be difficult due to the modeling requirements at the component level and the large number of possible configurations and operating modes at the system level. To conduct this evaluation, we use the Modelica language for modeling and simulation because it enables users to represent the important physics of the problem, interchange and rearrange components in an efficient manner, and implement a range of control configurations. In this work, we considered three case studies: a portable building, a large commercial retail store, and a multifamily residential apartment unit. Each of these employs a different system design, ranging from a single package vertical unit incorporating PCM to a central plant with independent heat pump, evaporative cooling, and thermal energy storage components. This paper describes the technologies in question, presents modeling at the component and system levels, and demonstrates building energy and demand charge cost savings with local time-of-use tariffs in a hot-dry climate.

Helmns, Dre↗

Generalist multimodal AI: A review of architectures, challenges and opportunities

Multimodal models are expected to be a critical component to future advances in artificial intelligence. Here, this field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural language processing (NLP) and vision. It is widely hoped that further extending the foundation models to multiple modalities (e.g., text, image, video, sensor, time series, graph, etc.) will ultimately lead to generalist multimodal models, i.e. one model across different data modalities and tasks. However, there is little research that systematically analyzes recent multimodal models (particularly the ones that work beyond text and vision) with respect to the underling architecture proposed. Therefore, this work provides a fresh perspective on generalist multimodal models (GMMs) via a novel architecture and training configuration specific taxonomy. This includes factors such as Unifiability, Modularity, and Adaptability that are pertinent and essential to the wide adoption and application of GMMs. The review further highlights key challenges and prospects for the field and guide the researchers into the new advancements.

Artificial intelligence (AI)↗

Evaluating and Explaining Natural Language Generation with GenX

Current methods for evaluation of natural language generation models focus on measuring text quality but fail to probe the model creativity, i.e., its ability to generate novel but coherent text sequences not seen in the training corpus. We present the GenX tool which is designed to enable interactive exploration and explanation of natural language generation outputs with a focus on the detection of memorization. We demonstrate the utility of the tool on two domain-conditioned generation use cases - phishing emails and ACL abstracts.

Duskin, Kayla R.↗

Towards a robust out-of-the-box neural network model for genomic data

The accurate prediction of biological features from genomic data is paramount for precision medicine and sustainable agriculture. For decades, neural network models have been widely popular in fields like computer vision, astrophysics and targeted marketing given their prediction accuracy and their robust performance under big data settings. Yet neural network models have not made a successful transition into the medical and biological world due to the ubiquitous characteristics of biological data such as modest sample sizes, sparsity, and extreme heterogeneity. Here, we investigate the robustness, generalization potential and prediction accuracy of widely used convolutional neural network and natural language processing models with a variety of heterogeneous genomic datasets. Mainly, recurrent neural network models outperform convolutional neural network models in terms of prediction accuracy, overfitting and transferability across the datasets under study. While the perspective of a robust out-of-the-box neural network model is out of reach, we identify certain model characteristics that translate well across datasets and could serve as a baseline model for translational researchers.

59 BASIC BIOLOGICAL SCIENCES↗

QCOR; A Language Extension Specification for the Heterogeneous Quantum-Classical Model of Computation

Quantum computing (QC) is an emerging computational paradigm that leverages the laws of quantum mechanics to perform elementary logic operations. Existing programming models for QC were designed with fault-tolerant hardware in mind, envisioning stand-alone applications. However, the susceptibility of near-term quantum computers to noise limits their stand-alone utility. To better leverage limited computational strengths of noisy quantum devices, hybrid algorithms have been suggested whereby quantum computers are used in tandem with their classical counterparts in a heterogeneous fashion. This modus operandi calls out for a programming model and a high-level programming language that natively and seamlessly supports heterogeneous quantum-classical hardware architectures in a single-source-code paradigm. Motivated by the lack of such a model, we introduce a language extension specification, called QCOR, which enables single-source quantum-classical programming. Programs written using the QCOR library–based language extensions can be compiled to produce functional hybrid binary executables. After defining QCOR’s programming model, memory model, and execution model, we discuss how QCOR enables variational, iterative, and feed-forward QC. Additionally, QCOR approaches quantum-classical computation in a hardware-agnostic heterogeneous fashion and strives to build on best practices of high-performance computing. The high level of abstraction in the language extension is intended to accelerate the adoption of QC by researchers familiar with classical high-performance computing.

97 MATHEMATICS AND COMPUTING↗

A fractional calculus framework for open quantum dynamics: From Liouville to Lindblad to memory kernels

Open quantum systems exhibit dynamics ranging from unitary evolution to irreversible dissipation. While the Gorini–Kossakowski–Sudarshan–Lindblad equation uniquely characterizes Markovian completely positive and trace-preserving (CPTP) evolution, many physical platforms display non-Markovian features such as algebraic relaxation and coherence backflow. Fractional calculus provides a natural way to model such long-memory behavior through power-law temporal kernels introduced by fractional time derivatives. Here, we develop a unified framework that embeds fractional master equations within the broader hierarchy of open-system formalisms. The fractional equation forms a structured subclass of memory-kernel models, reduces to the Lindblad form at unit order, and, through Bochner–Phillips subordination, admits a CPTP representation as an average over Lindblad semigroups. Its resolvent structure further connects fractional dynamics to established non-Markovian approaches, including Nakajima–Zwanzig kernels and hierarchical equations of motion, providing a compact surrogate for long-memory effects. This formulation positions fractional calculus as a rigorous and practical language for modeling non-Markovian quantum dynamics in chemical physics and physical chemistry, providing a CPTP-preserving, computationally efficient surrogate for structured condensed-phase environments where long-time memory and dissipation play a central role.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

RuleMonkey: software for stochastic simulation of rule-based models

Background: The system-level dynamics of many molecular interactions, particularly protein-protein interactions, can be conveniently represented using reaction rules, which can be specified using model-specification languages, such as the BioNetGen language (BNGL). A set of rules implicitly defines a (bio)chemical reaction network. The reaction network implied by a set of rules is often very large, and as a result, generation of the network implied by rules tends to be computationally expensive. Moreover, the cost of many commonly used methods for simulating network dynamics is a function of network size. Together these factors have limited application of the rule-based modeling approach. Recently, several methods for simulating rule-based models have been developed that avoid the expensive step of network generation. The cost of these “network-free” simulation methods is independent of the number of reactions implied by rules. Software implementing such methods is now needed for the simulation and analysis of rule-based models of biochemical systems. Results: Here, we present a software tool called RuleMonkey, which implements a network-free method for simulation of rule-based models that is similar to Gillespie’s method. The method is suitable for rule-based models that can be encoded in BNGL, including models with rules that have global application conditions, such as rules for intramolecular association reactions. In addition, the method is rejection free, unlike other network-free methods that introduce null events, i.e., steps in the simulation procedure that do not change the state of the reaction system being simulated. We verify that RuleMonkey produces correct simulation results, and we compare its performance against DYNSTOC, another BNGL-compliant tool for network-free simulation of rule-based models. We also compare RuleMonkey against problem-specific codes implementing network-free simulation methods. Conclusions: RuleMonkey enables the simulation of rule-based models for which the underlying reaction networks are large. It is typically faster than DYNSTOC for benchmark problems that we have examined. RuleMonkey is freely available as a stand-alone application http://public.tgen.org/rulemonkey. It is also available as a simulation engine within GetBonNie, a web-based environment for building, analyzing and sharing rule-based models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Thermal Adaptation of Enzyme‐Mediated Processes Reduces Simulated Soil CO2 Fluxes Upon Soil Warming

Abstract Understanding factors influencing carbon effluxes from soils to the atmosphere is important in a world experiencing climatic change. Two important uncertainties related to soil organic carbon (SOC) stock responses to a changing climate are (a) whether soil microbial communities acclimate or adapt to changes in soil temperature and (b) how to represent this process in SOC models. To further explore these issues, we included thermal adaptation of enzyme‐mediated processes in a mechanistic SOC model (ReSOM) using the macromolecular rate theory. Thermal adaptation is defined here to encompass all potential responses of soil microbes and microbial communities following a change in temperature. To assess the effects of thermal adaptation of enzyme‐mediated processes on simulated SOC losses, ReSOM was applied to data collected from a 13‐year soil warming experiment. Results show that a model omitting thermal adaptation of enzyme‐mediated processes substantially overestimates observed CO 2 effluxes during the initial years of soil warming. The bias against observed CO 2 effluxes was lower for models including thermal adaptation of enzyme‐mediated processes. In addition, for a simulated linear 3°C soil warming over 100 years, models including thermal adaptation of enzyme‐mediated processes simulated SOC losses of a factor of three smaller than models omitting this process. As thermal adaptation of microbial community characteristics is generally not included in models simulating feedback between the soil, biosphere and atmosphere, we encourage future studies to assess the potential impact that microbial adaptation has on soil carbon – climate feedback representations in models. Plain Language Summary A major uncertainty in projecting how much soil organic carbon (SOC) will be converted to CO 2 as a consequence of climate change is related to how soil microbes may adapt to increasing soil temperatures. While this “microbial thermal adaptation” has been shown to occur in short‐term lab incubation experiments, its effect on SOC cycling on a decadal timescale is not clear. To address this knowledge gap, a mechanistic SOC model was used to simulate data collected from a 13‐year soil warming experiment, to assess how microbial thermal adaptation affects predicted SOC losses upon soil warming. The model results show that incorporating microbial thermal adaptation into the model led to reduced CO 2 effluxes from the soil to the atmosphere compared to the common approach of omitting this mechanism. Our results imply that projected SOC losses for the decades to come may be reduced when this mechanism is incorporated in land models. We therefore advocate for more research on the mechanisms controlling microbial thermal adaptation, and how to implement this mechanism in SOC models. Key Points A crucial aspect of soil organic carbon (SOC) models is the representation of soil microbes Predicted soil CO 2 fluxes upon soil warming are reduced when accounting for microbial thermal adaptation On a centennial time scale, this thermal adaptation results in up to a factor of three lower predicted SOC loss

Van de Broek, Marijn↗