Search NASA⌕ Search

SEARCH · Search NASA

Results for “model complexity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Large Language Models (LLMs) have propelled groundbreaking advancements across several domains and are commonly used for text generation applications. However, the computational demands of these complex models pose significant challenges, requiring efficient hardware acceleration. Benchmarking the performance of LLMs across diverse hardware platforms is crucial to understanding their scalability and throughput characteristics. We introduce LLM-Inference-Bench, a comprehensive benchmarking suite to evaluate the hardware inference performance of LLMs. We thoroughly analyze diverse hardware platforms, including GPUs from Nvidia and AMD and specialized AI accelerators, Intel Habana and SambaNova. Our evaluation includes several LLM inference frameworks and models from LLaMA, Mistral, and Qwen families with 7B and 70B parameters. Our benchmarking results reveal the strengths and limitations of various models, hardware platforms, and inference frameworks. We provide an interactive dashboard to help identify configurations for optimal performance for a given hardware platform.

Chitty-Venkata, Krishna Teja↗
DOE OSTI2025

A High-Fidelity Model of the Peach Bottom 2 Turbine-Trip Benchmark Using VERA

This work presents a high-fidelity simulation of the Peach Bottom turbine trip (PBTT) benchmark using the Virtual Environment for Reactor Applications (VERA), a multiphysics reactor modeling tool developed by the U.S. Department of Energy’s Consortium for Advanced Simulation of Light Water Reactors energy innovation hub. The PBTT benchmark, based on a 1977 transient event at the end of cycle 2 in a General Electric Type-4 boiling water reactor (BWR), is a critical test case for validating core physics models with thermal feedback during rapid reactivity events. VERA was employed to perform end-to-end, pin-resolved simulations from conditions at the beginning of cycle 1 through the turbine-trip transient, incorporating detailed neutron transport, fuel depletion, and subchannel thermal hydraulics. The simulation reproduced key benchmark observables with high accuracy: the peak power excursion occurred at 0.75 s, matching the scram time and closely aligning with the benchmark average of 0.742 s; the simulated maximum power spike was approximately 7600 MW, which is within 3% of the benchmark average of 7400 MW; and void-collapse dynamics were consistent with benchmark expectations. Reactivity predictions during cycles 1 and 2 remained within 1500 pcm and 400 pcm of criticality, respectively. These results confirm VERA’s ability to model complex coupled neutronic and thermal hydraulic behavior in a BWR turbine-trip transient, which will support its use in future studies of modeling dryout, fuel performance, and uncertainty quantification for transients of this type.

BWR↗
DOE OSTI2022

S K-edge XAS of Cu Ⅱ , Cu Ⅰ , and Zn Ⅱ oxidized Dithiolene complexes: Covalent contributions to structure and the Jahn-Teller effect

We report reduced dithiolene ligands are bound to high valent Mo centers in the active site of the oxotransferase family of enzymes. Related model complexes have been studied with great insight by Prof. Holm and his colleagues. This study focuses on the other limit of dithiolene chemistry: an investigation of the 2-electron oxidized dithiolene bound to low-valent late transition metal (TM) ions (Zn II , Cu I , and Cu II ). The bonding descriptions of the oxidized dithiolene [N,N-dimethyl piperazine 2,3-dithione (Me 2 Dt 0 )] complexes are probed using S K-edge X-ray absorption spectroscopy (XAS) and the results are correlated to density functional theory (DFT) calculations. These experimentally supported calculations are then extended to explain the different geometric structures of the three complexes. The Zn II (Me 2 Dt 0 ) 2 complex has only ligand-ligand repulsion so it is stabilized at the D 2d symmetry limit. The Cu I (Me 2 Dt 0 ) 2 complex has additional weak backbonding thus distorts somewhat from D 2d toward D 2h symmetry. The Cu II (Me 2 Dt 0 ) 2 complex has a strong σ donor bond that leads to both a large Jahn-Teller stabilization to D 2h and an additional covalent contribution to the geometry. The combined strong stabilization results in the square planar, D 2h structure. This study quantifies the competition between the ligand-ligand repulsion and the change in electronic structures in determining the final geometric structures of the oxidized dithiolene complexes, and provides quantitative insights into the Jahn-Teller stabilization energy and its origin.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Unveiling Unusual Reactivity of SO 2 and Unusual Type of S–X Long Bonds

A new reactivity of SO 2 to form unusual stable M−X−SO 2 (X = F, Cl, H) complexes is unveiled in this study. Moreover, a new type of S−X long bonds, which are significantly longer than traditional S−X covalent bonds, has been discovered. The P,N-ligated Ni−F complex model 1A can bind a SO 2 molecule through the new F−S long bond (2.207 Å), and a stable Ni−F−SO 2 complex 1B is generated, being exergonic by 2.2 kcal/mol. According to natural localized molecular orbital analysis, the new S−F long bond has a unique p(F) → π*(O=S=O) bonding interaction, which is shown to arise from the long S−F length. In comparison, the strength of the new F−S long bond (−2.2 kcal/mol) is found to be significantly stronger than common noncovalent interactions such as the hydrogen and halogen bond. The substituent modulations suggest that the electron-donating groups can increase the strength of new F−S bonds and enhance binding free energies ΔG bind . The scope of possible M−X complexes was explored, and various metals and X (F, Cl, and H) ligands were found to form stable M−X−SO 2 complexes. Specifically, the anionic M−X complexes display much higher ΔG bind values, ranging from −8 to −10 kcal/mol. The study paves the way for a green, recyclable, and adjustable SO 2 absorption method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Accurate prediction of protein structures and interactions using a three-track neural network

DeepMind presented notably accurate predictions at the recent 14th Critical Assessment of Structure Prediction (CASP14) conference. We explored network architectures that incorporate related ideas and obtained the best performance with a three-track network in which information at the one-dimensional (1D) sequence level, the 2D distance map level, and the 3D coordinate level is successively transformed and integrated. The three-track network produces structure predictions with accuracies approaching those of DeepMind in CASP14, enables the rapid solution of challenging x-ray crystallography and cryo–electron microscopy structure modeling problems, and provides insights into the functions of proteins of currently unknown structure. The network also enables rapid generation of accurate protein-protein complex models from sequence information alone, short-circuiting traditional approaches that require modeling of individual subunits followed by docking. Here, we make the method available to the scientific community to speed biological research.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Towards Compact Neural Networks via End-to-End Training: A Bayesian Tensor Approach with Automatic Rank Determination

Post-training model compression can reduce the inference costs of deep neural networks, but uncompressed training still consumes enormous hardware resources and energy. To enable low-energy training on edge devices, it is highly desirable to directly train a compact neural network from scratch with a low memory cost. Low-rank tensor decomposition is an effective approach to reduce the memory and computing costs of large neural networks. However, directly training low-rank tensorized neural networks is a very challenging task because it is hard to determine a proper tensor rank a priori, and the tensor rank controls both model complexity and accuracy. Here, this paper presents a novel end-to-end framework for low-rank tensorized training. We first develop a Bayesian model that supports various low-rank tensor formats (e.g., CANDECOMP/PARAFAC, Tucker, tensor-train, and tensor-train matrix) and reduces neural network parameters with automatic rank determination during training. Then we develop a customized Bayesian solver to train large-scale tensorized neural networks. Our training methods shows orders-of-magnitude parameter reduction and little accuracy loss (or even better accuracy) in the experiments. On a very large deep learning recommendation system with over 4.2 ×10 9 model parameters, our method can reduce the parameter number to 1.6 ×10 5 automatically in the training process (i.e., by 2.6 ×10 4 times) while achieving almost the same accuracy. Code is available at https://github.com/colehawkins/bayesian-tensor-rank-determination.

compact neural networks↗
DOE OSTI2023

FORGE: Pre-Training Open Foundation Models for Science

Large language models (LLMs) are poised to revolutionize the way we conduct scientific research. However, both model complexity and pre-training cost are impeding effective adoption for the wider science community. Identifying suitable scientific use cases, finding the optimal balance between model and data sizes, and scaling up model training are among the most pressing issues that need to be addressed. In this study, we provide practical solutions for building and using LLM-based foundation models targeting scientific research use cases. We present an end-to-end examination of the effectiveness of LLMs in scientific research, including their scaling behavior and computational requirements on Frontier, the first Exascale supercomputer. We have also developed for release to the scientific community a suite of open foundation models called FORGE with up to 26B parameters using 257B tokens from over 200M scientific articles, with performance either on par or superior to other state-of-the-art comparable models. We have demonstrated the use and effectiveness of FORGE on scientific downstream tasks. Our research establishes best practices that can be applied across various fields to take advantage of LLMs for scientific discovery.

Yin, Junqi↗
DOE OSTI2021

Simulation of hardened cement degradation and estimation of uncertainty in predicted failure times with peridynamics

Modeling the degradation of cement-based infrastructure due to aqueous environmental conditions continues to be a challenge. In order to develop a capability to predict concrete infrastructure failure due to chemical degradation, here we created a chemomechanical model of the effects of long-term water exposure on cement paste. The model couples the mechanical static equilibrium balance with reactive–diffusive transport and incorporates fracture and failure via peridynamics (a meshless simulation method). The model includes fundamental aspects of degradation of ordinary Portland cement (OPC) paste, including the observed softening, reduced toughness, and shrinkage of the cement paste, and increased reactivity and transport with water induced degradation. This version of the model focuses on the first stage of cement paste decalcification, the dissolution of portlandite. Given unknowns in the cement paste degradation process and the cost of uncertainty quantification (UQ), we adopt a minimally complex model in two dimensions (2D) in order to perform sensitivity analysis and UQ. We calibrate the model to existing experimental data using simulations of common tests such as flexure, compression and diffusion. Then we calculate the global sensitivity and uncertainty of predicted failure times based on variation of eleven unique and fundamental material properties. We observed particularly strong sensitivities to the diffusion coefficient, the reaction rate, and the shrinkage with degradation. Also, the predicted time of first fracture is highly correlated with the time to total failure in compression, which implies fracture can indicate impending degradation induced failure; however, the distributions of the two events overlap so the lead time may be minimal. Extension of the model to include the multiple reactions that describe complete degradation, viscous relaxation, post-peak load mechanisms, and to three dimensions to explore the interactions of complex fracture patterns evoked by more realistic geometry is straightforward and ongoing.

36 MATERIALS SCIENCE↗
DOE OSTI2025

BlueCRAB Domain Overlapping Coupling: Theory & Verification

Coupling low- and high-fidelity codes is a useful way to model complex engineering systems. Thanks to the high-fidelity code, complex phenomena can be resolved in areas of the system where this is required, yet the efficiency of the lower-fidelity code is still retained in modeling the rest of the system. This document details the theory and implementation of coupling two different thermal-hydraulic codes: the system thermal-hydraulics (STH) code System Analysis Module (SAM) and the coarse-mesh computational fluid dynamics (CFD) code Pronghorn. Both applications are included in the Comprehensive Reactor Analysis Bundle (BlueCRAB) code suite and are based on the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework. The domain overlapping (DO) coupling approach was adopted, as it offers proven advantages over more conventional domain decomposition methods. In the DO coupling, SAM provides Pronghorn with boundary conditions that depend on the system-level simulation of the entire plant. In return, the overlapping coupled SAM components–termed “surrogate components”–receive friction factors and source terms computed online based on the Pronghorn simulation. The framework is designed to be generic and enable coupling regardless of geometry and the number of inlet/outlet boundaries in the DO coupled domain. The developed method leads to consistent pressure drops, enthalpies, and scalar concentrations when comparing the coupled SAM and Pronghorn simulations. This document presents the DO coupling approach, along with two verification and two demonstration cases. The proposed problems explore different physical aspects relevant to nuclear reactor analysis, including buoyancy-driven flows, complex flow patterns, and multiple inlets and outlets. Periodically, new versions of this “BlueCRAB Domain Overlapping Coupling: Theory & Verification” report will be issued to reflect future developments and verification tests.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

MatCal Users Guide: Release 1.3.0

Any continuum mechanics model will require three components: (1) a discretized geometry of the boundary value problem being studied, (2) the partial differential equations to be solved, and (3) the initial conditions and boundary conditions for the problem. To describe material behavior in these computational models, material models contribute to (2) the underlying equations and, occasionally, to (3) the initial conditions for the simulation. These material models can exhibit a mathematical form that is empirically based, based on first principles, or developed from both empirical observations and known physics. In general, these models are meant to represent a class of materials with well understood behavior. As a result, material models have parameters that must be tuned or calibrated so that the model response matches characterization data available for the specific material it is intended to represent when used to simulate a specific system. For simple models, such as isotropic, linear elastic materials in solid mechanics, this calibration process can be a simple analytical calculation directly extracting the parameters from experimental measurements. For complex models that have many inputs and require many characterization datasets to adequately identify the material behavior, the model calibration process can require an inverse problem approach where an optimization is performed to tune the model parameters to the available data.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Importance of Electron Correlation on the Geometry and Electronic Structure of [2Fe–2S] Systems: A Benchmark Study of the [Fe 2 S 2 (SCH 3 ) 4 ] 2–,3–,4– , [Fe 2 S 2 (SCys) 4 ] 2– , [Fe 2 S 2 (S- p -tol) 4 ] 2– , and [Fe 2 S 2 (S- o -xyl) 4 ] 2– Complexes

Iron–sulfur clusters are crucial for biological electron transport and catalysis. Obtaining accurate geometries, energetics, manifolds of their excited electronic states, and reduction energies is important to understand their role in these processes. Here, using a [2Fe–2S] model complex with Fe II and Fe III oxidation states, which leads to different charges, i.e., [Fe 2 S 2 (SMe) 4 ] 2–,3–,4– , we benchmarked a variety of computational methodologies ranging from density functional theory (DFT) to post-Hartree–Fock methods, including complete active space self-consistent field (CASSCF), multireference configuration interaction, the second-order N-electron valence state perturbation theory (NEVPT2), and the linearized integrand approximation of adiabatic connection (AC0) approaches. Additionally, we studied three experimentally well-characterized complexes, [Fe 2 S 2 (SCys) 4 ] 2– , [Fe 2 S 2 (S-o-tol) 4 ] 2– , and [Fe 2 S 2 (S-o-xyl) 4 ] 2– , via DFT methods. We conclude that the dynamic electron correlation is important for accurately predicting the geometry of these complexes. Broken symmetry (BS) DFT correctly predicts experimental geometries of low-spin multiplicity, while CASSCF does not. However, BS-DFT significantly overestimates the difference between the low- and high-spin electronic states for a given oxidation state. At the same time, CASSCF underestimates it but provides relative energies closer to the reference NEVPT2 results. Finally, AC0 provides energetics of NEVPT2 quality with the additional advantage of being able to use large CASSCF sizes. NEVPT2 gives the best estimates of the Fe III /Fe III → Fe II /Fe III (4.27 eV) and Fe II /F III → Fe II /F II (7.72 eV) reduction energies. The results provide insight into the electronic structure of these complexes and assist in the understanding of their physical properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Elucidating Phosphate and Cadmium Cosorption Mechanisms on Mineral Surfaces with Direct Spectroscopic and Modeling Evidence

The simultaneous sorption of cations and anions at the mineral–water interface can substantially alter their individual sorption characteristics; however, this phenomenon lacks a mechanistic understanding. Our study provides direct spectroscopic and modeling evidence of the molecular cosorption mechanisms of the cadmium ion (Cd 2+ ) and phosphate (P) on goethite and layered manganese (Mn) oxide of birnessite, through in situ attenuated total reflection Fourier-transform infrared (ATR-FTIR), P K-edge X-ray absorption near-edge structure (XANES) spectroscopy, and surface complexation modeling. Phosphate synergistically cosorbed with Cd on goethite predominantly through P-bridged ternary complexes (≡Fe–P–Cd) and electrostatic interactions at wide pH conditions. Likewise, P and Cd exhibited synergistic cosorption on birnessite by forming P-bridged ternary complexes (≡Mn–P–Cd) and weak competitive sorption at the layer edge sites. As pH and Cd loading increased, the surface P species transitioned from a binary complex to a ternary complex and/or Cd 3 (PO 4 ) 2 precipitate for both goethite and birnessite. Compared to that in solution at pH 8, the formation of Cd 3 (PO 4 ) 2 was inhibited by the presence of goethite and birnessite, ascribed to the specific adsorption of P and Cd, more pronounced in birnessite due to the stronger sorption of Cd at its vacant sites. Finally, the discovered cosorption mechanisms of P and Cd have important implications for understanding and predicting their mobility and availability in Cd-contaminated settings.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Mechanisms of Pacific decadal variability in ESMs: the roles of stochastic forcing, feedbacks & external forcing

This project explored how and why climate patterns in the Pacific Ocean—specifically Pacific Decadal Variability (PDV)—change over time, and how well leading Earth System Models (ESMs) capture these changes under different climate scenarios. By analyzing large climate model datasets and running new simulations, the team investigated how ocean and atmosphere processes interact to shape PDV. The study tested a leading scientific hypothesis using both simplified and complex models, helping to uncover the key mechanisms that drive long-term climate swings in the Pacific. This work improves our ability to detect, predict, and understand how human-driven climate change may influence major ocean-climate patterns in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Modeling the Effects of Global Change on Ecosystem Processes in a Tropical Rainforest

Ongoing land-use change and climate change in wet tropical forests can potentially drive shifts in tree species composition, representing a change in individual species within a functional group, tropical evergreen trees. The impacts on the global carbon cycle are potentially large, but unclear. We explored the differential effects of species within this functional group, in comparison with the effects of climate change, using the Century model as a research tool. Simulating effects of individual tree species on biome-level biogeochemical cycles constituted a novel application for Century. Background and Objectives: A unique, long-term, replicated field experiment containing five evergreen tree species in monodominant stands under similar environmental conditions in a Costa Rican wet forest provided data for model evaluation. Our objectives were to gain insights about this forest’s biogeochemical cycles and effects of tree species within this functional group, in comparison with climate change. Materials and Methods: We calibrated Century, using long-term meteorological, soil, and plant data from the field-based experiment. In modeling experiments, we evaluated effects on forest biogeochemistry of eight plant traits that were both observed and modeled. Climate-change simulation experiments represented two climate-change aspects observed in this region. Results: Model calibration revealed that unmodeled soil processes would be required to sustain observed P budgets. In species-traits experiments, three separate plant traits (leaf death rate, leaf C:N, and allocation to fine roots) resulted in modeled biomass C stock changes of >50%, compared with a maximum 21% change in the climate-change experiments. Conclusions: Modeled ecosystem properties and processes in Century were sensitive to changes in plant traits and nutrient limitations to productivity. Realistic model output was attainable for some species, but unusual plant traits thwarted predictions for one species. Including more plant traits and soil processes could increase realism, but less-complex models provide an accessible means for exploring plant-soil-atmosphere interactions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Learning Forecasts of Rare Stratospheric Transitions from Short Simulations

Abstract Rare events arising in nonlinear atmospheric dynamics remain hard to predict and attribute. We address the problem of forecasting rare events in a prototypical example, sudden stratospheric warmings (SSWs). Approximately once every other winter, the boreal stratospheric polar vortex rapidly breaks down, shifting midlatitude surface weather patterns for months. We focus on two key quantities of interest: the probability of an SSW occurring, and the expected lead time if it does occur, as functions of initial condition. These optimal forecasts concretely measure the event’s progress. Direct numerical simulation can estimate them in principle but is prohibitively expensive in practice: each rare event requires a long integration to observe, and the cost of each integration grows with model complexity. We describe an alternative approach using integrations that are short compared to the time scale of the warming event. We compute the probability and lead time efficiently by solving equations involving the transition operator, which encodes all information about the dynamics. We relate these optimal forecasts to a small number of interpretable physical variables, suggesting optimal measurements for forecasting. We illustrate the methodology on a prototype SSW model developed by Holton and Mass and modified by stochastic forcing. While highly idealized, this model captures the essential nonlinear dynamics of SSWs and exhibits the key forecasting challenge: the dramatic separation in time scales between a single event and the return time between successive events. Our methodology is designed to fully exploit high-dimensional data from models and observations, and has the potential to identify detailed predictors of many complex rare events in meteorology.

Finkel, Justin↗
DOE OSTI2026

Deep learning for time series forecasting: a survey of recent advances

Time series forecasting plays a critical role in numerous real-world applications, such as finance, healthcare, transportation, and scientific computing. In recent years, deep learning has become a powerful tool for modeling complex temporal patterns and improving forecasting accuracy. This survey provides an overview of recent deep learning approaches for time series forecasting, involving various architectures including RNNs, CNNs, GNNs, transformers, large language models, MLP-based models, and diffusion models. We first identify key challenges in the field, such as temporal dependency, efficiency, and cross-variable dependency, which drive the development of forecasting techniques. Then, the general advantages and limitations of each architecture are discussed to contextualize their adaptation in time series forecasting. Furthermore, we highlight promising design trends like multi-scale modeling, decomposition, and frequency-domain techniques, which are shaping the future of the field. This paper serves as a compact reference for researchers and practitioners seeking to understand the current landscape and future trajectory of deep learning in time series forecasting.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

The synthesis and characterization of an iron(VII) nitrido complex

Abstract Complexes of iron in high oxidation states are captivating research subjects due to their pivotal role as active intermediates in numerous catalytic processes. Structural and spectroscopic studies of well-defined model complexes often provide evidence of these intermediates. In addition to the fundamental molecular and electronic structure insights gained by these complexes, their reactivity also affects our understanding of catalytic reaction mechanisms for small molecule and bond-activation chemistry. Here, we report the synthesis, structural and spectroscopic characterization of a stable, octahedral Fe(VI) nitrido complex and an authenticated, unique Fe(VII) species, prepared by one-electron oxidation. The super-oxidized Fe(VII) nitride rearranges to an Fe(V) imide through an intramolecular amination mechanism and ligand exchange, which is characterized spectroscopically and computationally. This enables combined reactivity and stability studies on a single molecular system of a rare high-valent complex redox pair. Quantum chemical calculations complement the spectroscopic parameters and provide evidence for a diamagnetic ( S = 0) d 2 Fe(VI) and a genuine S = 1/2, d 1 Fe(VII) configuration of these super-oxidized nitrido complexes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗