Search NASA⌕ Search

SEARCH · Search NASA

Results for “Building benchmarking models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

222 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Dynamics of streamflow permanence in a headwater network: Insights from catchment-scale model simulations

The hillslope and channel dynamics that govern streamflow permanence in headwater systems have important implications for ecosystem functioning and downstream water quality. Recent advancements in process-based, semi-distributed hydrologic models that build upon empirical studies of streamflow permanence in well-monitored headwater catchments show promise for characterizing the dynamics of streamflow permanence in headwater systems. However, few process-based models consider the continuum of hillslope-stream network connectivity as a control on streamflow permanence in headwater systems. The objective of this study was to expand a process-based, catchment-scale hydrologic model to better understand the spatiotemporal dynamics of headwater streamflow permanence and to identify controls of streamflow expansion and contraction in a headwater network. Further, we aimed to develop an approach that enhanced the fidelity of model simulations, yet required little additional data, with the intent that the model might be later transferred to catchments with limited long-term and spatially explicit measurements. This approach facilitated network-scale estimates of the controls of streamflow expansion and contraction, albeit with higher degrees of uncertainty in individual reaches due to data constraints. Our model simulated that streamflow permanence was highly dynamic in first-order reaches with steep slopes and variable contributing areas. The simulated stream network length ranged from nearly 98±2% of the geomorphic channel extent during wet periods to nearly 50±10% during dry periods. The model identified a discharge threshold of approximately 1 mm d –1 , above which the rate of streamflow expansion decreases by nearly an order of magnitude, indicating a lack of sensitivity of streamflow expansion to hydrologic forcing during high-flow periods. Overall, we demonstrate that process-based, catchment-scale models offer important insights on the controls of streamflow permanence, despite uncertainties and limitations of the model. We encourage researchers to increase data collection efforts and develop benchmarks to better evaluate such models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

High-Burnup BWR LOCA Burst Analysis Using High-Fidelity Multiphysics Simulations

The US nuclear industry is looking to improve on the operating economics of the current fleet of light-water reactors (LWRs). One way of achieving this is by operating fuel to higher burnup. In pressurized water reactors (PWRs), relaxing the current burnup limit will allow for cycle length extensions and power uprates; in boiling water reactors (BWRs) it may allow for improved fuel utilization and reduced feed assemblies, as well as more efficient power uprates and increased capacity factors that will support the Administration’s Executive Order to facilitate 5 GW of power uprates at existing nuclear facilities. However, one of the key limitations to operating fuel to higher burnup is the risk of fuel fragmentation, relocation, and dispersal (FFRD). Recognizing the high interest in extending burnup limits, the US Nuclear Regulatory Commission (NRC) has issued Draft Regulatory Guide DG-1434, which defines an approach that would be acceptable to the NRC for addressing FFRD risk. The approach defined will require better understanding of the phenomena leading to FFRD as well as best-estimate simulation methods to understand FFRD risk in high-burnup cores. The Nuclear Energy Advanced Modeling and Simulation program is supporting the FFRD industry challenge problem through development of state-of-the-art, high-fidelity modeling and simulation LWR analysis capabilities; namely, the BISON fuel performance code and the VERA core simulator software. These tools, along with the US NRC TRACE system analysis code, have been utilized for analysis of FFRD risk in both PWR and BWR cores in recent years. The work documented in this report addresses the lack of high-fidelity research for BWRs and builds on a previous activity where the framework has been applied to Cycles 16 through 18 of Limerick Unit 1, a BWR/4, with introduction of 8 high-burnup lead use assemblies (HBLUAs) that were representative of the 8 HBLUAs loaded into Limerick Unit 2 in 2021. VERA was used in this previous activity to model rod-by-rod depletion in these cycles, and its solution was used to initialize a TRACE simulation of a large-break loss-of-coolant accident (LBLOCA) at the end of Cycle 18. In the work documented in this report, the TRACE model was improved by refining the core mesh and utilizing a new feature that allows for capturing the full 3D VERA power distribution in the model. This allows for a more detailed solution for setting BISON boundary conditions. Furthermore, the solutions from VERA and TRACE were used to set up and perform BISON simulations of about 1,000 rods sampled from the core, including all burnup levels. Utilizing two cladding burst models, it was shown that no fuel rods were predicted to burst during the postulated LBLOCA transient. Additionally, a sensitivity study was performed by artificially increasing linear heat rate during the postulated LBLOCA to identify parameters that correlate with rod burst susceptibility. Burnup, fission gas release, and hoop strain were all found to be positively correlated with rod burst susceptibility. Small-break loss-of-coolant accident (SBLOCA) analyses were also performed; these analyses predicted cladding temperature increases that were bounded by the LBLOCA cladding temperatures for all small break sizes studied for this plant. However, future refinements to the plant response assumptions during the SBLOCA could impact the predicted cladding response. Finally, a benchmark study was performed between CTF and TRACE for LOCA conditions to better qualify CTF for BWR LOCA modeling.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Robust Carbon Dioxide Plume Imaging Using Joint Tomographic Inversion of Seismic Onset Time and Distributed Pressure and Temperature Measurements (Final Report)

We develop and demonstrate rapid and cost-effective methodologies for spatiotemporal tracking of CO2 plumes during geologic sequestration using joint inversion of seismic data and distributed pressure and temperature measurements. Key elements of our methodology are: (a) a computationally efficient approach to pressure and temperature propagation, (b) analysis of time lapse seismic data using a novel ‘seismic onset time’ approach to detect fluid front propagation, and (c) data assimilation and uncertainty assessment via joint inversion of pressure, temperature and time lapse seismic data, and (d) validating the numerical tomographic inversion using a CO2 injection demonstration projects, specifically data collected from the from the Petra Nova Parish Holdings CCUS project in the West Ranch Field, Texas and the Chester-16 reef CO2 injection site in Northern Michigan which is part of the DOE Midwestern Carbon Sequestration Project. The research team is led by Texas A&M University and includes Battelle as a subcontractor with support from Shell, Anadarko, Chevron and JX Nippon. A carbon dioxide (CO2) water-alternating-gas (WAG) pilot was conducted to gain insights into tertiary oil recovery potential via CO2 flood in the West Ranch Field as part of the Petra Nova project, the world’s largest post-combustion CO2 capture and utilization initiative. With a fluvial formation geology and large contrasts in permeability, this is a challenging and novel application of CO2 enhanced oil recovery (EOR). We build a predictive dynamic model of the subsurface that incorporates the multiphase and compositional data acquired during the pilot operation. The calibrated model is used for the carbon dioxide plume imaging. The study began with an initialization of the pilot sector model extracted from a calibrated full-field model. The pilot model calibration follows a two-step hierarchical workflow. First, we performed a large-scale update of the permeability distribution by integrating available bottomhole pressure and multiphase production data. In the second step, local permeability field is fine-tuned using a streamline-based method to match CO2 breakthrough times at the producers. The predictive capability of the calibrated model was verified through two blind validation tests: (1) the model showed good agreement with saturation logs acquired at two observation wells; and (2) the model reproduced the CO2 recovery as a fraction of the injected CO2. The use of seismic onset times has shown great promise for integrating near-continuous seismic surveys for updating geologic models. In this study, we analyze the impact of seismic survey frequency on the onset time approach aiming to extend the application of onset time to infrequent seismic surveys. In addition, we quantitatively examine the nonlinearity of the onset time method and compare it to the commonly used amplitude inversion method. We carry out a sensitivity analysis of seismic survey frequency based on the complete seismic survey data (over 175 surveys) of steam injection in a heavy oil reservoir (Peace River Unit) in Canada. Our results show that an adequate onset time map can be obtained from the infrequent seismic surveys by interpolation between seismic surveys as long as there is no change in the dominant underlying physics between the successive surveys. The study also shows that nonlinearity of the onset time method can be -smaller than that of the amplitude inversion method by several orders of magnitude. Application to the Brugge benchmark case shows that the onset time method obtains comparable permeability update as the traditional seismic amplitude inversion method with faster computation and improved convergence characteristics. We extend the streamline-based data integration approach to incorporate distributed temperature sensor (DTS) data using the concept of thermal tracer travel time. Then, a hierarchical workflow composed of evolutionary and streamline methods is employed to jointly history match the DTS and pressure data. Finally, CO2 saturation and streamline maps are used to visualize the CO2 plume movement during the sequestration process. The hierarchical workflow is applied to a carbon sequestration project in a carbonate reef reservoir within the Northern Niagaran Pinnacle Reef Trend in Michigan, USA. The monitoring data set consists of distributed temperature sensing (DTS) data acquired at the injection well and a monitoring well, flowing bottom-hole pressure data at the injection well, and time-lapse pressure measurements at several locations along the monitoring well. The history matching results indicate that the CO2 movement is mostly restricted to the intended zones of injection which is consistent with an independent warm-back analysis of the temperature data. In addition to employing simulation models and inverse methods for CO2 plume imaging, we also initialized a data-driven technology for detecting inter-well connectivity based on production and pressure data. Our machine-learning framework is built on the statistical recurrent unit (SRU) model and interprets well-based injection/production data into inter-well connectivity without relying on a geologic model. We test it on synthetic and field-scale CO2 EOR projects utilizing the water-alternating-gas (WAG) process. The validation of the proposed data-driven inter-well connectivity assessment is performed using synthetic data from simulation models where inter-well connectivity can be easily measured using the streamline-based flux allocation. The SRU model is shown to offer excellent prediction performance on the synthetic case. Despite significant measurement noise and frequent well shut-ins imposed in the field-scale case, the SRU model offers good prediction accuracy, the overall relative error of the phase production rates at most producers ranges from 10% to 30%. It is shown that the dominant connections identified by the data-driven method and streamline method are in close agreement. Texas A&M University, the lead organization in the project, was primarily responsible for the development of tomographic approaches for CO2 plume mapping in conjunction with distributed pressure, temperature and seismic onset time data. Battelle, as a subcontractor, was primarily responsible for the development of analytical and empirical methods for analyzing transient injection rate and pressure data from point/line sources such as injection and monitoring wells. An additional area of emphasis for Battelle was the use of machine learning for such tasks as inferring reservoir connectivity information from injection-production data, and identifying variable importance for machine learning-based proxy models developed from full-physics simulations. The two organizations also collaborated on the application of the tomographic inversion methodology for a field data set.

02 PETROLEUM↗
DOE OSTI2025

Artificial Intelligence–Enabled Digital Twin for U.S. Cities

Over 50 participants—including national laboratory researchers, academic scholars, industry representatives, and stakeholders from the City of Chicago—convened in person and online to assess the readiness and potential of an Artificial Intelligence–Enabled Digital Twin (AIDT) for urban systems, with the Greater Chicago area serving as the benchmark location. The workshop underscored that the Chicago Urban Integrated Field Laboratory provides an unparalleled testbed for developing and validating urban DTs—combining dense, multiscale observations, advanced physics-based and AI modeling capabilities, and strong stakeholder and industry engagement. Discussions highlighted available datasets, AI architectures for high resolution, multipurpose urban DTs, key applications, and near- and long-term priorities for scaling this framework within Chicago and to other U.S. and global cities.

AIDT↗
DOE OSTI2020

Energy Intensity Baselining and Tracking Guidance

Each company joining the U.S. Department of Energy’s (DOE’s) Better Buildings, Better Plants Program (Better Plants) commits to establishing an energy consumption and energy intensity (EI) baseline and to tracking its energy performance over a 10-year period against that baseline. The baseline must reflect a company’s energy consumption over a 12-month period, covering all its U.S.-based operations. Energy consumption is calculated by fuel type in terms of primary energy (also known as source energy). EI is broadly defined as the amount of energy consumed per unit of output produced. For this guidance document and for the program, the term energy performance represents an evaluation of a facility’s capacity to use energy efficiently. Metrics used to assess a facility’s energy performance can include EI, energy consumption, improvements in EI, etc. Establishing an energy baseline and tracking system is a critical first step in effectively managing energy use. Developing a baseline can help a company understand energy use within the corporation and give it a point of comparison to evaluate future efforts to improve energy performance. It can also support efforts to validate a company’s energy management activities, improve comparative analyses when using benchmarks, and help in predicting future energy needs. In addition, a company that normalizes its performance data can determine highly defensible measures of energy savings generated through implemented energy efficiency projects. Establishing a baseline and tracking energy performance is also a requirement for ISO 50001 certification. Although basic energy data can be collected through utility bills, most manufacturers will have to perform additional analyses to develop accurate and robust energy baselines and tracking systems. Energy is consumed in many ways within the manufacturing sector and can come from multiple sources. Energy is sometimes generated and sold to other parties or captured and reused on-site. External events can exert a significant impact on a facility or company’s energy use independent of any purposeful efforts to improve energy efficiency. Operational changes, such as production shifts—which may be inevitable for some companies over the 10-year period covered by the program—can also make a big difference in energy use. Since Better Plants asks companies to account for all their U.S.-based operations, mergers, acquisitions, and divestitures can also have significant implications for a company’s energy metrics. This document aims to demystify the sometimes complex baselining process. It devotes special attention to the task of normalizing and adjusting energy consumption to account for external factors, such as weather and production changes. A key recommendation is that companies use regression analysis to normalize their energy consumption data whenever possible. Regression analysis is a statistical technique that estimates the dependence of a variable (i.e., energy use in the context of Better Plants) on one or more independent variables such as ambient temperature, while controlling for the influence of other variables at the same time. A properly developed regression analysis can provide a reliable estimate of energy savings resulting from energy improvement strategies and projects by accounting for the effects of variables such as annual production levels and weather. DOE has developed a companion Energy Performance Indicator software tool (EnPI) to simplify the baselining process. This tool can run regression models, calculate changes in EI at the facility level, and automatically compile facility-level data into a corporate-wide metric. Note that although the relevant equations used to calculate EI are provided in this document, the EnPI tool will automatically perform most calculations for the user. Additionally, Better Plants Partners (Partners) can call on their Technical Account Manager (TAM) to help them establish a baseline and assist with the necessary calculations to track progress.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

matsim-agents v1.0

matsim-agents is a multi-agent AI framework for atomistic materials simulation and discovery. It orchestrates large language models (LLMs), machine-learned interatomic potentials (MLIPs), and DFT codes into a single agentic loop running on laptops and DOE leadership-class supercomputers. MULTI-AGENT ORCHESTRATION A LangGraph state machine with three nodes: a Planner that converts a natural-language research objective into structured tasks; an Executor that dispatches atomistic tools and loops until the queue is empty; and an Analyst that summarizes results into a human-readable report. State is checkpointed after every step and human-in-the-loop gates can be inserted at any edge. HYPOTHESIS-DRIVEN DISCOVERY CHAT An interactive REPL (matsim-agents chat) that couples LLM dialogue with atomistic simulation. Chemical formulas are automatically detected in conversation turns and trigger a full crystal-phase exploration: structure generation → relaxation → stability scoring → result injection back into the conversation, creating a closed hypothesis-refinement loop. CRYSTAL PHASE ENUMERATION Given a composition, the phase explorer enumerates prototypes by stoichiometry: elemental (fcc/bcc/hcp/sc/diamond), binary 1:1 (rocksalt/CsCl/zincblende/ wurtzite/fluorite/rutile), ternary 1:1:3 (cubic perovskite), ternary 1:2:4 (perovskite + spinel), quaternary 1:1:2:6 (Fm-3m double perovskite). 2-D prototypes (graphene, h-BN, MoS2 2H/1T) and multilayer stacking are also supported via --include-2d and --num-layers. SUPERCELL GENERATION AND SITE DECORATION Auto-tiling to a minimum atom count (--min-atoms), explicit NxNxN tiling (--supercell), symmetry-distinct site decorations (--n-orderings), and isotropic lattice-scale sweeps (--lattice-scales) for volume bracketing. MLFF RELAXATION AND STABILITY SCORING HydraGNN (multi-headed GNN) drives structure relaxation via ASE with FIRE, BFGS, or BFGSLineSearch. Stability output: delta-E/atom ranking across phases and a max-residual-force dynamical-stability proxy. Other MLIPs (MACE, NequIP, Orb) can be plugged in through the same interface. DFT BACKENDS Quantum ESPRESSO pw.x and VASP 6.6 are first-class labellers. Both have validated GPU builds and SLURM/PBS launchers for three DOE platforms: Frontier (AMD MI250X, ROCm), Aurora (Intel PVC, oneAPI), Perlmutter (NVIDIA A100, CUDA). QE produces ~100 binaries (pw.x, ph.x, epw.x, ...). VASP supports scf, relax, vc-relax, and vc-relax-shape run types. ACTIVE-LEARNING LOOP matsim-agents al run CONFIG.yaml drives an iterative HydraGNN-DFT loop: MD generates candidates → ensemble/MC-dropout uncertainty selects the most informative → DFT labels them in parallel inside one allocation → dataset grows → HydraGNN retrains → repeat. DFT backend is a single YAML toggle (dft.backend: vasp | qe). LLM-generated seed structures are supported (no curated POSCAR library needed). Config uses ${VAR}, ${VAR:-default}, ${VAR:?msg} shell-style substitution for cross-user/cross-site portability. LLM BACKENDS Ollama (local, default), vLLM (HPC multi-GPU serving), OpenAI, Anthropic, HuggingFace Transformers+Accelerate. Selected at runtime via flag or env var with no code changes. HPC PORTABILITY Same Python entry points run on Frontier (ROCm 7.2), Aurora (oneAPI), and Perlmutter (CUDA 12). DFT and ML stacks are never co-loaded in the same shell; they couple through the scheduler and filesystem. Advanced multi-node launchers (serve, discovery-chat, single-relaxation, active-learning, QE warm-start) are provided for all three platforms. CODABENCH COMPETITION BUNDLE A self-contained benchmark: 159 atomistic test structures across 11 material classes, 5 tasks (formation energy, forces, ML relaxation, AI-DFT relaxation, phase stability ranking), public/private leaderboard split (30/70), and four ready-to-run baselines: MACE-MP-0, HydraGNN, UMA, AllScAIP.

Lupo Pasini, Massimiliano [Oak Ridge National Labo↗