Search NASA⌕ Search

SEARCH · Search NASA

Results for “Building benchmarking models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

$\mathrm{PPT}$-Multicore: performance prediction of Open$\mathrm{MP}$ applications using reuse profiles and analytical modeling

In this report we present PPT-Multicore, an analytical model embedded in the Performance Prediction Toolkit (PPT) to predict parallel applications’ performance running on a multicore processor. PPT-Multicore builds upon our previous work towards a multicore cache model. We extract LLVM basic block labeled memory trace using an architecture-independent LLVM-based instrumentation tool only once in an application’s lifetime. The model uses the memory trace and other parameters from an instrumented sequentially executed binary. We use probabilistic and computationally efficient reuse profiles to predict the cache hit rates and runtimes of OpenMP programs’ parallel sections. We model Intel’s Broadwell, Haswell, and AMD’s Zen2 architectures and validate our framework using different applications from PolyBench and PARSEC benchmark suites. The results show that PPT-Multicore can predict cache hit rates with an overall average error rate of 1.23% while predicting the runtime with an error rate of 9.08%.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Benchmark Comparison of HyRAM and ALDEA Software for Hydrogen Release Behavior

There are several different calculation approaches and tools that can be used to evaluate the risk of hydrogen energy applications. A comparative study of Air Liquide’s ALDEA (Air Liquide Dispersion and Explosion Assessment) tools suite and Sandia’s HyRAM (Hydrogen Risk Assessment Models) toolkit has been conducted. The purpose of this study was to understand and evaluate the differences between the two calculation approaches, and identify areas for model improvements. There were several scenarios examined in this effort regarding hydrogen release dynamics. These scenarios include free jet release cases at varying pressures, vessel blowdown, and hydrogen build-up scenarios with and without ventilation. For each scenario, the input and output of the HyRAM calculations are documented, along with a comparison to the ALDEA results. Generally, the results from the two different tools were reasonably aligned. However, there were fundamental differences in evaluation methodology and functional limitations in HyRAM that caused discrepancies in some calculations.

08 HYDROGEN↗
DOE OSTI2021

FPGA-based HPC accelerators: An evaluation on performance and energy efficiency

Hardware specialization is a promising direction for the future of digital computing. Reconfigurable technologies enable hardware specialization with modest non-recurring engineering cost, but their performance and energy efficiency compared to state-of-the-art processor architectures remain an open question. In this article, we use FPGAs to evaluate the benefits of building specialized hardware for numerical kernels found in scientific applications. In order to properly evaluate performance, we not only compare Intel Arria 10 and Xilinx U280 performance against Intel Xeon, Intel Xeon Phi, and NVIDIA V100 GPUs, but we also extend the Empirical Roofline Toolkit (ERT) to FPGAs in order to assess our results in terms of the Roofline model. We show design optimization and tuning techniques for peak FPGA performance at reasonable hardware usage and power consumption. As FPGA peak performance is known to be far less than that of a GPU, we also benchmark the energy efficiency of each platform for the scientific kernels comparing against microbenchmark and technological limits. Results show that while FPGAs struggle to compete in absolute terms with GPUs on memory- and compute-intensive kernels, they require far less power and can deliver nearly the same energy efficiency.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A broad-host-range event detector: expanding and quantifying performance between Escherichia coli and Pseudomonas species

Modern microbial biodesign relies on the principle that well-characterized genetic parts can be reused and reconfigured for different functions. However, this paradigm has only been successful in a limited set of hosts, mostly comprised from common lab strains of Escherichia coli . It is clear that new applications such as chemical sensing and event logging in complex environments will benefit from new host chassis. This study quantitatively compared how the same chemical event logger performed across four strains and three different microbial species. An integrase-based sensor and memory device was operated by two representative soil Pseudomonads— Pseudomonas fluorescens SBW25 and Pseudomonas putida DSM 291. Quantitative comparisons were made between these two non-traditional hosts and two benchmark E. coli chassis including the probiotic Nissle 1917 and common cloning strain DH5α. The performance of sensor and memory components changed according to each host, such that a clear chassis effect was observed and quantified. These results were obtained via fluorescence from reporter proteins that were transcriptionally fused to the integrase and downstream recombinant region and via data-driven kinetic models. The Pseudomonads proved to be acceptable chassis for the operation of this event logger, which outperformed the common E. coli DH5α in many ways. This study advances an emerging frontier in synthetic biology that aims to build broad-host-range devices and understand the context by which different species can execute programmable genetic operations.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Open-source Tools for Solving Grid Optimization Problems: ARPA-e Benchmark Algorithm Overview [Slides]

This document contains the official formulation that will be used for evaluation in Challenge 2 of the Grid Optimization (GO) Competition. Minor changes may occur within the formulation. Entrants will be notified when a new version is released. Changes are not expected to be of a significance that would cause a change in approach for the Entrants. This formulation builds upon the Challenge 1 formulation published in ARPA-E DE-FOA-0001952. Entrants will be judged based on the current official Challenge 2 formulation posted on the GO Competition website (this document, which is subject to change), not the formulation posted in DE-FOA-0001952. Entrants are permitted and encouraged to use any alternative problem formulation and modeling convention within their own software (such as convex relaxation, decoupled power flow formulations, current-voltage formulations, etc.) in an attempt to produce an exact or approximate solution to this particular mathematical program. However, the judging of all submitted approaches must conform to the official formulation presented here.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Design Principles for the Synthesis of Self-Pillared ZSM-5 Zeolite Nanosheets

The design of next-generation materials for emerging energy and environmental applications heavily relies on empirical approaches to direct nonclassical nucleation and crystal growth pathways, polymorphism, intercrystalline transformations, and seed-assisted growth processes. A long-standing obstacle to nanoporous materials design is the complexity of their crystallization, which hinders the development of predictive models and/or physical descriptors that can guide their synthesis. In this study, we use a combination of state-of-the-art synthesis, characterization, and computational design to prepare hierarchical MFI-type zeolites, which we couple with benchmark catalytic testing to assess structure-property-performance relationships. These hierarchical materials are intergrowths of two commercially relevant zeolite frameworks, MFI and MEL, prepared as self-pillared pentasil (SPP) zeolites through seed-assisted, organic-free syntheses for which little theoretical guidance existed. Here, by comparing a large library of zeolite seeds with different pore sizes, dimensions, and structural composite building units, we determined the relative impact of seed and silica source selection, among other synthesis variables. Combined experimental and computational studies are used to test several hypotheses in literature to rationalize the choice of seed structure and establish a more robust selection criteria for seed-assisted synthesis of zeolites. Specifically, we show that a data-driven approach to develop structural descriptors correlates to new, facile routes to rationally design SPP zeolites, addressing knowledge gaps in the fundamental understanding of (non)classical crystal growth mechanisms that are characteristic of nanoporous aluminosilicates.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Phonon Olympics: Phonon property and lattice thermal conductivity benchmarking from open-source packages

Three widely used open-source packages for determining phonon properties and lattice thermal conductivities (ALAMODE, phono3py, and ShengBTE) are benchmarked by teams of expert users and the package developers. The phonons for Ge, RbBr, monolayer MoSe 2 , and AlN are modeled at zero temperature, and they scatter through three-phonon and phonon-isotope processes, with thermal conductivities obtained from the linearized Peierls–Boltzmann transport equation with input from density functional theory calculations. Over a wide range of temperatures, the thermal conductivities calculated by the teams fall within at most ±15% of their mean values for each of the four materials. The phonon frequencies, obtained from the harmonic force constants, do not show large differences between the calculations, indicating that the modal heat capacities and group velocities are not responsible for the thermal conductivity variations. It is the lifetimes associated with three-phonon scattering, obtained from the cubic force constants, that drive the variations. The many decisions required to calculate the cubic force constants (e.g., supercell size, atomic displacement, neighbor cutoff, and application of symmetries) make identification of the precise origin of the thermal conductivity variations challenging. The calculated thermal conductivities do not generally show agreement with experimental measurements, which is attributed to the limitations of the density functional theory calculations. Guidance for the development of best practices is provided, which will help to standardize protocols needed for building thermal conductivity databases. The results provide a baseline for future benchmarking of other packages and more advanced calculations.

McGaughey, Alan J. H. [Carnegie Mellon Univ., Pitt↗
DOE OSTI2021

Design and Performance of Kokkos Staging Space toward Scalable Resilient Application Couplings

With the growing number of applications designed for heterogeneous HPC devices, application programmers and users are finding it challenging to compose scalable workflows as ensembles of these applications, that are portable, performant and resilient. The Kokkos C++ library has been designed to simplify this cumbersome procedure by providing an intra-application uniform programming model and portable performance. However, assembling multiple Kokkos-enabled applications into a complex workflow is still a challenge. Although Kokkos enables a uniform programming model, the inter-application data exchange still remains a challenge from both performance and software development cost perspectives. In order to address this issue, we propose Kokkos data staging memory space, an extension of Kokkos' data abstraction (memory space) for heterogeneous computing systems. This new abstraction allows to express data on a virtual shared-space for multiple Kokkos applications, thus extending Kokkos to support inter-application data exchange to build an efficient application workflow. Additionally, we study the effectiveness of asynchronous data layout conversions for applications requiring different memory access patterns for the shared data. Our preliminary evaluation with a synthetic benchmark indicate the effectiveness of this conversion adapted to three different scenarios representing access frequency and use patterns of the shared data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Africa Battery Energy Storage Systems (BESS) Capacity Building Utility-Scale Storage: BESS Valuation, Tariffs, and Remuneration [Slides]

Utility-scale Battery Energy Storage Systems (BESS) are key to enhancing grid reliability, integrating renewable energy, and providing operational flexibility. Designing effective valuation, remuneration, and tariff frameworks is essential to ensure both system benefits and financial viability for developers. This presentation outlines a structured methodology for evaluating BESS projects, covering policy and legal considerations, cost and revenue analysis, benchmarking, financial sensitivity, and risk assessment, while ensuring alignment with public interest. It also explores valuation of multiple storage services - bulk energy, ancillary services, and infrastructure support - and monetization strategies through capacity payments, energy tariffs, tolling, arbitrage, and non-wires alternative payments. Technical factors, including round-trip efficiency, degradation, and storage duration, are integrated into financial and operational modeling to quantify both system-wide and project-level benefits. Through case studies and simulation-based approaches, this framework provides regulators, utilities, and developers with practical guidance for tariff design, payment structures, and investment decisions, maximizing the economic and societal value of BESS deployment.

25 ENERGY STORAGE↗
DOE OSTI2026

Foundation model framework for all tasks involving jet physics

Foundation models use large datasets to build an effective representation of data that can be deployed on diverse downstream tasks. Previous research developed the omnilearn foundation model for jet physics, using unique properties of particle physics, and showed that it could significantly advance discovery potential across collider experiments. This paper introduces a major upgrade, resulting in the omnilearned framework. This framework has three new elements: (1) updates to the model architecture and training, (2) using over 1 × 10 9 jets used for training, and (3) providing well-documented software for accessing all datasets and models. We demonstrate omnilearned with three representative tasks: top-quark jet tagging with the community delphes-based benchmark dataset, b tagging with ATLAS full simulation, and anomaly detection with CMS experimental data. In each case, omnilearned is the state of the art, further expanding the discovery potential of past, current, and future collider experiments.

Bhimji, Wahid [Lawrence Berkeley National Laborato↗
DOE OSTI2024

Weak lensing combined with the kinetic Sunyaev–Zel’dovich effect: a study of baryonic feedback

ABSTRACT Extracting precise cosmology from weak lensing surveys requires modelling the non-linear matter power spectrum, which is suppressed at small scales due to baryonic feedback processes. However, hydrodynamical galaxy formation simulations make widely varying predictions for the amplitude and extent of this effect. We use measurements of Dark Energy Survey Year 3 weak lensing (WL) and Atacama Cosmology Telescope DR5 kinematic Sunyaev–Zel’dovich (kSZ) to jointly constrain cosmological and astrophysical baryonic feedback parameters using a flexible analytical model, ‘baryonification’. First, using WL only, we compare the $S_8$ constraints using baryonification to a simulation-calibrated halo model, a simulation-based emulator model, and the approach of discarding WL measurements on small angular scales. We find that model flexibility can shift the value of $S_8$ and degrade the uncertainty. The kSZ provides additional constraints on the astrophysical parameters, with the joint WL + kSZ analysis constraining $S_8=0.823^{+0.019}_{-0.020}$. We measure the suppression of the non-linear matter power spectrum using WL + kSZ and constrain a mean feedback scenario that is more extreme than the predictions from most hydrodynamical simulations. We constrain the baryon fractions and the gas mass fractions and find them to be generally lower than inferred from X-ray observations and simulation predictions. We conclude that the WL + kSZ measurements provide a new and complementary benchmark for building a coherent picture of the impact of gas around galaxies across observations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Calibration strategy of the PROSPECT-II detector with external and intrinsic sources

This paper presents an energy calibration scheme for an upgraded reactor antineutrino detector for the Precision Reactor Oscillation and Spectrum Experiment (PROSPECT). The PROSPECT collaboration is preparing an upgraded detector, PROSPECT-II (P-II), to advance capabilities for the investigation of fundamental neutrino physics, fission processes and associated reactor neutrino flux, and nuclear security applications. P-II will expand the statistical power of the original PROSPECT (P-I) dataset by at least an order of magnitude. The new design builds upon previous P-I design and focuses on improving the detector robustness and long-term stability to enable multi-year operation at one or more sites. The new design optimizes the fiducial volume by elimination of dead space previously occupied by internal calibration channels, which in turn necessitates the external deployment. In this paper, we describe a calibration strategy for P-II. Here, the expected performance of externally deployed calibration sources is evaluated using P-I data and a well-benchmarked simulation package by varying detector segmentation configurations in the analysis. The proposed external calibration scheme delivers a compatible energy scale model and achieves comparable performance with the inclusion of an additional AmBe neutron source, in comparison to the previous internal arrangement. Most importantly, the estimated uncertainty contribution from the external energy scale calibration model meets the precision requirements of the P-II experiment.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Mesoscale Convective Systems Modulated by Convectively Coupled Equatorial Waves

Mesoscale convective systems (MCSs) produce over 50% of tropical precipitation and account for the majority of extreme rainfall and flooding events. MCSs are considered the building blocks of larger-scale convectively coupled equatorial waves (CCEWs). While CCEWs can provide favorable environments for convection, how CCEWs can systematically impact organized convection and thereby MCS characteristics is less clear. We examine this question by analyzing a global MCS tracking data set. During the active phase of CCEWs, MCS frequency increases and MCSs rain harder, produce more lifetime total rain, and grow larger in size. The probability of extreme MCSs also elevates. These changes are most pronounced when MCSs are associated with Kelvin waves and tropical depression-type waves while less so with the Madden-Julian Oscillation. Furthermore, these results can be benchmarks to improve model representation of MCS interactions with large-scale circulations and can be leveraged for operational forecasts of high-impact MCSs at extended lead times.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Characterizing Quantum Classifier Utility in Natural Language Processing Workflows

Quantum Natural Language Processing (QNLP) develops natural language processing (NLP) models for deployment on quantum computers. We explore feature and data prototype selection techniques to address challenges posed by encoding high dimensional features. Our study builds quantum circuit classifiers that includes classical feature pre-processing, quantum embedding and quantum model training. The quantum models are built on 4 or 6 qubits and the quantum neural network (QNN) uses the established bricklayer design. We compare the dependence of model performance (in terms of accuracy and F1 scores) on feature length, embedding gates and parameterized unitary design. We compare the performance of quantum machine learning models to classical convolution neural network model (CNN) on binary and multi-class classification tasks using two datasets of synthetic features and labels. The first is the ECP-CANDLE P3B3 dataset a corpus of synthetically generated cancer pathology reports. The second dataset is extracted from well-known benchmark dataset (MADELON) - features are generated with a combination of informative, repeated and uninformative features. Both datasets are used for binary classification and multi-class classification with 3 classes. We observe robust, accurate performance from all models on the binary classification tasks, but multiclass classification is a challenge for the quantum models-there is a notable decrease in accuracy when using 3 classes. Overall the performance is comparable in terms of recall and accuracy between QNNs and CNNs, even with large datasets. These results provide a point of comparison between quantum and classical models on real-world datasets.

Hamilton, Kathleen↗
DOE OSTI2024

Scalable Implicit Solvers with Dynamic Mesh Adaptation for a Relativistic Drift-Kinetic Fokker–Planck–Boltzmann Model

In this work we consider a relativistic drift-kinetic model for runaway electrons along with a Fokker–Planck operator for small-angle Coulomb collisions, a radiation damping operator, and a secondary knock-on (Boltzmann) collision source. Here, we develop a new scalable fully implicit solver utilizing finite volume and conservative finite difference schemes and dynamic mesh adaptivity. A new data management framework in the PETSc library based on the p4est library is developed to enable simulations with dynamic adaptive mesh refinement (AMR), distributed memory parallelization, and dynamic load balancing of computational work. This framework and the runaway electron solver building on the framework are able to dynamically capture both bulk Maxwellian at the low-energy region and a runaway tail at the high-energy region. To effectively capture features via the AMR algorithm, a new AMR indicator prediction strategy is proposed that is performed alongside the implicit time evolution of the solution. This strategy is complemented by the introduction of computationally cheap feature-based AMR indicators that are analyzed theoretically. Numerical results quantify the advantages of the prediction strategy in better capturing features compared with nonpredictive strategies; and we demonstrate trade-offs regarding computational costs. The robustness with respect to model parameters, algorithmic scalability, and parallel scalability are demonstrated through several benchmark problems including manufactured solutions and solutions of different physics models. We focus on demonstrating the advantages of using implicit time stepping and AMR for runaway electron simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Short-Term Transcriptomic Points of Departure Are Consistent with Chronic Points of Departure for Three Organophosphate Pesticides across Mouse and Fathead Minnow

New approach methods (NAMs) can reduce the need for chronic animal studies. Here, we apply benchmark dose (concentration) (BMD(C))–response modeling to transcriptomic changes in the liver of mice and in fathead minnow larvae after short-term exposures (7 days and 1 day, respectively) to several dose/concentrations of three organophosphate pesticides (OPPs): fenthion, methidathion, and parathion. The mouse liver transcriptional points of departure (TPODs) for fenthion, methidathion, and parathion were 0.009, 0.093, and 0.046 mg/Kg-bw/day, while the fathead minnow larva TPODs were 0.007, 0.115, and 0.046 mg/L, respectively. The TPODs were consistent across both species and reflected the relative potencies from traditional chronic toxicity studies with fenthion identified as the most potent. Moreover, the mouse liver TPODs were more sensitive than or within a 10-fold difference from the chronic apical points of departure (APODs) for mammals, while the fathead minnow larva TPODs were within an 18-fold difference from the chronic APODs for fish species. Short-term exposure to OPPs significantly impacted acetylcholinesterase mRNA abundance (FDR p-value <0.05, |fold change| ≥2) and canonical pathways (IPA, p-value <0.05) associated with organism death and neurological/immune dysfunctions, indicating the conservation of key events related to OPP toxicity. Together, these results build confidence in using short-term, molecular-based assays for the characterization of chemical toxicity and risk, thereby reducing reliance on chronic animal studies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Comparing simulated demand flexibility against actual performance in commercial office buildings

Commercial building energy benchmarking has been used as a mechanism to evaluate energy use of a single building over time, relative to other similar buildings, or to simulations of a reference building conforming to various energy standards. Lack of empirical demand flexibility data and consistent flexibility metrics has limited the ability to compare demand flexibility performance with estimated demand flexibility in buildings. In this study, we collected demand response performance data for a total of 831 demand response events from 192 sites as a first step to build such a building demand flexibility dataset, and propose a standard core data schema to consolidate field data from different sources. We also performed parametric simulations of a control strategy called “global temperature adjustment” using commercial office prototype building models. We then compared the simulated demand flexibility performance against the actual data for offices with global temperature adjustment strategy implemented. During demand response events with an average outside air temperature of 34 °C (range 23 °C–42 °C), the measured demand decrease intensity of the demand flexibility metrics were 6.1 watts per square meter (W/m 2 ), 10.0 W/m 2 , 11.1 W/m 2 , 7.1 W/m 2 , and 4.7 W/m 2 for small, small–medium, medium, medium–large, and large office buildings, respectively. Compared to the measured data in medium- and large-size buildings, the simulated demand decrease intensity was 0.7 W/m 2 (17%) lower on average. The discrepancy between simulated and measured peak demand intensities fell within one standard deviation of the mean measured data. Here, the comparison results validate the credibility of simulations in capturing real building data for assessing the technical potential of building demand flexibility.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Physics-based reward driven image analysis in microscopy

The rise of electron microscopy has expanded our ability to acquire nanometer and atomically resolved images of complex materials. The resulting vast datasets are typically analyzed by human operators, an intrinsically challenging process due to the multiple possible analysis steps and the corresponding need to build and optimize complex analysis workflows. We present a methodology based on the concept of a Reward Function coupled with Bayesian Optimization, to optimize image analysis workflows dynamically. The Reward Function is engineered to closely align with the experimental objectives and broader context and is quantifiable upon completion of the analysis. Here, cross-section, high-angle annular dark field (HAADF) images of ion-irradiated (Y, Dy)Ba 2 Cu 3 O 7–δ thin-films were used as a model system. The reward functions were formed based on the expected materials density and atomic spacings and used to drive multi-objective optimization of the classical Laplacian-of-Gaussian (LoG) method. These results can be benchmarked against the DCNN segmentation. This optimized LoG* compares favorably against DCNN in the presence of the additional noise. We further extend the reward function approach towards the identification of partially-disordered regions, creating a physics-driven reward function and action space of high-dimensional clustering. We pose that with correct definition, the reward function approach allows real-time optimization of complex analysis workflows at much higher speeds and lower computational costs than classical DCNN-based inference, ensuring the attainment of results that are both precise and aligned with the human-defined objectives.

47 OTHER INSTRUMENTATION↗