SEARCH · Search NASA

Results for “performance benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Visualization of post-detonation fireball flowfields and comparison to CFD modeling

Visualization of flow structures within post-detonation fireballs has been performed for benchmark validation of numerical simulations. Custom pressed PETN explosives with a 12-mm diameter hemispherical form factor were used to produce a spherically symmetric post-detonation flow with low soot yield. Hydroxyl-radical planar laser induce fluorescence (OH-PLIF) was employed to visualize the structure ranging from approximately 10 μs to 35 μs after shock breakout from the explosive pellet. Fireball simulations were performed using the HyBurn Computational Fluid Dynamics (CFD) package. Experimental OH-PLIF results were compared to synthetic OH-PLIF from post-processing of CFD simulations. From the comparison of experimental and synthetic OH-PLIF images, CFD is shown to replicate much of the flow structure observed in the experiments, revealing potential differences in turbulent length scales and OH kinetics. Furthermore, results provide significant advancement in experimental resolution of these harsh turbulent combustion environments and validate physical models thereof.

Detonator↗

DOE OSTI2021

Performance of three-dimensional printed nasopharyngeal swabs for COVID-19 testing

At the start of the COVID-19 pandemic, the US faced nationwide shortages of nasopharyngeal swabs due to both overwhelmed supply chains and an increase in demand. To address this shortfall, multiple 3D printed swabs were ultimately produced and sold for COVID-19 testing. In this work, we present a framework for mechanical and functional bench-testing of nasopharyngeal swabs using standard and widely available material testing equipment. Using this framework, we offer a comprehensive, quantitative comparison of the 3D printed swabs to benchmark their performance against traditional flocked swabs. The test protocols were designed to emulate the clinical use of the nasopharyngeal swabs and to evaluate potential failure modes. Overall, the 3D printed swabs performed comparably to, or outperformed, the traditional swabs in all mechanical tests. While traditional swabs outperformed some of the new 3D printed swabs in terms of sample uptake and retention, similar amounts of RNA were recovered from both 3D printed and traditional swabs.

3D printing↗

DOE OSTI2025

Ansatz-Free Hamiltonian Learning with Heisenberg-Limited Scaling

Learning the unknown interactions that govern a quantum system is crucial for quantum information processing, device benchmarking, and quantum sensing. The problem, known as Hamiltonian learning, is well understood under the assumption that interactions are local, but this assumption may not hold for arbitrary Hamiltonians. Previous methods all require high-order inverse polynomial dependency with precision, unable to surpass the standard quantum limit and reach the gold-standard Heisenberg-limited scaling. Whether Heisenberg-limited Hamiltonian learning is possible without prior assumptions about the interaction structures, a challenge we term ansatz-free Hamiltonian learning , remains an open question. In this work, we present a quantum algorithm to learn arbitrary sparse Hamiltonians without any structure constraints using only black-box queries of the system’s real-time evolution and minimal digital controls to attain Heisenberg-limited scaling in estimation error. Our method is also resilient to state-preparation-and-measurement errors, enhancing its practical feasibility. We numerically demonstrate our ansatz-free protocol for learning physical Hamiltonians and validating analog quantum simulations, benchmarking our performance against the state-of-the-art Heisenberg-limited learning approach. Moreover, we establish a fundamental trade-off between total evolution time and quantum control on learning arbitrary interactions, revealing the intrinsic interplay between controllability and total evolution-time complexity for any learning algorithm. These results pave the way for further exploration into Heisenberg-limited Hamiltonian learning in complex quantum systems under minimal assumptions, potentially enabling new benchmarking and verification protocols.

machine learning↗

DOE OSTI2024

Hybrid programming-model strategies for GPU offloading of electronic structure calculation kernels

To address the challenge of performance portability and facilitate the implementation of electronic structure solvers, we developed the basic matrix library (BML) and Parallel, Rapid O(N), and Graph-based Recursive Electronic Structure Solver (PROGRESS) library. The BML implements linear algebra operations necessary for electronic structure kernels using a unified user interface for various matrix formats (dense and sparse) and architectures (CPUs and GPUs). Focusing on density functional theory and tight-binding models, PROGRESS implements several solvers for computing the single-particle density matrix and relies on BML. In this paper, we describe the general strategies used for these implementations on various computer architectures, using OpenMP target functionalities on GPUs, in conjunction with third-party libraries to handle performance critical numerical kernels. In this study, we demonstrate the portability of this approach and its performance in benchmark problems.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Steepest-descent algorithm for simulating plasma-wave caustics via metaplectic geometrical optics

The design and optimization of radiofrequency-wave systems for fusion applications is often performed using ray-tracing codes, which rely on the geometrical-optics (GO) approximation. However, GO fails at wave cutoffs and caustics. To accurately model the wave behavior in these regions, more advanced and computationally expensive “full-wave” simulations are typically used, but this is not strictly necessary. A new generalized formulation called metaplectic geometrical optics (MGO) has been proposed that reinstates GO near caustics. The MGO framework yields an integral representation of the wavefield that must be evaluated numerically in general. We present an algorithm for computing these integrals using Gauss-Freud quadrature along the steepest-descent contours. Benchmarking is performed on the standard Airy problem, for which the exact solution is known analytically. Furthermore, the numerical MGO solution provided by the new algorithm agrees remarkably well with the exact solution and significantly improves on previously derived analytical approximations of the MGO integral.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2023

Online transfer learning strategy for enhancing the scalability and deployment of deep reinforcement learning control in smart buildings

In recent years, advanced control strategies based on Deep Reinforcement Learning (DRL) proved to be effective in optimizing the management of integrated energy systems in buildings, reducing energy costs and improving indoor comfort conditions when compared to traditional reactive controllers. However, the scalability and implementation of DRL controllers are still limited since they require a considerable amount of time before converging to a near-optimal solution. This issue is currently addressed in literature through the offline pre-training of the DRL agent. However this solution results in two main critical issues: (1) the need to develop a building surrogate model to perform the training task, and (2) the need to perform a fine-tuning process over several training episodes to obtain a near-optimal control policy. In this context, this paper introduces an Online Transfer Learning (OTL) strategy that exploits two knowledge-sharing techniques, weight-initialization and imitation learning, to transfer a DRL control policy from a source office building to various target buildings in a simulation environment coupling EnergyPlus and Python. A DRL controller based on discrete Soft Actor–Critic (SAC) is trained on the source building to manage the operation of a cooling system consisting of a chiller and a thermal storage. Several target buildings are defined to benchmark the performance of the OTL strategy with that of a Rule-Based Controller (RBC) and two DRL-based control strategies, deployed in offline and online fashion. The strategy adopted for OTL emulates the real world implementation with a simulation process by implementing the transferred DRL agent for a single episode in the target buildings. Target buildings have the same geometrical features and are served by the same energy system as the source building, but differ in terms of weather conditions, electricity price schedules, occupancy patterns, and building envelope efficiency levels. The results show that the OTL strategy can reduce the cumulated sum of temperature violations on average by 50% and 80% respectively when compared to RBC and online DRL while enhancing the energy system operation with electricity cost savings ranging between 20% and 40%. Furthermore, the OTL agent performs slightly worse than the offline DRL controller but it does not require any modeling effort and can be implemented directly on target buildings emulating a real-world implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Degradation in Photovoltaic Encapsulant Transmittance: Results of the Second PVQAT TG5 Artificial Weathering Study

The optical degradation of encapsulants from ultraviolet (UV) radiation has historically resulted in a significant loss in performance throughout the life of a photovoltaic (PV) module. IEC test methods have recently been developed to screen for PV encapsulants prone to loss in optical performance. The present study was performed to benchmark polymeric packaging materials relative to IEC 62788-1-4 (covering the measurement of optical transmittance) and IEC 62788-1-7 (on the durability of transmittance), provide feedback toward improvement of the methods, and develop insight regarding optical degradation. Contemporary materials were examined, including: poly(ethylene-co-vinyl acetate) (EVA), thermoplastic polyolefin (TPO), polyolefin elastomer (POE), and polyvinyl butyral (PVB) encapsulants; a poly(ethene-co-tetrafluoroethene)/poly(ethylene terephthalate) (ETFE/PET) transparent backsheet; and a polystyrene (PS) working reference material. The use of silica-, specialty-, and rolled-glass was also compared in laminated coupons. Specimen size was separately examined from 2.5 cm to 12.5 cm. Weathering was performed with a xenon source, using IEC TS 62788-7-2 methods A2, A3, A4, and A5 (chamber temperature of 55 Degrees C, 65 Degrees C, 75 Degrees C, or 85 Degrees C), respectively. Characterizations were made using a UV-VIS-NIR spectrophotometer (transmittance and reflectance, with and without an integrating sphere), a UV-VIS fluorescence spectrophotometer, a camera, and an optical microscope. Performance was analyzed, including solar weighted transmittance, yellowness index, UV cut-off wavelength, and haze (scattering). Separate Arrhenius analyses were performed to assess retention of transmittance and changes in yellowness index. The activation energy for both characteristics was found to range from 15 kJ?mol-1-80 kJ/mol-1, with an average of 48 kJ/mol-1, similar to the average of 45 kJ/mol-1 identified in the previous international PV Quality Assurance Task Force (PVQAT) Task Group 5 (TG5) study of more traditional encapsulants. The separate degradation modes of discoloration and scattering were distinguished in the encapsulants using a comprehensive spectral characterization. Based on these results, the IEC 62788-1-7 pass/fail criteria of 5% change in transmittance was confirmed to identify a known bad encapsulant.

durability↗

DOE OSTI2022

Impact of battery cell imbalance on electric vehicle range

Due to manufacturing variation, battery cells often possess heterogeneous characteristics, leading to battery state-of-charge variation in real-time. Since the lowest cell state-of-charge determines the useful life of battery pack, such variation can negatively impact the battery performance and electric vehicles range. Existing research has been focused on control design to mitigate cell imbalance. However, it is yet unclear how much impacts the cell imbalance can have on electric vehicle range. This paper closes this knowledge gap by using a simulation environment consisting of real-world driving speed data, vehicle longitudinal control, propulsion and vehicle dynamics, and cell level battery modeling. In particular, each battery cell is modeled as an equivalent circuit model, and variations among cell parameters are introduced to assess their impact on electric vehicles range and to identify the most influential parameter variations. Simulation results and analysis can be used to assist balancing control design and to benchmark control performance.

25 ENERGY STORAGE↗

DOE OSTI2024

Risk-Aware Framework Development for Disruption Prediction: Alcator C-Mod and DIII-D Survival Analysis

Abstract Survival regression models can achieve longer warning times at similar receiver operating characteristic performance than previously investigated models. Survival regression models are also shown to predict the time until a disruption will occur with lower error than other predictors. Time-to-event predictions from time-series data can be obtained with a survival analysis statistical framework, and there have been many tools developed for this task which we aim to apply to disruption prediction. Using the open-source Auton-Survival package we have implemented disruption predictors with the survival regression models Cox Proportional Hazards, Deep Cox Proportional Hazards, and Deep Survival Machines. To compare with previous work, we also include predictors using a Random Forest binary classifier, and a conditional Kaplan-Meier formalism. We benchmarked the performance of these five predictors using experimental data from the Alcator C-Mod and DIII-D tokamaks by simulating alarms on each individual shot. We find that developing machine-relevant metrics to evaluate models is an important area for future work. While this study finds cases where disruptive conditions are not predicted, there are instances where the desired outcome is produced. Giving the plasma control system the expected time-to-disruption will allow it to determine the optimal actuator response in real time to minimize risk of damage to the device.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2025

Discrete fracture network model benchmarks developed and applied in a DECOVALEX-2023 repository performance assessment study

This study presents newly developed benchmarks for modeling flow and transport within discrete fracture networks (DFNs) and useful methods for analyzing the results. The new benchmarks are designed to test modeling approaches for use in probabilistic performance assessment models of deep geologic repositories in fractured rock. The benchmarks simulate flow and transport through a 1 km 3 block of fractured rock. The first simulates migration of a short pulse of tracer through a simple network of four intersecting fractures. The second adds 1089 stochastically generated fractures. The third changes the pulse to a continuous point source. Evaluation of model performance relies on moment analysis and comparison of the results of different models. The expected nondimensional first moment of the conservative tracer for each benchmark is 1. The benchmarks were simulated by teams from Canada, Czechia, Germany, Korea, Sweden, Taiwan, and the United States as part of a DECOVALEX-2023 study (decovalex.org). The teams used various approaches, including explicit DFN modeling, DFN upscaling to an equivalent continuous porous medium (ECPM), and a combination of both methods. Transport mechanisms are modeled using either the advection-dispersion equation or particle tracking. Results demonstrate strong agreement among the models in breakthrough behavior up to the 75th percentile. Significant deviations in first moments and well-clustered outputs led to the identification of inaccuracies in several models. Such findings exemplify the benefit of exercising these benchmarks and using the presented methods to test DFN flow and transport models.

Benchmark↗

DOE OSTI2021

Visualization of shocked material instabilities using a fast-framing camera and XFEL four-pulse train

Many questions regarding dynamic materials could be answered by using time-resolved ultra-fast imaging techniques to characterize the physical and chemical behavior of materials in extreme conditions and their evolution on the nanosecond scale. In this work, we perform multi-frame phase-contrast imaging (PCI) of micro-voids in low density polymers under laser-driven shock compression. At the Matter in Extreme Conditions (MEC) Instrument at the Linac Coherent Light Source (LCLS), we used a train of four x-ray free electron laser (XFEL) pulses to probe the evolution of the samples. To visualize the void and shock wave interaction, here, we deployed the Icarus V2 detector to record up to four XFEL pulses, separated by 1-3 nanoseconds. In this work, we image elastic waves interacting with the micro-voids at a pressure of several GPa. Monitoring how the material’s heterogeneities, like micro-voids, dictate its response to a compressive wave is important for benchmarking the performances of inertial confinement fusion energy materials. For the first time in a single sample, we have combined an ultrafast x-ray framing camera and four XFEL pulse train to create an ultrafast movie of micro-void evolution under laser-driven shock compression. Eventually, we hope this technique will resolve the material density as it evolves dynamically under laser shock compression.

fusion↗

DOE OSTI2022

LBNL Fault Detection and Diagnostics Datasets

These datasets can be used to evaluate and benchmark the performance accuracy of Fault Detection and Diagnostics (FDD) algorithms or tools. It contains operational data from simulation, laboratory experiments, and field measurements from real buildings for seven HVAC systems/equipment (rooftop unit, single-duct air handler unit, dual-duct air handler unit, variable air volume box, fan coil unit, chiller plant, and boiler plant). Each dataset includes a .pdf file to document key information necessary to understand the content and scope, multiple csv files containing all the time-series data for faults at different severity levels and one fault-free case, and a ttl file to visualize the data according to BRICK schema. The dataset was created by LBNL, PNNL, NREL, ORNL and Drexel University.

AC↗

DOE OSTI2022

Calibrating the Classical Hardness of the Quantum Approximate Optimization Algorithm

The trading of fidelity for scale enables approximate classical simulators such as matrix product states (MPSs) to run quantum circuits beyond exact methods. A control parameter, the so-called bond dimension $\mathcal{χ}$ for MPSs, governs the allocated computational resources and the output fidelity. Here, we characterize the fidelity for the quantum approximate optimization algorithm by the expectation value of the cost function that it seeks to minimize and find that it follows a scaling law $\mathscr{F}$(ln $\mathcal{χ}$/N), where N is the number of qubits. With ln $\mathcal{χ}$ amounting to the entanglement that a MPS can encode, we show that the relevant variable for investigating the fidelity is the entanglement per qubit. Importantly, our results calibrate the classical computational power required to achieve the desired fidelity and benchmark the performance of quantum hardware in a realistic setup. For instance, we quantify the hardness of performing better classically than a noisy superconducting quantum processor by readily matching its output to the scaling function. Moreover, we relate the global fidelity to that of individual operations and establish its relationship with $\mathcal{χ}$ and N. We sharpen the requirements for noisy quantum computers to outperform classical techniques at running a quantum optimization algorithm in speed, size, and fidelity.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2023

TRANSLATE - a Monte Carlo simulation of electron transport in liquid argon

Here, the microphysics of electron and photon propagation in liquid argon is a key component of detector design and calibrations needed to construct and perform measurements within a wide range of particle physics experiments. As experiments grow in scale and complexity, and as the precision of their intended measurements increases, the development of tools to investigate important microphysics effects impacting such detectors becomes necessary. In this paper we present a new time-domain Monte Carlo simulation of electron transport in liquid argon. The simulation models the TRANSport in Liquid Argon of near-Thermal Electrons (TRANSLATE) with the aim of providing a multi-purpose software package for the study and optimization of detector environments, with a particular focus on ongoing and next generation liquid argon neutrino experiments utilizing the time projection chamber technology. TRANSLATE builds on previous work of Wojcik and Tachiya, amongst others, introducing additional processes, including ionization, thus modeling the full range of drift electron scattering interactions. The simulation is validated by benchmarking its performance with swarm parameters from data collected in experimental setups operating in gas and liquid.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2021

The physics potential of a reactor neutrino experiment with Skipper CCDs: Measuring the weak mixing angle

We analyze in detail the physics potential of an experiment like the one recently proposed by the vIOLETA collaboration: a kilogram-scale Skipper CCD detector deployed 12 meters away from a commercial nuclear reactor core. This experiment would be able to detect coherent elastic neutrino nucleus scattering from reactor neutrinos, capitalizing on the exceptionally low ionization energy threshold of Skipper CCDs. To estimate the physics reach, we elect the measurement of the weak mixing angle as a case study. We choose a realistic benchmark experimental setup and perform variations on this benchmark to understand the role of quenching factor and its systematic uncertainties, background rate and spectral shape, total exposure, and reactor antineutrino flux uncertainty. We take full advantage of the reactor flux measurement of the Daya Bay collaboration to perform a data driven analysis which is, up to a certain extent, independent of the theoretical un- certainties on the reactor antineutrino flux. We show that, under reasonable assumptions, this experimental setup may provide a competitive measurement of the weak mixing angle at few MeV scale with neutrino-nucleus scattering.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Random projection using random quantum circuits

The random sampling task performed by Google's Sycamore processor gave us a glimpse of the “quantum supremacy era.” This has definitely shed some light on the power of random quantum circuits in this abstract task of sampling outputs from the (pseudo)random circuits. In this paper, we explore a practical near-term use of local random quantum circuits in dimensional reduction of large low-rank data sets. We make use of the well-studied dimensionality reduction technique called the random projection method. This method has been extensively used in various applications such as image processing, logistic regression, entropy computation of low-rank matrices, etc. We prove that the matrix representations of local random quantum circuits with sufficiently shorter depths [ ∼ O ( n ) ] serve as good candidates for random projection. We demonstrate numerically that their projection abilities are not far off from the computationally expensive classical principal components analysis on MNIST and CIFAR-100 image datasets. We also benchmark the performance of quantum random projection against the commonly used classical random projection in the tasks of dimensionality reduction of image data sets and computing von Neumann entropies of large low-rank density matrices. And finally, using variational quantum singular value decomposition, we demonstrate a near-term implementation of extracting the singular vectors with dominant singular values after quantum random projecting a large low-rank matrix to lower dimensions. All such numerical experiments unequivocally demonstrate the ability of local random circuits to randomize a large Hilbert space at sufficiently shorter depths with robust retention of properties of large data sets in reduced dimensions. Published by the American Physical Society 2024

Kumaran, Keerthi (ORCID:0009000949125721)↗

DOE OSTI2025

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters

The application of deep machine learning methods in astronomy has exploded in the last decade, with new models showing remarkably improved performance on benchmark tasks. Not nearly enough attention is given to understanding the models' robustness, especially when the test data are systematically different from the training data, or "out of domain." Domain shift poses a significant challenge for simulation-based inference, where models are trained on simulated data but applied to real observational data. In this paper, we explore domain shift and test domain adaptation methods for a specific scientific case: simulation-based inference for estimating galaxy cluster masses from X-ray profiles. We build datasets to mimic simulation-based inference: a training set from the Magneticum simulation, a scatter-augmented training set to capture uncertainties in scaling relations, and a test set derived from the IllustrisTNG simulation. We demonstrate that the Test Set is out of domain in subtle ways that would be difficult to detect without careful analysis. We apply three deep learning methods: a standard neural network (NN), a neural network trained on the scatter-augmented input catalogs, and a Deep Reconstruction-Regression Network (DRRN), a semi-supervised deep model engineered to address domain shift. Although the NN improves results by 17% in the Training Data, it performs 40% worse on the out-of-domain Test Set. Surprisingly, the Scatter-Augmented Neural Network (SANN) performs similarly. While the DRRN is successful in mapping the training and Test Data onto the same latent space, it consistently underperforms compared to a straightforward Yx scaling relation. These results serve as a warning that simulation-based inference must be handled with extreme care, as subtle differences between training simulations and observational data can lead to unforeseen biases creeping into the results.

Ntampaka, Michelle [Baltimore, Space Telescope Sci↗

DOE OSTI2022

Verification of the LOTUS code with C5G7 benchmark

In this study, the verification of the neutron transport code LOTUS through the well-known C5G7 benchmark is performed. LOTUS uses the current coupled collision probability method with the expansion of the flux by orthogonal polynomials (CCCPO) for the solution of the neutron transport equation. The expansion of the flux by orthogonal polynomials allows one to avoid discretization of the calculation regions and significantly decreases the simulation time. The results of the LOTUS calculations are compared with the results of the reference OpenMC Monte Carlo simulations. The results of the comparison demonstrate almost perfect agreement with Monte-Carlo for the second order of the flux expansion. Even though the results obtained in the presented study agree well with the results of reference Monte Carlo calculations, further investigations are necessary for a better understanding of the stability and limitations of the code.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗