SEARCH · Search NASA

Results for “performance benchmarking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Evaluation of Cathode Materials with Lithium-Metal Anodes: Baseline Performance and Protocol Standardization of Coin Cells

The collaborative evaluation of electrode materials across multiple research entities requires standardized electrochemical testing protocols to produce reliable, one-to-one comparisons between different systems of interest. Similar to the work done by Long et al. on protocol standardization for coin-cell testing with graphite anodes [J. Electrochem. Soc., 163, A2999, (2016)], here we introduce two standardized testing protocols designed to quickly evaluate important electrochemical properties of cathode materials using lithium-metal anodes. The two protocols measure kinetic and thermodynamic capacity losses, rate- and voltage-dependent cycling capacities, instabilities at high voltage and high cycling rate, and overpotentials at various states of charge. We then apply these protocols to four commercially available cathode materials to establish benchmark performance metrics that can be used to screen and evaluate new cathode materials.

25 ENERGY STORAGE↗

DOE OSTI2023

Emergent Behaviors and the Limits of Large Language Model Generalization

Over the past couple years, large language models (LLMs) have rapidly grown in size and performance across wide numbers of tasks, leading some to herald them as machine learning models with truly “general” capabilities. We address some of the ways that the language used to describe these models can be both deceptive and a poor framing for making progress towards understanding their capabilities, and also review arguments on to what extent these models can represent and interact with the meaning of language. Emergent behaviors in these highly complex models are unpredictable and research into understanding them is still in early phases, which limits the strength of claims of generality about them. Moreover, while these models demonstrate surprising emergent reasoning capabilities on many tasks, there are still many limitations in generalization that overall high benchmark performance can hide. We review the literature showcasing limitations of LLMs as well as techniques to mitigate or overcome these challenges, while also highlighting how fundamental problems in model evaluation may prevent true claims of generality. We conclude with a practical section on using LLMs on real world problems while appropriately evaluating and validating these tasks to prevent or mitigate the downstream impacts of incorrect results.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Reassessing the Origins and Contemporary Relevance of ck Acceptability Parameters: Evolving Perspectives on Similarity

“Sensitivity and Uncertainty Analyses Applied to Criticality Safety Validation,” introduces sensitivity and uncertainty methods to address challenges in defining and extending areas of applicability for criticality safety validation. These areas are traditionally defined by the bounds or limits on key parameters, but establishing valid ranges and managing complex parameter variations remain challenging. NUREG/CR-6655 introduces ck and other integral indices, as well as concepts such as the completeness of benchmark coverage, to better quantify system similarities. The work proposed herein seeks to evaluate these foundational concepts to ensure that the bounds remain effective in guiding the assessment of similarity and applicability in modern applications. The concept of completeness, along with other parameters envisioned within the framework, serves as an example of the foundational ideas that have been established, though their effectiveness in practice may not be fully understood. Advancements in scripting tools, coupled with the speed and efficiency of modern computing and statistical models, now allow for faster and more thorough assessments than previously possible. These advancements also enable the identification of trends within the data, which could provide additional insight into system behavior and further broaden the scope of previously performed benchmarks. By leveraging these capabilities, we will revisit and expand the scope of these foundational methods to determine whether the necessary elements for robust similarity evaluation are already embedded, partially realized, or remain untapped.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

GPU acceleration of all-electron electronic structure theory using localized numeric atom-centered basis functions

We present an implementation of all-electron density-functional theory for massively parallel GPU-based platforms, using localized atom-centered basis functions and real-space integration grids. Special attention is paid to domain decomposition of the problem on non-uniform grids, which enables compute- and memory-parallel execution across thousands of nodes for real-space operations, e.g. the update of the electron density, the integration of the real-space Hamiltonian matrix, and calculation of Pulay forces. To assess the performance of our GPU implementation, we performed benchmarks on three different architectures using a 103-material test set. We find that operations which rely on dense serial linear algebra show dramatic speedups from GPU acceleration: in particular, SCF iterations including force and stress calculations exhibit speedups ranging from 4.5 to 6.6. For the architectures and problem types investigated here, this translates to an expected overall speedup between 3–4 for the entire calculation (including non-GPU accelerated parts), for problems featuring several tens to hundreds of atoms. Additional calculations for a 375-atom Bi2Se3 bilayer show that the present GPU strategy scales for large-scale distributed-parallel simulations.

42 ENGINEERING↗

DOE OSTI2024

Mechanochemically Robust LiCoO 2 with Ultrahigh Capacity and Prolonged Cyclability

Pushing intercalation-type cathode materials to their theoretical capacity often suffers from fragile Li-deficient frameworks and severe lattice strain, leading to mechanical failure issues within the crystal structure and fast capacity fading. This is particularly pronounced in layered oxide cathodes because the intrinsic nature of their structures is susceptible to structural degradation with excessive Li extraction, which remains unsolved yet despite attempts involving elemental doping and surface coating strategies. Herein, a mechanochemical strengthening strategy is developed through a gradient disordering structure to address these challenges and push the LiCoO 2 (LCO) layered cathode approaching the capacity limit (256 mAh g -1 , up to 93% of Li utilization). This innovative approach also demonstrates exceptional cyclability and rate capability, as validated in practical Ah-level pouch full cells, surpassing the current performance benchmarks. Comprehensive characterizations with multiscale X-ray, electron diffraction, and imaging techniques unveil that the gradient disordering structure notably diminishes the anisotropic lattice strain and exhibits high fatigue resistance, even under extreme delithiation states and harsh operating voltages. Consequently, this designed LCO cathode impedes the growth and propagation of particle cracks, and mitigates irreversible phase transitions. In conclusion, this work sheds light on promising directions toward next-generation high-energy-density battery materials through structural chemistry design.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Transparent and Conductive Inorganic/Polymer‐Composite Encapsulants for Long‐Term Perovskite Solar Cells Operation

An innovative inorganic/polymer-composite encapsulation scheme comprising a polymer-based transparent conductive composite (TCC) coupled with a transparent conductive oxide is introduced to extend the lifetime of moisture-sensitive devices such as perovskite solar cells (PSC). The TCC comprises conductive silver-coated polymethyl methacrylate (Ag-PMMA) microsphere fillers protruding from a transparent non-conductive polymer matrix. TCC samples (5% Ag-PMMA by area) demonstrate high optical transparencies (%T approx. 85% in the 370–1200 nm region), low out-of-plane electrical resistivities (R < 0.2 Ω cm 2 ), and equilibrium permeabilities of less than 1 g mm/m 2 /day, all of which are well-maintained after 1,000 hours of environmental exposure. In practice, the TCC is employed between two indium zinc oxide (IZO) thin films, with the in-plane conductivity of IZO and the out-of-plane conductivity of TCC working collectively to function as a single encapsulating electrode. This encapsulation scheme is exemplified by benchmarking performances of PSCs subjected to accelerated aging conditions of quasi-maximum power point tracking under light soaking in air at 50 °C, 40% R.H. to 60% R.H. Notable improvements in operational lifetimes are observed, with a champion encapsulated PSC maintaining over 90% of its initial efficiency of 21.65% for up to 1,430 hours, compare to less than 300 hours for an unencapsulated control.

14 SOLAR ENERGY↗

DOE OSTI2021

Amino‐Functionalised Hybrid Ultramicroporous Materials that Enable Single‐Step Ethylene Purification from a Ternary Mixture

Abstract Pyrazine‐linked hybrid ultramicroporous (pore size <7 Å) materials (HUMs) offer benchmark performance for trace carbon capture thanks to strong selectivity for CO 2 over small gas molecules, including light hydrocarbons. That the prototypal pyrazine‐linked HUMs are amenable to crystal engineering has enabled second generation HUMs to supersede the performance of the parent HUM, SIFSIX‐3‐Zn , mainly through substitution of the metal and/or the inorganic pillar. Herein, we report that two isostructural aminopyrazine‐linked HUMs, MFSIX‐17‐Ni (17=aminopyrazine; M=Si, Ti), which we had anticipated would offer even stronger affinity for CO 2 than their pyrazine analogs, unexpectedly exhibit reduced CO 2 affinity but enhanced C 2 H 2 affinity. MFSIX‐17‐Ni are consequently the first physisorbents that enable single‐step production of polymer‐grade ethylene (>99.95 % for SIFSIX‐17‐Ni ) from a ternary equimolar mixture of ethylene, acetylene and CO 2 thanks to coadsorption of the latter two gases. We attribute this performance to the very different binding sites in MFSIX‐17‐Ni versus SIFSIX‐3‐Zn .

Mukherjee, Soumya↗

DOE OSTI2021

Amino‐Functionalised Hybrid Ultramicroporous Materials that Enable Single‐Step Ethylene Purification from a Ternary Mixture

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

blocks_3d: software for general 3d conformal blocks

We introduce the software blocks_3d for computing four-point conformal blocks of operators with arbitrary Lorentz representations in 3d CFTs. It uses Zamolodchikov-like recursion relations to numerically compute derivatives of blocks around a crossing-symmetric configuration. It is implemented as a heavily optimized, multi-threaded, C++ application. We give performance benchmarks for correlators containing scalars, fermions, and stress tensors. As an example application, we recompute bootstrap bounds on four-point functions of fermions and study whether a previously observed sharp jump can be explained using the “fake primary” effect. We conclude that the fake primary effect cannot fully explain the jump and the possible existence of a “dead-end” CFT near the jump merits further study.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2022

Combustion dynamics of crude and upgraded Thermal DeOxygenation oils in a compression ignition engine

Thermal DeOxygenation (TDO) is a robust thermochemical conversion scheme to produce hydrocarbons from biomass feedstock. The process targets the carbohydrate fraction of biomass to yield a broad mixture of primarily aromatic hydrocarbons within a boiling point range of 348–798 K with low oxygen content (<4 wt%). The resulting materials are amenable to traditional hydrotreating and distillation processes with approximately 70% by mass in the distillate fuel range. The simple conversion scheme combined with commercially viable upgrading routes makes TDO oils a feasible alternative fuel for transportation applications. Here this paper is the first systematic treatment of fit-for-purpose testing of TDO oils in a compression ignition engine. Blends of partially upgraded TDO oils (e.g. whole oil, distilled oil, hydrotreated oil and hydrotreated-distilled oil) are prepared with certified ultra-low sulfur diesel at 5%, 10%, 15% and 20% by volume. The resulting fuels are analyzed for fuel characteristics and combustion dynamics in an instrumented single-cylinder compression ignition engine. All fuel blends at 10% blend level by volume exhibited adequate engine performance. Hydrotreating of the oils is a necessary step to meet cetane number and EPA soot emissions requirements at 20% blend volume. Combined distillation and hydrotreatment meet or exceed all fuel specification and engine performance benchmarks. Partially upgraded TDO oils are suitable fuel options for compression ignition applications.

42 ENGINEERING↗

DOE OSTI2025

Comparative experimental study of heat transfer processes in accumulation energy recovery exchangers

In this study, an experimental comparison between three different energy accumulating ceramic heat exchangers for energy recovery in ventilation systems was presented. The units were selected to represent three different approaches on the energy recovery process: honeycomb structure with more accumulation mass (more energy can be stored in one unit)- Unit 1.1, honeycomb structure with lower accumulation mass- Unit 1.2, and a rectangular structure with expanded heat transfer surface- Unit 1.3. The achieved results are useful for the future application of such units in ventilation systems. It was established that all evaluated units demonstrated an acceptable effectiveness of thermal energy recovery from the exhaust air. Their average energy recovery efficiency ranged between 70 % and 80 %, aligning with expected performance benchmarks for regenerative heat exchangers employed in contemporary mechanical ventilation systems. It was also established that the factor which has the highest impact on thermal effectiveness is the heat transfer surface available in the tested heat exchangers. Units with the highest number of channels (i.e., with the highest amount of single channel walls, which can be used for heat transfer) achieve the highest thermal effectiveness. However, higher thermal effectiveness can negatively affect the ventilation potential of the units. Unit 1.3, which was characterized by the highest thermal efficiency, was also characterized by the lowest achievable flow rate. It was also found that the important technical aspect that should be taken into account when analyzing accumulation energy recovery units is also the fluctuation of the supply air temperature. The ability to ensure minimal temperature fluctuations is a significant operational advantage, as it ensures a higher level of safety at lower outside temperatures.

Energy recovery↗

DOE OSTI2022

Demonstrating the viability of Lagrangian in situ reduction on supercomputers

Performing exploratory analysis and visualization of large-scale time-varying computational science applications is challenging due to inaccuracies that arise from under-resolved data. In recent years, Lagrangian representations of the vector field computed using in situ processing are being increasingly researched and have emerged as a potential solution to enable exploration. However, prior works have offered limited estimates of the encumbrance on the simulation code as they consider “theoretical” in situ environments. Further, the effectiveness of this approach varies based on the nature of the vector field, benefitting from an in-depth investigation for each application area. With this study, an extended version of Sane et al. (2021), we contribute an evaluation of Lagrangian analysis viability and efficacy for simulation codes executing at scale on a supercomputer. We investigated previously unexplored cosmology and seismology applications as well as conducted a performance benchmarking study by using a hydrodynamics mini-application targeting exascale computing. Here, to inform encumbrance, we integrated in situ infrastructure with simulation codes, and evaluated Lagrangian in situ reduction in representative homogeneous and heterogeneous HPC environments. To inform post hoc accuracy, we conducted a statistical analysis across a range of spatiotemporal configurations as well as a qualitative evaluation. Additionally, our study contributes cost estimates for distributed-memory post hoc reconstruction. In all, we demonstrate viability for each application — data reduction to less than 1% of the total data via Lagrangian representations, while maintaining accurate reconstruction and requiring under 10% of total execution time in over 90% of our experiments.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Characterization of 6 Li-loaded pulse-shape-discriminating plastic scintillators

Lithium-loaded organic plastic scintillators combine sensitivity to γ rays with the ability to detect both fast and slow neutrons, making them valuable for applications in nuclear security and in basic nuclear and particle physics. The goal of this work is to characterize the neutron response of two custom lithium-loaded organic plastic scintillators developed at Lawrence Livermore National Laboratory. Both are ternary polystyrene-based formulations containing 1.5 wt.% 6 Li salts of isobutyric acid, but they differ in their primary and secondary dye compositions: one uses m-terphenyl as the primary fluor and with Exalite 404 as the wavelength shifter, whereas the other uses 2,5-diphenyloxazole (PPO) and 9,10-diphenyl-anthracene, respectively. The temporal response of the scintillators was measured via time-correlated single photon counting for γ-ray and neutron events. The proton light yield was measured using the double time-of-flight technique from 1.3 to 15 MeV at the 88-Inch Cyclotron at Lawrence Berkeley National Laboratory. For the slow neutron response, an AmBe source moderated with polyethylene was used, and the light output from the 6 Li(n,α)t reaction was characterized. Differences in ionization quenching and temporal response were observed between the two materials with the PPO-containing scintillator exhibiting higher ionization quenching. These results provide performance benchmarks that can guide the design and optimization of future lithium-loaded plastic scintillators for use in basic science and applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2023

Evaluation of 1,2-diacyl-3-acetyl triacylglycerol production in Yarrowia lipolytica

Plants produce many high-value oleochemical molecules. While oil-crop agriculture is performed at industrial scales, suitable land is not available to meet global oleochemical demand. Worse, establishing new oil-crop farms often comes with the environmental cost of tropical deforestation. The field of metabolic engineering offers tools to transplant oleochemical metabolism into tractable hosts while simultaneously providing access to molecules produced by non-agricultural plants. Here, we evaluate strategies for rewiring metabolism in the oleaginous yeast Yarrowia lipolytica to synthesize a foreign lipid, 3-acetyl-1,2-diacyl-sn-glycerol (acTAG). Oils made up of acTAG have a reduced viscosity and melting point relative to traditional triacylglycerol oils making them attractive as low-grade diesels, lubricants, and emulsifiers. Furthermore, this manuscript describes a metabolic engineering study that established acTAG production at g/L scale, exploration of the impact of lipid bodies on acTAG titer, and a techno-economic analysis that establishes the performance benchmarks required for microbial acTAG production to be economically feasible.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Selective Formation of Acetic Acid and Methanol by Direct Methane Oxidation Using Rhodium Single-Atom Catalysts

Atomically dispersed catalysts such as single-atom catalysts have been shown to be effective in selectively oxidizing methane, promising a direct synthetic route to value-added oxygenates such as acetic acid or methanol. However, an important challenge of this approach has been that the loading of active sites by single-atom catalysts is low, leading to a low overall yield of the products. We report an approach that can address this issue. It utilizes a metal–organic framework built with porphyrin as the linker, which provides high concentrations of binding sites to support atomically dispersed rhodium. It is shown that up to 5 wt% rhodium loading can be achieved with excellent dispersity. When used for acetic acid synthesis by methane oxidation, a new benchmark performance of 23.62 mmol·gcat –1 ·h –1 was measured. Furthermore, the catalyst exhibits a unique sensitivity to light, producing acetic acid (under illumination, up to 66.4% selectivity) or methanol (in the dark, up to 65.0% selectivity) under otherwise identical reaction conditions.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Maximizing long-term biohydrogen production with Clostridium thermocellum for high solids conversion of lignocellulosic biomass

Biological hydrogen production from lignocellulosic biomass sustainably couples organic waste reduction with renewable energy generation. Efficient conversion is challenged by the structural complexity of lignocellulose and resulting recalcitrance to enzymatic degradation. Clostridium thermocellum natively breaks down biomass with highly effective hemi-/cellulases systems (i.e., cellulosomes) and generates hydrogen in anaerobic cultivation, creating a compelling platform for lignocellulosic biohydrogen production. Achieving commercially viable production rates requires balancing high biomass loading and throughput against uniform mixing conditions required for enzyme dispersion, pH and temperature control, and efficient hydrogen and metabolite removal in continuous operation. To address these barriers to process intensification, we implemented novel reactor and process designs for high-solids lignocellulosic biomass fermentations using the C. thermocellum KJC19-9 strain, genetically engineered for co-utilization of cellulose and hemicellulose sugars (i.e., xylose). Via computational fluid dynamics (CFD) modeling and experimental validation, we achieved a >50% improvement in biohydrogen production with an improved anchor-type impeller morphology, coupled to a threefold reduction in agitation rate. To further reduce rheological constraints and accumulation of toxic metabolites, we then transitioned the process to sequencing fed-batch operation. The resulting process generated 24.87 L H 2 L −1 from 160 g L −1 of deacetylated and mechanically refined (DMR)-pretreated corn stover biomass over 16 days while solubilizing >95% of influent cellulose and hemicellulose, setting a new performance benchmark for continuous production of biohydrogen from lignocellulose.

08 HYDROGEN↗

DOE OSTI2021

End-to-End Jet Classification of Boosted Top Quarks with CMS Open Data

We describe a novel application of the end-to-end deep learning technique to the task of discriminating top quark-initiated jets from those originating from the hadronization of a light quark or a gluon. The end-to-end deep learning technique combines deep learning algorithms and low-level detector representation of the high-energy collision event. In this study, we use lowlevel detector information from the simulated CMS Open Data samples to construct the top jet classifiers. To optimize classifier performance we progressively add low-level information from the CMS tracking detector, including pixel detector reconstructed hits and impact parameters, and demonstrate the value of additional tracking information even when no new spatial structures are added. Relying only on calorimeter energy deposits and reconstructed pixel detector hits, the end-to-end classifier achieves a ROC-AUC score of 0.975±0.002 for the task of classifying boosted top quark jets. After adding derived track quantities, the classifier ROC-AUC score increases to 0.9824±0.0013, serving as the first performance benchmark for these CMS Open Data samples.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Boosting RDataFrame performance with transparent bulk event processing

RDataFrame is ROOT’s high-level interface for Python and C++ data analysis. Since it first became available, RDataFrame adoption has grown steadily and it is now poised to be a major component of analysis software pipelines for LHC Run 3 and beyond. Thanks to its design inspired by declarative programming principles, RDataFrame enables the development of highperformance, highly parallel analyses without requiring expert knowledge of multi-threading and I/O: user logic is expressed in terms of self-contained, small computation kernels tied together by a high-level API. This design completely decouples analysis logic from its actual execution, and opens several interesting avenues for workflow optimization. In particular, in this work we explore the benefits of moving internal data processing from an event-by-event to a bulkby-bulk loop. This refactoring dramatically reduces the framework’s runtime overheads; in collaboration with the I/O layer it improves data access patterns; it exposes information that optimizing compilers might use to auto-vectorize the invocation of user-defined computations; finally, while existing user-facing interfaces remain unaffected, it becomes possible to additionally offer interfaces that explicitly expose bulks of events, useful e.g. for the injection of GPU kernels into the analysis workflow. In order to inform similar future R&D, design challenges will be presented, as well as an investigation of the relevant timememory trade-off backed by novel performance benchmarks.

Guiraud, Enrico↗