Search NASA⌕ Search

SEARCH · Search NASA

Results for “benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Recent Advances in Immobilizing and Benchmarking Molecular Catalysts for Artificial Photosynthesis

Transition metal complexes have been widely used as catalysts or chromophores in artificial photosynthesis. Traditionally, they are employed in homogeneous settings. Despite their functional versatility and structural tunability, broad industrial applications of these catalysts are impeded by the limitations of homogeneous catalysis such as poor catalyst recyclability, solvent constraints (mostly organic solvents), and catalyst durability. Over the past few decades, researchers have developed various methods for molecular catalyst heterogenization to overcome these limitations. Here, in this review, we summarize recent developments in heterogenization strategies, with a focus on describing methods employed in the heterogenization process and their effects on catalytic performances. Alongside the in-depth discussion of heterogenization strategies, this review aims to provide a concise overview of the key metrics associated with heterogenized systems. We hope this review will aid researchers who are new to this research field in gaining a better understanding.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

A Practical Probabilistic Benchmark for AI Weather Models

Since the weather is chaotic, it is necessary to forecast an ensemble of future states. Recently, multiple AI weather models have emerged claiming breakthroughs in deterministic skill. Unfortunately, it is hard to fairly compare ensembles of AI forecasts because variations in ensembling methodology become confounding and the baseline data volume is immense. We address this by scoring lagged initial condition ensembles—whereby an ensemble can be constructed from a library of deterministic hindcasts. This allows the first parameter‐free intercomparison of leading AI weather models' probabilistic skill against an operational baseline. Lagged ensembles of the two leading AI weather models, GraphCast and Pangu, perform similarly even though the former outperforms the latter in deterministic scoring. These results are elaborated upon by sensitivity tests showing that commonly used multiple time‐step loss functions damage ensemble calibration.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Benchmarking of X‐Ray Fluorescence Microscopy with Ion Beam Implanted Samples Showing Detection Sensitivity of Hundreds of Atoms

Abstract Single impurities in insulators are now often used for quantum sensors and single photon sources, while nanoscale semiconductor doping features are being constructed for electrical contacts in quantum technology devices, implying that new methods for sensitive, non‐destructive imaging of single‐ or few‐atom structures are needed. X‐ray fluorescence (XRF) can provide nanoscale imaging with chemical specificity, and features comprising as few as 100 000 atoms have been detected without any need for specialized or destructive sample preparation. Presently, the ultimate limits of sensitivity of XRF are unknown – here, gallium dopants in silicon are investigated using a high brilliance, synchrotron source collimated to a small spot. It is demonstrated that with a single‐pixel integration time of 1 s, the sensitivity is sufficient to identify a single isolated feature of only 3000 Ga impurities (a mass of just 350 zg). With increased integration (25 s), 650 impurities can be detected. The results are quantified using a calibration sample consisting of precisely controlled numbers of implanted atoms in nanometer‐sized structures. The results show that such features can now be mapped quantitatively when calibration samples are used, and suggest that, in the near future, planned upgrades to XRF facilities might achieve single‐atom sensitivity.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Benchmarking thermal energy storage cost for industrial process heat

Process heat accounts for roughly half of industrial energy demand, and currently 95% of process heat is derived from the combustion of natural gas, oil, and coal. Electrification of industrial heating could be an alternative, potentially expanding locations suitable for manufacturing; however, industrial facility owners may desire energy storage to stabilize energy costs. In this work, the economic benefits of pairing thermal storage with electrified process heat to reduce the average price paid for energy are analyzed. Cost savings focus on energy arbitrage, or leveraging flexible energy pricing schemes, alone. The cost of natural gas combustion across decades (2019-2060) is compared to the costs of electricity and thermal energy storage in four United States Independent System Operator (ISO) regions. Systems installed today may not yield positive net present value (NPV) compared to the use of natural gas. However, using estimated electricity prices, systems installed in 2030 using arbitrage alone could be profitable when compared to natural gas in some regions of the U.S. Furthermore, if capital expenditures could be reduced by 50% for sensible thermal storage systems by 2030, profitable systems are found across all regions. This implies that electrification of industrial process heat, when paired with inexpensive thermal energy storage systems, could be less expensive than brownfield natural gas systems, using arbitrage as the only source of revenue and without a dependency on any future policy drivers such as pricing externalities that could further incentivize the electrification of industrial process heat.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Roadmap and Benchmarking: Privacy in Federated Load Forecasting

Data-driven techniques for energy demand forecasting continue to emerge with promising impacts on distribution grid planning. However, the development of robust and generalizable machine learning models requires that representative high quality training data are available. Distributed energy resources have begun to embed intelligence, gathering large amounts of data on customer demand, behavior, and household devices that are connected to the grid. Though utilities aggregate meter-level demand data for load shaping, demand response, outage management, reliability planning, and billing applications, there lies an inherent privacy concern in sharing consumption data that may identify individual consumer behavioral patterns. Hence, while sharing the data is crucial, the private sensitive customer data must be safeguarded from being exposed or manipulated. In this study, we propose a roadmap for implementing a based privacy preserving framework to support the advancement of data-driven analytics in data-sensitive distributed energy resources environments. The roadmap incorporates federated learning–a distributed training framework, differential privacy–a statistical framework that provides guarantees to safeguard the leakage of sensitive data, secure multiparty computation and homomorphic encryption– techniques for encrypting model gradients and applying secure aggregation on the server. Moreover, we perform baseline experiments on the federated short-term load forecasting (STLF) task using open-source residential load profile datasets, offering insights into the challenges of integrating differential privacy into federated learning.

Abebe, Waqwoya [Oak Ridge National Laboratory (ORN↗
DOE OSTI2026

Forest aboveground biomass estimation through integration of sentinel-2 and PALSAR-2 time series: assessing models trained on GEDI and field inventory benchmarks

Accurate and spatially explicit forest Aboveground Biomass (AGB) mapping through remote sensing is critical for quantifying terrestrial carbon stocks and informing effective forest management strategies. However, AGB estimation in dense forests with complex terrain remains challenging due to satellite sensor signal saturation problem (saturation issue occurs in high biomass forests), structural complexity, and limited ground truth for calibration. This study presents a novel framework that integrates multi-temporal Sentinel-2 optical imagery, ALOS PALSAR-2 Synthetic Aperture Radar (SAR) data, and topographic variables with explainable Machine Learning to map AGB across mountainous forests within subtropical and temperate oceanic climate zones of Mexico. We evaluate the effects of temporal granularity and sensor synergy by comparing multiple temporal inputs and sensor configurations (Sentinel-2, PALSAR-2, and their fusion), and assess model performance using two reference datasets: NASA GEDI LiDAR-derived biomass and Mexico’s National Forest and Soil Inventory (INFyS). Our results showed that models trained on INFyS consistently outperformed those trained on GEDI, highlighting limitations in GEDI’s reliability in biomass estimates within this study region. Furthermore, the integration of Sentinel-2 and PALSAR-2 provided improved predictions compared to single-sensor models, particularly when combined with temporally explicit yearly statistics. The best-performing model, which was trained on INFyS data, and considered both Sentinel-2 and PALSAR-2 yearly statistics, as well as topographic variables, achieved an R2 of 0.64, RMSE of 51.10 Mg/ha, and relative RMSE (rRMSE) of 58.69%. Explainable ML analysis identified Sentinel-2 spectral indices and topographic features as key predictors, while PALSAR-2 metrics provided complementary information, partially mitigating saturation effects in high-biomass areas. Specifically, integrating both sensors substantially improved AGB estimation in high biomass forest (≥200 Mg/ha), yielding 98% gains over optical-only model, with resulting estimates exceeding GEDI L4B by 29% and ESA-CCI-BIOMASS by 174%. Terrain-stratified analysis indicated close agreement with GEDI in low-slope areas, with increasing divergence as slope steepness increased, while estimates remained consistently higher than ESA-CCI-BIOMASS across all slope classes. The proposed approach advances multi-sensor fusion and temporal feature engineering for AGB mapping using open-access satellite datasets, providing a scalable and reproducible framework for annual biomass monitoring in topographically complex mountainous forests. The resulting 25 m resolution biomass product has the potential to provide spatially detailed information for forest monitoring and may support applications in carbon accounting and forest management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Fundamental benchmarking of the discharge properties of negative electrodes in lead acid batteries

The unprecedented scale of energy storage deployment needed to allow high penetration of intermittent renewable energy sources into the electrical grid places significant economic cost and performance targets on battery technologies. Lead batteries, owing to their highly abundant and inexpensive raw materials, can be considered an important solution to grid storage as long as they achieve high material utilization, fast recharge rates, and long cycle life. To address the limitations in material utilization, we need to revisit the electrochemical processes during the discharge step and answer the following question: what are the fundamental limits of the discharge reaction? In this work we discuss how well-defined lead metal surfaces with nanometer scale roughness allow us to resolve the accessible discharge capacity for both faradaic and non-faradaic processes as a function of electrolyte concentration and in the presence of traditional additives. The direct connection between PbSO 4 layer morphology and discharge rates gives us important insights on the mechanism of discharge as related to the dissolution and passivation events. In conclusion, this work sets the stage for reimagining the design of lead batteries with implications to grid storage applications.

25 ENERGY STORAGE↗
DOE OSTI2025

Benchmarking optimization methods for materials research: Gradient descent and Bayesian optimization for lithium-ion battery aging diagnostics

Accurate and efficient parameter estimation is essential for battery diagnostics and aging analysis. Here, in this study, we compare two optimization-based approaches—gradient descent and Bayesian optimization—for extracting parameters from differential voltage analysis in lithium-ion batteries. While these techniques are widely used, their relative strengths and limitations for this application are not well understood. The study evaluates the trade-offs between these methods in terms of result quality, computational cost, and reliability within this specific application. The diagnostic results from our battery data suggest adopting gradient descent as an initial method for rapid and efficient analysis, while employing more stable optimization techniques, such as Bayesian optimization, as a verification step to mitigate potential instability. Comparing the two methods provides information on algorithmic choice, while inspiring further discussions on selecting appropriate techniques for specific research tasks.

Zhao, Ziqing [Boston Univ., MA (United States)] (O↗
DOE OSTI2026

Benchmarking state-of-the-art theory and empirical models of pionless neutrino-argon scattering in GENIE

Upcoming experiments need improved simulations of neutrino scattering. This work uses the popular GENIE event generator to test a variety of neutrino interaction models against recent MicroBooNE measurements of pionless charged-current interactions. The GENIE code can easily interchange model components, including nucleon form factor parameterizations, quasielastic cross-section calculations, treatments of the nuclear ground state and hadronic final-state interactions. Leveraging this software capability in comparisons with MicroBooNE data, the performance of some of GENIE’s most theoretically sophisticated model components is evaluated and contrasted with more empirically-driven alternatives.

Neutrino cross section↗
DOE OSTI2026

Worldwide benchmarking of cost-effective radiometers for direct and diffuse irradiance

Solar energy projects can benefit from direct normal irradiance (DNI) and diffuse horizontal irradiance (DHI) measurements during all project phases. Several commercial measurement systems for DNI and DHI are available. Sun trackers with pyranometers and pyrheliometers can provide highly accurate measurements but are often impractical in solar energy applications. For less expensive and more robust sensors, it is often unclear which accuracy can be expected under a project site's specific atmospheric conditions. We address this challenge through our dedicated experimental comparison of relevant sensor systems (rotating shadowband irradiometer [short RSI], Delta-T SPN1, EKO MS-90, PyranoCam, Sunto CaptPro, Kipp & Zonen CSD3) at up to six sites worldwide. The RSI systems (rRMSD 3 to 8.6%, DNI; 4.8 to 7.6%, DHI) and PyranoCam (rRMSD 2.6 to 5.2%, DNI; 4.4 to 5.8%, DHI) exhibit similar error metrics and are the most accurate systems in the test. Delta-T SPN1 and EKO MS-90 (rRMSD 6.8 to 15%, DNI; 10.6 to 20.1%, DHI) but especially Kipp & Zonen CSD3 and Sunto CaptPro show significant deviations (rRMSD 17.7 to 20%, DNI; 33 to 58%, DHI). We evaluate the influence of relevant atmospheric parameters on the sensors' accuracies by a rather unique measurement setup. MS-90's DNI errors depend on DNI itself, with overestimations for low reference DNI. The deviations of SPN1's DHI and DNI measurements increase sharply in situations with high circumsolar irradiance. Also CaptPro and CSD3's increased measurement errors are related to circumsolar irradiance. For RSI and PyranoCam, only moderate influences on the measurements are identified, indicating a general applicability of these instruments.

14 SOLAR ENERGY↗