Search NASA⌕ Search

SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

PCA -BASED COMPRESSOR HARDWARE DESIGN GENERATOR IN CHISEL

SF-25-077 This repository includes a hardware generator written in Chisel that generates lossy compression hardware designs based on principal component analysis (PCA), along with a flexible testbench. It also includes a Python tool for evaluating the accuracy loss of integer quantization.

Kazutomo, Yoshi [Argonne National Laboratory (ANL)↗

Autonomie Simulation Datasets in Support of U.S. DOT-NHTSA Advanced Vehicle Technology Research

Understanding how new vehicle technologies affect fuel economy and energy use is critical to the regulatory work performed by the U.S. Department of Transportation’s National Highway Traffic Safety Administration (NHTSA), which sets Corporate Average Fuel Economy (CAFE) standards under the Energy Policy and Conservation Act of 1975. In order to support this work, Argonne National Laboratory uses Autonomie, a full-vehicle simulation tool, to evaluate advanced powertrain architectures and their effects on vehicle energy consumption and performance. A wide range of vehicle classes has been assessed (i.e., internal combustion engine vehicles, hybrid electric vehicles, plug-in hybrid electric vehicles, battery-electric vehicles, and fuel cell electric vehicles), as well as the effects of various technology improvements such as lightweighting, aerodynamic refinements, and low-rolling-resistance tires. Simulations have been run across multiple drive cycles to capture fuel and electricity use under realistic operating conditions. The resulting datasets include detailed vehicle-level results, model assumptions, and validation reports, all of which have been made publicly available through NHTSA in support of the 2023 notice of proposed rulemaking covering light-duty vehicles for model years 2027 to 2035. These data are critical to stakeholders working in fuel economy regulation, vehicle technology assessment, and energy policy analysis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

eLog analysis for accelerators: status and future outlook

This work demonstrates electronic logbook (eLog) systems leveraging modern AI-driven information retrieval capabilities at the accelerator facilities of Fermilab, Jefferson Lab, Lawrence Berkeley National Laboratory (LBNL), SLAC National Accelerator Laboratory. We evaluate contemporary tools and methodologies for information retrieval with Retrieval Augmented Generation (RAGs), focusing on operational insights and integration with existing accelerator control systems. The study addresses challenges and proposes solutions for state-of-the-art eLog analysis through practical implementations, demonstrating applications and limitations. We present a framework for enhancing accelerator facility operations through improved information accessibility and knowledge management, which could potentially lead to more efficient operations.

Accelerator Physics↗

Advancing the Understanding of Manufacturing Tools for Hardware Security

This project’s goal was to explore new methods and tools to evaluate the focused ion beam (FIB) effect on active electrical devices, which is becoming increasingly challenged by the continual decrease in transistor geometry. Novel hole transfer methods leveraging FIB patterning were demonstrated utilizing selective area atomic layer deposition (ALD) and metal assisted chemical etching. A FIB damage electrical tester device was fabricated, and the effects of FIB beams were characterized by examining change in performance of damaged transistors. Detailed characterization of end-of-range damage for common FIB ions were correlated to modeling methods. Finally, undamaged and damaged devices were simulated by Charon to begin understanding the FIB effects on active devices. This test platform along with modeling methods give a powerful way to assess FIB damage in materials and devices, and with more development can help establish methods to predict FIB damage effects on electrical devices.

42 ENGINEERING↗

Evaluating a Commercial Dynamic Line Rating Software with the National PMU Dataset

To accelerate the development of data-driven applications for power systems, the Department of Energy (DOE) supported the collection and curation of a synchrophasor dataset spanning two years of observations from transmission utilities across the US. This National PMU Dataset (NPDS) was anonymized and distributed to awardees of a DOE research grant under nondisclosure agreements (NDAs) but has also been retained at PNNL to enable further research. Agreements with data contributors prevent the data from being shared outside the organization. However, establishing a blind research validation methodology is envisioned to maximize the value proposition of the NPDS. In this validation strategy, researchers may share algorithms/software (potentially as executables to protect intellectual property) with PNNL, and PNNL will share feedback about the software’s performance on subsets of the NPDS. Such a blind methodology ensures that sensitive information about critical infrastructure remains protected, but the value of the NPDS can be extended to research beyond PNNL. Through iterative feedback, the algorithms may be tweaked to address real-world artifacts. As the NPDS data is temporally and geographically diverse, it may capture features absent in smaller datasets used during the development of the algorithm under test. This report presents lessons learned from applying the blind validation methodology to LineID™, a synchrophasor-based dynamic line rating software developed by Topolonet Corporation. Improvements made to the software through iterative feedback, limitations of the validation methodology, as well as how the limitations of the NPDS affected the evaluation process are discussed. Observations indicate that the proposed validation methodology can be valuable for evaluating other tools in the future.

97 MATHEMATICS AND COMPUTING↗

Architecting the Grid Edge: Ensuring Reliability and Resilience

Changes in technology, customer expectations, and business and regulatory environments are rapidly evolving causing fundamental changes in the nation’s electrical infrastructure. Nowhere is this more apparent that at the “grid edge”, where there is an increasing number of new devices and systems, as well as complex new interactions between them. This is leading to the traditional relationship between the end-use customers and their utilities being expanded by an increasing number of stakeholders, each with their own operational and financial objectives, governed by regulatory policy. While there are concerns about the rapidly increasing complexity negatively impacting reliable and resilience of the electrical infrastructure, these changes are also bringing new resources and opportunities that hold great potential if they can be properly coordinated. This white paper outlines the considerations for the coordination of multi-stakeholder objectives with electric utility requirements using the concept of grid services. Describing a framework that enables new stakeholders to achieve their local technical and economic objectives, while simultaneously delivering operational benefits to the electrical infrastructure. The concepts of grid architecture are presented as a tool to evaluate how stakeholders might participate in, and benefit from, services, and how utilities can make decision on the reliance on services to ensure reliability and resilience, translating abstract concepts into actionable information for utilities and grid edge stakeholders. The end result of proper coordination, informed by grid architecture, will be a range of new devices and systems, operated by new stakeholders, achieving their local objectives while also increasing the reliability, resilience, security, and affordability of the nation’s critical electrical infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Architecting the Grid Edge: Ensuring Reliability and Resilience

Changes in technology, customer expectations, and business and regulatory environments are rapidly evolving causing fundamental changes in the nation’s electrical infrastructure. Nowhere is this more apparent that at the “grid edge”, where there is an increasing number of new devices and systems, as well as complex new interactions between them. This is leading to the traditional relationship between the end-use customers and their utilities being expanded by an increasing number of stakeholders, each with their own operational and financial objectives, governed by regulatory policy. While there are concerns about the rapidly increasing complexity negatively impacting reliable and resilience of the electrical infrastructure, these changes are also bringing new resources and opportunities that hold great potential if they can be properly coordinated. This white paper outlines the considerations for the coordination of multi-stakeholder objectives with electric utility requirements using the concept of grid services. Describing a framework that enables new stakeholders to achieve their local technical and economic objectives, while simultaneously delivering operational benefits to the electrical infrastructure. The concepts of grid architecture are presented as a tool to evaluate how stakeholders might participate in, and benefit from, services, and how utilities can make decision on the reliance on services to ensure reliability and resilience, translating abstract concepts into actionable information for utilities and grid edge stakeholders. The end result of proper coordination, informed by grid architecture, will be a range of new devices and systems, operated by new stakeholders, achieving their local objectives while also increasing the reliability, resilience, security, and affordability of the nation’s critical electrical infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗

High-Quality Factor Microwave Resonators using Rhenium

Coplanar waveguide resonators are a perfect tool to evaluate the losses induced by defects and interfaces in superconducting devices. Even if niobium is the most used superconductor for resonators and qubits, its native oxide at the metal-air (MA) interface limits the device results. Tantalum has recently significantly improved qubit performances due to a thinner and less disordered oxide layer compared to Nb. To further improve the MA interface, we used rhenium, a superconducting material with 1.7 K critical temperature resistant to oxidation: it forms an oxide layer thinner than 1 nm. In this study, we will present a thorough investigation of rhenium CPW resonator measurements with internal quality factors at the single photon level exceeding 2 million. The devices have been fabricated on a sapphire substrate while the processing parameters have been varying and optimized. The measurements have been performed as a function of power and temperature to disentangle different sources of losses, such as two-level systems (TLS) and quasi-particles. A peculiar TLS temperature dependence has been measured and analyzed. In this work, we also vary the participation ratio of the devices to extract the losses introduced by the involved interfaces with higher fidelity and precision. We carried on a deep material characterization effort to link the results to the differences in the fabrication steps, and we will present material characterization measurements performed via AFM, ToF-SIMS, XPS, and TEM.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

eLog Analysis for Accelerators: Status and Future Outlook

This work demonstrates electronic logbook (eLog) systems leveraging modern AI-driven information retrieval capabilities at the accelerator facilities of Fermilab, Jefferson Lab, Lawrence Berkeley National Laboratory (LBNL), SLAC National Accelerator Laboratory. We evaluate contemporary tools and methodologies for information retrieval with Retrieval Augmented Generation (RAGs), focusing on operational insights and integration with existing accelerator control systems. The study addresses challenges and proposes solutions for state-of-the-art eLog analysis through practical implementations, demonstrating applications and limitations. We present a framework for enhancing accelerator facility operations through improved information accessibility and knowledge management, which could potentially lead to more efficient operations.

Hellert, Thorsten [LBNL, ALS]↗

Projected Operational Energy Life Cycle Data Development: 2025 Update

This report documents the data sources and methods used to develop the energy life cycle data for use by the National Institute of Standards and Technology (NIST) Engineering Laboratory (EL) to be used for the development of measurement science and incorporation into decision-support tools for evaluating building and facility capital investments. The data are posted separately under DOI 10.18141/2575194.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Machine Learning Based Metamodel for Faster Life Cycle Assessment of Large Portfolio of Buildings

Managing a large portfolio of buildings involves decisions on reuse, retrofit, renovation, rehabilitation, and new construction, influenced by trade-offs between performance metrics such as cost, time, and operational flexibility over the building's life cycle. Traditional life cycle assessment tools for evaluating these metrics can be labor- and compute-intensive, requiring extensive data and modeling for each building. Metamodels (or surrogate models) using machine learning have been explored as faster alternatives, but training these models has been hindered by the limited availability of comprehensive data on key life cycle metrics. Recent advancements in machine learning, particularly deep learning techniques like zero-shot and few-shot learning, allow models to learn from sparse or limited data. We propose a machine learning-based metamodel that leverages these techniques for rapid estimation of key building life cycle metrics. This presentation will cover the model architecture, data collection, training, and validation processes, along with an ongoing case study applied to a large portfolio of buildings. We will discuss the model's performance in terms of accuracy, compute time, limitations, and its potential for expanding to additional life cycle metrics. This data-driven approach offers a promising direction for the rapid evaluation of large building portfolios.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Radiological Safety Analysis Computer (RSAC) Program Version 7.4 Users’ Manual

The Radiological Safety Analysis Computer (RSAC) Program Version 7.4 (RSAC-7) is the newest version of the RSAC legacy code. RSAC-7 calculates the consequences of a release of radionuclides to the atmosphere. Users generates a fission product inventory from either reactor operating history or a nuclear criticality event. RSAC-7 models the effects of high-efficiency particulate air filters or other cleanup systems and calculates the decay and ingrowth during transport through processes, facilities, and the environment. Doses are calculated for inhalation, air immersion, ground surface, ingestion, and cloud gamma pathways. RSAC-7 is used as a tool to evaluate accident conditions in emergency response scenarios, radiological sabotage events, and safety basis accident consequences. This users’ manual contains the mathematical models and operating instructions for RSAC-7. Instructions, screens, and examples are provided to guide the user through the functions provided by RSAC-7. This program is designed for users who are familiar with radiological dose assessment methods.

73 - NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Control Room of the Future Testbed Workshop – After-Action Report

The U.S. Department of Energy’s Office of Electricity is supporting a one-year, multi-laboratory effort to define the needs and requirements for a Control Room of the Future testbed, or CROFT. The effort responds to increasing grid complexity driven by large new loads, dynamic generation resources, and the growing adoption of advanced technologies and tools, including artificial intelligence (AI) and machine learning (ML). To support safe, secure, and effective grid modernization, CROFT will focus on how emerging technologies and tools can be rigorously evaluated in realistic operational settings, with attention to human-machine interaction, cognitive load, and workforce readiness. The project team includes Argonne National Laboratory, Idaho National Laboratory, National Laboratory of the Rockies, and Pacific Northwest National Laboratory. As part of the scoping effort, the team conducted two industry-focused workshops: one at DTECH on February 5, 2026, informed by prior industry interviews, and a second on May 4, 2026, adjacent to IEEE T&D. These engagements brought together utilities, vendors, consultants, national laboratories, academia, and government stakeholders to identify and prioritize use cases, barriers, validation needs, data-sharing constraints, and near- and longer-term requirements. This feedback will directly inform CROFT’s architecture and research focus areas, ensuring the testbed is grounded in real-world operational needs and designed to evaluate emerging technologies and tools in realistic control-room environments.

artificial intelligence↗

Learning from Arctic Microgrids: Cost and Resiliency Projections for Renewable Energy Expansion with Hydrogen and Battery Storage

Electricity in rural Alaska is provided by more than 200 standalone microgrid systems powered predominantly by diesel generators. Incorporating renewable energy generation and storage to these systems can reduce their reliance on costly imported fuel and improve sustainability; however, uncertainty remains about optimal grid architectures to minimize cost, including how and when to incorporate long-duration energy storage. This study implements a novel, multi-pronged approach to assess the techno-economic feasibility of future energy pathways in the community of Kotzebue, which has already successfully deployed solar photovoltaics, wind turbines, and battery storage systems. Using real community load, resource, and generation data, we develop a series of comparison models using the HOMER Pro software tool to evaluate microgrid architectures to meet over 90% of the annual community electricity demand with renewable generation, considering both battery and hydrogen energy storage. We find that near-term planned capacity expansions in the community could enable over 50% renewable generation and reduce the total cost of energy. Additional build-outs to reach 75% renewable generation are shown to be competitive with current costs, but further capacity expansion is not currently economical. We additionally include a cost sensitivity analysis and a storage capacity sizing assessment that suggest hydrogen storage may be economically viable if battery costs increase, but large-scale seasonal storage via hydrogen is currently unlikely to be cost-effective nor practical for the region considered. While these findings are based on data and community priorities in Kotzebue, we expect this approach to be relevant to many communities in the Arctic and Sub-Arctic regions working to improve energy reliability, sustainability, and security.

25 ENERGY STORAGE↗

eLog analysis for accelerators: status and future outlook

This work demonstrates electronic logbook (eLog) systems leveraging modern AI-driven information retrieval capabilities at the accelerator facilities of Fermilab, Jefferson Lab, Lawrence Berkeley National Laboratory (LBNL), SLAC National Accelerator Laboratory. We evaluate contemporary tools and methodologies for information retrieval with Retrieval Augmented Generation (RAGs), focusing on operational insights and integration with existing accelerator control systems. The study addresses challenges and proposes solutions for state-of-the-art eLog analysis through practical implementations, demonstrating applications and limitations. We present a framework for enhancing accelerator facility operations through improved information accessibility and knowledge management, which could potentially lead to more efficient operations.

Sulc, A. [LBL, Berkeley]↗

Global Geo-processed Data of Aquifer Properties by 0.5° Grid, Country and Water Basins

This repository of global hydrogeologic datasets contains aquifer properties on 0.5° scale, including depth to groundwater (Fan et al., 2013), aquifer thickness (de Graaf et al., 2015), WHYMap aquifer classes (Richts et al., 2011), recharge (Döll and Fiedler, 2008; Gleeson et al., 2016), lakes (Messager et al., 2016), porosity and permeability (Gleeson et al., 2014), digitized and geo-processed from their respective sources. Globally gridded aquifer properties could be used independently to estimate global groundwater availability or used as critical inputs to the superwell model to simulate groundwater extraction and provide estimates of pumped volumes and unit costs under user-specific scenarios. Key resources related to this data are: Niazi, H., Ferencz, S. B., Graham, N. T., Yoon, J., Wild, T. B., Hejazi, M., Watson, D. J., & Vernon, C. R. (2025). Long-term hydro-economic analysis tool for evaluating global groundwater cost and supply: Superwell v1.1. Geoscientific Model Development, 18(5), 1737-1767. https://doi.org/10.5194/gmd-18-1737-2025 superwell model repository which uses this data to simulate groundwater extraction and provides estimates of the global extractable volumes and unit-costs ($/km3) of accessible groundwater production under user-specified extraction scenarios. Repository Overview Main output: aquifer_properties_rec.csv contains all processed outputs, including aquifer properties like porosity, permeability, recharge, lake areas, aquifer thickness, and depth to groundwater. shapefiles.zip: contains all digitized GIS databases and shapefile for all aquifer properties prep_inputs.R and prep_inputs_recharge_lakes.R: R scripts that process the shapefiles to produce the aquifer_properties_rec.csv file plot_inputs.R: R script for plotting the maps and conducting preliminary analysis on the available groundwater volume basin_to_country_mapping.csv, basin_country_region_mapping.csv and continent_county_mapping.csv provide the mapping between continents, 32 energy-economic macro regions, countries, and water basins for post-processing aquifer_properties_rec.csv Maps: Each map visualizes the spatial distribution of one of the aquifer properties across the globe map_in_Porosity.png map_in_Permeability.png map_in_Aquifer_thickness.png map_in_Depth_to_water.png map_in_Recharge.png map_in_Grid_area_km.png map_in_Lake_area_km.png map_in_WHYClass.png Sample inputs sample_inputs.py: this script samples inputs from the aquifer_properties_rec dataset, ensuring the sampled and original inputs maintain the same distributions sampled_data_100.csv contains 100 sampled data points and sampled_data_100.png compares their distributions Dataset Overview The main outputs are consolidated in a comprehensive aquifer_properties_rec.csv file and include the following fields: GridCellID: Unique identifier for each (roughly 0.5°) grid cell Continent: Continent name Country: Country name GCAM_basin_ID: Identifier for GCAM hydrologic basin Basin_long_name: Full name of the basin WHYClass: Hydrogeologic classification based on WHYMap aquifer classes (Richts et al., 2011) Porosity: Soil porosity (%) (Gleeson et al., 2014) Permeability: Soil permeability (in square meters; Gleeson et al., 2014) Aquifer_thickness: Thickness of the aquifer (in meters; de Graaf et al., 2015) Depth_to_water: Depth to groundwater (in meters; Fan et al., 2013) Recharge: long-term annual averaged recharge rates (in m/yr; Döll and Fiedler, 2008; Gleeson et al., 2016) Grid_area: Area of the grid cell (in square meters) Lakes_area: Area of inland lakes (in square meters; Messager et al., 2016) Key References The datasets are digitized versions of global hydrogeologic properties from the following key literature sources: Depth to Groundwater: Fan, Y., Li, H., & Miguez-Macho, G. (2013). Global Patterns of Groundwater Table Depth. Science, 339(6122), 940-943. https://doi.org/10.1126/science.1229881 Aquifer Thickness: de Graaf, I. E. M., Sutanudjaja, E. H., van Beek, L. P. H., & Bierkens, M. F. P. (2015). A high-resolution global-scale groundwater model. Hydrol. Earth Syst. Sci., 19(2), 823-837. https://doi.org/10.5194/hess-19-823-2015 Porosity and Permeability: Gleeson, T., Moosdorf, N., Hartmann, J., & van Beek, L. P. H. (2014). A glimpse beneath earth's surface: GLobal HYdrogeology MaPS (GLHYMPS) of permeability and porosity. Geophysical Research Letters, 41(11), 3891-3898. https://doi.org/10.1002/2014GL059856 Aquifer classes: Richts, A., Struckmeier, W. F., & Zaepke, M. (2011). WHYMAP and the Groundwater Resources Map of the World 1:25,000,000. In J. A. A. Jones (Ed.), Sustaining Groundwater Resources: A Critical Element in the Global Water Crisis (pp. 159-173). Springer Netherlands. https://doi.org/10.1007/978-90-481-3426-7_10 Recharge: Döll, P., & Fiedler, K. (2008). Global-scale modeling of groundwater recharge. Hydrol. Earth Syst. Sci., 12(3), 863-885. https://doi.org/10.5194/hess-12-863-2008; Gleeson, T., Befus, K. M., Jasechko, S., Luijendijk, E., & Cardenas, M. B. (2016). The global volume and distribution of modern groundwater. Nature Geoscience, 9(2), 161-167. https://doi.org/10.1038/ngeo2590 Inland Lakes: Messager, M. L., Lehner, B., Grill, G., Nedeva, I., & Schmitt, O. (2016). Estimating the volume and age of water stored in global lakes using a geo-statistical approach. Nature Communications, 7(1), 13603. https://doi.org/10.1038/ncomms13603 Cite as Niazi, H., Watson, D., Hejazi, M., Yonkofski, C., Ferencz, S., Vernon, C., Graham, N., Wild, T., & Yoon, J. (2024). Global Geo-processed Data of Aquifer Properties by 0.5° Grid, Country and Water Basins. MultiSector Dynamics-Living, Intuitive, Value-adding, Environment. https://doi.org/10.57931/2484226 Contact Reach out to Hassan Niazi or open an issue in the superwell repository for questions or suggestions.

aquifer thickness↗

Repowering: The Other Side of the Reliability Coin

Extreme weather, cracked backsheets, severe PID, poorly built modules, and installation flaws - all can compromise a solar plant's health and force repowering long before end of life. With more than 70% of U.S. PV capacity less than seven years old, the fleet is young, but its rapid expansion has introduced new materials and system designs that are still being tested under real-world conditions. As a result, reliability - not economics - is what most often drives repowering decisions. Repowering is frequently assumed to be an economically motivated choice, but our work shows that reliability concerns are the real trigger. Drawing from industry interviews, case studies, and modeling, we highlight the physical, electrical, and policy barriers owners face when deciding whether to repair, repower, or decommission. At the same time, repowering can create opportunities: renewed interconnection periods, improved energy yields, and strategic upgrades to extend system value. We present a quantitative framework using NLR's System Advisor Model (SAM) and PV in Circular Economy (PV ICE) tool to evaluate trade-offs across financial, material, and energy impacts. These findings provide practical guidance for navigating the realities of repowering today and underscore the critical role of reliability in shaping the future performance and sustainability of the PV fleet.

14 SOLAR ENERGY↗