Search NASA⌕ Search

SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Feasibility Analyses for the Microgrid of the Mountain in the Cordillera Central Region of Puerto Rico

Distributed energy resource (DER) development can benefit communities through improvement of access to reliable electricity and a resilient energy system. Many place-specific considerations must be accounted for when designing electrical systems with co-located generation and loads. This paper presents an overview of four studies focusing on different aspects for regional DER development in the Cordillera Central region of Puerto Rico, including a grid and load stability study with the introduction of solar energy generation, microgrid design based on the solar resource in the area, resilience considerations during power outage scenarios, and qualitative risk aspects for components in the microgrid. Additionally, a conceptual substation microgrid analysis is conducted using the Microgrid Design Toolkit (MDT) to evaluate trade-offs between cost and energy availability, providing insights into optimal design strategies. A microgrid resilience assessment is performed using the Resilient Nodal Cluster Analysis Tool (ReNCAT) to identify critical loads and evaluates their accessibility during outages, emphasizing the importance of community needs. Finally, a qualitative risk assessment utilizing Hazard and Operability Analysis (HAZOP) methods highlights potential hazards and mitigations for microgrid components, ensuring robust system design and operation.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Applying energy justice metrics to photovoltaic materials research

Abstract Achieving the energy transition sustainably requires addressing how new technologies may impact justice in the energy system. The Justice Underpinning Science and Technology Research (JUST-R) metrics framework was recently proposed to aid researchers in considering justice in early-stage research on energy technologies; however, case study evaluations of the framework revealed a desire from researchers to see metrics specialized to particular fields of study. Here, we refine metrics from the JUST-R framework to enhance its applicability to photovoltaic (PV) materials research. Metrics are reorganized to align with aspects of the research process (e.g., research team or source materials). For most metrics, baseline values are suggested to enable researchers to compare their project to competing technologies or standards at their institutions. These refinements are integrated into a tool to facilitate easier understanding and evaluation of justice considerations in early-stage PV research, which can serve as a template for evaluating other energy technologies. Graphical abstract

14 SOLAR ENERGY↗
DOE OSTI2024

Computationally evaluating high-yield metabolites for sustainable aviation fuel (SAF) using machine learning

The computational tool described in this report helps identify promising biological pathways that produce SAF platform molecules (either a drop-in SAF, or a precursor that can be easily converted to a drop-in SAF). The workflow the computational tool follows first identifies possible biological pathways from a user-defined metabolite. These pathways may, or may not lead to a SAF platform molecule, thus the second step involves insilico testing of the end product of each pathway to assess whether it is, or is not, a SAF platform molecule. The identification of biological pathways performed in the first step is facilitated by linking the metabolite to a biological reaction database. Pathways are found by identifying pathways in the reaction database that include the metabolite. The computational tool includes an alternative way to find pathways. The alternative way develops a Flux Balanced Analysis (FBA), and modifying the FBA to include reactions that transform the metabolite. These modifications serve as a basis for understanding, in a semi-quantitative way, if there is an increase in the flux to desirable products. The second step, in silico testing of the end-products, is accomplished by estimating key physical properties relevant to SAF. When good models are available, we have integrated those models into the computational tool. In a few instances, we have developed our own models. In all instances, we have validated the models against available measured data. Finally, we have evaluated the effectiveness of our computational tool by genetically engineering Rhodosporidium toruloides. Validation occurred without the use of a FBA, and further validation is required.

09 BIOMASS FUELS↗
DOE OSTI2024

Documentation for Python Automation in CYME for DER Hosting Capacity Analysis of Different Feeder Configurations

This file provides the documentation for several Python scripts that were developed by Sandia National Laboratories to enhance the automation and customization capabilities for performing various distribution system planning and analysis tasks in CYME. Specifically, these scripts (.py files detailed in Figure 1) enable the user to evaluate different distribution system configurations and the resulting impacts on hosting capacity results and other metrics. In general, these scripts—and the accompanying documentation—provide the foundation upon which future customized tools can be created. For example, the scripts show how to extract and modify parameters of various circuit components, set up and run analyses using built-in CYME tools (iteratively), and export reports for further evaluations and comparisons. Thus, the capabilities and syntaxes used in the scripts can be adapted and leveraged for countless other objectives.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Towards philosophical reasoning with agentic LLMs: Socratic method for scientific assistance

As large language models (LLMs) become central tools in science, improving their reasoning capabilities is critical for meaningful and trustworthy applications. We introduce a Socratic agent for scientific reasoning, implemented through a structured system prompt that guides LLMs via classical principles of inquiry. Unlike typical prompt engineering or retrieval-based methods, our approach leverages definition, analogy, hypothesis elimination, and other Socratic techniques to generate more coherent, critical, and domain-aware responses. We evaluate the agent across diverse scientific domains and benchmark it on the abstraction and reasoning corpus challenge dataset, achieving 97.15% under a fixed prompting protocol and without fine-tuning or external tools. Expert evaluation shows improved reasoning depth, clarity, and adaptability over conventional LLM outputs, suggesting that structured prompting rooted in philosophical reasoning can improve the scientific utility of language models.

LLM reasoning↗
DOE OSTI2024

Investigating Formal Methods Tools and their Applicability for Hardware Vulnerability Remediation

Formal methods use mathematical logic and equations to prove that a system or code is secure. In this poster, I examine existing formal methods tools and their application for projects working to remediate vulnerabilities in hardware and hardware description language. This poster is focused on the tools ReWire and AutoGenILA and I hope to evaluate their benefits and weaknesses with the intention of creating an internal report on the application and weaknesses of existing formal methods tools and identifying gaps for future formal methods tool creation.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2024

TCO Analysis Approach and Regional Analysis of dWPT for Class 8 Tractors

Dynamic Wireless Power Transfer (dWPT) is a method by which battery electric vehicles (BEVs) can charge their battery while traveling on the road without the need for a physical conductive connection to the power source. dWPT has been proposed as a strategy to enable a reduction in vehicle battery capacity and associated mass and cost. In this slide deck presented at the EVs@Scale Consortium - Wireless Power Transfer Pillar Deep-Dive Meeting on November 11th, 2023, NREL provides results from an evaluation of dWPT using data from Class 8 tractors driving in the Atlanta Metro Area. NREL selected data for archetypal days representing local, regional, and long-haul trips, defined according to trip length, that included travel on primary roadways. EVI-InMotion (Electric Vehicle Infrastructure - InMotion), a systems planning and optimization tool developed at NREL, was used to evaluate dWPT performance assuming dWPT charging on 120 road segments for a total roadway lane distance of 2,365 miles. The EVI-InMotion results and representative day drive cycles were analyzed with NREL's T3CO (Transportation Technology Total Cost of Ownership) tool to estimate the total cost of ownership (TCO) for scenarios comprising two model years - 2030 and 2040 - and two technology progress cases. TCO was calculated for diesel, fuel cell electric, BEVs with batteries sized assuming no dWPT capabilities, and 200kWh BEVs with dWPT installed. This analysis finds that en-route stationary charging frequency and downtime when not on electrified roadways are the main contributors to TCO for the dWPT vehicles and that these vehicles can achieve cost parity with FCEVs at low electricity costs. Based on the scenario assumptions used here, low electricity costs would further help the cost parity with diesel vehicles in regional and long-haul cases due to stationary fueling downtime. This presentation also concludes that key factors affecting the parity potential of dWPT-capable vehicles include more extensive dWPT road coverage, higher en-route charging power, less expensive power batteries, and higher hydrogen or diesel fuel costs.

ADVANCED PROPULSION SYSTEMS,ENERGY PLANNING, POLIC↗
DOE OSTI2024

Transportation and Systems Analysis Collaborations in Support of a Federal Consolidated Interim Storage Facility

The U.S. Department of Energy’s Integrated Waste Management (IWM) program under the Office of Nuclear Energy is planning for the future transportation, storage, and eventual disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant sites across the United States. To better enable informed decision-making regarding the back end of the nuclear fuel cycle, the IWM program has been sponsoring the development and application of system analysis tools capable of analyzing various options for managing SNF and HLW. With these tools, integrated waste management system (IWMS) architecture analyses are being conducted to support the future deployment of a comprehensive nuclear waste management system that considers all major back-end aspects of the nuclear fuel cycle (i.e., transportation, storage, and disposal). System analyses and assessments typically use these modeling and simulation tools to investigate implications of changes in various assumptions and parameters such as acceptance rates, receipt logic, facility capacities and capabilities, use of standardized canisters, start and stop dates of facilities, etc. The Next Generation System Analysis Model (NGSAM) is an agent-based simulation toolkit that is used for a system-level simulation and analysis focused on SNF management in the United States. An analyst using NGSAM has the ability to define several factors like the number of storage facilities, capacity at each facility, transportation schedules, shipment rates, and other conditions. NGSAM’s primary purpose is to provide a system analyst with capabilities to model the IWMS and gain insights into SNF and HLW management alternatives including the impact of system choices, associated cost estimates, and development of integrated yet flexible approaches. IWM is also developing the Stakeholder Tool for Assessing Radioactive Transportation (START). START is a web-based geospatial tool developed to provide visualization and initial evaluation of transportation options associated with future SNF and HLW shipment planning and operations. This includes characterizing safety, economic, and environmental conditions on and in proximity to shipment origins as well as along prospective transportation routes. Information from the START tool can be presented/shared as maps, graphics, geospatial files, and tabular form to enable easy data representation and export functionality. The system analysis, NGSAM, and START teams had been working closely for several years before formalizing this collaboration. START provides the SNF routing information for use in NGSAM. System analysts use the NGSAM tool to generate results (schedule, costs, infrastructure acquisitions, shipment rates, etc.). Subject-matter experts and system analysts work together to inform how NGSAM should model the waste management system. Specifically, this paper discusses the collaborations between the system analysis, NGSAM, and START teams and their accomplishments over the past year. Some examples of these efforts include calibrating and adding data to the START output files to meet NGSAM needs, gaining a better understanding of START data used in NGSAM, as well as how updates in START data could result in an improved NGSAM analysis. Detailed examples of various tasks that have been performed by the team will be discussed in the full paper. Continued efforts in this direction are expected in the coming years.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Simulating competition in the US bioeconomy to produce hard‐to‐electrify transportation fuels using limited biomass resources

This study presents a novel bioeconomy optimization framework, BiOpt, designed to address critical questions regarding the strategic use of limited US biomass resources for biofuel production. By integrating detailed techno-economic analyses, life cycle assessments, and resource assessment data, BiOpt optimizes resource distributions across competing technologies to maximize economic performance and/or minimize greenhouse gas emissions. Using feedstock scenarios from the 2023 Billion Ton Study, the analysis explores optimal biomass allocations across sustainable aviation fuel, diesel, and marine biofuel conversion pathways given varying production targets and policy incentives. Results demonstrate distinct feedstock preferences and pathway utilizations when prioritizing economic returns vs. emissions reductions. For instance, fats, oils, and greases were highly favored in cost-optimized scenarios, while low-carbon feedstocks such as wet waste dominated greenhouse gas-minimized strategies. The findings underscore the pivotal role of policy incentives and technological advances in shaping biofuel supply chains and provide actionable insights for scaling sustainable biofuel production to decarbonize hard-to-electrify sectors. This framework offers a robust tool for policymakers and stakeholders to evaluate biofuel strategies that balance energy output, economic viability, and environmental impact.

09 BIOMASS FUELS↗
DOE OSTI2026

Thermoelectric heating and cooling–integrated dishwasher with thermal energy storage

Household dishwashers must address several performance goals: maximize washing and drying performance, while minimizing cycle duration, energy consumption, and water consumption. This study develops and examines a novel thermoelectric heating and cooling (TEHC) system with thermal energy storage applied to a household dishwasher (DW), aiming to improve the energy and drying performance of a commercially-available dishwasher while maintaining its washing performance, water consumption, and cycle duration. Experimental testing conducted on the novel TEHC-DW system demonstrates an 8.7% reduction in total energy consumption, lowering the per-cycle usage to 0.952 kWh, and a 40% reduction in energy consumption for internal water heating. The novel TEHC-DW system also demonstrates better drying performance, shortening the drying time by 42% to reach the same remaining moisture content as a commercially-available system. In addition, a resistance-capacitance network model is developed that predicts total drying time, total energy consumption, and the highest temperature reached in the tub (53.4 °C). The model accuracy is validated with experimental data (within ±1 K), and the model functions as a design tool via a parametric study to evaluate the next-generation design and the effect of the number of thermoelectric modules and thermoelectric driving force (i.e., current). Overall, this study demonstrates the potential for TEHC technology to improve energy efficiency and drying performance in household dishwashers.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Heuristic algorithms for design of integrated monitoring of geologic carbon storage sites

Designs for Risk Evaluation and Management (DREAM) is a tool developed under the National Risk Assessment Partnership (NRAP) to enhance geologic carbon storage safety and efficiency. Using potential leakage scenarios generated externally by the users preferred history-matching approach, DREAM constructs ideal combinations of sensor locations in the right place at the right time to detect as many leaks as possible, detect them as early as possible, and minimize cost. This user-friendly tool, developed in Java, features a window-based GUI for input and a 3D visualization tool for viewing the domain space and optimized monitoring plans. DREAM's latest version accommodates real-world usage by allowing for joint optimization of wellbore point sensor placements and surface geophysics survey geometries, and by using more efficient multi-objective optimization algorithms. We show an example where, these two improvements combined allow us to support containment assurance and go from detecting 80–90 % of the potential CO 2 leakage to +99.7 %, a step-change improvement that can make the deciding difference in whether a site is suitable for geologic carbon storage. Though developed for geologic carbon storage, this tool would be equally applicable in many surface or offshore environmental monitoring projects.

58 GEOSCIENCES↗
DOE OSTI2025

In-Transit Data Transport Strategies for Coupled AI-Simulation Workflow Patterns

Coupled AI-Simulation workflows are becoming the major workloads for HPC facilities, and their increasing complexity necessitates new tools for performance analysis and prototyping of new in-situ workflows. We present SimAI-Bench, a tool designed to both prototype and evaluate these coupled workflows. In this paper, we use SimAI-Bench to benchmark the data transport performance of two common patterns on the Aurora supercomputer: a one-to-one workflow with co-located simulation and AI training instances, and a many-to-one workflow where a single AI model is trained from an ensemble of simulations. For the one-to-one pattern, our analysis shows that node-local and DragonHPC data staging strategies provide excellent performance compared Redis and Lustre file system. For the many-to-one pattern, we find that data transport becomes a dominant bottleneck as the ensemble size grows. Our evaluation reveals that file system is the optimal solution among the tested strategies for the many-to-one pattern.

Tummalapalli, Harikrishna [Argonne National Labora↗
DOE OSTI2024

Generator Scorecard

Code built on Archive Walker. The Generator Scorecard analyzes power grid measurements to automate the process of evaluating the performance of generators. The tool includes three aspects: frequency response, voltage response, and voltage schedule tracking.

Follum, Jim↗
DOE OSTI2026

AFUE Analysis Software Tool

The Annual Fuel Utilization Efficiency (AFUE) analysis of residential and light commercial furnaces follows ANSI/ASHRAE Standard 103-2017 (i.e., Method of Testing for Annual Fuel Utilization Efficiency of Residential Central Furnaces and Boilers) . The analysis is a complex, comprehensive method based on furnace configuration and specific components equipped, requiring detailed furnace testing and measurement data. For this reason, an AFUE Analysis Tool using Microsoft Excel enabled with Visual Basic for Applications (VBA) was developed with a user-friendly interface and comprehensive coverage. The tool consists of three worksheets: unit and configuration selection, geometry and measurement data input, and AFUE plus key results. This tool can be used to estimate the AFUE of both condensing and noncondensing furnaces with single-stage, two-stage, and step-modulating functions. The tool was validated with experimental data from Oak Ridge National Laboratory’s natural gas furnace projects that are commercially available. The results indicate the tool is reasonably accurate in the evaluation of a new R&D modified furnace unit.

Gao, Zhiming [Oak Ridge National Laboratory (ORNL)↗
DOE OSTI2026

Modeling and Calibration of Supplier Selection Problem in Freight Agent-Based Simulations

Freight transportation modeling often struggles with data limitations, especially in accurately representing complex supplier selection processes and their impact on network flows. This research addresses this critical gap by developing a large-scale, calibrated agent-based model for supplier selection, complemented by a probabilistic heuristic for international shipments. Our approach integrates trade relationships between industry sectors, transportation costs, and a supplier-rating model adapted from existing literature. The model’s core objective is to minimize the discrepancy between modeled and observed commodity flows while ensuring a close match to regional shipping distance distributions. Implemented and tested across four major U.S. metropolitan areas—Atlanta, Chicago, Dallas–Fort Worth, and Los Angeles—the model demonstrates high fidelity in replicating observed freight patterns. Key findings reveal consistent alignment with national shipping distance trends and highlight significant spatial variations in commodity trade assignments and demand across the study regions. This behaviorally informed and transport-sensitive framework is designed to approximate real-world decision making, providing a robust tool for policymakers and planners to evaluate targeted interventions, assess infrastructure investments, and enhance supply chain resilience in the face of disruptions.

Ismael, Abdelrahman (ORCID:0000000303712110)↗
DOE OSTI2024

Adoption Readiness Level Assessment of Redox Flow Batteries

Adoption readiness levels (ARLs) were developed by the Department of Energy’s Office of Technology Transitions (OTT) to holistically capture barriers to market adoption for a technology. The framework consists of 17 risk dimensions falling into 4 broad categories: Value Proposition, Market Acceptance, Resource Maturity, and License to Operate. OTT’s Commercial Adoption Readiness Assessment Tool (CARAT) can be used to evaluate a technology’s ARL. This work applies CARAT to redox flow batteries to evaluate the level of risk for this technology class across the 17 dimensions. Redox flow batteries were found to bear 1-2 high risk dimensions, 10-11 medium risk dimensions, 5 low risk dimensions, and scored an overall low readiness on the CARAT scoring scale (ranges reflect variation with flow battery chemistry). Herein, we describe the factors and evaluation across the dimensions leading to this score for redox flow batteries.

25 ENERGY STORAGE↗
DOE OSTI2024

Optimizing Carbon Capture, Transport, and Storage: Overcoming Challenges with Machine Learning and Cost-Benefit Analysis

Carbon Capture, Utilization, and Storage (CCUS) is a critical strategy for reducing CO₂ emissions and mitigating climate change. However, its widespread deployment faces numerous challenges across the capture, transport, and storage phases. These challenges include the technical complexity of predicting subsurface behaviors during CO₂ injection, ensuring long-term storage integrity, optimizing transportation networks, and balancing the economic and environmental trade-offs. Addressing these issues requires an integrated approach combining advanced subsurface modeling with system-level analyses to assess costs, risks, and benefits. This presentation provides an overview of studies conducted by the National Energy Technology Laboratory (NETL) to tackle these challenges. NETL’s efforts encompass cutting-edge research in subsurface fluid behavior machine learning predictions, alongside the development of innovative tools for system optimization and economic evaluation. By bridging technical expertise and strategic analysis, NETL aims to advance the deployment of CCUS technologies to support global decarbonization efforts. Presented at the Carnegie Mellon University CEE IESS Student Seminar October 4, 2024.

Shih, Chung Yan↗