Search NASA⌕ Search

SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Identifying impacts of contact tracing on HIV epidemiological inference from phylogenetic data

Abstract Robust sampling methods are foundational to inferences using phylogenies. Yet the impact of using contact tracing, a type of non-uniform sampling used in public health applications such as infectious disease outbreak investigations, has not been investigated in the molecular epidemiology field. To understand how contact tracing influences a recovered phylogeny, we developed a new simulation tool called SEEPS (Sequence Evolution and Epidemiological Process Simulator) that allows for the simulation of contact tracing and the resulting transmission tree, pathogen phylogeny, and corresponding virus genetic sequences. Importantly, SEEPS takes within-host evolution into account when generating pathogen phylogenies and sequences from transmission histories. Using SEEPS, we demonstrate that contact tracing can significantly impact the structure of the resulting tree, as described by popular tree statistics. Contact tracing generates phylogenies that are less balanced than the underlying transmission process, less representative of the larger epidemiological process, and affects the internal/external branch length ratios that characterize specific epidemiological scenarios. We also examined real data from a 2007–2008 Swedish HIV-1 outbreak and the broader 1998–2010 European HIV-1 epidemic to highlight the differences in contact tracing and expected phylogenies. Aided by SEEPS, we show that the data collection of the Swedish outbreak was strongly influenced by contact tracing even after downsampling, while the broader European Union epidemic showed little evidence of universal contact tracing, agreeing with the known epidemiological information about sampling and spread. Overall, our results highlight the importance of including possible non-uniform sampling schemes when examining phylogenetic trees. For that, SEEPS serves as a useful tool to evaluate such impacts, thereby facilitating better phylogenetic inferences of the characteristics of a disease outbreak. SEEPS is available at https://github.com/MolEvolEpid/SEEPS.

Virology↗
DOE OSTI2026

Unified Modeling Architecture for Load Management in Extreme Heat: The New York City Case

Integration of renewable resources to meet growing energy demand is becoming a global priority under decarbonization mandates. This study contributes to ongoing efforts on this key subject by assessing the feasibility of using coastal-urban renewable energy resources, namely, offshore wind and rooftop photovoltaic systems, to meet electricity demand of New York City during the intense recent heat wave period of June 2025. A unified modeling framework, based on the urbanized weather research and forecasting model, is used to simulate climate, renewable resources, and energy demand variables. Findings show significant energy load mismatch of approximately 1150 GWh over the month, between the demand and the combined renewable generation outcome. Three storage integration scenarios are analyzed to mitigate the deficits, reducing said deficits by a minimum of approximately 9% over the duration of the month. This study provides a transferable modeling framework tool for evaluating renewable integration in dense urban environments that can be used by grid operators to support grid resilience during extreme heat events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

CGSim: A Simulation Framework for Large Scale Distributed Computing Environment

Large-scale distributed computing infrastructures such as the Worldwide LHC Computing Grid (WLCG) require comprehensive simulation tools for evaluating performance, testing new algorithms, and optimizing resource allocation strategies. However, existing simulators suffer from limited scalability, hardwired algorithms, lack of real-time monitoring, and inability to generate datasets suitable for modern machine learning approaches. We present CGSim, a simulation framework for large-scale distributed computing environments that addresses these limitations. Built upon the validated SimGrid simulation framework, CGSim provides high-level abstractions for modeling heterogeneous grid environments while maintaining accuracy and scalability. Key features include a modular plugin mechanism for testing custom workflow scheduling and data movement policies, interactive real-time visualization dashboards, and automatic generation of event-level datasets suitable for AI-assisted performance modeling. We demonstrate CGSim’s capabilities through a comprehensive evaluation using production ATLAS PanDA workloads, showing significant calibration accuracy improvements across WLCG computing sites. Scalability experiments show near-linear scaling for multi-site simulations, with distributed workloads achieving 6 × better performance compared to single-site execution. The framework enables researchers to simulate WLCG-scale infrastructures with hundreds of sites and thousands of concurrent jobs within practical time budget constraints on commodity hardware.

Vatsavai, Sairam Sri [Brookhaven National Laborato↗
DOE OSTI2024

Radiological Safety Analysis Computer Program V 7.2

Users generates a fission product inventory from either reactor operating history or a nuclear criticality event. RSAC-7 models the effects of high-efficiency particulate air filters or other cleanup systems and calculates the decay and ingrowth during transport through processes, facilities, and the environment. Doses are calculated for inhalation, air immersion, ground surface, ingestion, and cloud gamma pathways. RSAC-7 is used as a tool to evaluate accident conditions in emergency response scenarios, radiological sabotage events, and safety basis accident consequences.

Jordan, RobertaA. [Idaho National Laboratory (INL)↗
DOE OSTI2026

Model Assessment Wizard (MAW)

SAND2026-18710O The Model Assessment Wizard (MAW) is a tool for evaluating ontologies and provides users with a comprehensive workbench for analysis. MAW features sub-modules for visualization, alignment, Shapes Constraint Language (SHACL) and Web Ontology Language (OWL) constraints, and simplification. Users can upload data, identify missing information, visualize ontologies, and update constraints. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA0003525.

Murdock, Jaimie [Sandia National Lab. (SNL-CA), Li↗
DOE OSTI2026

PCA -BASED COMPRESSOR HARDWARE DESIGN GENERATOR IN CHISEL

SF-25-077 This repository includes a hardware generator written in Chisel that generates lossy compression hardware designs based on principal component analysis (PCA), along with a flexible testbench. It also includes a Python tool for evaluating the accuracy loss of integer quantization.

Kazutomo, Yoshi [Argonne National Laboratory (ANL)↗
DOE OSTI2026

Autonomie Simulation Datasets in Support of U.S. DOT-NHTSA Advanced Vehicle Technology Research

Understanding how new vehicle technologies affect fuel economy and energy use is critical to the regulatory work performed by the U.S. Department of Transportation’s National Highway Traffic Safety Administration (NHTSA), which sets Corporate Average Fuel Economy (CAFE) standards under the Energy Policy and Conservation Act of 1975. In order to support this work, Argonne National Laboratory uses Autonomie, a full-vehicle simulation tool, to evaluate advanced powertrain architectures and their effects on vehicle energy consumption and performance. A wide range of vehicle classes has been assessed (i.e., internal combustion engine vehicles, hybrid electric vehicles, plug-in hybrid electric vehicles, battery-electric vehicles, and fuel cell electric vehicles), as well as the effects of various technology improvements such as lightweighting, aerodynamic refinements, and low-rolling-resistance tires. Simulations have been run across multiple drive cycles to capture fuel and electricity use under realistic operating conditions. The resulting datasets include detailed vehicle-level results, model assumptions, and validation reports, all of which have been made publicly available through NHTSA in support of the 2023 notice of proposed rulemaking covering light-duty vehicles for model years 2027 to 2035. These data are critical to stakeholders working in fuel economy regulation, vehicle technology assessment, and energy policy analysis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

eLog analysis for accelerators: status and future outlook

This work demonstrates electronic logbook (eLog) systems leveraging modern AI-driven information retrieval capabilities at the accelerator facilities of Fermilab, Jefferson Lab, Lawrence Berkeley National Laboratory (LBNL), SLAC National Accelerator Laboratory. We evaluate contemporary tools and methodologies for information retrieval with Retrieval Augmented Generation (RAGs), focusing on operational insights and integration with existing accelerator control systems. The study addresses challenges and proposes solutions for state-of-the-art eLog analysis through practical implementations, demonstrating applications and limitations. We present a framework for enhancing accelerator facility operations through improved information accessibility and knowledge management, which could potentially lead to more efficient operations.

Accelerator Physics↗
DOE OSTI2024

Advancing the Understanding of Manufacturing Tools for Hardware Security

This project’s goal was to explore new methods and tools to evaluate the focused ion beam (FIB) effect on active electrical devices, which is becoming increasingly challenged by the continual decrease in transistor geometry. Novel hole transfer methods leveraging FIB patterning were demonstrated utilizing selective area atomic layer deposition (ALD) and metal assisted chemical etching. A FIB damage electrical tester device was fabricated, and the effects of FIB beams were characterized by examining change in performance of damaged transistors. Detailed characterization of end-of-range damage for common FIB ions were correlated to modeling methods. Finally, undamaged and damaged devices were simulated by Charon to begin understanding the FIB effects on active devices. This test platform along with modeling methods give a powerful way to assess FIB damage in materials and devices, and with more development can help establish methods to predict FIB damage effects on electrical devices.

42 ENGINEERING↗
DOE OSTI2024

Evaluating a Commercial Dynamic Line Rating Software with the National PMU Dataset

To accelerate the development of data-driven applications for power systems, the Department of Energy (DOE) supported the collection and curation of a synchrophasor dataset spanning two years of observations from transmission utilities across the US. This National PMU Dataset (NPDS) was anonymized and distributed to awardees of a DOE research grant under nondisclosure agreements (NDAs) but has also been retained at PNNL to enable further research. Agreements with data contributors prevent the data from being shared outside the organization. However, establishing a blind research validation methodology is envisioned to maximize the value proposition of the NPDS. In this validation strategy, researchers may share algorithms/software (potentially as executables to protect intellectual property) with PNNL, and PNNL will share feedback about the software’s performance on subsets of the NPDS. Such a blind methodology ensures that sensitive information about critical infrastructure remains protected, but the value of the NPDS can be extended to research beyond PNNL. Through iterative feedback, the algorithms may be tweaked to address real-world artifacts. As the NPDS data is temporally and geographically diverse, it may capture features absent in smaller datasets used during the development of the algorithm under test. This report presents lessons learned from applying the blind validation methodology to LineID™, a synchrophasor-based dynamic line rating software developed by Topolonet Corporation. Improvements made to the software through iterative feedback, limitations of the validation methodology, as well as how the limitations of the NPDS affected the evaluation process are discussed. Observations indicate that the proposed validation methodology can be valuable for evaluating other tools in the future.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Architecting the Grid Edge: Ensuring Reliability and Resilience

Changes in technology, customer expectations, and business and regulatory environments are rapidly evolving causing fundamental changes in the nation’s electrical infrastructure. Nowhere is this more apparent that at the “grid edge”, where there is an increasing number of new devices and systems, as well as complex new interactions between them. This is leading to the traditional relationship between the end-use customers and their utilities being expanded by an increasing number of stakeholders, each with their own operational and financial objectives, governed by regulatory policy. While there are concerns about the rapidly increasing complexity negatively impacting reliable and resilience of the electrical infrastructure, these changes are also bringing new resources and opportunities that hold great potential if they can be properly coordinated. This white paper outlines the considerations for the coordination of multi-stakeholder objectives with electric utility requirements using the concept of grid services. Describing a framework that enables new stakeholders to achieve their local technical and economic objectives, while simultaneously delivering operational benefits to the electrical infrastructure. The concepts of grid architecture are presented as a tool to evaluate how stakeholders might participate in, and benefit from, services, and how utilities can make decision on the reliance on services to ensure reliability and resilience, translating abstract concepts into actionable information for utilities and grid edge stakeholders. The end result of proper coordination, informed by grid architecture, will be a range of new devices and systems, operated by new stakeholders, achieving their local objectives while also increasing the reliability, resilience, security, and affordability of the nation’s critical electrical infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Architecting the Grid Edge: Ensuring Reliability and Resilience

Changes in technology, customer expectations, and business and regulatory environments are rapidly evolving causing fundamental changes in the nation’s electrical infrastructure. Nowhere is this more apparent that at the “grid edge”, where there is an increasing number of new devices and systems, as well as complex new interactions between them. This is leading to the traditional relationship between the end-use customers and their utilities being expanded by an increasing number of stakeholders, each with their own operational and financial objectives, governed by regulatory policy. While there are concerns about the rapidly increasing complexity negatively impacting reliable and resilience of the electrical infrastructure, these changes are also bringing new resources and opportunities that hold great potential if they can be properly coordinated. This white paper outlines the considerations for the coordination of multi-stakeholder objectives with electric utility requirements using the concept of grid services. Describing a framework that enables new stakeholders to achieve their local technical and economic objectives, while simultaneously delivering operational benefits to the electrical infrastructure. The concepts of grid architecture are presented as a tool to evaluate how stakeholders might participate in, and benefit from, services, and how utilities can make decision on the reliance on services to ensure reliability and resilience, translating abstract concepts into actionable information for utilities and grid edge stakeholders. The end result of proper coordination, informed by grid architecture, will be a range of new devices and systems, operated by new stakeholders, achieving their local objectives while also increasing the reliability, resilience, security, and affordability of the nation’s critical electrical infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

High-Quality Factor Microwave Resonators using Rhenium

Coplanar waveguide resonators are a perfect tool to evaluate the losses induced by defects and interfaces in superconducting devices. Even if niobium is the most used superconductor for resonators and qubits, its native oxide at the metal-air (MA) interface limits the device results. Tantalum has recently significantly improved qubit performances due to a thinner and less disordered oxide layer compared to Nb. To further improve the MA interface, we used rhenium, a superconducting material with 1.7 K critical temperature resistant to oxidation: it forms an oxide layer thinner than 1 nm. In this study, we will present a thorough investigation of rhenium CPW resonator measurements with internal quality factors at the single photon level exceeding 2 million. The devices have been fabricated on a sapphire substrate while the processing parameters have been varying and optimized. The measurements have been performed as a function of power and temperature to disentangle different sources of losses, such as two-level systems (TLS) and quasi-particles. A peculiar TLS temperature dependence has been measured and analyzed. In this work, we also vary the participation ratio of the devices to extract the losses introduced by the involved interfaces with higher fidelity and precision. We carried on a deep material characterization effort to link the results to the differences in the fabrication steps, and we will present material characterization measurements performed via AFM, ToF-SIMS, XPS, and TEM.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

eLog Analysis for Accelerators: Status and Future Outlook

This work demonstrates electronic logbook (eLog) systems leveraging modern AI-driven information retrieval capabilities at the accelerator facilities of Fermilab, Jefferson Lab, Lawrence Berkeley National Laboratory (LBNL), SLAC National Accelerator Laboratory. We evaluate contemporary tools and methodologies for information retrieval with Retrieval Augmented Generation (RAGs), focusing on operational insights and integration with existing accelerator control systems. The study addresses challenges and proposes solutions for state-of-the-art eLog analysis through practical implementations, demonstrating applications and limitations. We present a framework for enhancing accelerator facility operations through improved information accessibility and knowledge management, which could potentially lead to more efficient operations.

Hellert, Thorsten [LBNL, ALS]↗
DOE OSTI2025

Projected Operational Energy Life Cycle Data Development: 2025 Update

This report documents the data sources and methods used to develop the energy life cycle data for use by the National Institute of Standards and Technology (NIST) Engineering Laboratory (EL) to be used for the development of measurement science and incorporation into decision-support tools for evaluating building and facility capital investments. The data are posted separately under DOI 10.18141/2575194.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

Machine Learning Based Metamodel for Faster Life Cycle Assessment of Large Portfolio of Buildings

Managing a large portfolio of buildings involves decisions on reuse, retrofit, renovation, rehabilitation, and new construction, influenced by trade-offs between performance metrics such as cost, time, and operational flexibility over the building's life cycle. Traditional life cycle assessment tools for evaluating these metrics can be labor- and compute-intensive, requiring extensive data and modeling for each building. Metamodels (or surrogate models) using machine learning have been explored as faster alternatives, but training these models has been hindered by the limited availability of comprehensive data on key life cycle metrics. Recent advancements in machine learning, particularly deep learning techniques like zero-shot and few-shot learning, allow models to learn from sparse or limited data. We propose a machine learning-based metamodel that leverages these techniques for rapid estimation of key building life cycle metrics. This presentation will cover the model architecture, data collection, training, and validation processes, along with an ongoing case study applied to a large portfolio of buildings. We will discuss the model's performance in terms of accuracy, compute time, limitations, and its potential for expanding to additional life cycle metrics. This data-driven approach offers a promising direction for the rapid evaluation of large building portfolios.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Radiological Safety Analysis Computer (RSAC) Program Version 7.4 Users’ Manual

The Radiological Safety Analysis Computer (RSAC) Program Version 7.4 (RSAC-7) is the newest version of the RSAC legacy code. RSAC-7 calculates the consequences of a release of radionuclides to the atmosphere. Users generates a fission product inventory from either reactor operating history or a nuclear criticality event. RSAC-7 models the effects of high-efficiency particulate air filters or other cleanup systems and calculates the decay and ingrowth during transport through processes, facilities, and the environment. Doses are calculated for inhalation, air immersion, ground surface, ingestion, and cloud gamma pathways. RSAC-7 is used as a tool to evaluate accident conditions in emergency response scenarios, radiological sabotage events, and safety basis accident consequences. This users’ manual contains the mathematical models and operating instructions for RSAC-7. Instructions, screens, and examples are provided to guide the user through the functions provided by RSAC-7. This program is designed for users who are familiar with radiological dose assessment methods.

73 - NUCLEAR PHYSICS AND RADIATION PHYSICS↗