Search NASA⌕ Search

SEARCH · Search NASA

Results for “KPI”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Ocpp 2.0.1. Interim Kpi Calculator

The project is split into four pieces. The first is a raw OCPP log parser. The second is a file splitter. The third is a message parser. The final piece is the Interim KPI calculator. The OCPP log parser was created from two different formats of raw OCPP 2.0.1 data. Its intended purpose is to extract device IDs and OCPP event messages from nontabular text logs. The parser looks for specific substrings in the logs to identify which of the two "standards" it should select from. The KPI generator does not perform any of its calculations in parallel. Instead, we opt for a naive batching approach. The splitter takes the file generated from the parser and creates many smaller files for each of the device IDs in the dataset. This allows the pandas queries in the log formatter to be iterate over a significantly smaller slice of data, increasing performance significantly. The message parser step takes messages from each of the files (containing distinct device IDs) and breaks the message out into pieces. The final result is a file with different columns specifying different attributes of the JSON message. The file is an aggregation of all different devices. This is the most complex portion of the code. The KPI calculator takes the parsed messages, as a single file, and calculates the KPI from that data. An excel file is produced with four sheets. These contain the metrics for Session Success, Charge Start Success, Charge End Success, and Charge Start Time. It includes the metrics for the different equations in the Interim KPI Implementation Guide as well as a weighted sum of the different equations for each KPI (excluding Charge End Success and Charge Start Time).

Quinn, Casey↗
DOE OSTI2026

A Centralized AI Lakehouse Framework for Brain Tumor MRI Classification and Segmentation, University KPI Forecasting, and Water Potability Prediction

In many university and healthcare projects, models are built for very different data types such as tables, institutional time series, and medical images, but they are deployed as separate applications. In this work, that separation made testing and maintenance difficult because each module had its own pipeline and runtime requirements. This paper presents an integrated AI lakehouse-style implementation that runs three model pipelines inside one containerized backend. For medical imaging, we used MRI datasets from IEEE DataPort: a four-class classification set with 7012 images (5708 train/1304 test) and a segmentation set with 3063 image–mask pairs. The classification model (ResNet50 transfer learning) is evaluated using a proper train–validation–test protocol across multiple splits (80/10/10, 70/10/20, 60/10/30, and 10/30/60), achieving a test accuracy of 99.00% under the standard 80/10/10 split. Additionally, a patient-level evaluation is conducted using an external glioma dataset to provide a more realistic assessment without data leakage. The segmentation model (DeepLabV3-ResNet50) achieved 83.09% validation mIoU and 88.79% Dice score. For university KPI forecasting, we used annual IPEDS and NSF HERD data from 2010 to 2023 for three universities (BSU, EOU, and UAB). To examine the effect of preprocessing on forecasting performance, two case studies are conducted. In the first case, linear interpolation is applied to generate semester-level data. In the second case, the original annual data is used directly without interpolation. Random Forest regression and ARIMA models are evaluated using MAE, RMSE, MAPE, and R 2 . The results showed that interpolation improved apparent forecasting performance due to smoothing, while evaluation on the original annual data provided a more realistic assessment of model behavior. To further validate the framework on a larger dataset, an additional case study is conducted using a student dropout dataset. For water potability, we trained and compared multiple tabular classifiers on a large dataset (1,048,575 samples). A Random Forest model (100 trees, max depth 10) achieved 85.86% test accuracy and high recall for unsafe samples (0.8447). All modules are served via FastAPI and deployed together using Docker, with workflow automation routing requests to the correct endpoint. System-level benchmarking indicates that the backend maintains stable throughput and latency under concurrent requests.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

OpenStudio System-level KPI Reporting Measure v1.0

This is a OpenStudio measure that calculates and reports the system-level key performance indicators (KPIs) for evaluating building energy performance at the system level. The systems are defined by the service it provides in commercial buildings, which include (1) lighting, (2) Miscellaneous Electric Loads (MELs), (3) Heating, Ventilation and Air Conditioning (HVAC), and (4) Service Water Heating (SWH).

Li, Han↗
DOE OSTI2019

Pansophy enhancements for SRF through collecting and analyzing inputs/outputs to further project efficiency in reporting and performance

SRF cavity and Cryomodule testing and production requires a consistent means of collecting and analyzing data against quality and production parameters. JLab's engineering data management system, Pansophy, is utilized to assist project leaders and subject matter experts (SMEs) with such tasks, by providing a means to data mine key parameter indicators (KPI) and production planning and status data. Recent enhancements to reporting and trending have been utilized for the LCLS-II and CEBAF 12GeV upgrade projects. Further enhancements are being planned for future projects, like SNS-PPU, such as KPI trending, KPI quality, vendor quality, production timelines and user defined queries. Being able to understand past trends will assist with enhancements to future projects.

Bookwalter, Valerie D.↗
DOE OSTI2024

Review of Technical Photovoltaic Key Performance Indicators and the Importance of Data Quality Routines

Technical key performance indicators (KPIs) are important metrics used to assess and quantitatively summarize various aspects of photovoltaic (PV) systems, including long-term performance, economic viability, and carbon footprint. Herein, a group of experts of the International Energy Agency's Photovoltaic Power Systems Programme Task 13 collect and describ the most important technical KPIs used in the industry. Thereby, a set of best practices for reliably handling PV system data is presented and the impact of data quality and climatic variability on KPI calculation is investigated. Further, the effective use of technical KPIs allows triggering data-driven and informed decisions to optimize PV systems and providing a comprehensive overview of how PV systems operate across different conditions and climates. With the worldwide growth of the PV industry, more companies operate/own PV systems in different regions, where the climatic and seasonal profiles differ. This requires context-aware evaluation of KPIs, or the judicious application of multiple KPIs, to ensure that each asset is evaluated correctly. Beyond that, there is untapped potential in the utilization of KPIs through geospatial mapping and extrapolation of fleet KPIs. This study demonstrates that the uncertainty in KPI estimation is not well understood and depends on data quality, climatic variability, and system configuration.

14 SOLAR ENERGY↗
DOE OSTI2019

Los Alamos National Laboratory Nuclear Material Management and Storage Program: Storage Health Metrics

The Strategic Materials Sustainment Program (SMSP) supports activities needed to manage the National Nuclear Security Administration’s (NNSA) inventory of strategic materials. As part of the SMSP, the Nuclear Material Management and Storage (NMM&S) program at the Los Alamos National Laboratory (LANL) is responsible for: (1) safe and secure storage of the SMSP strategic materials and others, (2) analysis, forecasting, and management of accountable nuclear materials; and (3) disposition of nuclear material through the Office of Nuclear Materials Integration (ONMI). The nuclear material management (NMM) mission is to ensure efficient nuclear material management lifecycle activities at LANL. The storage program function includes the management of storage capabilities across the site, supply chain management of nuclear materials, storage requirements integration, and nuclear container management (i.e., procurement, compliance, and safety). This report identifies key performance indicators (KPI) and describes the criteria and metrics used to assess the health of the storage component of the NMM&S program. “Health” is the ability of a process, system, facility, or program to safely and reliably accomplish its required mission. A health assessment provides timely identification of significant risks to enable mission performance. Significant risks identified are most effectively mitigated, avoided, or eliminated by evaluating and coordinating with stakeholders to specifically target, document, and often proceduralize strategies directed towards risk reduction. An effective health assessment involves status measurements of specific metrics that are tied directly to representative KPIs for a program. This document will baseline the KPI, criteria, and specific metrics that will be used to measure the “health” of the LANL Storage Program (i.e., NMM is not included).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Machine Learning–Guided Boolean Matrix Inference for Real-Time O-RAN Conflict Detection

Open Radio Access Networks (O-RAN) are emerging, software-driven cellular architectures that promote flexibility by enabling components from different vendors to interoperate. Multiple control applications called xApps can independently adjust network parameters in near real time, often without awareness of each other's actions. This creates a system highly prone to unintended conflicts and performance degradation due to the inherent complexity of such openness. To model such systems and ultimately prevent or mitigate xApp conflicts, it is essential to understand the dynamic relationships between xApps (A), the control parameters they adjust (P), and the resulting KPI responses (K). While the mappings from A to P and from K to A can often be derived from xApp specifications, the relationship from P to K is typically hidden within the system’s dynamics and must be inferred from observed data. We propose a novel data-driven Boolean inference framework that uncovers the hidden P?K dependencies using machine learning and interpretable rule induction. Continuous parameters and KPIs are first binarized using decision tree classifiers, and a binary influence matrix L is then inferred by solving Boolean matrix equations over time. This compact representation improves interpretability and enables real-time tracking of dynamically evolving parameter-KPI dependencies. We demonstrate the effectiveness of our method in a realistic mobile handover scenario, where it accurately recovers the underlying logic and enables proactive conflict detection.

42 - ENGINEERING↗
DOE OSTI2026

Kivalina Biomass Reactor

This report summarizes work performed under DOE Award DE-EE00010149 to support the reliable operation of a community-scale biochar reactor system in Kivalina, Alaska. The project focused on improving sanitation and waste management in a remote community by assessing the installed system, identifying spare parts, defining key performance indicators (KPIs), preparing operator and maintenance manuals, and developing mobile reporting tools for operational data and KPI tracking. The team also produced training materials and recorded videos to support operator onboarding and continuity. The project demonstrated progress in system readiness, documentation, and digital reporting, while also identifying challenges common to remote deployments, including travel constraints, upstream system failures, and local resource limitations. This work provides a practical framework for improving the operation, monitoring, and future replication of biomass reactor systems in remote communities.

09 BIOMASS FUELS↗
DOE OSTI2021

Occupant-Centric key performance indicators to inform building design and operations

Building performance indicators are widely used to guide building design and track and benchmark operational performance. Traditional building performance indicators mostly focus on the energy efficiency perspective. As occupants are the primary building service recipients in residential and most commercial buildings, their comfort and wellbeing are crucial. As such, this study first identified significant attributes of occupant-centric key performance indicators (KPIs) and analyzed the diverse factors that should be considered in formulating an occupant-centric KPI. Then a suite of occupant-centric KPIs were synthesized from the review and enhancement of existing occupant-related performance metrics. The proposed occupant KPIs represent the occupant lens on three integrative aspects of building performance: resource use (including energy and water), indoor environmental quality, and human–building interactions. A simulation-based case study was conducted to demonstrate how occupant-centric KPIs can be used to quantify the impacts of building operation changes from the occupants’ point of view. Highlights: Occupant-centric metrics are currently ad hoc and limited, yet crucial to inform building design and operations. Literature was reviewed to reveal the state-of-the-art and gaps of occupant-centric metrics. A suite of occupant-centric key performance indicators (KPIs) covering five groups of building services were synthesized. Proposed occupant KPIs represent three aspects of performance: resource use and demand, occupant comfort and health, and human–building interactions. A case study using whole building simulation was conducted to demonstrate the use of occupant-centric KPIs in evaluating building operations during a power outage.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

User-Centric Communication With Aerial Network for 6G: A Reinforcement Learning Approach

Meeting the diverse needs of user verticals requires innovative cellular architectures that can offer additional degrees of freedom to provide on-demand services. The terrestrial user-centric radio access network (UC-RAN) stands out as an excellent choice for this purpose. However, a drawback of UC-RAN is its tendency to prioritize high-priority verticals, often resulting in a subpar quality of experience for low-priority verticals. This issue is particularly exacerbated in hotspot areas. Here, to address this problem, we introduce an aerial network integrated with terrestrial UC-RAN to provide coverage to users which are not served by the terrestrial network. Furthermore, we analyze the impact of key configuration and optimization parameters (COPs), such as location, transmit power, altitude, and beamwidth of aerial base stations (ABSs) on system key performance indicators (KPIs), such as coverage, latency satisfaction, average spectral efficiency, and energy efficiency. We formulate a robust multiobjective function to maximize these KPIs without biasing toward any specific KPI(s). Finally, we propose a deep reinforcement learning optimization framework based on the state-of-the-art soft actor-critic algorithm to control ABS COPs and optimize system KPIs. Experimental evaluations demonstrate that the proposed optimization framework can converge to near-optimal solutions derived from the pseudo brute force in a few thousand epochs.

6G↗
DOE OSTI2023

PARETO 0.9.0 Release

PARETO 0.9.0 Release. Highlights: New Features - Initial beneficial reuse implementation - Post-optimization timing for infrastructure buildout Bug Fixes - Address Pyomo solver bug for UI Gurobi solve - Update Toy Case Study to feasible data for hydraulics post_process - Update Jupyter notebook for fall release UI Updates - Added functionality to optimize with hydraulics options - Added new plots to KPI dashboard for water quality and hydraulics timelines

PARETO,PARETO-UI,PSE,Process Systems Engineering,P↗
DOE OSTI2025

Implementation Guide of Customer-Focused Key Performance Indicators for Electric Vehicle Charging

This report describes how individual and unique messages that are sent over in OCPP sessions and/or transactions are used to calculate the interim set of key performance indicators (KPI) established by ChargeX Consortium’s Working Group 1: Defining the Charging Experience in the report entitles “Customer-Focused Key Performance Indicators for Electric Vehicle Charging.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Implementation Guide of Customer-Focused Key Performance Indicators for Electric Vehicle Charging

This report describes how individual and unique messages that are sent over in OCPP sessions and/or transactions are used to calculate the interim set of key performance indicators (KPI) established by ChargeX Consortium’s Working Group 1: Defining the Charging Experience in the report entitles “Customer-Focused Key Performance Indicators for Electric Vehicle Charging.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

PV Operations Software Transparency: A PVMAC Industry Snapshot

The rapid growth of photovoltaic (PV) deployment has increased reliance on software platforms for monitoring, workflow automation, diagnostics, and performance analytics. As these tools play a central role in asset management and operations and maintenance (O&M), greater transparency in methodologies, data handling, and validation practices benefits the broader PV ecosystem. To better understand current practices and identify opportunities for improved clarity and interoperability, 24 software providers contributed detailed responses through the PV O&M Analytics Collaborative (PVMAC) initiative, the first structured questionnaire of its kind in the industry, covering onboarding, interoperability, data quality, diagnostics, AI/ML, and other operational categories. These providers represent over 1.1 TW of solar assets under management. The analysis shows broad adoption of digital twins, AI/ML, and API integrations, but also highlights challenges in onboarding processes, inconsistent definitions and methodologies, variability in key performance indicator (KPI) calculations, and limited independent validation. Greater standardization, clearer documentation, and stronger validation frameworks could improve transparency, comparability, and trust across PV operations software platforms.

14 SOLAR ENERGY↗
DOE OSTI2021

Development and Application of Schema Based Occupant-Centric Building Performance Metrics

Occupant behavior can significantly influence the operation and performance of buildings. Many occupant-centric key performance indicators (KPIs) rely on having accurate counts of the number of occupants in a building, which is very different to how occupancy information is currently collected in the majority of buildings today. To address this gap, the authors develop a standardized methodology for the calculation of percent space utilization for buildings, which is formulated with respect to two prevalent operational data schemas: the Brick Schema and Project Haystack. The methodology is scalable across different levels of spatial granularity and irrespective of sensor placement. Moreover, the methods are intended to make use of typical occupancy sensors that capture presence level occupancy and not counts of people. Since occupant-hours is a preferable metric to use in KPI calculations, a method to convert between percent space utilization and occupant-hours using the design occupancy for a space is also developed. The methodology is demonstrated on a small commercial office space in Boulder, Colorado using data collected between June 2018 and February 2019. A multiple linear regression is performed that shows strong evidence for a relationship between building energy consumption and percent space utilization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2019

A Study into the Benefits of Using Discrete Event Simulation in TRU and Mixed Low-Level Waste (MLLW) Disposal at Advanced Mixed Waste Treatment Plant (AMWTP) - 19536

As part of the 1995 Settlement agreement reached between the Idaho State Government and the Idaho National laboratory, it was agreed that the approximately 65,000 cubic metres of waste stored at the AMWTP site was to be shipped out of the state to the waste isolation pilot plant (WIPP) in New Mexico or a similar disposal facility by the end of December 2018. In June 2016, the operation of AMWTP was taken over by Fluor Idaho, a subsidiary of Fluor Inc. To improve their capability of processing all of the varied waste contained on the extensive site, Fluor Idaho requested the assistance of DBD Ltd. We were tasked with producing an all-encompassing operational research (OR) model/discrete event simulation (DES) model of the site, which is able to produce live end-date predictions based on current inventory and waste tracking against milestones. The DES model, is capable of predicting years worth of plant operation in a matter of minutes including the variation caused by such complexities as resource/staff availability, equipment breakdown and maintenance, prioritisation of different waste types, and varying shift patterns of both staff and facilities. The DES model can be run from its own bespoke dashboard, that can be customised to suit the audience it is being used to inform, producing clear key performance indicator (KPI) graphics and high-level overviews for senior management, down to drum by drum breakdowns of the predicted feed plans for each individual facility on the AMWTP site for a work planner to analyse and compare to the current operations. Simulation can produce these types of outputs for very low cost and low risk, as it avoids experimentation to find potential alternatives to the status-quo that could result in loss of production or time. These methods can also be used to produce cost benefit analyses for suggested processing options feeding into optioneering studies and cost reduction strategies. As a tool for plant optimisation and tracking, discrete event simulation can provide detailed results quickly and reliably. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Enhancing Cloud Cybersecurity: Prescriptive Controls for Operational Technology

This whitepaper provides strategic insights and recommendations into security cloud-based solutions for electric utilities, encompassing operational technology (OT), virtual power plants (VPP), distributed energy resources (DERs), applications, networks, and data storage as they transition to and leverage cloud infrastructure through managed service providers (MSPs) and cloud service providers (CSPs). Principles derived from established frameworks serve as a foundation for best practices across cybersecurity projects and remove the constraints of settling on a single framework. For organizations that prefer not to integrate a specific framework altogether, elements of the proposed approach could be adopted or tailored to best fit defined requirements and expected functionalities. The Cirrus assessment, a utility cloud feasibility tool, and the roadmap it provides serve as a precursor to this paper, which seeks to be a valuable resource for defining next steps following cloud technology integration feasibility appraisal. With its comprehensive approach to adoption, the Cirrus framework offers strategic guidance on responsibly preparing for or deploying a utility cloud solution. The previously published whitepaper, “Use Case-Informed Framework for Utility Cloud Migration,” details the guiding strategy, research, and deployment of cloud solutions within electric and interconnected grid systems. Before implementing the controls suggested in this document, it is recommended that stakeholders complete Cirrus's cloud integration assessment and pair the results with their unique cybersecurity controls to form a comprehensive cloud-based utility cybersecurity plan. The Cirrus outcome will consider a series of future architectures for the grid before and after the energy transition and evaluate the arguments for and against cloud applications for each electric and interconnected grid layer. This document is a companion to the original whitepaper, "Use Case-Informed Framework for Utility Cloud Migration" to further identify and recommend security controls based on Cirrus’s cloud integration assessment output. The following whitepaper outlines the cybersecurity controls that secure cloud-service models pertinent to the electric sector using the predefined categories identify, protect, detect, and respond and recover. The objective is to outline prescriptive security controls based on the type of architecture and data stored in the cloud. The focus includes dissecting the shared responsibility model and elucidating what on-premises Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS) entail. A pivotal consideration in this context is allocating responsibility for foundational cybersecurity aspects—having used Cirrus for the cloud integration assessment. The ensuing controls detailed herein also represent a checklist of controls necessary for a secure cloud transition, equipping utilities with the knowledge to navigate this digital transformation with confidence and strategic foresight in a safe and responsible manner.

42 ENGINEERING↗