Search NASA⌕ Search

SEARCH · Search NASA

Results for “analysis workflow”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

Watching the Watchers with Verified Formal-Assurance Tools (Abbreviated Final Report)

The “Watching the Watchers” project studied the problem of establishing assurance cases for tools that are used to assure other things. Specifically, we were interested in understanding the tools and techniques one could apply to software to build an assurance case to evaluate their applicability, difficulty, level of assurance provided, and scalability. To do so we chose a set of use cases of relevance to LLNL and our various DOE and non-DOE partners and developed demonstrators to perform this evaluation. Our key focal point was around additive manufacturing problems and assurance gaps that we identified in the additive manufacturing workflow from start to completion. We also explored other areas related to AI, data analysis, and concurrent programming. Follow-on research is planned to take our prototypes from this project and adapt and mature them to fit LLNL mission applications.

97 MATHEMATICS AND COMPUTING↗

Supporting Greater Interactivity in the IPython Visualization Ecosystem

Interactive visualizations are invaluable tools for building intuition and supporting rapid exploration of datasets and models. Numerous libraries in Python support interactivity, and workflows that combine Jupyter and IPyWidgets in particular make it straightforward to build data analysis tools on the fly. However, the field is missing the ability to arbitrarily overlay widgets and plots on top of others to support more flexible details-on-demand techniques. This work discusses some limitations of the base IPyWidgets library, explains the benefits of IPyVuetify and how it addresses these limitations, and finally presents a new open-source solution that builds on IPyVuetify to provide easily integrated widget overlays in Jupyter.

Martindale, Nathan↗

Hyaloscypha finlandica Metabolome Repository

This repository provides the curated data tables, manuscript figure and table exports, dependency records, and workflow scripts supporting an integrated comparative genomics and untargeted LC-MS/MS metabolomics analysis of Hyaloscypha finlandica strain PMI 746, a root-associated dark septate endophyte of poplar. The repository includes genome-mining summaries from antiSMASH, FunBGCeX, BGC-Prophet, and BiG-SCAPE; processed metabolomics inputs; metabolite annotation evidence; statistical outputs; and publication-facing figures and tables. Raw LC-MS/MS spectra, full genome/protein downloads, and large generated tool outputs are referenced through public archive/accession records and are not stored in Git.

59 BASIC BIOLOGICAL SCIENCES↗

Towards Exascale Scientific Metadata Management

Advances in technology and computing hardware are enabling scientists from all areas of science to produce massive amounts of data using large-scale simulations or observational facilities. In this era of data deluge, effective coordination between the data production and the analysis phases hinges on the availability of metadata that describe the scientific datasets. Existing workflow engines have been capturing a limited form of metadata to provide provenance information about the identity and lineage of the data. However, much of the data produced by simulations, experiments, and analyses still need to be annotated manually in an ad hoc manner by domain scientists. Systematic and transparent acquisition of rich metadata becomes a crucial prerequisite to sustain and accelerate the pace of scientific innovation. Yet, ubiquitous and domain-agnostic metadata management infrastructure that can meet the demands of extreme-scale science is notable by its absence. To address this gap in scientific data management research and practice, we present our vision for an integrated approach that (1) automatically captures and manipulates information-rich metadata while the data is being produced or analyzed and (2) stores metadata within each dataset to permeate metadata-oblivious processes and to query metadata through established and standardized data access interfaces. We motivate the need for the proposed integrated approach using applications from plasma physics, climate modeling and neuroscience, and then discuss research challenges and possible solutions.

97 MATHEMATICS AND COMPUTING↗

CMS Data Processing Workflows during an Extended Cosmic Ray Run

The CMS Collaboration conducted a month-long data taking exercise, the Cosmic Run At Four Tesla, during October-November 2008, with the goal of commissioning the experiment for extended operation. With all installed detector systems participating, CMS recorded 270 million cosmic ray events with the solenoid at a magnetic field strength of 3.8 T. This paper describes the data flow from the detector through the various online and offline computing systems, as well as the workflows used for recording the data, for aligning and calibrating the detector, and for analysis of the data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

High Energy Physics Exascale Requirements Review. An Office of Science review sponsored jointly by Advanced Scientific Computing Research and High Energy Physics, June 10-12, 2015, Bethesda, Maryland

The U.S. Department of Energy (DOE) Office of Science (SC) Offices of High Energy Physics (HEP) and Advanced Scientific Computing Research (ASCR) convened a programmatic Exascale Requirements Review on June 10–12, 2015, in Bethesda, Maryland. This report summarizes the findings, results, and recommendations derived from that meeting. The high-level findings and observations are as follows. Larger, more capable computing and data facilities are needed to support HEP science goals in all three frontiers: Energy, Intensity, and Cosmic. The expected scale of the demand at the 2025 timescale is at least two orders of magnitude — and in some cases greater — than that available currently. The growth rate of data produced by simulations is overwhelming the current ability of both facilities and researchers to store and analyze it. Additional resources and new techniques for data analysis are urgently needed. Data rates and volumes from experimental facilities are also straining the current HEP infrastructure in its ability to store and analyze large and complex data volumes. Appropriately configured leadership-class facilities can play a transformational role in enabling scientific discovery from these datasets. A close integration of high-performance computing (HPC) simulation and data analysis will greatly aid in interpreting the results of HEP experiments. Such an integration will minimize data movement and facilitate interdependent workflows. Long-range planning between HEP and ASCR will be required to meet HEP’s research needs. To best use ASCR HPC resources, the experimental HEP program needs (1) an established, long-term plan for access to ASCR computational and data resources, (2) the ability to map workflows to HPC resources, (3) the ability for ASCR facilities to accommodate workflows run by collaborations potentially comprising thousands of individual members, (4) to transition codes to the next-generation HPC platforms that will be available at ASCR facilities, (5) to build up and train a workforce capable of developing and using simulations and analysis to support HEP scientific research on next-generation systems.

97 MATHEMATICS AND COMPUTING↗

BIM Interoperability Tool for Improving IFC-based Model Data Exchange Between Architectural Design and Structural Analysis for Linear Piping Components

There is a growing need in the AEC industry for the digitalization of model-based data exchange in BIM workflows. However, users continue to face difficulties exchanging data between BIM-based computer-aided design (CAD) and computer-aided engineering (CAE) software, even with the open, non-proprietary data exchange format called Industry Foundation Classes (IFC). Proposed solutions in academic research focus primarily on building systems, with comparatively little attention to piping models. Therefore, this paper introduces an interoperability tool for enabling piping model data exchange between architectural and structural analysis domains. The tool is tested using a piping model created in Autodesk Revit and shows marked improvement for IFC-based CAD-to-CAE interoperability over existing practice.

97 MATHEMATICS AND COMPUTING↗

High-throughput physiochemical and biogeochemical characterization for coastal soils and waters

Coastal environments span large biogeochemical gradients and provide critical ecosystem services worldwide, thereby having a disproportionately larger influence on global biogeochemical cycles and greenhouse gas fluxes than their geographical extent suggests. Despite this, cohesive quantitative tools to understand and describe these environments, including scalable, standardized field and laboratory methodologies are lacking. In this work, we advanced the streamlining and standardizing of quantitative approaches to measure and understand coastal physiochemical properties and biogeochemical processes across systems and scales. Outcomes of this work includes workflows for multiple complementary and in-line analyses, from basic physiochemical datasets to targeted molecular approaches and proof of concept through manipulation and analysis of coastal soils and waters with varying salinity, minerology, and biogeochemistry.

54 ENVIRONMENTAL SCIENCES↗

Interactions Between Climate Policy and Technology-influenced Travel Behavior: Mitigating Induced Demand from CACC

Advances in vehicle technology have influenced the development of automated vehicle systems, where vehicles that do not require human intervention are already deployed in the roadway networks. While these advances are proved to increase roadway safety and highway capacity, more research is needed to understand the long-term and regional-level impacts on mobility, land use, energy consumption, and emissions. This study proposes a multi-model approach to analyze the effect of vehicle automation and deep decarbonization policies over a period from 2020 to 2040 in Austin, Texas. We use the Global Change Analysis Model (GCAM) to develop internally the scenarios that are then passed to the SMART Mobility modeling workflow, a large-scale simulation framework combining the POLARIS activity-based travel demand model and mesoscopic traffic simulator with the Autonomie vehicle energy consumption model and the UrbanSim land use simulator. Results suggest that the introduction of vehicles with advanced automation could increase fuel consumption when no decarbonization policies are implemented. Also, advances in vehicle technology research and development could lead to a decline in energy use in the long-term. Energy pricing and vehicle electrification incentives could help reduce the impact of vehicle automation. Finally, our analysis indicates the relevance of introducing land use processes in longterm vehicle automation studies.

land use↗

Automated Bacterial Identification and Morphological Feature Analysis in Low‐Dose Cryo‐EM Using YOLOv11

Bacteria rapidly adapt to environmental cues through morphological and ultrastructural changes that correlate with physiology and behavior. Cryogenic transmission electron microscopy (cryo‐TEM) can capture these phenotypic changes in near‐native, vitrified states, but manual analysis of low‐dose micrographs is labor intensive and limits throughput. Here, we present an end‐to‐end workflow that combines low‐dose cryo‐TEM imaging with a YOLOv11‐based instance‐segmentation model to automatically identify bacteria and quantify key structural features directly from the micrographs. This workflow enables (i) robust bacterial localization and counting from low‐magnification atlas/montage images, (ii) automated measurements of cell‐envelope (outer–inner membrane) thickness and anisotropy from higher‐magnification views, and (iii) detection and quantification of bacteria–flagella interactions, including overlap length and curvature metrics for interacting versus noninteracting flagella. Using Pantoea sp. YR343 grown under distinct media conditions, we show that the automated measurements agree with manual annotations while substantially reducing analysis time. Together, these tools provide a practical framework for scalable bacterial identification and quantitative phenotyping in low‐dose cryo‐TEM datasets and establish a foundation for extending cryo‐TEM image analysis toward higher‐throughput studies of microbial heterogeneity and biointerfaces.

YOLOv11↗

An automated workflow that generates atom mappings for large‐scale metabolic models and its application to Arabidopsis thaliana

SUMMARY Quantification of reaction fluxes of metabolic networks can help us understand how the integration of different metabolic pathways determines cellular functions. Yet, intracellular fluxes cannot be measured directly but are estimated with metabolic flux analysis (MFA), which relies on the patterns of isotope labeling of metabolites in the network. The application of MFA also requires a stoichiometric model with atom mappings that are currently not available for the majority of large‐scale metabolic network models, particularly of plants. While automated approaches such as the Reaction Decoder Toolkit (RDT) can produce atom mappings for individual reactions, tracing the flow of individual atoms of the entire reactions across a metabolic model remains challenging. Here we establish an automated workflow to obtain reliable atom mappings for large‐scale metabolic models by refining the outcome of RDT, and apply the workflow to metabolic models of Arabidopsis thaliana . We demonstrate the accuracy of RDT through a comparative analysis with atom mappings from a large database of biochemical reactions, MetaCyc. We further show the utility of our automated workflow by simulating 15 N isotope enrichment and identifying nitrogen (N)‐containing metabolites which show enrichment patterns that are informative for flux estimation in future 15 N‐MFA studies of A. thaliana . The automated workflow established in this study can be readily expanded to other species for which metabolic models have been established and the resulting atom mappings will facilitate MFA and graph‐theoretic structural analyses with large‐scale metabolic networks.

59 BASIC BIOLOGICAL SCIENCES↗

X-composer: enabling cross-environments in-situ workflows between HPC and cloud

As large-scale scientific simulations and big data analyses become more popular, it is increasingly more expensive to store huge amounts of raw simulation results to perform post-analysis. To minimize the expensive data I/O, "in-situ" analysis is a promising approach, where data analysis applications analyze the simulation generated data on the fly without storing it first. However, it is challenging to organize, transform, and transport data at scales between two semantically different ecosystems due to the distinct software and hardware difference. To tackle these challenges, we design and implement the X-Composer framework. X-Composer connects cross-ecosystem applications to form an "in-situ" scientific workflow, and provides a unified approach and recipe for supporting such hybrid in-situ workflows on distributed heterogeneous resources. X-Composer reorganizes simulation data as continuous data streams and feeds them seamlessly into the Cloud-based stream processing services to minimize I/O overheads. For evaluation, we use X-Composer to set up and execute a cross-ecosystem workflow, which consists of a parallel Computational Fluid Dynamics simulation running on HPC, and a distributed Dynamic Mode Decomposition analysis application running on Cloud. Our experimental results show that X-Composer can seamlessly couple HPC and Big Data jobs in their own native environments, achieve good scalability, and provide high-fidelity analytics for ongoing simulations in real-time.

Wang, Dali↗

Modularization of EDGE Workflows Using Nextflow: Improving the Efficiency and Maintainability of Bioinformatics Software

EDGE is a bioinformatics platform developed in 2016 by researchers at Los Alamos National Laboratory (LANL) to facilitate the analysis of next-generation sequencing data by researchers with varying levels of experience in bioinformatics (Li et al., 2017). Users with single-end, paired-end or long-read sequencing data can provide their reads as input to EDGE and select the combination of workflows to run that are most useful for their research (e.g., quality control of reads, genome assembly, or the taxonomic classification of input reads). Table 1 summarizes the modules available in EDGE. EDGE is available as a web platform at https://edgebioinformatics.org, as installable source code maintained on GitHub under a GPLv3 license, and as a publicly hosted Docker image.

59 BASIC BIOLOGICAL SCIENCES↗

A framework for the correction of slow physiological drifts during MR-guided HIFU therapies: Proof of concept

Purpose: While respiratory motion compensation for magnetic resonance (MR)-guided high intensity focused ultrasound (HIFU) interventions has been extensively studied, the influence of slow physiological motion due to, for example, peristaltic activity, has so far been largely neglected. During lengthy interventions, the magnitude of the latter can exceed acceptable therapeutic margins. The goal of the present study is to exploit the episodic workflow of these therapies to implement a motion correction strategy for slow varying drifts of the target area and organs at risk over the entire duration of the intervention. Methods: The therapeutic workflow of a MR-guided HIFU intervention is in practice often episodic: Bursts of energy delivery are interleaved with periods of inactivity, allowing the effects of the beam on healthy tissues to recede and/or during which the plan of the intervention is reoptimized. These periods usually last for at least several minutes. It is at this time scale that organ drifts due to slow physiological motion become significant. In order to capture these drifts, the authors propose the integration of 3D MR scans in the therapy workflow during the inactivity intervals. Displacements were estimated using an optical flow algorithm applied on the 3D acquired images. A preliminary study was conducted on ten healthy volunteers. For each volunteer, 3D MR images of the abdomen were acquired at regular intervals of 10 min over a total duration of 80 min. Motion analysis was restricted to the liver and kidneys. For validating the compatibility of the proposed motion correction strategy with the workflow of a MR-guided HIFU therapy, an in vivo experiment on a porcine liver was conducted. A volumetric HIFU ablation was completed over a time span of 2 h. A 3D image was acquired before the first sonication, as well as after each sonication. Results: Following the volunteer study, drifts larger than 8 mm for the liver and 5 mm for the kidneys prove that slow physiological motion can exceed acceptable therapeutic margins. In the animal experiment, motion tracking revealed an initial shift of up to 4 mm during the first 10 min and a subsequent continuous shift of ∼2 mm/h until the end of the intervention. This leads to a continuously increasing mismatch of the initial shot planning, the thermal dose measurements, and the true underlying anatomy. The estimated displacements allowed correcting the planned sonication cell cluster positions to the true target position, as well as the thermal dose estimates during the entire intervention and to correct the nonperfused volume measurement. A spatial coherence of all three is particularly important to assure a confluent ablation volume and to prevent remaining islets of viable malignant tissue. Conclusions: This study proposes a motion correction strategy for displacements resulting from slowly varying physiological motion that might occur during a MR-guided HIFU intervention. The authors have shown that such drifts can lead to a misalignment between interventional planning, energy delivery, and therapeutic validation. The presented volunteer study and in vivo experiment demonstrate both the relevance of the problem for HIFU therapies and the compatibility of the proposed motion compensation framework with the workflow of a HIFU intervention under clinical conditions.

60 APPLIED LIFE SCIENCES↗

Trigger Detection for Adaptive Scientific Workflows Using Percentile Sampling

The increasing complexity of both scientific simulations and high-performance computing system architectures are driving the need for adaptive workflows, in which the composition and execution of computational and data manipulation steps dynamically depend on the evolutionary state of the simulation itself. Consider, for example, the frequency of data storage. Critical phases of the simulation should be captured with high frequency and with high fidelity for postanalysis; however, we cannot afford to retain the same frequency for the full simulation due to the high cost of data movement. We can instead look for triggers, indicators that the simulation will be entering a critical phase, and adapt the workflow accordingly. In this paper, we present a methodology for detecting triggers and demonstrate its use in the context of direct numerical simulations of turbulent combustion using S3D. We show that chemical explosive mode analysis (CEMA) can be used to devise a noise-tolerant indicator for rapid increase in heat release. However, exhaustive computation of CEMA values dominates the total simulation, and thus is prohibitively expensive. To overcome this computational bottleneck, we propose a quantile sampling approach. Our sampling-based algorithm comes with provable error/confidence bounds, as a function of the number of samples. Most importantly, the number of samples is independent of the problem size, and thus our proposed sampling algorithm offers perfect scalability. Our experiments on homogeneous charge compression ignition and reactivity controlled compression ignition simulations show that the proposed method can detect rapid increases in heat release, and its computational overhead is negligible. Our results will be used to make dynamic workflow decisions regarding data storage and mesh resolution in future combustion simulations.

97 MATHEMATICS AND COMPUTING↗

A Data Processing Pipeline To Extract A Knowledge Graph From Heterogeneous Data For Socio-technical Analysis Of Critical Infrastructure Influence

The code is written in Python and consists of the following pipeline that is implemented in Apache Airflow. This pipeline intends to understand the companies that are directly or indirectly involved with a type of critical infrastructure system at some point in that system's lifecycle. The pipeline takes a configuration file that specifies a list of initial companies to consider, a geographic region of interest, and a set of SEC form types as well as other data sources (e.g. CrunchBase) from which to extract entities and relations. There are four main components to this pipeline as currently implemented: Entity Extraction, Network Construction, Analysis, and Visualization. First, Entity Extraction, is implemented as the `topear-extract_organizations` Apache Airflow workflow. Given an initial query that specifies a geographic region of interest and a time interval, the software will extract CI facilities of interest and organizations that have a direct influence relationship to those facilities (e.g. ownership). During the course of the LDRD, we focused on Electric Vehicle charging stations and this information is available via the Department of Energy (DOE) database on fueling stations maintained by NREL. Within the context of the DOE CESER project, we have focused on Battery Energy Storage Systems (BESS). Second, the Network Extraction component will iteratively construct a social network graph given the set of organizations and people extracted in the previous step. Organizations (and eventually People if desired) are then fed as a query to the `topgear-construct_social_network` Apache Airflow workflow which given a set of initial companies and data sets (e.g. SEC EDGAR form types, OpenCorporates, Crunchbase). This Airflow workflow will iteratively query such data sources to discover relationships with new organizations and people. For example, this module can iteratively query SEC EDGAR for metadata that documents the number of each type of form for the given set of companies and their location. This forms metadata represents a catalog of data sources from SEC EDGAR for the extracted social network knowledge graph. The pipeline then downloads these forms from the website and saves them in a build directory for further processing. These documents are then parsed for entities and relations. Again, we note that in additional to SEC data sources, this step can also pull in information on organizations via API services such as CrunchBase and OpenCorporates or bulk data sources. At the end of this step, the resultant social network, the Critical Infrastructure network, and the edges that encode relationships between organizations and CI facilities, form the Adversarial Socio-Technical Network (ASTN) that informs the analysis. Third, the Analysis component processes these generated ASTN. Previously, that has included the ability to compare prevalence of different vendors for a given infrastructure component type across different regions as well as identify common public and private investors across those vendors. This was demonstrated for EV Charging Stations across several different metropolitan areas within an IEEE PES GridEdge publication. More recently, we have looked at ways to identify infrastructure owners and operators of BESS with the most nameplate capacity across different states as well as other indictors of risk resulting from changes in ownership over time. Finally, the Visualization component consists of an HTML/CSS/JS framework by which users can interact geospatial, operational, and organizational relationships across a given portfolio of Critical Infrastructure facilities. The objective is to provide a library of UI/UX modules that can be repurposed for stakeholder-specific dashboards. All of the modules are related via a common event model that enables UI actions in one view to percolate across the other views.

Weaver, Gabriel [Idaho National Laboratory (INL), ↗

Policy, Permit, Perform: Using City Benchmarking Data and Building Construction Permit History to Identify Energy Performance Improvements

The City of Portland (City) and Multnomah County 2015 Climate Action Plan targets a 40 percent reduction in carbon emissions below 1990 levels by 2030. To reach this goal, the plan includes a key objective to reduce the total energy use of existing buildings by 25 percent. Buildings are responsible for one-half of carbon emissions in Portland, Oregon, U.S., and improving their performance is critical to achieving the City’s climate goals. As part of its climate action planning, the City passed an ordinance on April 22, 2015, requiring commercial buildings 20,000 ft2 and larger to benchmark and disclose annual energy performance metrics through ENERGY STAR® Portfolio Manager® (ESPM), including greenhouse gas emissions, building energy use intensity (EUI) and ENERGY STAR scores. Twenty-five cities in the U.S. have adopted similar policies requiring energy benchmarking. These policies are generating a treasure trove of data about the drivers of building performance, but practitioners are only beginning to link benchmarking data to other datasets to produce actionable insight into improving building performance. In 2016, the City received a financial assistance award from the U.S. Department of Energy (DOE) through the Cities Leading through Energy Analysis and Planning project (Award Number DE-0007737). Portland’s project evaluated the application of the DOE Building Energy Asset Score Tool and rating system developed by Pacific Northwest National Laboratory (PNNL) to commercial buildings that report to the City. The City used building construction permit history to develop Asset Scores for a set of office buildings that reported energy performance for 2015 – the first year the City mandated energy benchmarking and reporting for commercial buildings 50,000 ft2 and larger. The primary project objective was to link energy benchmarking data and commercial building permit data to analyze commercial buildings systems that present the best, specific opportunities to improve energy performance. Integrating these datasets from two City departments, the Bureau of Development Services and the Bureau of Planning and Sustainability, could expand Portland’s use of analytics to inform climate policy decisions and strategic targeting of financial incentives for building owners and managers who are best positioned to improve the performance of their buildings. The project began with the commercial benchmarking data received for 340 commercial buildings that submitted calendar year 2015 energy reports. The City retained Research Into Action and Energy 350 (RIA team) to evaluate this self-reported benchmarking data. Based on a survey of 53 building managers, the RIA team found that most respondents used the City’s compliance tools, including a How-to Guide and Help Desk, and found access to utility data to be straightforward. However, almost one-third of the respondents encountered challenges when estimating the gross floor area (GFA), and some experienced confusion regarding the input of property use types and details into ESPM. Based on the RIA team’s recommendations, the City refined its How-to Guide, created online answers to frequently asked questions, and hosted office hour sessions to help building managers accurately characterize their building’s physical characteristics and operations in ESPM. Concurrently with the RIA team’s evaluation, the City worked with PNNL to estimate DOE Asset Score Preview (Preview) scores for 181 of the 340 commercial buildings that submitted ESPM reports to the City. Asset Score Tool is a web-based tool developed by PNNL for DOE to evaluate and rate the as-built energy efficiency of a building. Asset Score Tool’s full analysis capability runs a detailed energy model based on building geometry, age, envelope, lighting and mechanical systems using standard operating assumptions to give the building a score, similar to a miles per gallon rating for a car. Preview, a simplified deployment of the full Asset Score Tool, provides a preliminary score range using only seven data points, six of which are readily available in the ESPM benchmarking data. Analysis of the combined Preview scores and the operational ESPM scores identified buildings with a high potential for energy improvements through either retro-commissioning and retuning of existing operations or capital investments into building systems. The City contracted Whole Building Solutions (WBS) to mine building permit history and develop full Asset Scores for a subset of 26 office buildings that were eligible for both ENERGY STAR scores and Asset Scores. WBS researched permits and building plans to identify mechanical, lighting and envelope systems and other building characteristics necessary to complete Asset Scores. This historical data was recorded using the web-based Asset Score Tool, which evaluates the as designed energy efficiency of existing buildings. Much of this City information was available online after 2010; however, WBS had to search through microfiche files and the City’s database to obtain permit and plan history prior to 2010. Although building geometry, mechanical system type and basic envelope information was consistently identifiable, WBS found permit data gaps that prevented complete and accurate Asset Scores for most of the office buildings. If the City decides to develop Asset Scores based on building permit information in the future, WBS recommended requiring lighting plans, control diagrams and as-built drawings that reflect how the buildings are actually constructed. In addition, WBS recommended uploading plans and permits from microfiche storage into a more comprehensive, searchable database consistent with the City’s current online permit information. To identify the actual lighting types, WBS and City staff conducted site visits of all 26 office buildings. As part of managing the flow of ESPM and Asset Score data for the project, Earth Advantage, a sub-recipient of the Cities-LEAP award, created a DOE Standard Energy Efficiency Data (SEED) (USDOE 2018) instance for the City and used Asset Score’s Application Programming Interface (API) (Asset Score 2018) capabilities to develop two new features in the SEED Platform™: (1) automated Asset Score Preview ranges calculated based on benchmarking data and the City’s estimate of number of building floors; and (2) storage of full Asset Score information. Leveraging the construction permit history and site visit information for the 26 office buildings, The Cadmus Group (Cadmus) analyzed benchmarking data and Asset Score information to identify opportunities and drivers to improve performance. Correlation and regression analysis of the combined dataset was completed to determine whether building operations or specific systems – mechanical, lighting or envelope – present the best opportunities to improve energy performance. The central outcome of this project was Cadmus’ detailed analysis of the richer dataset that was created by combining the City of Portland’s commercial building permit activity and building-specific energy performance information based on metrics from ESPM and Asset Score Tool. Some of their findings collaborate with well-known facts, such as buildings with less efficient lighting systems are good targets for efficiency improvements through lighting upgrades. This analysis also helped identify that individual heating, ventilation, and air conditioning (HVAC) equipment efficiency does not necessarily correlate with building performance. However, overall HVAC system performance, as measured with the Total System Performance Ratio (TSPR) metric, is a better indicator of building performance (Goel et al. 2014). As a metric, TSPR considers whole system performance that includes equipment efficiency and system controls, such as resets for static pressure and chilled water setpoints, which can be more effective and financially feasible options for improving building performance. Given the high cost associated with envelope retrofits, opportunities to upgrade envelope insulation are likely to be limited. However, buildings with single-pane and non-thermal break windows are good candidates for window replacements, such as upgrading to double-pane windows with thermal breaks. This research project determined that developing Asset Scores based on site visits is preferable to mining City building permit data. In addition, the use of benchmarking data to develop Asset Score Preview Scores is recommended as a first step in engaging building managers to develop full Asset Scores. Asset Score Tool outputs can help building managers quickly identify opportunities for improvement and then work with the utility incentive administrator and energy service providers to develop their retrofit plan. Where full Asset Scores are available, analysis using a quadrant matrix with ENERGY STAR scores is recommended to identify buildings that present the best opportunities for operational-behavioral improvements versus ones with opportunities for upgrades to physical building systems. This workflow and the tools will help cities, utility incentive administrators, building portfolio managers and energy service providers develop energy programs and strategies for screening and analysis of buildings with the greatest energy savings potential. This report describes the project approach and research results to inform future coordination of ESPM and Asset Score data, including the use of benchmarking data to generate Preview scores. Given better awareness of energy performance, building managers can make more informed decisions to reduce energy consumption and carbon emissions. With cities, states and jurisdictions adopting benchmarking and auditing ordinances, there are substantial amounts of data submitted to cities that could be used to inform investments in energy efficiency.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Transmission Operator Workflows for Real-Time Reliability Studies: A Review of Control Room Practices and Naturalistic Decision Making

This report provides an overview of real-time reliability study tools and their use by power system operators in the control room environment. After introducing some of the nuances of the control room environment and the differences in perspectives between power system engineers and operators, the roles and responsibilities of key entities involved in RTCA workflows are introduced. These are specifically the transmission system operator (TOP) and reliability coordinator (RC), which are required to run tools such as real-time contingency analysis (RTCA) as part of a real-time reliability assessment every 30 minutes, as dictated by a series of standards issued by the North American Electric Reliability Corporation (NERC). The process by which power systems operators operate the grid is discussed in terms of naturalistic decision making (NDM) and the recognition-primed decision-making (RPD) model. This cognitive model describe how experts working in high-risk, high-stress environments make safety-critical decisions under uncertainty and time pressure. For power system operators, the mental simulations involved in the traditional RPD model are supplemented by physics-based simulations using numerical tools, such as RTCA, to improve situational awareness and effectiveness of control actions. Next, a generic workflow is introduced to describe operator decision making for running RTCA tools and responding to system violations on a pre-contingent basis. The types of analysis performed and control actions chosen by power system operators are described in detail. The overall high-level workflow is then expanded in subsequent sections, with special attention given to high-voltage violations, low-voltage violations, and thermal overloads. Each type of violation is described in detail, with explanations of common causes, impacts on equipment and customers, and mitigation strategies. An additional workflow diagram is provided for each type of violation.

24 POWER TRANSMISSION AND DISTRIBUTION↗