SEARCH · Search NASA

Results for “data infrastructures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

All sources NASA NTRS DOE OSTI

DOE OSTI2026

A Brief Survey of Data Streaming Technologies

Streaming data is data that is emitted at variable volumes in a continuous, incremental manner with the goal of low-latency processing often at a different physical location. Network infrastructure is used to facilitate the connection between data sources and sinks, and must be robust to handle the requirements of the workflow. The U.S. Department of Energy Office of Science (DOE SC) a federal agency supporting fundamental scientific research for energy and the Nation’s largest supporter of basic research in the physical sciences. DOE SC has the responsibility for operating $\mathbf{1 0}$ National Laboratories, and 28 scientific user facilities supporting advanced supercomputers, particle accelerators, large x-ray light sources, neutron scattering sources, and other specialized facilities for nanoscience and genomics. This paper investigates the state of streaming data workfows, and details some of the approaches to this challenging problem.

Kissel, Ezra↗

DOE OSTI2026

The LCLStream Ecosystem for Multi-Institutional Dataset Exploration

We describe a new end-to-end experimental data streaming framework designed from the ground up to support new types of applications – AI training, extremely high-rate X-ray time-of-flight analysis, crystal structure determination with distributed processing, and custom data science applications and visualizers yet to be created. Throughout, we use design choices merging cloud microservices with traditional HPC batch execution models for security and flexibility. This project makes a unique contribution to the DOE Integrated Research Infrastructure (IRI) landscape. By creating a flexible, API-driven data request service, we address a significant need for high-speed data streaming sources for the X-ray science data analysis community. With the combination of data request API, mutual authentication web security framework, job queue system, high-rate data buffer, and complementary nature to facility infrastructure, the LCLStreamer framework has prototyped and implemented several new paradigms critical for future generation experiments.

Rogers, David [ORNL] (ORCID:0000000251871768)↗

DOE OSTI2023

Toward implementing autonomous adaptive data acquisition for scanning hyperspectral imaging of biological systems

Autonomous experimentation is an emerging area of research, primarily related to autonomous vehicles, scientific combinatorial discovery approaches in materials science and drug discovery, and iterative research loops of planning, experimentation, and analysis. However, autonomous approaches developed in these contexts are difficult to apply to high-dimensional mapping technologies, such as scanning hyperspectral imaging of biological systems, due to sample complexity and heterogeneity. We briefly cover the history of adaptive sampling algorithms and surrogate modeling in order to define autonomous adaptive data acquisition as an objective-based, flexible building block for future biological imaging experimentation driven by intelligent infrastructure. We subsequently summarize the recent implementations of autonomous adaptive data acquisition (AADA) for scanning hyperspectral imaging, assess how these address the difficulties of autonomous approaches in hyperspectral imaging, and highlight the AADA design variation from a goal-oriented perspective. Finally, we present a modular AADA architecture that embeds AADA-driven flexible building blocks to address the challenge of time resolution for high-dimensional scanning hyperspectral imaging of nonequilibrium dynamical systems. In our example research-driven experimental design case, we propose an AADA infrastructure for time-resolved, noninvasive, and label-free scanning hyperspectral imaging of living biological systems. This AADA infrastructure can accurately target the correct state of the system for experimental workflows that utilize subsequent expensive, high-information-content analytical techniques.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

Electrifying Airport GSE: Monte Carlo Grid Impacts

Airports globally are shifting from ICE-powered to electric Ground Support Equipment (eGSE) to enhance efficiency, reduce operational costs, and improve operator health. Leveraging predictable routes, flat terrain, and low operational speeds, airports provide ideal conditions for electrification. This study evaluates freight GSE electrification at Dallas-Fort Worth International Airport (DFW), USA, using the Agile@ platform, which integrates three analytical methods: Freight Facility Model (FFM), Activity-Structure-Intensity-Fuel (ASIF), and Monte Carlo simulations. Results from 10,000 simulations indicate modest but critical increases in electricity demand and significant variability in GSE energy consumption. These insights emphasize the importance of data-driven scheduling, targeted maintenance, and strategic infrastructure planning. For high-uncertainty scenarios, airports are advised to deploy buffer energy storage systems (battery banks), implement demand-response charging strategies, schedule flexible workforce shifts, and prioritize proactive maintenance-particularly for equipment with higher operational uncertainty, such as tug tractors with trailers. Agile@ thus offers a robust, scalable, and data-driven framework to optimize long-term GSE planning and enhance reliability across diverse airport environments.

Bose, Ranjan [ORNL] (ORCID:0009000791026327)↗

DOE OSTI2022

Electric Vehicle Charging Infrastructure Trends from the Alternative Fueling Station Locator: First Q2022

The U.S. Department of Energy's Alternative Fueling Station Locator contains information on public and private nonresidential alternative fueling stations in the United States and Canada and currently tracks ethanol (E85), biodiesel, compressed natural gas, electric vehicle (EV) charging, hydrogen, liquefied natural gas, and propane stations. Of these fuels, EV charging continues to experience rapidly changing technology and growing infrastructure. This report provides a snapshot of the state of EV charging infrastructure in the United States in the first calendar quarter of 2022 (Q1). Using data from the Station Locator, this report breaks down the growth of public and private charging infrastructure by charging level, network, and location. Additionally, this report measures the current state of charging infrastructure compared with two different 2030 infrastructure requirement scenarios. This information is intended to help transportation planners, policymakers, researchers, infrastructure developers, and others understand the rapidly changing landscape of EV charging infrastructure. This is the ninth report in a series. Reports from previous quarters can be found in the Alternative Fuels Data Center (AFDC) and National Renewable Energy Laboratory (NREL) publication databases, as well as the AFDC Charging Infrastructure Trends page (https://afdc.energy.gov/fuels/electricity_infrastructure_trends.html).

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2022

Electric Vehicle Charging Infrastructure Trends from the Alternative Fueling Station Locator (Second Quarter 2022)

The U.S. Department of Energy's Alternative Fueling Station Locator contains information on public and private nonresidential alternative fueling stations in the United States and Canada and currently tracks ethanol (E85), biodiesel, compressed natural gas, electric vehicle (EV) charging, hydrogen, liquefied natural gas, and propane stations. Of these fuels, EV charging continues to experience rapidly changing technology and growing infrastructure. This report provides a snapshot of the state of EV charging infrastructure in the United States in the second calendar quarter of 2022 (Q2). Using data from the Station Locator, this report breaks down the growth of public and private charging infrastructure by charging level, network, and location. Additionally, this report measures the current state of charging infrastructure compared with two different 2030 infrastructure requirement scenarios. This information is intended to help transportation planners, policymakers, researchers, infrastructure developers, and others understand the rapidly changing landscape of EV charging infrastructure. This is the tenth report in a series. Reports from previous quarters can be found in the Alternative Fuels Data Center (AFDC) and National Renewable Energy Laboratory (NREL) publication databases, as well as the AFDC Charging Infrastructure Trends page (https://afdc.energy.gov/fuels/electricity_infrastructure_trends.html).

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2022

Adaptive Neurocontrol for Grid-Following Inverters

The new generation of power systems involve a large number of autonomous operating units with the flow of data being restricted by privacy concerns or infrastructure hurdles. The systems are also time-varying so the control should adjust in a timely manner to avoid failures that usually have very negative economical implications. Adaptive neurocontrol which takes elements from adaptive control (great for time-varying problems) and model identification (could be in the form of neural network) by using local available data is a compelling tool. In this work, we summarize analytical results for adaptive neurocontrol, followed with numerical verification of how the method could work for future grids.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Data Requirements for Application of Risk-Based Dynamic Contingency Analysis to Evaluate Hurricane Impact to Electrical Infrastructure in Puerto Rico

This paper presents a risk-based dynamic contingency analysis framework that was used to evaluate the hurricane impact to electrical infrastructure in Puerto Rico. PNNL developed a scalable risk-based framework for identifying high-voltage transmission resilience improvements by classifying and prioritizing high-risk power grid contingencies (system failures) under hurricane impact. The risk-based framework is founded on grid outage definitions with their associated probabilities of occurrence from hurricane events, in combination with an impact assessment derived from detailed dynamic cascading failure analysis. This paper focuses on a discussion around data requirements for transmission resilience planning for hurricane events, derived from the development of the risk-based framework and its application to Puerto Rico. This paper launches an important first step in encouraging the engineering community and power system industry to move towards establishing resilience planning as a routine practice. Since actual results for Puerto Rico contain sensitive information, sample simulation results will be used to illustrate the data requirements and risk-based dynamic cascading framework on the Puerto Rico power grid, as well as demonstrate the potential for such a simulation framework. The paper includes a discussion on the lessons learned, importance and need for improved datasets that are not usually considered in traditional power system planning. The paper will also elaborate on how the scalable simulation framework and datasets might be expanded to larger footprints and leveraged for modelling other types of natural disasters.

DCAT, Puerto Rico, hurricane, Power System Stabili↗

DOE OSTI2026

CONTROL AND DATA ACQUISITION IN A CYBER-PHYSICAL MIDSTREAM TESTBED

This thesis presents the development of a laboratory-scale cyber–physical midstream pipeline testbed designed to address this gap and support research in industrial control systems security. The platform integrates pumps, valves, sensors, programmable logic controllers (PLCs), and a human–machine interface (HMI) to emulate the monitoring and control architecture of real pipeline operations. The physical process is implemented as a closed-loop liquid circulation system designed to replicate flow behavior characteristic of midstream pipeline infrastructure. The testbed enables real-time data acquisition of key process variables, including flow rate and pressure facilitating the generation of datasets representative of normal pipeline operation. A threat model encompassing common ICS attack vectors was developed, including sensor spoofing, command injection, false data injection, denial-of-service attacks, and relay manipulation. Multiple attack scenarios were implemented and evaluated to demonstrate how cyber intrusions targeting sensors, actuators, networks, and software propagate into measurable physical consequences in pipeline flow and pressure. The developed platform serves as a practical, cost-effective environment for experimentation, education, and future cybersecurity research in midstream pipeline systems.

42 ENGINEERING↗

DOE OSTI2024

A Data Processing Pipeline To Extract A Knowledge Graph From Sec Documents For Socio-technical Analysis Of Critical Infrastructure Influence

The code is written in Python and consists of the following pipeline that is implemented in Apache Airflow. This pipeline intends to understand the companies that are directly or indirectly involved with a type of critical infrastructure system at some point in that system's lifecycle. The pipeline takes a configuration file that specifies a list of initial companies to consider, a geographic region of interest (disk) expressed as a latitude/longitude point and distance, and a set of SEC form types from which to extract entities and relations. There are three main components to this pipeline as currently implemented: Social Network Extraction, Critical Infrastructure Network Extraction, and Inference and Fusion. First, Social Network Extraction, implemented as the `organizations_sec` component of the workflow graph queries the SEC EDGAR webservice using the list of initial companies from the configuration file. Given this, it extracts metadata that documents the number of each type of form for the given set of companies and their location. This forms metadata represents a catalog of data sources for the extracted social network knowledge graph. The pipeline then downloads these forms from the website and saves them in a build directory for further processing. These documents are then parsed for entities and relations. Second, the Critical Network Extraction component extracts entities and relations for a critical infrastructure sector. Currently, we focus on Electric Vehicle charging stations and this information is available via the Department of Energy (DOE) database on fueling stations maintained by NREL. Third, the Inference and Fusion component relates the social network graph to the critical infrastructure graph in order to understand the impact of a company within a geographic region. Relations include ownership of the EV Charging Station asset as well as maintenance/ownership of the EV payment networks. The fused network can be represented in many ways and currently we emit a knowledge graph.

Weaver, GabrielA.↗

DOE OSTI2025

Quality-Controlled Meteorological Data from the Flood Control District of Maricopa County (FCDMC) Network, Phoenix, Arizona (1987-2024)

This dataset contains 15- or 30-minute interval meteorological data from the Flood Control District of Maricopa County (FCDMC), Arizona, USA, covering eight key variables across multiple sensor stations between 1987 and 2024. Each variable is stored as a separate CSV file, containing time-series data that have undergone rigorous quality control (QC) procedures and, where appropriate, short-gap interpolation for consistency. The quality control (QC) pipeline consisted of four sequential tests: (1) a range test to ensure all values fall within physically realistic limits, (2) a step test to identify abrupt and implausible changes between consecutive records, (3) a proximity test that validates flagged values from step test using data from nearby stations and exceedance probability thresholds, and (4) a persistence test to detect and remove periods of unrealistically constant readings. These thresholds were calibrated to Arizona’s environmental conditions and sensor specifications. After QC, short gaps (≤2 hours) were linearly interpolated to ensure consistent temporal resolution, except for wind variables. Due to a major upgrade in FCDMC’s data transmission system, only ALERT-2 protocol data (2016–2024) for wind variables are included; earlier ALERT-1 data were excluded because of irregular sampling and high missing rates. This dataset supports regional climate and infrastructure resilience studies by providing standardized, high-resolution meteorological data for the greater Phoenix metropolitan area.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

EV Charging Infrastructure Energization: An Overview of Approaches for Simplifying Processes and Accelerating Timelines to Processing EV Charging Load Service Requests

The United States has seen significant growth in electric vehicle (EV) adoption, leading to increased demand for EV charging infrastructure and electricity. Growth in electricity demand from EV charging, coupled with growth in other sectors like data centers and electrification of other sectors, is impacting electricity infrastructure and load service request processes after two decades of relatively flat electricity demand. While most electric vehicle charging occurs at home, enroute and depot charging for medium and heavy-duty vehicles, both using high-powered EV charging, are critical to meet electric vehicle operational needs. Over the past decade, EV charging infrastructure site developers, site hosts, and electric distribution utilities have navigated the process to integrate chargers onto the electric grid. Site developers and site hosts have expressed distress that the integration process for high-powered EV charging projects does not meet the needs of the EV market for timeliness or cost. High-powered charging stations typically require a load service request or an agreement with the local utility to connect to the grid. The process of energizing a new high-powered charging site can be complex and time consuming, often taking up to 2 years. This timeline is the result of current utility energization processes having been designed for construction projects that take longer to build (i.e., buildings). The specific challenges stem from various factors, including compartmentalization in application processes, the integration of EV charging process approvals with other distributed energy resources (DERs), and the need to ensure grid reliability. The energization process needs to evolve to meet the growing demand for high-powered EV charging. This white paper compiles information gathered through various conversations with key stakeholders, including utilities, utility regulators, EV charging operators, site developers, and authorities having jurisdiction (AHJ) as well as through an extensive literature review. This document identifies the challenges and provides potential solutions to streamline the process of connecting EV charging infrastructure to the power grid in the United States, serving as a starting point for future conversations around these solutions.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

InfraSys (Infrastructure Systems) [SWR-24-42]

This package implements a data store for components and time series in support of Python-based modeling packages. While it is designed to support teams modeling transmission and distribution systems for electrical grids, it can be used by any package that needs to store components (e.g., generators and buses) that have quantities (e.g., power and voltage) which may vary over time. The package was inspired by InfrastructureSystems.jl (https://github.com/NREL-Sienna/InfrastructureSystems.jl).

Thom, Daniel↗

DOE OSTI2026

Scalable and Secure Power Outage Data Reporting: A Hexagonal Geospatial Approach

Power outages disrupt critical infrastructure and cause billions of dollars in economic losses annually in the United States. Accurate and granular outage reporting is vital for effective restoration and mitigation. This paper examines the integration of the Hexagonal Hierarchical Geospatial Indexing System (H3) to enhance power outage reporting, leveraging its uniform grid structure, scalable resolutions, and support for privacy-preserving analysis. Using high-resolution LandScan Global population data and K-anonymization techniques, this work achieves a balance between data granularity and privacy. Results show that lower privacy thresholds (e.g., K-anonymity = 2) enable higher resolution, while stricter thresholds (e.g., >15 people per hex) reduce granularity, potentially affecting localized responses. State-and county-level resolution case studies demonstrate H3’s adaptability and the trade-offs between precision and privacy. The proposed H3-based framework offers a scalable and efficient solution for geospatial data integration within the energy sector, such as outage data, aiding utilities and regulators in improving resilience and response efforts, particularly in disaster-prone regions.

Ahmad, Nasir [ORNL] (ORCID:0000000150677368)↗

DOE OSTI2026

Unlocking Synergistic Benefits of Colocation of Data Centers at Airports

This white paper evaluates the potential of a new energy system configuration: Strategic colocation of data centers - on airport property or adjacent to airports - in order to realize significant operational, economic, and environmental benefits to airports, data centers, and the communities they serve. While increasing demand from both airports and data centers requires both parties to make significant infrastructure investments, colocation can mitigate some of the energy, land use, permitting, and connectivity challenges of siting and powering these industries.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Transitioning from File-Based HPC Workflows to Streaming Data Pipelines with openPMD and ADIOS2

This paper aims to create a transition path from file-based IO to streaming-based workflows for scientific applications in an HPC environment. By using the openPMP-api, traditional workflows limited by filesystem bottlenecks can be overcome and flexibly extended for in situ analysis. The openPMD-api is a library for the description of scientific data according to the Open Standard for Particle-Mesh Data (openPMD). Its approach towards recent challenges posed by hardware heterogeneity lies in the decoupling of data description in domain sciences, such as plasma physics simulations, from concrete implementations in hardware and IO. The streaming backend is provided by the ADIOS2 framework, developed at Oak Ridge National Laboratory. This paper surveys two openPMD-based loosely-coupled setups to demonstrate flexible applicability and to evaluate performance. In loose coupling, as opposed to tight coupling, two (or more) applications are executed separately, e.g. in individual MPI contexts, yet cooperate by exchanging data. This way, a streaming-based workflow allows for standalone codes instead of tightly-coupled plugins, using a unified streaming-aware API and leveraging high-speed communication infrastructure available in modern compute clusters for massive data exchange. We determine new challenges in resource allocation and in the need of strategies for a flexible data distribution, demonstrating their influence on efficiency and scaling on the Summit compute system. The presented setups show the potential for a more flexible use of compute resources brought by streaming IO as well as the ability to increase throughput by avoiding filesystem bottlenecks.

Poeschel, Franz↗

DOE OSTI2021

Electric Vehicle Charging Infrastructure Trends from the Alternative Fueling Station Locator: First Quarter 2021

The U.S. Department of Energy’s (DOE’s) Alternative Fueling Station Locator contains information on public and private non-residential alternative fueling stations in the United States and Canada and currently tracks ethanol (E85), biodiesel, compressed natural gas, electric vehicle (EV) charging, hydrogen, liquefied natural gas, and propane stations. Of these fuels, EV charging continues to experience rapidly changing technology and growing infrastructure. This report provides a snapshot of the state of EV charging infrastructure in the United States in the first calendar quarter of 2021 (Q1). Using data from the Station Locator, this report breaks down the growth of public and private charging infrastructure by charging level, network, and location. Additionally, this report measures the current state of charging infrastructure compared with the target infrastructure volume for 2030. This information is intended to help transportation planners, policymakers, researchers, infrastructure developers, and others understand the rapidly changing landscape for EV charging. This is the fifth report in a series. Previous reports from 2020 can be found in the Alternative Fuels Data Center (AFDC) and National Renewable Energy Laboratory (NREL) publication databases, as well as the AFDC Charging Infrastructure Trends page (https://afdc.energy.gov/fuels/electricity_infrastructure_trends.html).

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

Electric Vehicle Charging Infrastructure Trends from the Alternative Fueling Station Locator: Second Quarter 2021

The U.S. Department of Energy's (DOE's) Alternative Fueling Station Locator contains information on public and private non-residential alternative fueling stations in the United States and Canada and currently tracks ethanol (E85), biodiesel, compressed natural gas, electric vehicle (EV) charging, hydrogen, liquefied natural gas, and propane stations. Of these fuels, EV charging continues to experience rapidly changing technology and growing infrastructure. This report provides a snapshot of the state of EV charging infrastructure in the United States in the second calendar quarter of 2021 (Q2). Using data from the Station Locator, this report breaks down the growth of public and private charging infrastructure by charging level, network, and location. Additionally, this report measures the current state of charging infrastructure compared with the target infrastructure volume for 2030. This information is intended to help transportation planners, policymakers, researchers, infrastructure developers, and others understand the rapidly changing landscape for EV charging. This is the sixth report in a series. Reports from previous quarters can be found in the Alternative Fuels Data Center (AFDC) and National Renewable Energy Laboratory (NREL) publication databases, as well as the AFDC Charging Infrastructure Trends page (https://afdc.energy.gov/fuels/electricity_infrastructure_trends.html).

33 ADVANCED PROPULSION SYSTEMS↗