Search NASA⌕ Search

SEARCH · Search NASA

Results for “data transmission and processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Alaska Meteorology, Energy, and Transmission (MET) Toolkit

The Alaska MET (Meteorology, Energy, and Transmission) Toolkit is the National Laboratory of the Rockies' (NLR) new flagship atmospheric dataset, designed to support comprehensive long-term planning and operations across the entire power sector. Serving as the regional counterpart to CONUS-wide HRRR MET Toolkit, this dataset provides a comprehensive, high-fidelity meteorological record covering Alaska.The Alaska MET Toolkit is delivered at an hourly resolution on a standardized 2-km horizontal grid. This dataset is repackaged from the National Oceanic and Atmospheric Administration's (NOAA) operational High-Resolution Rapid Refresh for Alaska (HRRR-AK) forecasts. Spanning from 2019 to 2025, it overcomes the technical barriers of native weather models by providing spatial regridding from the native 3-km HRRR-AK horizontal resolution to a 2-km grid, temporal gap-filling, and vertical interpolation at key energy-relevant heights. By delivering highly accurate, validation-backed data across a comprehensive suite of atmospheric variables - including temperature, pressure, humidity, and wind characteristics - the Alaska MET Toolkit provides a highly accessible and strictly standardized foundation for modern power system modeling.

17 WIND ENERGY↗
DOE OSTI2026

Low power on-chip data transmission for wafer-scale monolithic active pixel sensors

Here, this paper details the implementation of the digital pulse shaping subsystem within the Backbone Transmission Line Encoding (BTLE) driver, a low-power, long-distance on-chip data transmission solution designed in a 65 nm CMOS process. Digital pulse shaping is critical for minimizing inter-symbol interference (ISI) caused by bandwidth limitations of on-chip interconnects, especially in wafer-scale monolithic active pixel sensors (MAPS). A duobinary encoder coupled with a parallelized polyphase finite impulse response (FIR) filter is used for efficient shaping of the transmitted signal spectrum. This reconfigurable architecture achieves reliable 160 Mb/s data transfer over a 10 cm on-chip link, as validated by simulations demonstrating low power consumption (FoM 37.3 fJ/bit/mm of transmission line length) and effective ISI mitigation.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Signatures of Mollicutes-related endobacteria in publicly available Mucoromycota genomes

ABSTRACT Mucoromycota fungi and their Mollicutes-related endobacteria (MRE) are an ideal system for studying bacterial–fungal interactions and evolution due to the long-term and intimate nature of their interactions. However, methods for detecting MRE face specific challenges due to the poor representation of MRE in sequencing databases coupled with the high sequence divergence of their genomes, making traditional similarity searches unreliable. This has precluded estimations on the diversity of MRE associated with Mucoromycota. To determine the prevalence of previously undetected MRE in fungal genome sequences, we scanned 389 Mucoromycota genome assemblies available from the National Center for Biotechnology Information for the presence of MRE sequences using publicly available tools to map contigs from fungal assemblies to publicly available MRE genomes. We demonstrate a higher diversity of MRE genomes than previously described in Mucoromycota and a lack of cophylogeny between MRE and the majority of their fungal hosts. This supports the late invasion hypothesis regarding MRE acquisition across most of the examined fungal families. In contrast with other Mucoromycota lineages, MRE from the Gigasporaceae displayed some degree of cophylogeny with their hosts, which may indicate that horizontal transmission is restricted between members of this family or that transmission is strictly vertical. These results underscore the need for a refined process to capture sequencing data from potential fungal endosymbionts to discern their evolution and transmission. Screens of fungal genomes for MRE can help improve the quality of fungal genome assemblies while identifying new MRE lineages to further test hypotheses on their origin and evolution. IMPORTANCE Mollicutes-related endobacteria (MRE) are obligate intracellular bacteria found within Mucoromycota fungi. Despite their frequent detection, MRE roles in host functioning are still unknown. Comparative genomic investigations can improve our understanding of the impact of MRE on their fungal hosts by identifying similarities and differences in MRE genome evolution. However, MRE genomes have only been assembled from a small fraction of Mucoromycota hosts. Here, we demonstrate that MRE can be present yet undetected in publicly available Mucoromycota genome assemblies. We use these newfound sequences to assess the broader diversity of MRE and their phylogenetic relationships with respect to their hosts. We demonstrate that publicly available tools can be used to extract novel MRE sequences from assembled fungal genomes leading to insights on MRE evolution. This work contributes to a greater understanding of the fungal microbiome, which is crucial to improving knowledge on the dynamics and impacts of fungi in microbial ecosystems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Atomic-Scale Characterization of Dilute Dopants in Topological Insulators via STEM–EDS Using Registration and Cell Averaging Techniques

Magnetic dopants in three-dimensional topological insulators (TIs) offer a promising avenue for realizing the quantum anomalous Hall effect (QAHE) without the necessity for an external magnetic field. Understanding the relationship between site occupancy of magnetic dopant elements and their effect on macroscopic property is crucial for controlling the QAHE. By combining atomic-scale energy-dispersive X-ray spectroscopy (EDS) maps obtained by aberration-corrected scanning transmission electron microscopy (AC-STEM) and novel data processing methodologies, including semi-automatic lattice averaging and frame registration, we have determined the substitutional sites of Mn atoms within the 1.2% Mn-doped Sb 2 Te 3 crystal. More importantly, the methodology developed in this study extends beyond Mn-doped Sb 2 Te 3 to other quantum materials, traditional semiconductors, and even electron irradiation sensitive materials.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Unsupervised Segmentation and Clustering Workflow for Efficient Processing of 4D-STEM and 5D-STEM Data

Four-dimensional scanning transmission electron microscopy (4D-STEM) enables mapping of diffraction information with nanometer-scale spatial resolution, offering detailed insight into local structure, orientation, and strain. However, as data dimensionality and sampling density increase, particularly for in situ scanning diffraction experiments (5D-STEM), robust segmentation of structurally consistent behavior across sequential measurements becomes essential for efficient and physically meaningful analysis. Here, we introduce a clustering framework that identifies crystallographically distinct domains from 4D-STEM datasets. By using local diffraction-pattern similarity as a metric, the method extracts closed contours delineating spatially contiguous regions. This approach produces cluster-averaged diffraction patterns that improve signal quality while reducing data volume by orders of magnitude, enabling rapid and accurate orientation, phase, and strain mapping. We demonstrate the applicability of this approach to in situ liquid-cell 4D-STEM data of gold nanoparticle growth. Our method provides a scalable and generalizable route for spatially coherent segmentation, data compression, and quantitative structure–strain mapping across diverse 4D-STEM modalities. The full analysis code and example workflows are publicly available to support reproducibility and reuse.

4D-STEM↗
DOE OSTI2026

Data for "Understanding multiscale disorder in superconducting nanowire single photon detectors"

This dataset addresses DC transport, dark-count measurements, and bias-dependent microwave transmission spectroscopy of superconducting nanowire. This publication includes the raw and processed data to produce figures in the paper "Understanding multiscale disorder in superconducting nanowire single photon detectors" (Sarkar et al., 2026).

Sarkar, Nirjhar [Oak Ridge National Laboratory] (O↗
DOE OSTI2022

Entropy and its Relationship with Statistics

The purpose of our report is to discuss the notion of entropy and its relationship with statistics. Our goal is to provide a manner in which you can think about entropy, its central role within information theory and relationship with statistics. We review various relationships between information theory and statistics—nearly all are well-known but unfortunately are often not recognized. Entropy quantities the "average amount of surprise" in a random variable and lies at the heart of information theory, which studies the transmission, processing, extraction, and utilization of information. For us, data is information. What is the distinction between information theory and statistics? Information theorists work with probability distributions. Instead, statisticians work with samples. In so many words, information theory using samples is the practice of statistics.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Challenges and Opportunities for Electric Utility Modeling and Asset Valuation Frameworks: Case Study on Valuing New Pumped Storage Hydropower

Asset valuation by electric utilities is becoming increasingly difficult in the rapidly changing electric sector. Rapid deployment of variable generation and inverter-based storage systems along with uncertain demand growth, climate, policies, and other factors create a challenging environment for understanding the value proposition of a new potential asset. This report describes an effort between the Tennessee Valley Authority (TVA) and three U.S. Department of Energy laboratories to perform a detailed review of utility modeling and analysis practices for asset valuation and identify challenges and opportunities for advancing its methods into the future. It focuses on a case study of new potential pumped storage hydropower (PSH) because of growing interest in new PSH capacity to provide energy balancing, firm capacity, and a range of ancillary services. Staff from the DOE labs conducted systematic interviews about current practices in capacity expansion modeling, production-cost modeling, hydrological modeling, and transmission stability modeling while also discussing how scenario analysis is conducted and how models and data are integrated. The effort resulted in a set of model, integration, and scenario recommendations that could be valuable to TVA, other utilities, system operators, and other stakeholders conducting integrated grid analysis. Individual model recommendations suggest exploring computational tradeoffs with detail and resolution across spatiotemporal structure, supply- and demand-side details, transmission overlays, market interactions, and ancillary services. Automated processes to pass data between models and conduct larger scenario suites could also enhance valuation practices by enabling a more consistent study of asset value across a broader range of uncertain future grid conditions where PSH could be particularly valuable. TVA and other industry stakeholders can learn from and adapt applied research-grade methods developed by DOE laboratories and other research institutions to improve decision making and accelerate progress towards a reliable, economic, sustainable energy system.

13 HYDRO ENERGY↗
DOE OSTI2024

Open Source Synergy: Developing and Validating PMU Data Analysis Techniques Using Open Source Tools and Datasets

This paper presents an exploration into the development and validation of data analysis approaches for Phasor Measurement Units (PMUs) using open-source datasets and tools. Various methods for event detection, event classification, frequency response, and oscillation analysis were tested. We leverage the capabilities of Archive Walker (AW), the Frequency Response Analysis Tool (FRAT), and the Oscillation Baselining and Analysis Tool (OBAT), all open-source tools, for efficient processing and analysis of synchrophasor data. The open-source Transmission Signature Library (TSL) dataset was employed as a dataset for a comprehensive evaluation to assess the performance and reliability of the proposed methods.

PMU, event analysis, oscillation, Frequency Respon↗
DOE OSTI2021

Visualizing defects and pore connectivity within metal–organic frameworks by X-ray transmission tomography

Metal–Organic Frameworks (MOFs) have the potential to change the landscape of molecular separations in chemical processes owing to their ability of selectively binding molecules. Their molecular sorting properties generally rely on the micro- and meso-pore structure, as well as on the presence of coordinatively unsaturated sites that interact with the different chemical species present in the feed. In this work, we show a first-of-its-kind tomographic imaging of the crystal morphology of a metal– organic framework by means of transmission X-ray microscopy (TXM), including a detailed data reconstruction and processing approach. Corroboration with Focused Ion Beam-Scanning Electron Microscopy (FIB-SEM) images shows the potential of this strategy for further (non-destructively) assessing the inner architecture of MOF crystals. By doing this, we have unraveled the presence of large voids in the internal structure of a MIL-47(V) crystal, which are typically thought of as rather homogeneous lattices. This challenges the established opinion that hydrothermal syntheses yield relatively defect-free material and sheds further light on the internal morphology of crystals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Revealing the Crystalline Architecture of Semicrystalline Ion Exchange Membranes for the Design of Conductive and Durable Alkaline Anion Exchange Membranes

Alkaline anion exchange membrane (AAEM) fuel cells offer a cost-effective alternative to proton exchange membrane (PEM) fuel cells by eliminating the need for expensive precious metal catalysts. In both PEMs and AAEMs, semicrystalline polymers are a common choice, as the crystalline domains can act as mechanical reinforcements that limit swelling and promote mechanical durability in the material. However, spatially resolved characterization of crystalline organization in ion exchange membranes beyond ensemble-averaged X-ray scattering is underrepresented, likely in part due to ionization damage limitations in soft materials. Here, in this study, we resolve the nanometer-size crystallites in semicrystalline ion exchange membranes by applying cryogenic four-dimensional scanning transmission electron microscopy (cryo-4D-STEM) along with data-processing algorithms designed to optimize signals at a low dose to minimize radiation damage. We investigate the effects of synthesis components, including molecular weight and thermal treatment, on a model system of AAEMs in comparison to Nafion, the most commonly used and commercially successful PEM today. We find that excess water uptake in polymer membranes, a property directly associated with weak mechanical durability and with possible negative impacts on ion conductivity, can be reduced by over 30% by varying the polymer's crystalline morphology through changes in synthesis parameters such as molecular weight and thermal history. Our results indicate that this improvement is correlated with smaller crystalline domains with a more homogeneous distribution. More broadly, these results demonstrate how the crystalline architecture of polymer membranes can be tuned through their chemistry and thermal treatment in order to improve their conductivity and durability for commercial fuel cell performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Optimizing the sensitivity of high repetition rate broadband transient optical spectroscopy with modified shot-to-shot detection

A major limitation of transient optical spectroscopy is that relatively high laser fluences are required to enable broadband, multichannel detection with acceptable signal-to-noise levels. Under typical experimental conditions, many condensed phase and nanoscale materials exhibit fluence-dependent dynamics, including higher order effects such as carrier–carrier annihilation. With the proliferation of commercial laser systems, offering both high repetition rates and high pulse energies, have come new opportunities for high sensitivity pump-probe measurements at low pump fluences. However, experimental considerations needed to fully leverage the statistical advantage of these laser systems have not been fully described. Here, we demonstrate a high repetition rate, broadband transient spectrometer capable of multichannel shot-to-shot detection at 90 kHz. Importantly, we find that several high-speed cameras exhibit a time-domain fixed pattern noise resulting from interleaved analog-to-digital converters, which is particularly detrimental to the conventional “ON/OFF” modulation scheme used in pump-probe spectroscopy. Using a modified modulation and data processing scheme, we achieve a noise level of 10−5 in 4 s for differential transmission, an order of magnitude lower than for commercial 1 kHz transient spectrometers for the same acquisition time. We leverage the high sensitivity of this system to measure the differential transmission of monolayer graphene at low pump fluence. We show that signals on the order of 10−6 OD can be measured, enabling a new data acquisition regime for low-dimensional materials.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Small Hydropower Interconnections: Analysis of Interconnection Processes

Small hydropower projects have faced the challenge of navigating the process to interconnect their generation source to electricity distribution and transmission grids. Small hydropower developers have found interconnection procedures to be opaque and ultimately result in unexpected cost surprises and long timelines. Noting these challenges, the U.S. Department of Energy Water Power Technologies Office enlisted Pacific Northwest National Laboratory (PNNL) and Oak Ridge National Laboratory (ORNL) to investigate the small hydropower interconnection landscape across the United States. After reviewing the status of small hydropower (“Small Hydropower Interconnections: Small Hydropower in the United States”) and the interconnection procedures across the United States (“Small Hydropower Interconnections: State Interconnection Processes”) in the first two white papers of this series, this paper uses recent data from small hydropower interconnection applications to benchmark the efficacy of the process. Using data from interconnection queues hosted by utilities, balancing authorities, independent system operators (ISOs), and regional transmission organizations (RTOs), this paper provides context for the costs, timelines, and types of upgrades required for small hydropower projects. Interconnection applications and study reports for small hydropower projects were analyzed to collect key pieces of information about the interconnection process, timeline, costs, and type of upgrades required for interconnection. Information sourced from the reports was entered into an Interconnection Benchmarking database (IBdb), which may be found in Appendix A.1. Information from this database was used to evaluate the performance and challenges associated with interconnecting small hydropower projects. This white paper presents a description of the sources contained in the interconnection database (Section 2.0), an analysis of the interconnection timeline (Section 3.0), an evaluation the cost of interconnection upgrades (Section 4.0), and a description of the types of infrastructure upgrades (Section 5.0). The final paper in this series (“Small Hydropower Interconnections: Best Practices”) will use the analysis described here to outline best practices for interconnection processes that will help overcome barriers to future small hydropower development.

13 HYDRO ENERGY↗
DOE OSTI2021

Investigating the dielectric properties of barium titanate nanocomposites using transmission electron microscopy image processing

Abstract Barium titanate (BTO) is a ferroelectric perovskite material used in energy storage applications because of its high dielectric constant. A previous study showed that the dielectric constant for BTO nanoparticles drastically increases to over 15,000 at a particle size of 70 nm. This result is highly contested, but its implications to energy storage motivated our investigation into the dielectric constants of BTO nanoparticles that are incorporated into a polymer matrix. We developed a novel method of using image processing techniques on transmission electron microscope images of BTO-polymer nanocomposites. Data on the positions, shapes, sizes, and orientations of BTO nanoparticles were used to build more realistic computational models that simulate the dielectric behavior of the nanocomposites. Here, we investigate the relationship between regions of enhanced electric field and the composite dielectric constant.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Open Source Platform for Live Processing of High Data Rate Electron Microscopy (SBIR Phase I Award Topic 15, Subtopic B, Final Scientific / Technical Report)

4D scanning transmission electron microscopy (STEM) is experiencing a revolution both in terms of data size, and data veracity, as are many other areas of experimental data acquisition. This presents enormous opportunities to make new scientific discoveries, but is also hamstrung by aging software that is no longer fit for purpose. Experimental data acquisition platforms must make the same investments in software infrastructure that the simulation community made decades ago to take advantage of high-performance computing (HPC) if they hope to realize the full potential of the latest advances made in detector technology. This requires rethinking the design and deployment of hardware, moving away from small, fixed commodity computing capabilities with closed interfaces to open, modular, scalable systems designed for parallelism and throughput. The technical approach will leverage best-in-class open source technologies, and develop new approaches strategically to build an open source platform for experimental data acquisition targeting high data rate electron microscopy. The project will develop a software platform that uses the power and performance of modern HPC resources to ingest the large volume of data produced by electron microscopes using direct electron detectors. A set of configurable pipelines will be used to enable the processing to be tailored to the problem being investigated with builtin visualization of data at interactive rates. This project will leverage investments made by the DOE and other agencies to provide a powerful software platform for the experimental data community working with most powerful electron microscopes, such as 4D STEM detectors. It will create a platform that serves as a reference for the community. Permissive open source licensing will make the platform available to all, with a simple deployment strategy offering the ability to keep data close to where it is generated. This advanced software platform will require customization for each deployment, creating opportunities for software services that are typically offered to extend open source software platforms.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Queued Up: 2025 Edition – Characteristics of Power Plants Seeking Transmission Interconnection As of the End of 2024 [Slides]

Electric transmission system operators (ISOs, RTOs, or utilities) require proposed power plants seeking to connect to the transmission grid to undergo a series of impact studies before they can be built. This process establishes what new transmission equipment or upgrades may be needed before a project can connect to the system and assigns the costs of that equipment. The lists of projects in this process are known as “interconnection queues”. In collaboration with interconnection.fyi, Berkeley Lab compiled, aggregated, and cleaned interconnection queue data from >50 transmission grid operators (7 ISO/RTOs and 49 non-ISO balancing areas), which collectively represent ~97% of currently installed U.S. electric generating capacity. The dataset includes requests submitted to queues through the end of 2024, and only includes requests seeking to connect to the transmission grid (not distribution-connected or behind-the-meter projects). The files below include both a PDF report and an Excel data file. The PDF report analyzes interconnection data and metrics through the end of 2024. The Excel data file includes (a) the full project-level interconnection queue dataset through 2024, (b) a codebook (data dictionary) describing each data field, and (c) 35 additional tabs featuring tables summarizing a range of interconnection metrics. Key highlights from the Queued Up: 2025 Edition (featuring data through 2024) include: • As of the end of 2024, there were ~10,300 projects actively seeking grid interconnection in the U.S., representing 1,400 GW of generation and approximately 890 GW of storage. • Historic withdrawal rates alongside relatively fewer new requests resulted in a 12% decrease in total active queue volume compared to the prior year. • Active natural gas capacity (136 GW, +72% year-over-year) increased in 2024, while solar (956 GW, -12%), storage (890 GW, -13%), and wind (271 GW, -26%) capacity decreased. • 408 GW of capacity already has a draft or executed interconnection agreement (IA) but has not yet reached commercial operations. • The time projects spend in queues before reaching COD is increasing. For the regions with available data, the median duration from IR to COD has doubled from <2 years for projects built in 2000-2007 to over 4 years for those built in 2018-2024. • Ultimately, most of this proposed capacity will not be built. Only 13% of capacity that submitted interconnection requests from 2000-2019 had reached commercial operations by the end of 2024; 77% of that capacity had been withdrawn and 10% was still active. • FERC Order 2023 and various other reforms are being implemented. These are important measures to reduce interconnection bottlenecks and enhance grid system reliability, but it is too early to measure and assess their full impact. • New additions for the 2025 edition include: (a) additional detail on data processing and gaps; (b) updates on interconnection reforms; (c) new analysis on interconnection agreements, and more.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

State-of-the-art of data collection, analytics, and future needs of transmission utilities worldwide to account for the continuous growth of sensing data

Nowadays, transmission system operators require higher degree of observability in real-time to gain situational awareness and improve the decision-making process to guarantee a safe and reliable operation. Digitalization of energy systems allows utilities to monitor the system dynamic performance in real-time at fast time scales. The use of such technologies has unlocked new opportunities to introduce new data driven algorithms for improving the stability assessment and control of the system. Motivated by these challenges, a group of experts have worked together to highlight and establish a baseline set of these common concerns, which can be used as motivation to propose innovative analytics and data-driven solutions. In this document, the results of a survey on 10 transmission system operators around the world are presented and it aims to understand the current practices of the participating companies, in terms of data acquisition, handling, storage, modelling and analytics. The overall objective of this document is to capture the actual needs from the interviewed utilities, thereby laying the groundwork for setting valid assumptions for the development of advanced algorithms in this field.

24 POWER TRANSMISSION AND DISTRIBUTION↗