SEARCH · Search NASA

Results for “data transmission and processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19

All sources NASA NTRS DOE OSTI

DOE OSTI2022

State Estimation for Distribution Networks with Asynchronous Sensors Using Stochastic Descent: Preprint

This paper investigates the problem of state estimation for distribution networks with asynchronous sensors comprising of a mix of smart meters and phasor measurement units (PMUs) with multiple sampling and reporting rates. We consider two independent scenarios of state estimation and tracking, with either voltages or currents as states. With these two sets, we investigate estimation under (a) full data, assuming all measurements are available and (b) limited data, where an online algorithmic approach is adopted to estimate the possibly time-varying states by processing measurements as and when available. The proposed algorithm, inspired by the classical Stochastic Gradient Descent (SGD) approach updates the states based on the previous estimate and the newly available measurements. Finally, we demonstrate the estimation and tracking efficacy through numerical simulations on the IEEE-37 test network, while also highlighting how estimation with currents as states leads to faster convergence.

asynchronous sensors↗

DOE OSTI2022

Machine Learning Based Network Parameter Estimation Using AMI Data

The expansion of distribution power system and the growing penetration of distributed energy resources present new challenges for situational awareness. Calibrating the extended system model with sensor measurements and maintaining the usability is critical for utilities. This paper presents a distribution network parameter estimation (DNPE) approach using machine learning (ML) and metering data that improve the quality of extended distribution power system modeling. The reliability model can improve the ability of endpoint data to be translated into network-level situational awareness in real time and help distribution system operators (DSOs) solve branch flow and voltage problems. In addition, a data analytic and automate processing scheme is proposed to improve the sensor data quality and prevent misleading information. The effectiveness of the proposed method is verified with actual advanced metering infrastructure (AMI) data on a real utility feeder model, while considering the higher penetration of photovoltaic power generation. The test of DNPE and study results are demonstrated in this paper.

Parameter estimation, machine learning, power dist↗

DOE OSTI2023

EAGLE-I Power Outage Data 2014 - 2022

The provided EAGLE-I historic dataset includes eight years of power outage information at the county level from 2014 to 2022 at 15-minute intervals collected by the EAGLE-I program at ORNL. The data has been collected from utility's public outage maps using an ETL process. The dataset details FIPS code, county name, state name, total number of customers without power, and a date/timestamp. Also included is the EAGLE-I coverage of each state for each year. For detailed metadata, refer to the metadata DOI.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

ORNL Neutron Cross Section Measurements of 90 Zr

Nuclear criticality modeling and simulations rely on the quality of the existing evaluated nuclear data libraries such as Evaluated Nuclear Data File (ENDF)/B, the Joint Evaluated Fission and Fusion (JEFF) nuclear data library, or the Japanese Evaluated Nuclear Data Library (JENDL). In some cases, the cross-section evaluations of those libraries were found to be deficient in describing criticality benchmarks accurately. More than two decades ago, the US Nuclear Criticality Safety Program (NCSP) established a Nuclear Data (ND) task which encompassed experiments and evaluations. In response to this, the Oak Ridge National Laboratory (ORNL) formed a Nuclear Criticality and Data group which performed ND experiments, data analysis, and evaluations to produce ENDF files for the ND libraries as identified in the NCSP Five-Year Plan. Before being submitted to the ENDF library, files were processed and tested for performance by running benchmark calculations. This procedure was centralized in the ORNL group and is now often referred to as the ND pipeline. NCSP collaborates with the Joint Research Center (JRC) of the European Commission in Geel, Belgium, to perform high-resolution neutron-induced cross section measurements at the Geel Linear Accelerator (GELINA). The objective is to address emerging ND problems in criticality calculations. Difficulties with ND include insufficient neutron energy range, missing covariances, and previously unrecognized inaccuracies with experiments. New neutron total and capture cross sections of 90 Zr in the neutron energy range from 100 eV to several hundred keV were recently performed. These measured data will be used, together with existing high-resolution transmission data from a metallic 90 Zr sample, to improve representation of the cross sections.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

ChatGPT and Other Large Language Models for Cybersecurity of Smart Grid Applications

Cybersecurity breaches targeting electrical substations constitute a significant threat to the integrity of the power grid, necessitating comprehensive defense and mitigation strategies. Any anomaly in information and communication technology (ICT) should be detected for secure communications between devices in digital substations. This paper proposes large language models (LLMs), e.g., ChatGPT, for the cybersecurity of IEC 61850-based communications. Multi-cast messages such as generic object oriented system events (GOOSE) and sampled values (SV) are used for case studies. The proposed LLM-based cybersecurity framework includes, for the first time, data pre-processing of communication systems and human-in-the-loop (HITL) training (considering the cybersecurity guidelines recommended by humans). The results show a comparative analysis of detected anomaly data carried out based on the performance evaluation metrics for different LLMs. A hardware-in-the-loop (HIL) testbed is used to generate and extract a dataset of IEC 61850 communications.

ChatGPT↗

DOE OSTI2024

Second harmonic generation for estimating state of charge of lithium-ion batteries

This study applied the nonlinear ultrasonic method, second harmonic generation, to precisely estimate the state of charge (SoC) in lithium-ion batteries. The second harmonic of the longitudinal wave is generated on a pouch cell battery at 5 MHz with a through-transmission setup. The relative nonlinear parameter β' is determined by analyzing the amplitudes at the fundamental and second harmonic frequencies. To enhance the nonlinear parameter's measurement accuracy, multiple excitation amplitudes are employed. Two separate charge/discharge tests (four-cycle and eight-cycle) are conducted on the battery at a rate of C/10. The nonlinear parameter is measured periodically during the charge/discharge process, and temperature compensation is applied to the measurement. The correlation curves between the nonlinear parameter and the actual SoC align well for the four-cycle and eight-cycle tests, and a robust linear relationship is observed for both correlation curves. A linear model and a second-order polynomial model are applied to fit the correlation using all data points from both tests. The two models are employed to validate the SoC prediction on a second battery by using a four-cycle test. Furthermore, the results indicate that both models can predict the SoC with an accuracy of approximately 3%, whereas the polynomial model demonstrates smaller errors in the regions near 0% and 100% SoC. Therefore, the nonlinear parameter β', measured through the second harmonic generation, can effectively predict lithium-ion battery SoC with an accuracy of less than 3%.

25 ENERGY STORAGE↗

DOE OSTI2025

CFD modeling of near-wall combustion and unburned methane prediction in natural gas spark ignition engines

Natural gas-powered engines play a critical role in gas drilling, compression, and transmission sectors, but methane (CH 4 ) from engine combustion slip can be significant over their lifespan, contributing to atmospheric pollution and signaling reduced engine efficiency. Here, to address this challenge, computational fluid dynamics (CFD) simulations offer valuable insights into the in-cylinder combustion process, enabling the optimization of combustion strategies and engine designs to minimize unburned CH 4 slip. This study aims to evaluate and improve combustion models for simulating the combustion process and predicting unburned CH 4 concentrations in natural gas spark-ignition (SI) engines, including engines that are part of combined reformer-engine systems. Specifically, the performance of two flamelet-based combustion models—the Extended Coherent Flame Model (ECFM) and the G-equation model—was assessed using experimental engine data collected under varying excess-air ratio (λ) conditions and fuel compositions, including natural gas and syngas blends. In addition, to enhance the predictive capabilities of the G-equation model, a flame-wall interaction (FWI) sub-model was integrated into its framework. The effects of its model parameters, such as quenching and influence distance, on combustion behavior and unburned methane predictions were analyzed in detail. The ECFM tended to predict delayed combustion phasing under diluted mixture conditions, resulting in overprediction of unburned CH 4 concentrations. In contrast, the G-equation model provided reasonable predictions of combustion pressure, while representing higher the CH 4 reduction rate across the operating condition compared to experimental data. Incorporating the FWI sub-model—with the quenching distance calculated based on a pressure-dependent relation (P -0.48 ) and a fixed influence distance of 1.5 mm—further improved the G-equation model’s accuracy in predicting CH 4 reduction rates without compromising its ability to simulate the combustion process.

Combustion model↗

DOE OSTI2020

Connecting Femtosecond Transient Absorption Microscopy with Spatially Coregistered Time Averaged Optical Imaging Modalities

Multimodal all-optical imaging involving coregistered femtosecond transient absorption microscopy (TAM), time-integrated photoluminescence (PL), and steady-state modalities such as confocal reflectance and transmission offers an appealing approach to gain a comprehensive understanding of complex electronic excited-state phenomena in spatially heterogeneous systems. A unique combination of these modalities allows us to unravel not only the competing electronic excited-state dynamical processes but also the underlying morphological information with simultaneous high temporal and spatial resolution. However, correlating the various images obtained from time-resolved and time-independent modalities is generally nontrivial and particularly challenging when the electronic dynamics under study evolve in both time and space. Here, we demonstrate a new approach for rationally correlating time-resolved microscopy with coregistered time-integrated or steady-state modalities. Specifically, our approach involves an extended global lifetime analysis of the time-resolved microscopic data set to separate distinct dynamical processes taking place on commensurate time scales, and the resulting decay-associated amplitude maps (DAAMs) were applied to explore correlations with the images acquired using time-independent modalities. The feasibility of our approach was validated through analyzing a multimodal data set acquired from a thin film of chloride-containing mixed lead halide perovskites (CH 3 NH 3 PbI 3–x Cl x ) using femtosecond transient absorption, time-integrated PL, and confocal reflectance microscopies. Analysis of the results obtained enable us to gain new insight into the complex ultrafast relaxation dynamics in this highly heterogeneous system.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗

DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images: Preprint

Bayesian model averaging↗

DOE OSTI2025

An Open-Access Repository of Synchrophasor Data Quality Examples: Curation and Example Applications

Synchrophasor measurements are critical in providing wide-area situational awareness to power system operators. However, data artifacts may be introduced due to various issues such as loss of communication, loss of GPS signal, internal clock error, and vendor-specific implementation of phasor estimation algorithms. Tools designed to provide actionable insights from synchrophasor data, hence, must be designed to be robust to these data quality issues. In this work, two years of synchrophasor data sourced from multiple electric utilities in the United States were analyzed to identify examples of data quality problems. These examples were then labeled and published in the Grid Event Signature Library, a publicly available repository of power system measurements hosted by the Oak Ridge National Laboratory. This paper describes the data curation process, and illustrates two application use cases where the dataset can be valuable to the research community. In the first use case, a random forest classifier is trained to distinguish power system disturbance signatures from data anomalies introduced in synchrophasor measurements due to clock errors. The second use case studies the impact of data quality issues on an example synchrophasor application (specifically, event start time determination). The choice of data quality problems investigated is informed by the examples in the repository curated in this work.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Enriching Load Data Using Micro-PMUs and Smart Meters

In modern distribution systems, load uncertainty can be fully captured by micro-PMUs, which can record high-resolution data; however, in practice, micro-PMUs are installed at limited locations in distribution networks due to budgetary constraints. In contrast, smart meters are widely deployed but can only measure relatively low-resolution energy consumption, which cannot sufficiently reflect the actual instantaneous load volatility within each sampling interval. In this paper, we have proposed a novel approach for enriching load data for service transformers that only have low-resolution smart meters. The key to our approach is to statistically recover the high-resolution load data, which is masked by the low-resolution data, using trained probabilistic models of service transformers that have both high- and low-resolution data sources, i.e., micro-PMUs and smart meters. The overall framework consists of two steps: first, for the transformers with micro-PMUs, a Gaussian Process is leveraged to capture the relationship between the maximum/minimum load and average load within each low-resolution sampling interval of smart meters; a Markov chain model is employed to characterize the transition probability of known high-resolution load. Next, the trained models are used as teachers for the transformers with only smart meters to decompose known low-resolution load data into targeted high-resolution load data. The enriched data can recover instantaneous load uncertainty and significantly enhance distribution system observability and situational awareness. Here, we have verified the proposed approach using real high- and low-resolution load data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Reuniting crystallography with real space: Ab initio structure elucidation with 4D-STEM

Structure elucidation via single-crystal methods has historically lacked experimental access to real-space information, instead relying exclusively on diffraction-space measurements of Bragg reflections. Here we exploit the dual-space imaging power of 4D scanning transmission electron microscopy to meaningfully integrate real-space information into the crystallographic workflow. We show that virtual apertures assembled by segmentation of high-angle annular dark-field images enable i) pixel-by-pixel separation of coherent Bragg signal from clusters of closely spaced nanocrystals and ii) selective extraction of integrated intensities from thinner subregions of individual specimens, facilitating retroactive tuning of multiple scattering artifacts. This strategy empowers us to simply pick and choose whichever nanoscale regions of interest generate the highest-quality diffraction patterns, allowing us to solve several independent structures of the metal-organic framework UiO-66 from specimens whose agglomerated morphology proved intractable for conventional microcrystal electron diffraction. Our method is compatible with both rotational and serial approaches to data processing, ultimately divulging the first scanning nanobeam electron diffraction structures determined by direct methods at subangstrom resolution.

Saha, Ambarneil↗

DOE OSTI2020

Simultaneous Optical Transmission Spectroscopy of a Terrestrial, Habitable-zone Exoplanet with Two Ground-based Multiobject Spectrographs

Investigating the atmospheres of rocky exoplanets is key to performing comparative planetology between these worlds and the terrestrial planets that reside in the inner solar system. Terrestrial exoplanet atmospheres exhibit weak signals, and attempting to detect them pushes at the boundaries of what is possible for current instrumentation. We focus on the habitable-zone terrestrial exoplanet LHS 1140b. Given its 25-day orbital period and 2 hr transit duration, capturing transits of LHS 1140b is challenging. We observed two transits of this object, approximately 1 yr apart, which yielded four data sets thanks to our simultaneous use of the IMACS and LDSS3C multiobject spectrographs mounted on the twin Magellan telescopes at Las Campanas Observatory. We present a jointly fit white light curve, as well as jointly fit 20 nm wavelength-binned light curves from which we construct a transmission spectrum. Binning the joint white light-curve residuals to 3-minute time bins gives an rms of 145 ppm; binning down to 10-minute time bins gives an rms of 77 ppm. Our median uncertainty in R{sub p}{sup 2}/R{sub s}{sup 2} in the 20 nm wavelength bins is 260 ppm, and we achieve an average precision of 1.3× the photon noise when fitting the wavelength-binned light curves with a Gaussian process regression. Our precision on R{sub p}{sup 2}/R{sub s}{sup 2} is a factor of four larger than the feature amplitudes of a clear, hydrogen-dominated atmosphere, meaning that we are not able to test realistic models of LHS 1140b’s atmosphere. The techniques and caveats presented here are applicable to the growing sample of terrestrial worlds in the Transiting Exoplanet Survey Satellite era, as well as to the upcoming generation of ground-based giant segmented mirror telescopes.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Risk-Informed Condition Evaluation of Solar-centered Energy Generation and Distribution Networks through Bayesian Learning and Inference

We develop a methodology based on Bayesian inference over Probabilistic Graphical Models (PGMs) to understand and quantify risk in solar-centered grids using targeted measurements and learned system behavior. Being non-prescriptive but, rather, able to infer system behavior and, ultimately, address risk queries from data, our machine learning-type paradigm is tailored for diverse topologies and threat scenarios often associated with distributed energy generation and photovoltaic distributed energy resources (PV-DERs) in particular. We describe algorithmic processes for: (i) learning the structure of PGMs that result from attack-prone PV-DER-proliferated distribution systems, (ii) quantifying cause-effect relationships, and (iii) evaluating risk queries based on diverse evidence. The contributions are illustrated on a residential grid subject to output impairment attacks on its PV-DER infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Forecasting of in situ electron energy loss spectroscopy

Abstract Forecasting models are a central part of many control systems, where high-consequence decisions must be made on long latency control variables. These models are particularly relevant for emerging artificial intelligence (AI)-guided instrumentation, in which prescriptive knowledge is needed to guide autonomous decision-making. Here we describe the implementation of a long short-term memory model (LSTM) for forecasting in situ electron energy loss spectroscopy (EELS) data, one of the richest analytical probes of materials and chemical systems. We describe key considerations for data collection, preprocessing, training, validation, and benchmarking, showing how this approach can yield powerful predictive insight into order-disorder phase transitions. Finally, we comment on how such a model may integrate with emerging AI-guided instrumentation for powerful high-speed experimentation.

36 MATERIALS SCIENCE↗

DOE OSTI2024

Efficient Anomaly Detection Driven By Different Machine Learning Architectures And Models

The rapid growth and ubiquitous adoption of the internet and cyber-physical systems (CPS) have fundamentally transformed modern communication, work, and human-system interactions. While networks now form the backbone of critical digital ecosystems, enabling seamless data transmission across diverse, interconnected systems, this increased connectivity also expands the attack surface, making real-time detection of network intrusions and anomalies a pressing challenge. Detecting unusual activities within network infrastructure requires advanced data traffic analysis to differentiate between legitimate and malicious interactions. Traditional approaches to network anomaly detectionâ??such as rule-based and signature-based systemsâ??often depend on predefined patterns to identify known anomalies, limiting their effectiveness against emerging, stealthy, or previously unseen threats. These conventional methods suffer from high false alarm rates and fail to adapt to the ever-evolving nature of network traffic, particularly in large-scale, decentralized environments where data volume, velocity, and variety are constantly increasing. This dissertation presents artificial intelligence (AI)-driven approaches to anomaly detection that leverage graphics processing unit (GPU)-enabled high-performance computing (HPC) platforms for processing massive network traffic data and monitoring the components of cyber-physical systems (CPS) for potentially hazardous conditions. The research advances several key contributions: (1) Designing efficient machine learning techniques for CPS condition monitoring and anomaly detection; (2) enabling federated learning (FL) frameworks that enable distributed detection while preserving data privacy and system resilience; (3) exploring graph-based methodologies combining graph neural networks (GNN) and graph machine learning (ML) approaches for the Internet of Things (IoT) and automotive network security, and (4) performing distributed edge computing optimizations that integrate FL with scalable technologies for reduced communication overhead. Through extensive experiments, these methodologies demonstrate that complex anomaly detection and condition monitoring tasks can be achieved while balancing computational efficiency and detection accuracy through fine-grained network information processing. The frameworks developed in this research establish a robust foundation for network anomaly detection, providing scalable, adaptive, and privacy-preserving solutions for safeguarding CPS and IoT networks in an increasingly interconnected digital landscape. The practical implications of these research findings are significant, as they can inform the development of next-generation network security systems and contribute to the protection of critical infrastructure against sophisticated cyber attacks.

Marfo, William↗

DOE OSTI2021

Machine learning to identify geologic factors associated with production in geothermal fields: a case-study using 3D geologic data, Brady geothermal field, Nevada

Abstract In this paper, we present an analysis using unsupervised machine learning (ML) to identify the key geologic factors that contribute to the geothermal production in Brady geothermal field. Brady is a hydrothermal system in northwestern Nevada that supports both electricity production and direct use of hydrothermal fluids. Transmissive fluid-flow pathways are relatively rare in the subsurface, but are critical components of hydrothermal systems like Brady and many other types of fluid-flow systems in fractured rock. Here, we analyze geologic data with ML methods to unravel the local geologic controls on these pathways. The ML method, non-negative matrix factorization with k -means clustering (NMF k ), is applied to a library of 14 3D geologic characteristics hypothesized to control hydrothermal circulation in the Brady geothermal field. Our results indicate that macro-scale faults and a local step-over in the fault system preferentially occur along production wells when compared to injection wells and non-productive wells. We infer that these are the key geologic characteristics that control the through-going hydrothermal transmission pathways at Brady. Our results demonstrate: (1) the specific geologic controls on the Brady hydrothermal system and (2) the efficacy of pairing ML techniques with 3D geologic characterization to enhance the understanding of subsurface processes.

58 GEOSCIENCES↗