Data-driven time series reconstruction for modern power systems research
Not Available
Chatzos, Minas↗
SEARCH · Search NASA
Results for “Data Driven Systems”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Data-Driven Closure Modeling in Sparsely Observed Dynamical Systems
Our collaborators at Texas A&M will be presenting this work.
Drennan, Daniel [Texas A&M University]↗
Chloride-based Wireline Tool for Measuring Feed Zone Inflow in Enhanced Geothermal Systems (EGS) Wells: Experimental, Numerical, and Data-driven Updates
Explore the source record for details and available documents.
Sausan, Sarah↗
Data-driven reduced-order models for port-Hamiltonian systems with operator inference
Hamiltonian operator inference has been developed in Sharma et al. (2022) to learn structure-preserving reduced-order models (ROMs) for Hamiltonian systems. The method constructs a low-dimensional model using only data and knowledge of the functional form of the Hamiltonian. The resulting ROMs preserve the intrinsic structure of the system, ensuring that the mechanical and physical properties of the system are maintained. In this work, we extend this approach to port-Hamiltonian systems, which generalize Hamiltonian systems by including energy dissipation, external input, and output. Based on snapshots of the system’s state and output, together with the information about the functional form of the Hamiltonian, reduced operators are inferred through optimization and are then used to construct data-driven ROMs. To further alleviate the complexity of evaluating nonlinear terms in the ROMs, a hyper-reduction method via discrete empirical interpolation is applied. Accordingly, we derive error estimates for the ROM approximations of the state and output. Lastly, we demonstrate the structure preservation, as well as the accuracy of the proposed port-Hamiltonian operator inference framework, through numerical experiments on a linear mass–spring-damper problem and a nonlinear Toda lattice problem.
97 MATHEMATICS AND COMPUTING↗
Interparticle Characterization of Mechanical Biomass Particle-Particle and Particle-Wall Interactions
The biomass materials industry faces significant challenges in managing material variability and its impact on storage and handling systems. Physical properties such as moisture content, particle size, and density fluctuate considerably, leading to operational issues like bridging and ratholing that disrupt material flow. These variations create a complex cascade effect throughout the process chain, affecting transportation, storage, and conversion processes. The economic consequences of this variability manifest in increased operational costs, maintenance requirements, and system downtime. Environmental factors further complicate the situation, as weather conditions and seasonal availability influence material properties and system performance. Engineers employ specialized equipment design, material characterization protocols, and pre-processing steps like size reduction and homogenization to address these challenges. A critical knowledge gap exists between continuous-level constitutive models and particle-scale behavior. This project developed a novel device to quantify interparticle mechanics between biomass particles, measuring friction and adhesion forces between particles and wall materials. The research focused on corn stover and southern pine forest residue, creating a comprehensive database of particle interactions. This breakthrough enables direct application in particle-based computational modeling, advancing the field's understanding of biomass handling characteristics and supporting the development of more reliable and efficient storage and handling systems. The project's outcomes contribute significantly to understanding biomass's mechanical and flow characteristics, particularly how variability at the particle level affects larger-scale handling operations. This knowledge is crucial for engineering feedstock supply systems that consistently meet quality and cost specifications for various conversion processes. The innovative experimental setup developed through this research represents a significant advancement in biomass characterization methodology. Providing precise measurements of particle-level interactions establishes a foundation for more accurate predictive modeling of bulk material behavior. This enhanced understanding of fundamental particle mechanics enables engineers to anticipate better and address handling challenges before they manifest in full-scale operations. This research opens new avenues for optimizing biomass handling systems through data-driven design approaches. The comprehensive database of particle interactions serves as a valuable resource for future research and development efforts, potentially leading to more efficient and cost-effective biomass processing solutions. This advancement in particle-level mechanics could revolutionize how biomass handling systems are designed and operated, contributing to more sustainable and reliable renewable energy production.
09 BIOMASS FUELS↗
Black and gray box learning of amplitude equations: Application to phase field systems
Here, we present a data-driven approach to learning surrogate models for amplitude equations and illustrate its application to interfacial dynamics of phase field systems. In particular, we demonstrate learning effective partial differential equations describing the evolution of phase field interfaces from full phase field data. We illustrate this on a model phase field system, where analytical approximate equations for the dynamics of the phase field interface (a higher-order eikonal equation and its approximation, the Kardar-Parisi-Zhang equation) are known. For this system, we discuss data-driven approaches for the identification of equations that accurately describe the front interface dynamics. When the analytical approximate models mentioned above become inaccurate, as we move beyond the region of validity of the underlying assumptions, the data-driven equations outperform them. In these regimes, going beyond black box identification, we explore different approaches to learning data-driven corrections to the analytically approximate models, leading to effective gray box partial differential equations.
42 ENGINEERING↗
Data Center Facility Monitoring with Physics Aware Approach
U.S. Department of Energy's National Renewable Energy Laboratory (NREL) hosts one of the world's most energy-efficient HPC data centers; this system uses component-level warm-water liquid cooling to efficiently remove heat from the data center and capture it for reuse in the building or rejection to the atmosphere. Given the complexity of this system, building data-driven tools for holistically monitoring and operating the entire data center is a priority for ensuring maximal efficiency and resiliency. In this advanced smart facility, over one million metrics are recorded per minute using state-of-the-art streaming data architecture and software to capture and process the state of the system in real time. Here we detail two efforts to effectively analyze, visualize, and interpret this large volume streaming data. We have developed a novel, flexible system for identifying and visualizing individual metric anomalies and component performance across the data center through automatic metadata extraction and physically-motivated visualization for quick interpretation. Additionally, to directly connect system maintenance to data stream processing we explore a physics informed multi-metric drift and anomaly detection application to detect scale-build up in heat exchangers.
anomaly detection↗
Data-Driven Global Sensitivity Analysis of Three-Phase Distribution System with PVs
Global sensitivity analysis (GSA) of distribution system with respect to stochastic PV variations plays an important role in designing optimal voltage control schemes. This paper proposes a Kriging, i.e., Gaussian process modeling enabled data-driven GSA method. The key idea is to develop a surrogate model that captures the hidden global relationship between voltage and real and reactive power injections from the historical data. With the surrogate model, the Sobol index can be conveniently calculated to assess the global sensitivity of voltage to various power injection variations. Comparison results with other model-based GSA methods on the IEEE 37-bus feeder, such as the polynomial chaos expansion and the Monte Carlo approaches demonstrate that the proposed method can achieve accurate GSA outcomes while maintaining high computational efficiency.
distribution system analysis↗
Gaussian processes meet NeuralODEs: a Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data
We present a machine learning framework (GP-NODE) for Bayesian model discovery from partial, noisy and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of differentiable programming to propagate gradient information through ordinary differential equation solvers and perform Bayesian inference with respect to unknown model parameters using Hamiltonian Monte Carlo sampling and Gaussian Process priors over the observed system states. This allows us to exploit temporal correlations in the observed data, and efficiently infer posterior distributions over plausible models with quantified uncertainty. The use of the Finnish Horseshoe as a sparsity-promoting prior for free model parameters also enables the discovery of parsimonious representations for the latent dynamics. A series of numerical studies is presented to demonstrate the effectiveness of the proposed GP-NODE method including predator–prey systems, systems biology and a 50-dimensional human motion dynamical system. This article is part of the theme issue ‘Data-driven prediction in dynamical systems’.
Science & Technology - Other Topics↗
X-BASE: the first terrestrial carbon and water flux products from an extended data-driven scaling framework, FLUXCOM-X
Mapping in situ eddy covariance measurements of terrestrial land–atmosphere fluxes to the globe is a key method for diagnosing the Earth system from a data-driven perspective. We describe the first global products (called X-BASE) from a newly implemented upscaling framework, FLUXCOM-X, representing an advancement from the previous generation of FLUXCOM products in terms of flexibility and technical capabilities. The X-BASE products are comprised of estimates of CO 2 net ecosystem exchange (NEE), gross primary productivity (GPP), evapotranspiration (ET), and for the first time a novel, fully data-driven global transpiration product (ETT), at high spatial (0.05°) and temporal (hourly) resolution. X-BASE estimates the global NEE at −5.75 ± 0.33 Pg C yr −1 for the period 2001–2020, showing a much higher consistency with independent atmospheric carbon cycle constraints compared to the previous versions of FLUXCOM. The improvement of global NEE was likely only possible thanks to the international effort to increase the precision and consistency of eddy covariance collection and processing pipelines, as well as to the extension of the measurements to more site years resulting in a wider coverage of bioclimatic conditions. However, X-BASE global net ecosystem exchange shows a very low interannual variability, which is common to state-of-the-art data-driven flux products and remains a scientific challenge. With 125 ± 2.1 Pg C yr −1 for the same period, X-BASE GPP is slightly higher than previous FLUXCOM estimates, mostly in temperate and boreal areas. X-BASE evapotranspiration amounts to 74.7×10 3 ± 0.9×10 3 km 3 globally for the years 2001–2020 but exceeds precipitation in many dry areas, likely indicating overestimation in these regions. On average 57 % of evapotranspiration is estimated to be transpiration, in good agreement with isotope-based approaches, but higher than estimates from many land surface models. Despite considerable improvements to the previous upscaling products, many further opportunities for development exist. Pathways of exploration include methodological choices in the selection and processing of eddy covariance and satellite observations, their ingestion into the framework, and the configuration of machine learning methods. For this, the new FLUXCOM-X framework was specifically designed to have the necessary flexibility to experiment, diagnose, and converge to more accurate global flux estimates.
Nelson, Jacob A.↗
Data Driven Modeling of Non-Equilibrium Dynamics in Chemical and Materials Systems (Midterm Report) [Slides]
Data from quantum mechanical calculations were generated to train a NN model for predicting phosphorescence energies. Model uses localization layer, which learns to resemble the triplet spin density without explicit training. As part of this allocation, the HIPPYNN software package was tested and openly released though the Feynman Center for Innovation.
36 MATERIALS SCIENCE↗
Development of an interatomic potential for the W–Ta system
A physics-inspired, data-driven interatomic potential framework for multi-element system is presented. This potential is based on the generalization of the embedded atom method potential and systematically incorporates two-, three- and many-body effects. Different atomic environments are described by atom-centered Gaussian basis sets which provides sufficient flexibility to capture diverse atomic environments and allows for easy optimization of the free parameters. An interatomic potential model for the tungsten–tantalum (W–Ta) system is developed using this framework by training on data from ab initio density functional theory (DFT) calculations. The potential is thoroughly tested at various compositions by comparing bulk and defect properties from experimental and DFT data. It is shown that the potential predicts the elastic constants, defect properties, such as vacancy and interstitial formation energies, core structures of dislocations, and melting points for both pure and tantalum and tungsten with an accuracy comparable to other single element machine learning based potentials. In conclusion, the potential model is used to investigate the formation energies of ordered alloys and vacancy formation energies for chemically random W–Ta alloys.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
Comparative Analysis of ML Techniques for Data-Driven Anomaly Detection, Classification and Localization in Distribution System
High penetration of Distributed Energy Resources (DERs), fundamental load behavior changes, controllable loads, and significant increase in Electrical Vehicles (EVs) lead to complex dynamic behavior of the electric distribution system. Increasing number of components also means more measurements, more data and more data anomalies. Detecting, classifying and localizing these anomalies are important for situational awareness, and at the same time, very challenging given increasing complexity of the system. Highly accurate and high-resolution analytical techniques are needed to support anomaly detection, classification and localization (AD-C-L) for monitoring, root cause analysis and decision making. This paper provides comprehensive review and analysis of the existing spatio-temporal AD-C-L techniques within the distribution system. Challenges for specific problems in AD-C- L have been also discussed in this paper. Existing AD-C- L techniques have been categorized and synthesized for specific merits and limitations of multiple Machine Learning (ML) methodologies using common developed metrics of performance. The comparative analysis is summarized and presented with the open research challenges and path forward for future research needs.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Leveraging High-Fidelity Datasets for Machine Learning-based Anomaly Detection in Smart Grids
Data-driven intrusion detection systems are increasingly becoming essential for protecting critical cyber-physical infrastructure, such as the power grid, against the growing number of sophisticated cyber-attacks. The development of such tools is reliant on the availability of high-fidelity cyber-physical datasets that cover a diverse variety of potential cyber events. In this work, a high-fidelity smart grid platform is utilized to develop an extensive dataset, which is used to train and test a machine learning-based intrusion detection system. The evaluation of the developed IDS shows robust performance even when tested with statistically diverse test data not used in training.
Hyder, Burhan↗
Next-Generation Energy Technologies for Connected and Automated On-Road Vehicles (NEXTCAR) - Predictive Data-Driven Vehicle Dynamics and Powertrain Control: from ECU to the Cloud (Final Scientific/Technical Report)
This project developed and demonstrated a predictive, data-driven vehicle control system designed to improve energy efficiency and driving performance. The team created intelligent self-driving car technology that optimizes fuel and electricity use by proactively planning vehicle actions. By combining Level 4 autonomous driving capabilities with vehicle-to-everything (V2X) connectivity, the system enables vehicles to adjust speed and change lanes in response to traffic signals, surrounding vehicles, and road conditions, reducing unnecessary stops and delays. In testing, the system improved vehicle fuel economy by more than 30% and reduced travel time by approximately 10%, compared to a conventional adaptive cruise control baseline. These results demonstrate the technical effectiveness of using predictive, V2X-enabled strategies, such as traffic light timing and surrounding traffic awareness, to inform real-time vehicle powertrain control and driving behavior. Additionally, a supporting cloud platform was developed to provide dispatch and route recommendations as well as to log vehicle data, demonstrating the economic feasibility of this approach at the fleet level. By optimizing dispatching and routing operations, this technology enables electric fleet operators to use their vehicles more efficiently and reduce reliance on diesel backups, lowering both operating costs and energy consumption. Overall, this project’s technology advances the future of clean, energy-efficient transportation, enabling vehicles and fleets to reduce energy waste, cut costs, and lower emissions through intelligent automation and connectivity.
33 ADVANCED PROPULSION SYSTEMS↗
Field validation of isotropic analytical models for simulating fabric shades
Fabric roller shades are common shading materials used in commercial and residential buildings. Accurately characterizing and modeling shades helps practitioners select the appropriate product and its control strategy based on climate and occupants' priorities, such as visual comfort and view to outdoors. Previous studies established a generalized method for modeling complex fenestration systems using data-driven tabulated bidirectional scattering distribution functions. However, deploying such a method at scale to all fabric shading products on the market is too costly and time-consuming. Analytical models that are based on a limited set of measurements (e.g., normal-normal and normal-hemispherical visible transmittance and reflectance, and directional cut-off angles) can be used to model the wide variety of shading products on the market. This study evaluates the performance of two isotropic analytical models, Roos-Wienold and Modified-Kotey, for modeling fabric roller shades, with a focus on the model's ability to predict occupant visual comfort. The performance evaluation was conducted through laboratory and field measurements and simulations. The results showed that both models are sufficient for predicting vertical illuminance at seated eye-level. Roos-Wienold model was able to predict binary visual comfort classification (glare/no-glare) under a wide range of luminance conditions, while Modified-Kotey model did not perform as well under high-contrast low-adaptation conditions. Both models are insufficient in predicting visual comfort at a four-point scale (e.g., imperceptible, perceptible, disturbing, intolerable). The two isotropic models become less accurate when the fabric exhibits high anisotropy.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
A Data-Driven Method for Estimating Behind-the-Meter Photovoltaic Generation in Hawaii
Due to the increasing penetration of distributed behind-the-meter photovoltaic (PV) systems and the installed utility revenue metering limited to monitoring only the net power import/export of the household, it is increasingly challenging for utilities to effectively plan and operate the grid. This paper proposes a methodology that estimates behind-the-meter PV generation using a selected subset of monitored PV systems. It is a data-driven approach, and the PV output is estimated utilizing a statistic regression model. A Minimum Redundancy Maximum Relevance (MRMR) algorithm is applied to preselect the optimal subset of the monitored PV systems. The performance of this approach is compared with a spatial interpolation method and a model-based approach. The proposed method is validated using high-resolution meter data recorded from 18 residential rooftop PV systems located on the island of Maui, Hawaii.
Data-driven modeling↗
Pursuit of paired dijet resonances in the Run 2 dataset with ATLAS
New particles with large masses that decay into hadronically interacting particles are predicted by many models of physics beyond the Standard Model. A search for a massive resonance that decays into pairs of dijet resonances is performed using 140 fb –1 of proton-proton collisions at $\sqrt{s}$ = 13 TeV recorded by the ATLAS detector during Run 2 of the Large Hadron Collider. Resonances are searched for in the invariant mass of the tetrajet system, and in the average invariant mass of the pair of dijet systems. A data-driven background estimate is obtained by fitting the tetrajet and dijet invariant mass distributions with a four-parameter dijet function and a search for local excesses from resonant production of dijet pairs is performed. No significant excess of events beyond the Standard Model expectation is observed, and upper limits are set on the production cross sections of new physics scenarios.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗