Search NASA⌕ Search

SEARCH · Search NASA

Results for “historic data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Data-Driven Global Sensitivity Analysis of Three-Phase Distribution System with PVs

Global sensitivity analysis (GSA) of distribution system with respect to stochastic PV variations plays an important role in designing optimal voltage control schemes. This paper proposes a Kriging, i.e., Gaussian process modeling enabled data-driven GSA method. The key idea is to develop a surrogate model that captures the hidden global relationship between voltage and real and reactive power injections from the historical data. With the surrogate model, the Sobol index can be conveniently calculated to assess the global sensitivity of voltage to various power injection variations. Comparison results with other model-based GSA methods on the IEEE 37-bus feeder, such as the polynomial chaos expansion and the Monte Carlo approaches demonstrate that the proposed method can achieve accurate GSA outcomes while maintaining high computational efficiency.

distribution system analysis↗
DOE OSTI2021

Forecasting Solar-Thermal Systems Performance under Transient Operation Using a Data-Driven Machine Learning Approach Based on the Deep Operator Network Architecture

Modeling and prediction of the dynamic behavior of thermal systems operating under intermittent energy input and variable load requirements represent one of the greatest challenges in the development of efficient and reliable renewable-based power generation technologies. In this work, a data-driven machine learning modeling framework was developed based on a modified version of the Deep Operator Network architecture where the time coordinate in the trunk net is replaced with historical data of the predicting quantity. The modeling framework can be used to accurately predict the performance of renewable-based energy conversion technologies including wind- and solar-based power plants. This novel framework was applied on a solar-thermal system that consists of a solar collection loop using a flat plate collector, a power generation loop comprising an Organic Rankine Cycle, and a thermal energy storage tank connecting both loops. Variable solar irradiance, air temperature, and power load profiles were used by the Deep Operator Network to predict the State-of-Charge and the efficiency of the thermal system for several days. The results were compared with the State-of-Charge and efficiency functions calculated using a physics-based model. For a simple operation scenario, characterized by a clear sky solar irradiance profile and constant load, the standard deviation in the State-of-Charge prediction by Deep Operator Network is below 0.9% during a seven-day prediction time horizon. For the most realistic operation scenario that considers real solar irradiance and a rough load profile, the maximum standard deviation in the predictions for the State-of-Charge and efficiency are below 6.8% and 2.5%, respectively. A comparison between Deep Operator Network and Long Short Term Memory network was also performed. In general, both networks predict very well the State-of-Charge for different data density conditions; however, a higher accuracy, with a standard deviation below 2.0%, is obtained by the Deep Operator Network during three and half days using sparser training data of 20-minute points. The same accuracy for the State-of-Charge prediction with the Long Short Term Memory network is achieved only for 14 h. Average standard deviations for the State-of-Charge prediction of 1.1% with the Deep Operator Network and 1.5% with the Long Short Term Memory network are obtained for a four-day prediction time using a denser training data of 5-minute points.

DeepONet↗
DOE OSTI2020

NREL’s Cyber-Energy Emulation Platform for Research and System Visualization

This paper presents NREL’s Cyber Energy Emulation (CEE) Platform. This is a novel emulation platform for achieving real-time visualization of large-scale environments involving cyber-physical devices. It allows for the environment to include real, physical hardware, along with emulated devices communicating with each other as part of the same system. The CEE Platform is also capable of streaming, collecting, storing, transporting, and visualizing all data within the emulated environment. By providing this capability, it enables high-fidelity visual analysis of events to be performed in real time as well as the use of historical data for forensic analysis. This paper presents the design of the CEE Platform as well as several potential use cases and applications. It also aims to highlight why this type of visualization tool has potential for research and education about cyber-physical systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Streaming Large-Scale Microscopy Data to a Supercomputing Facility

Data management is a critical component of modern experimental workflows. As data generation rates increase, transferring data from acquisition servers to processing servers via conventional file-based methods is becoming increasingly impractical. The 4D Camera at the National Center for Electron Microscopy generates data at a nominal rate of 480 Gbit s -1 (87,000 frames s -1 ⁠), producing a 700 GB dataset in 15 s. To address the challenges associated with storing and processing such quantities of data, we developed a streaming workflow that utilizes a high-speed network to connect the 4D Camera’s data acquisition system to supercomputing nodes at the National Energy Research Scientific Computing Center, bypassing intermediate file storage entirely. In this work, we demonstrate the effectiveness of our streaming pipeline in a production setting through an hour-long experiment that generated over 10 TB of raw data, yielding high-quality datasets suitable for advanced analyses. Additionally, we compare the efficacy of this streaming workflow against the conventional file-transfer workflow by conducting a postmortem analysis on historical data from experiments performed by real users. Our findings show that the streaming workflow significantly improves data turnaround time, enables real-time decision-making, and minimizes the potential for human error by eliminating manual user interactions.

4D-STEM↗
DOE OSTI2023

HERMES: A cyber-energy SAAS platform to provide real-time 2d and 3d interactive visualizations [SWR-23-15]

HERMES is a novel visualization SAAS platform for achieving real-time visualization of large-scale environments involving cyber-energy devices. The platform receives data from emulated environments which include physical hardware and network devices that represent a complex IT / OT system. The platform is capable of streaming, filtering, storing, and visualizing all data within the environment and scaling vertically and horizontally. This capability enables high fidelity visual analysis of events to be performed in real time as well as the collection and storage of historical data for forensic analysis.

Van Natta, Joshua↗
DOE OSTI2023

Data driven pathway analysis and forecast of global warming and sea level rise

Climate change is a critical issue of our time, and its causes, pathways, and forecasts remain a topic of broader discussion. In this paper, we present a novel data driven pathway analysis framework to identify the key processes behind mean global temperature and sea level rise, and to forecast the magnitude of their increase from the present to 2100. Based on historical data and dynamic statistical modeling alone, we have established the causal pathways that connect increasing greenhouse gas emissions to increasing global mean temperature and sea level, with its intermediate links encompassing humidity, sea ice coverage, and glacier mass, but not for sunspot numbers. Our results indicate that if no action is taken to curb anthropogenic greenhouse gas emissions, the global average temperature would rise to an estimated 3.28 °C (2.46–4.10 °C) above its pre-industrial level while the global sea level would be an estimated 573 mm (474–671 mm) above its 2021 mean by 2100. However, if countries adhere to the greenhouse gas emission regulations outlined in the 2021 United Nations Conference on Climate Change (COP26), the rise in global temperature would lessen to an average increase of 1.88 °C (1.43–2.33 °C) above its pre-industrial level, albeit still higher than the targeted 1.5 °C, while the sea level increase would reduce to 449 mm (389–509 mm) above its 2021 mean by 2100.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Digital Tools for the Preventive Conservation of Built Heritage: The Church of Santa Ana in Seville

Historic Building Information Modelling (HBIM) plays a pivotal role in heritage conservation endeavours, offering a robust framework for digitally documenting existing structures and supporting conservation practices. However, HBIM’s efficacy hinges upon the implementation of case-specific approaches to address the requirements and resources of each individual asset and context. This paper defines a flexible and generalisable workflow that encompasses various aspects (i.e., documentation, surveying, vulnerability assessment) to support risk-informed decision making in heritage management tailored to the peculiar conservation needs of the structure. This methodology includes an initial investigation covering historical data collection, metric and condition surveys and non-destructive testing. The second stage includes Finite Element Method (FEM) modelling and structural analysis. All data generated and processed are managed in a multi-purpose HBIM model. The methodology is tested on a relevant case study, namely, the church of Santa Ana in Seville, chosen for its historical significance, intricacy and susceptibility to seismic action. The defined level of detail of the HBIM model is sufficient to inform the structural analysis, being balanced by a more accurate representation of the alterations, through linked orthophotos and a comprehensive list of alphanumerical parameters. This ensures an adequate level of information, optimising the trade-off between model complexity, investigation time requirements, computational burden and reliability in the decision-making process. Field testing and FEM analysis provide valuable insight into the main sources of vulnerability in the building, including the connection between the tower and nave and the slenderness of the columns.

Chaves, Estefanía↗
DOE OSTI2025

Entropy-Assisted Quality Pattern Identification in Finance

Short-term patterns in financial time series form the cornerstone of many algorithmic trading strategies, yet extracting these patterns reliably from noisy market data remains a formidable challenge. In this paper, we propose an entropy-assisted framework for identifying high-quality, non-overlapping patterns that exhibit consistent behavior over time. We ground our approach in the premise that historical patterns, when accurately clustered and pruned, can yield substantial predictive power for short-term price movements. To achieve this, we incorporate an entropy-based measure as a proxy for information gain: patterns that lead to high one-sided movements in historical data yet retain low local entropy are more “informative” in signaling future market direction. Compared to conventional clustering techniques such as K-means and Gaussian Mixture Models (GMMs), which often yield biased or unbalanced groupings, our approach emphasizes balance over a forced visual boundary, ensuring that quality patterns are not lost due to over-segmentation. By emphasizing both predictive purity (low local entropy) and historical profitability, our method achieves a balanced representation of Buy and Sell patterns, making it better suited for short-term algorithmic trading strategies. This paper offers an in-depth illustration of our entropy-assisted framework through two case studies on Gold vs. USD and GBPUSD. While these examples demonstrate the method’s potential for extracting high-quality patterns, they do not constitute an exhaustive survey of all possible asset classes.

Physics↗
DOE OSTI2026

Cross-domain digital twin architecture for predictive maintenance via machine learning and Large Language Models

This research introduces a comprehensive framework for creating and deploying a digital twin platform for continuous monitoring and predictive maintenance within industrial settings. Through utilizing advanced technologies, including Unreal Engine 5, Unity 3D, the Message Queue Telemetry Transport protocol, Random Forest machine learning algorithms, and Large Language Models (LLMs), we establish a platform that digitally reproduces physical equipment and translates digital controls into real-world actions. This facilitates preventive maintenance approaches and improves operational effectiveness. The digital twin platform gathers sensor data from operational equipment, analyzes it using machine learning, and delivers practical insights to prevent potential malfunctions and enhance equipment performance. Furthermore, the incorporation of a web portal enables efficient monitoring and access to historical data, educational materials, and equipment status information. Preliminary findings indicate that digital twins can transform industrial equipment management and maintenance methodologies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Reanalysis of Water Withdrawal for Irrigation, Electric Power, and Public Supply Sectors in the Conterminous United States, 1950–2016

Accurately measuring water use by the economy is essential for developing reliable models of water resource availability. Indeed, these models rely on retrospective analyses that provide insights into shifting human population demands and adaptions to water shortages. However, accurate, methodologically consistent, empirically authentic, and spatiotemporally comprehensive historical datasets for water withdrawals are scarce. Herein, we present a reanalysis of annual resolution (1950–2016) historical data set on irrigation, electric power, and public supply water withdrawal within the conterminous United States (US) at the county-level, and, for power plants, at the site-level. To estimate electric power water use, we synthesized a historically comprehensive list of generators and historic patterns in generation across fuels, prime movers, and cooling technologies. Irrigation water use estimation required building a crop-demand model that utilized historical information on irrigated acreage for crops and golf courses, stage-specific crop water demand, and climate information. To estimate public water supply use, we developed a random forest model constructed from information on population, infrastructure, climate, and land cover. These estimates generally agree with total county and state water use information provided by the US Geological Survey (USGS) water use circular and estimates generated from independent studies for specific years. However, we also observed discrepancies between our estimates and USGS data that appear to be caused by inconsistencies in the methods used by the USGS's primary data sources at the state level over decades of data collection, highlighting the importance of reanalysis to yield spatiotemporally consistent and intercomparable estimates of water use.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Data-Driven Day-Ahead PV Estimation Using Autoencoder-LSTM and Persistence Model

Inherent variability in photovoltaic (PV) and associated impacts on power systems is a challenging problem for both the PV owners and the grid operators. Existing statistical and machine learning algorithms typically work well for weather conditions similar to historical data. Furthermore, uncertain weather conditions pose a great challenge to the estimation accuracy of the estimation models. With the enhanced integration of intelligent electronic devices and the realization of associated automation in the power grid, renewable energy data is becoming more accessible, which can be utilized by deep learning models and improve the PV power generation estimation accuracy. In this paper, a hybrid deep learning model driven by external weather data is proposed to do day-ahead PV output forecasting at 15-minute-interval. The proposed model is motivated by the recent advancement of Long-Short-Term-Memory (LSTM) networks and AutoEncoder (AE), which estimates uncertainties in sequence while making the prediction for complex weather conditions. Meanwhile, the persistence model (PM) is used to predict continuous sunny weather conditions. The forecasting result is validated with data from multiple locations

42 ENGINEERING↗
DOE OSTI2020

2019 accomplishments: degradation of mechanical properties in structural metals and welds for FTS reservoirs

This report documents work in 2019 at SRNL in support of the Aging and Lifetimes program. Specimens for fracture toughness testing were prepared in prior years by thermally pre-charging samples, provided by Sandia National Laboratories, of welded types 304L and 21-6-9 stainless steels. These samples were pre-charged in 2017. The fracture toughness of the first aged specimens was measured and compared to historical data. The measurements of the 304L and 21-6-9 weld and particularly HAZ represent some of the first fracture data relevant to modern GTS reservoirs. This work represents an on-going collaboration between SRNL and SNL to understand tritium embrittlement of structural metals in Gas Transfer System reservoirs which informs lifetime assessments. Continued testing was conducted on ongoing historical studies, including the effects of very long-term aging, and the relative performance of differently forged stockpile relevant 304L and 316L samples. New samples were pre-charged with tritium and placed in a freezer for an aging study to allow helium to build into the material. The precharged samples consist of smooth and notched tensile samples of 304L stainless steel, as well as tube tensile samples of different thermal treatments supplied by Sandia National Laboratories. Their charging marks the beginning of a new sequence of studies to explore fundamental deformation mechanisms underpinning tritium embrittlement. At predesignated times, samples will be removed from aging and tested to provide data which will help develop an understanding of material degradation with increasing aging time. Also documented is progress in employing various advanced characterization techniques including high resolution electron microscopy, thermally programed desorption, and small angle x-ray scattering, as well as facilities renovations and equipment procurements in support of sustained tritium impacts on materials program at SRNL.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Technology Integration to Gain Commercial Efficiency for the Urban Goods Delivery System, Meet Future Demand for City Passenger and Delivery Load/Unload Spaces, and Reduce Energy Consumption

This three-year project supported by the U.S. Department of Energy Vehicle Technologies Office has the potential to radically improve the urban freight system in ways that help both the public and private sectors. Working from 2018-2021, project researchers at the University of Washington’s Urban Freight Lab and collaborators at the Pacific Northwest National Laboratory have produced key data, tested technologies in complex urban settings, developed a prototype parking availability app, and helped close major knowledge gaps. All the fruits of this project can be harnessed to help cities better understand, support and actively manage truck load/unload operations and their urban freight transport infrastructure. Project learnings and tools can be used to help make goods delivery firms more efficient by reducing miles traveled and the time it takes to complete deliveries, benefitting businesses and residents who rely on the urban freight system for supplies of goods. And, ultimately, these project learnings and tools can be used to make cities more livable by minimizing wasted travel, which, in turn, contributes to reductions in fuel consumption and emissions. Cities today are challenged to effectively and efficiently manage their infrastructure to absorb the impacts of ever-increasing e-commerce-fueled delivery demand. All delivery trucks need to park somewhere to unload and load. Yet today’s delivery drivers have no visibility on available parking until they arrive at a site, which may be full. That means they can wind up cruising for parking, which wastes time and fuel and contributes to congestion. Once drivers do find parking, the faster they can unload at the spot, the faster they free up space for other drivers, helping others avoid circling for parking. This makes the parking space—and thus the greater load/unload network—more productive. To this end, the research team successfully met the project’s three goals, developing and piloting strategies and technologies to: 1. Reduce parking-seeking behavior in the study area by 20%; 2. Reduce parcel truck dwell time (the time a truck spends in a spot to load/unload) in the study area by 30%; 3. Increase curb space, alley space and private loading bay occupancy rates in the study area. The research team met these goals by creating and piloting on Seattle streets OpenPark, a first-of-its-kind real-time and forecasting curb parking app customized for commercial delivery drivers—giving drivers the “missing link” in their commonly used routing tools that tell them how best to get to delivery locations, but not what parking is available to use when they get there. Installing in-ground sensors on commercial vehicle load zones (CVLZs) and passenger load zones (PLZs) in the 10-block study area in Seattle’s downtown neighbourhood of Belltown let researchers glean real-time curb parking data. The research team also met project goals by piloting three parcel lockers in public and private spaces open to any delivery carrier, creating a consolidated delivery hub that lets drivers complete deliveries faster and spend less time parked. Researchers collected and analysed data to produce the first empirical, robust, statistically significant results as to the impact of the lockers, and app, on on-the-ground operations. In addition to collecting and analyzing sensor and other real-time and historical data, researchers rode along with delivery drivers to confirm real-world routing and parking behavior. Researchers also surveyed building managers on their private loading bay operations to understand how to boost usage.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Resolving root causes of experiment discrepancies guided by machine learning

Abstract Scientists rely on accurate experimental data to explain nature and then harness this knowledge for applications addressing human needs. However, discrepancies between experiments of the same observable can impede scientific progress if one does not understand the underlying causes. Here, we developed a process that unravels data discrepancies by first using Bayesian machine learning to relate discrepancies to few of many, potentially biasing metadata features that encode experiment procedures. This machine learning output guides human experts to study discrepancy causes by simulating suspicious aspects of historical experiments or designing modern ones to address open questions. The study findings then lead to rejecting or correcting historical data on firm scientific bases. This process is demonstrated for the energy spectrum of neutrons emitted promptly (<1 ns) after fission of 252 Cf, a trusted nuclear physics Standard. It reduces the spread in experimental 252 Cf spectra by up to a factor of 6.

Neudecker, D. (ORCID:0000000339200627)↗
DOE OSTI2020

A Data-Driven Method for Adaptive Reserve Requirement Estimation via Probabilistic Net Load Forecasting

The University of Colorado Boulder Boulder, CO, 80309, USA With the increasing penetration of renewable energy, power systems are subject to more uncertainty. This makes power system reserve scheduling more challenging. Most of the current reserve requirement determination methods calculate reserve requirements based on historical data, which does not consider the real-time or future system uncertainty. In this paper, a data-driven method is developed to determine the non-spinning reserve requirement (NSRR) in the Electric Reliability Council of Texas (ERCOT) system. The method follows the procedure of the current ERCOT method while adaptively determining the NSRR based on probabilistic net load forecasts. Case studies with two years of ERCOT data show that the developed method significantly reduces the NSRR by introducing an adaptive temporal resolution and update rate. Sensitivity analysis with different forecasting and percentile thresholds indicates the flexibility of the developed method.

non-spinning reserve↗
DOE OSTI2020

Null Space Monte Carlo Evaluation of the Plateau to River Model

The Plateau to River Groundwater Model (P2R Model) is a groundwater flow and contaminant fate and transport (F&T) simulation model used to support remedial activities conducted by CH2M HILL Plateau Remediation Company at the Hanford Site in Washington State. Figure 1-1 illustrates the P2R Model extents, discretization, and boundary conditions. The P2R Model provides a computational framework to simulate the F&T of contaminants in groundwater associated with the 200-PO-1, 200-UP-1, 200-BP-5, and 200-ZP-1 Groundwater Operable Units (OUs) in the Hanford Site Central Plateau. In addition, the model includes adjacent areas and facilities (e.g., the State Approved Land Disposal Site). Intended and anticipated uses of the model include calculating water levels, hydraulic gradients, and groundwater flows throughout the model domain (encompassing the 200 West and 200 East Areas) for use in subsequent F&T calculations for contaminants of concern and developing scale-appropriate, telescopic-mesh refinement models for detailed evaluation of areas within the model domain where required. The overall objective of the modeling effort is to provide a basis for making informed remedial action decisions based on descriptions of current and expected future contaminant concentrations in groundwater at decision points within the OU boundaries. The objective for the model development phase is to create a common modeling platform that can be used for investigations of the Central Plateau groundwater OUs and areas downgradient toward the Columbia River. The P2R Model calibration to historical data observed at the Hanford Site is documented in CP-57037, Model Package Report for the Plateau to River Model Version 8.3. The purpose of this environmental calculation is to describe a null space Monte Carlo (NSMC) evaluation was conducted with the historic calibration of the P2R model. Use of numerical groundwater models is always accompanied with uncertainty in the results produced by a model because models are approximations of reality. Thus, by definition, lack the detail to fully represent observed behavior. Use of numerical techniques, such as a NSMC analysis, can help in identifying and quantifying the potential uncertainties associated with a numerical model such as the P2R Model. Use of the NSMC approach results in 100 groundwater flow models that are variants of the calibrated P2R Model. These variant models can be used to evaluate uncertainty in model predictions made by the calibrated P2R Model for other analyses. A secondary purpose of the environmental calculation is to establish these variant models for use with other applications.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Photovoltaic Analysis and Response Support (PARS) Platform for Solar Situational Awareness and Resiliency Services

The project's primary objective is to develop a digital-twin based Photovoltaic (PV) Analysis and Response Support (PARS) platform, which aims to provide real-time situational awareness and optimal response plans. This platform is designed to enhance the performance of hybrid PV systems, making them competitive with or even superior to conventional generation resources. The PARS platform enabled the project team to develop and evaluate an extensive suite of grid support functionalities for the hybrid PV systems to enhance grid performance, across key areas including visibility, dispatchability, security, resilience, and reliability. Given the global push toward achieving 100% clean energy by 2035, there is a significant increase in the integration of inverter-based resources (IBRs) throughout the energy grid. Effectively managing the inherent variability and uncertainty associated with IBRs is crucial for ensuring cost-effectiveness, reliability, and security in both the main grid and islanded microgrids. Constrained to a limited array of IEEE test systems or standard feeder models, traditional IBR modeling struggles to assimilate new field data, accurately reflect system dynamics, and adapt to the evolving energy landscape. In our project, we embraced a Digital Twin (DT) strategy for crafting the PARS platform. A digital twin acts as a precise virtual counterpart of a physical system, built on historical data and continuously honed with real-time insights. This enables the high-fidelity DT to accurately mirror current system operations and forecast future scenarios. Consequently, the PARS platform becomes an ideal environment for testing and refining monitoring, control, power, and energy management algorithms designed to boost hybrid PV system performance. The defining feature of the PARS platform, distinguishing it from other advanced simulation tools, is its exceptional adaptability. This is achieved by employing actual network topologies and utilizing real-time field data for fine-tuning and calibration, ensuring a close emulation of real-world conditions. The project deliverables include: 1) High-fidelity IBR models and tools for real-time parameterization, utilizing real-time field measurements to refine IBR models for enhanced accuracy and performance; 2) Grid-forming and Grid-following capabilities to deliver resilience services, including blackstart, voltage and frequency support, cold-load pick-up, power reserves, and three-phase load balancing across grid-connected and microgrid settings; 3) Machine learning-based forecasting tools and methods for generating synthetic data and topologies, creating diverse and realistic simulation environments for evaluating varied operational scenarios; 4) Advanced microgrid power and energy management algorithms for optimizing the integration and operation of PV, storage, and demand response resources within both feeder and community scales. The power grid data sets are provided by four utility companies in North Carolina and the New York Power Administration. Acting as industry advisors, our industry partners communicated stakeholder needs and regulatory standards to the research teams, aiding technology transfer by incorporating the developed methodologies into their daily operations. This collaboration ensures that the PARS platform, functioning as a power system digital twin, enhances our understanding of IBR dynamic behaviors and enables the development and evaluation of IBR control functions that match or exceed the capabilities of conventional synchronous generators.

14 SOLAR ENERGY↗
DOE OSTI2020

Stochastic AC optimal power flow: A data-driven approach

There is an emerging need for efficient solutions to stochastic AC Optimal Power Flow (AC-OPF) to ensure optimal and reliable grid operations in the presence of increasing demand and generation uncertainty. Herein this paper presents a highly scalable data-driven algorithm for stochastic AC-OPF that has extremely low sample requirement. The novelty behind the algorithm’s performance involves an iterative scenario design approach that merges information regarding constraint violations in the system with data-driven sparse regression. Compared to conventional methods with random scenario sampling, our approach is able to provide feasible operating points for realistic systems with much lower sample requirements. Furthermore, multiple sub-tasks in our approach can be easily paralleled and based on historical data to enhance its performance and application. We demonstrate the computational improvements of our approach through simulations on different test cases in the IEEE PES PGLib-OPF benchmark library.

42 ENGINEERING↗