Engineering topics

Purkayastha, Avi

Publications and source records attributed to Purkayastha, Avi.

At least 19 records

DOE OSTI2024

WTK-LED: The WIND Toolkit Long-Term Ensemble Dataset

To satisfy a wide group of stakeholders across various wind energy disciplines, including but not limited to stakeholders in the distributed and utility scale wind industry, the new emerging airborne wind energy field, grid integration, power systems modeling, environmental modeling, and researchers in academia, and to close some of the gaps that current public datasets have, we aimed at developing an updated version of the meteorological WIND Toolkit, named WIND Toolkit Long-term Ensemble Dataset (WTK-LED), which is a meteorological dataset providing time series every 5 min and 2 km, including model uncertainty of wind speed at every modeling grid point so that users are provided with a range of possible wind speeds every 2 km. The data were produced using the Weather Research and Forecasting Model (WRF). The vertical grid used in WTK-LED includes many vertical layers in the atmospheric boundary layer to provide information of atmospheric quantities across the rotor layer of utility scale and distributed wind turbines. The WTK-LED includes: 1) Numerical simulations covering the continental United States, Alaska, and Hawaii, with high-resolution data being available for 3 years (2018-2020). 2) Climate simulations from Argonne National Laboratories covering the North American continent, including Alaska, Canada, and most of Mexico and the Caribbean Islands. These simulations complement the new WTK-LED to offer a 4-km dataset covering 20 years, from 2001-2020. 3) Specific long-term,high-resolution offshore simulations have been conducted separately for the US coasts, Hawaii, and the Great Lakes, leading to the 2023 National Offshore Wind data set. This report focuses on a description of the land-based WTK-LED for CONUS, Hawaii, and Alaska, for the 3-year 2-km/5-min dataset and the 20-year 4-km/hourly dataset, as well as the uncertainty quantification method. We also provide limited validation results. Based on our results to date, we suggest use cases and applications for each dataset of the WTK-LED.

17 WIND ENERGY↗

DOE OSTI2024

The 2023 National Offshore Wind data set (NOW-23)

Abstract. This article introduces the 2023 National Offshore Wind data set (NOW-23), which offers the latest wind resource information for offshore regions in the United States. NOW-23 supersedes, for its offshore component, the Wind Integration National Dataset (WIND) Toolkit, which was published a decade ago and is currently a primary resource for wind resource assessments and grid integration studies in the contiguous United States. By incorporating advancements in the Weather Research and Forecasting (WRF) model, NOW-23 delivers an updated and cutting-edge product to stakeholders. In this article, we present the new data set which underwent regional tuning and performance validation against available observations and has data available from 2000 through, depending on the region, 2019–2022. We also provide a summary of the uncertainty quantification in NOW-23, along with NOW-WAKES, a 1-year post-construction data set that quantifies expected offshore wake effects in the US Mid-Atlantic lease areas. Stakeholders can access the NOW-23 data set at https://doi.org/10.25984/1821404 (Bodini et al., 2020).

17 WIND ENERGY↗

DOE OSTI2024

Causes of and Solutions to Wind Speed Bias in NREL's 2020 Offshore Wind Resource Assessment for the California Pacific Outer Continental Shelf

This report provides the results of a detailed analysis into the causes of high wind speed bias in the 20-year wind resource data set for offshore California the National Renewable Energy Laboratory (NREL) released in 2020, herein called CA20. The data set was developed using the state-of-the-art Weather Research and Forecasting (WRF) model. Notably, no floating lidars were available at the time in offshore California to validate offshore hub-height wind speeds. In late 2020, the Pacific Northwest National Laboratory (PNNL) deployed two floating lidars in the California outer continental shelf (OCS), near the Bureau of Ocean Energy Management (BOEM) call areas of Humboldt and Morro Bay. Using these observations through 2021, NREL found considerable bias in modeled hub-height winds at both locations: up to +2 m/s at Humboldt over a 6-month period, and up to +1 m/s at Morro Bay over a one-year period. Upon the discovery of this bias, the Department of Energy (DOE) and BOEM funded NREL and PNNL to investigate the causes of, impacts of, and solutions to the bias in the CA20 data set. This report summarizes the findings of this research. We first investigated whether different WRF model setups could lead to reduced bias. We found that the choice of planetary boundary layer (PBL) scheme - which controls the vertical turbulent mixing of momentum, heat, and moisture in the lowermost part of the atmosphere - greatly affected hub-height wind speeds in the region. Specifically, switching from the Mellor-Yamada-Nakanishi-Niino (MYNN) scheme used in CA20 (and widely used across a range of operational and research weather models) to the less common Yonsei University (YSU) scheme nearly eliminated the bias at both the Humboldt and Morro Bay lidar locations. The large discrepancy between the MYNN- and YSU-modeled hub-height winds pointed towards the role of atmospheric stability. In general, PBL schemes agree well in conditions of high turbulence and mixing, normally referred to as "unstable" conditions. By contrast, PBL schemes start to diverge in "stable" conditions, where turbulence is low and thermal stratification (i.e., higher temperature air sitting on top of colder air) greatly suppresses vertical mixing. Under such conditions, winds aloft can decouple from surface effects and greatly accelerate, causing high wind speeds at hub-height and frequent low-level jets (LLJs). We determined that these stable conditions are in fact dominant in offshore California. The region is characterized by moderate-to-extreme stable stratification with a LLJ on average around 200 meters above sea-level. To our knowledge, no wind energy area globally has as strongly stable stratification as offshore California. Under these extreme conditions, we determined that the MYNN scheme models higher stability than YSU, resulting in less vertical turbulent mixing than YSU, allowing for the acceleration of hub-height winds, more intense LLJs, and higher-amplitude inertial oscillations. Using surface observations, we found that MYNN overestimates near-surface stability, whereas YSU tends to model stability better. We then considered several short-term case studies to assess additional meteorological drivers of the bias at Humboldt. We found that during synoptic scale northerly flows driven by the North Pacific High and inland thermal low, a coastal warm bias in the MYNN case studies contributes to the modeled wind speed bias by altering the boundary layer thermodynamics via a thermal wind mechanism. Given the strong performance of the YSU-based runs in offshore California, NREL has produced and published an updated version of the CA20 data set with YSU as the PBL scheme. This updated data set is now part of NREL's 2023 National Offshore Wind (NOW-23) data set, which covers all the U.S. offshore waters. The development and final validation of the NOW-23 data set in offshore California is documented in this report.

17 WIND ENERGY↗

DOE OSTI2024

Causes of and Solutions to Wind Speed Bias in NREL’s 2020 Offshore Wind Resource Assessment for the California Pacific Outer Continental Shelf

This report provides the results of a detailed analysis of the causes of high wind speed bias in the 20-year wind resource data set for offshore California that the National Renewable Energy Laboratory (NREL) released in 2020, herein called CA20. The data set was developed using the state-of-the-art Weather Research and Forecasting model. Notably, no floating lidars were available at the time in offshore California to validate offshore hub-height wind speeds. In late 2020, the Pacific Northwest National Laboratory (PNNL) deployed two floating lidars in the California Outer Continental Shelf, near the Bureau of Ocean Energy Management (BOEM) call areas of Humboldt and Morro Bay. Using these observations through 2021, NREL found considerable bias in modeled hub-height winds at both locations: up to +2 m/s at Humboldt over a 6-month period, and up to +1 m/s at Morro Bay over a 1-year period.

17 WIND ENERGY↗

DOE OSTI2024

WIND Toolkit Long-Term Ensemble Dataset

WIND Toolkit Long-term Ensemble Dataset (WTK-LED), an updated version of the meteorological WIND Toolkit, is a meteorological dataset providing high-resolution time series, including interannual variability and model uncertainty of wind speed at every modeling grid point to indicate ranges of possible wind speeds. The data were produced using the Weather Research and Forecasting Model (WRF). The vertical grid used in WTK-LED includes many vertical layers in the atmospheric boundary layer to provide information of atmospheric quantities across the rotor layer of utility scale and distributed wind turbines. The WTK-LED includes: (1) Numerical simulations of wind speed and other meteorological variables covering the contiguous United States (CONUS) and Alaska, with high-resolution (5-minute [min], 2-kilometer [km]) data for 3 years (2018-2020): WTK-LED CONUS, WTK-LED Alaska. (2) Climate simulations from Argonne National Laboratory covering North America, including Alaska, Canada, and most of Mexico and the Caribbean islands. These simulations complement the new WTK-LED to offer a 4-km, hourly dataset covering 20 years (2001-2020): WTK-LED Climate. (3) Specific long-term, high-resolution offshore simulations have been conducted separately for the U.S. coasts, Hawaii, and the Great Lakes, leading to the 2023 National Offshore Wind dataset: NOW-23. The data for Hawaii include land-based data and are part of WTK-LED Hawaii. Because the accuracy of simulations from a mesoscale model, such as WRF, varies depending on the location and weather situation, and can reach up to several m/s for wind speed, we provide simulated wind speed uncertainty estimates to the community to be used in conjunction with the deterministic model simulations. This dataset was developed to satisfy a wide group of stakeholders across various wind energy disciplines, including but not limited to stakeholders in the distributed and utility scale wind industry, the new emerging airborne wind energy field, grid integration, power systems modeling, environmental modeling, and researchers in academia, and to close some of the gaps that current public datasets have. Based on our validation results to date, we suggest use cases and applications for each dataset of the WTK-LED as shown in "WTK-LED Use Cases" resource below.

Array↗

DOE OSTI2023

NOW-23: the 2023 National Offshore Wind Data Set

In this report, we present the latest wind resource data specifically tailored for offshore regions in the United States. The data set, known as the 2023 National Offshore Wind data set (NOW-23), has been developed by the National Renewable Energy Laboratory (NREL) and its partners, and surpasses the previous resource data set, the Wind Integration National Dataset (WIND) Toolkit, which was released approximately ten years ago, in its offshore component. The WIND Toolkit has been widely utilized by stakeholders involved in wind resource assessments across the continental United States. However, with significant advancements in numerical weather prediction modeling over the past decade, the NOW-23 data set incorporates the latest research and development progress to provide stakeholders with an updated and cutting-edge resource for offshore wind analysis. The NOW-23 data set is created using the Weather Research and Forecasting (WRF) model and its output is available, as for its predecessor, at 5-minute time resolution and 2-kilometer horizontal spatial resolution. However, the NOW-23 data set improves upon the WIND Toolkit through: 1. A modeling period of at least 20 years (and as long as 23 years in selected regions), starting in 2000 (compared to the 7-year 2007–2013 modeling period in the WIND Toolkit). 2. For several offshore regions, a region-specific sensitivity analysis, driven by an ensemble of WRF simulations, to assess the most adequate region-specific WRF setup. 3. An updated WRF model, from Version 3.4 used in the WIND Toolkit to Version 4.2.1 used for the NOW-23 data set, which incorporates significant research advancements. 4. The use of the state-of-the-art reanalysis product ERA5 (which supersedes the older ERA-Interim used in the WIND Toolkit) to provide atmospheric forcing at the WRF domain boundaries. Figure 1 shows the NOW-23 mean wind speed at 160 m above sea level (asl), which we use as proxy for hub-height of a commercial offshore wind turbine in this report across all regions.

17 WIND ENERGY↗

DOE OSTI2023

NOW-23: The 2023 National Offshore Wind Data Set

17 WIND ENERGY↗

DOE OSTI2023

Data Center Facility Monitoring with Physics Aware Approach

U.S. Department of Energy's National Renewable Energy Laboratory (NREL) hosts one of the world's most energy-efficient HPC data centers; this system uses component-level warm-water liquid cooling to efficiently remove heat from the data center and capture it for reuse in the building or rejection to the atmosphere. Given the complexity of this system, building data-driven tools for holistically monitoring and operating the entire data center is a priority for ensuring maximal efficiency and resiliency. In this advanced smart facility, over one million metrics are recorded per minute using state-of-the-art streaming data architecture and software to capture and process the state of the system in real time. Here we detail two efforts to effectively analyze, visualize, and interpret this large volume streaming data. We have developed a novel, flexible system for identifying and visualizing individual metric anomalies and component performance across the data center through automatic metadata extraction and physically-motivated visualization for quick interpretation. Additionally, to directly connect system maintenance to data stream processing we explore a physics informed multi-metric drift and anomaly detection application to detect scale-build up in heat exchangers.

anomaly detection↗

DOE OSTI2022

BUTTER-E - Energy Consumption Data for the BUTTER Empirical Deep Learning Dataset

The BUTTER-E - Energy Consumption Data for the BUTTER Empirical Deep Learning Dataset adds node-level energy consumption data from watt-meters to the primary sweep of the BUTTER - Empirical Deep Learning Dataset. This dataset contains energy consumption and performance data from 63,527 individual experimental runs spanning 30,582 distinct configurations: 13 datasets, 20 sizes (number of trainable parameters), 8 network "shapes", and 14 depths on both CPU and GPU hardware collected using node-level watt-meters. This dataset reveals the complex relationship between dataset size, network structure, and energy use, and highlights the impact of cache effects. BUTTER-E is intended to be joined with the BUTTER dataset (see "BUTTER - Empirical Deep Learning Dataset on OEDI" resource below) which characterizes the performance of 483k distinct fully connected neural networks but does not include energy measurements.

Array↗

DOE OSTI2022

Automatic DDoS Attack Detection on SDNs: Preprint

Denial of Service (DoS) and Distributed Denial of Service (DDoS) attacks pose a serious threat to computing networks - especially to critical systems within the U.S. electrical grid. As attack mechanisms have increased in complexity and variety, more sophisticated detection mechanisms have become necessary to ensure network security. This paper explores the use of artificial intelligence to automate the process of detection and mitigation of DoS and DDoS attacks within the framework of Software-Defined Networking (SDN), to a high degree. Machine learning algorithms are trained to recognize DoS and DDoS attacks and are deployed in real-time to mitigate malicious network traffic. The results show a well-tuned gradient-boosted decision tree detecting DoS and DDoS attacks, as well as initial successful mitigation of attacks within an SDN framework.

cyber detection↗

DOE OSTI2022

Can reanalysis products outperform mesoscale numerical weather prediction models in modeling the wind resource in simple terrain?

Mesoscale numerical weather prediction (NWP) models are generally considered more accurate than reanalysis products in characterizing the wind resource at heights of interest for wind energy, given their finer spatial resolution and more comprehensive physics. However, advancements in the latest ERA-5 reanalysis product motivate an assessment on whether ERA-5 can model wind speeds as well as a state-of-the-art NWP model – the Weather Research and Forecasting (WRF) Model. We consider this research question for both simple terrain and offshore applications. Specifically, we compare wind profiles from ERA-5 and the preliminary WRF runs of the Wind Integration National Dataset (WIND) Toolkit Long-term Ensemble Dataset (WTK-LED) to those observed by lidars at a site in Oklahoma, United States, and in a United States Atlantic offshore wind energy area. We find that ERA-5 shows a significant negative bias (~-1ms-1) at both locations, with a larger bias at the land-based site. WTK-LED-predicted wind speed profiles show a limited negative bias (~-0.5ms-1) offshore and a slight positive bias (~+0.5ms-1) at the land-based site. On the other hand, we find that ERA-5 outperforms WTK-LED in terms of the centered root-mean-square error (cRMSE) and correlation coefficient, for both the land-based and offshore cases, in all atmospheric stability conditions. We find that WTK-LED's higher cRMSE is caused by its tendency to overpredict the amplitude of the wind speed diurnal cycle. At the land-based site, this is partially caused by wind plant wake effects not being accurately captured by WTK-LED.

17 WIND ENERGY↗

DOE OSTI2021

The North American Renewable Integration Study (NARIS): A U.S. Perspective

The North American electric power system is undergoing significant change, with renewable resources now contributing more generation than ever before. This transformation is poised to continue given decreasing technology costs and ambitious decarbonization goals at the federal, state, local, corporate, and consumer levels. The North American Renewable Integration Study (NARIS) aims to inform grid planners, utilities, industry, policymakers, and other stakeholders about challenges and opportunities for continental system integration of large amounts of wind, solar, and hydropower to support a low-carbon future grid. The National Renewable Energy Laboratory (NREL) conducted a detailed, continent-wide analysis with planning scenarios of transmission, generation, and demand to reach 80%–92% carbon reductions (from 2005) for the Canadian electric power system, and up to 80% reductions continent-wide. We used a suite of models to study future scenarios and gain insights, including potential impacts on costs, emissions, resource adequacy, and the specific technologies that help enable the transition to a low-carbon grid. Our analysis had a particular focus on the potential role of cooperation among the three North American countries and between regions within each country, and how transmission can support sharing of supply and demand diversity. The NARIS project began in 2016. This report describes a U.S. perspective in coordination with the U.S. Department of Energy, and a companion report describes a Canadian perspective in coordination with the Natural Resources Canada. NARIS was an extension of a previous body of work, including the Western Wind and Solar Integration Study, the Eastern Renewable Generation Integration Study, Interconnections Seam Study, and the Pan Canadian Wind Integration Study. NARIS analyzed the entire continent in detail while studying higher renewable generation than previous studies. The scenarios in NARIS were informed by the goals in the Mid-Century Strategies for the Paris Agreement in each country.

14 SOLAR ENERGY↗

DOE OSTI2021

The North American Renewable Integration Study (NARIS): A Canadian Perspective

The North American electric power system is undergoing significant change, with renewable resources now contributing more generation than ever before. This transformation is poised to continue given decreasing technology costs and ambitious decarbonization goals at the federal, state, local, corporate, and consumer levels. The North American Renewable Integration Study (NARIS) aims to inform grid planners, utilities, industry, policymakers, and other stakeholders about challenges and opportunities for continental system integration of large amounts of wind, solar, and hydropower to support a low-carbon future grid. The National Renewable Energy Laboratory (NREL) conducted a detailed, continent-wide analysis with planning scenarios of transmission, generation, and demand to reach 80%–92% carbon reductions (from 2005) for the Canadian electric power system, and up to 80% reductions continent-wide. We used a suite of models to study future scenarios and gain insights, including potential impacts on costs, emissions, resource adequacy, and the specific technologies that help enable the transition to a low-carbon grid. Our analysis had a particular focus on the potential role of cooperation among the three North American countries and between regions within each country, and how transmission can support sharing of supply and demand diversity. The NARIS project began in 2016. This report describes a Canadian perspective in coordination with the Natural Resources Canada, and a companion report describes a U.S. perspective in coordination with the U.S. Department of Energy. NARIS was an extension of a previous body of work, including the Western Wind and Solar Integration Study, the Eastern Renewable Generation Integration Study, Interconnections Seam Study, and the Pan Canadian Wind Integration Study. NARIS analyzed the entire continent in detail while studying higher renewable generation than previous studies. The scenarios in NARIS were informed by the goals in the Mid-Century Strategies for the Paris Agreement in each country.

14 SOLAR ENERGY↗

DOE OSTI2021

Artificial Intelligence for Data Center Operations (AI Ops)

HPC data centers such as the one at NREL's ESIF will increasingly need to rely on automation to keep pace with exascale growth in compute capability and to manage and optimize the data center environment and facility resources. Artificial intelligence (AI) and machine learning (ML) approaches provide the means to improve HPC data center efficiency (energy, operational, and managerial efficiency) and resiliency by learning historical trends and training models to operate on real-time data collected from both IT and facilities sources. The goal of coupled improvement of data center resiliency and energy efficiency through automated data collection and AI has led to a multi-year, multi-staged collaboration between NREL and Hewlett-Packard Enterprise's Advanced Technology Group, referred to as Artificial Intelligence for Data Center Operations (AIOps). The extended efforts within the AIOps project include a common goal of building capabilities for an advanced smart facility and demonstration of data collection and AI modeling techniques in the ESIF data center.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Holistic Approaches to HPC Power and Workflow Management

Constraints on power consumption are having pervasive effects on high-performance computing (HPC) systems, the facilities in which they are housed, and the application codes themselves. Whether these constraints are driven by physical limits on available power within a facility, are due to utility demand response, result from opportunities to reduce utility costs, or are imposed by sponsoring agencies, power management must now be added to the traditional goals of application and algorithm correctness, scalability, and performance. The specifics of these power constraints are likely to vary from site to site, and optimal strategies for managing power will vary. In this paper, we present the results of implementing several strategies for managing HPC system power and quantify the impact of these power reductions on application performance. These can be added to the suite of extant options that can be used to manage power and workflow on HPC systems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

Holistic Approaches to HPC Power & Workflow Management: Preprint

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2019

An FEM-MLMC algorithm for a moving shutter diffraction in time stochastic model

We consider a moving shutter and non-deterministic generalization of the diffraction in time model introduced by Moshinsky several decades ago to study a class of quantum transients. We first develop a moving-mesh finite element method (FEM) to simulate the determisitic version of the model. We then apply the FEM and multilevel Monte Carlo (MLMC) algorithm to the stochastic moving-domain model for simulation of approximate statistical moments of the density profile of the stochastic transients.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2017

Prediction and characterization of application power use in a high-performance computing environment

Power use in data centers and high-performance computing (HPC) facilities has grown in tandem with increases in the size and number of these facilities. Substantial innovation is needed to enable meaningful reduction in energy footprints in leadership-class HPC systems. In this paper, we focus on characterizing and investigating application-level power usage. We demonstrate potential methods for predicting power usage based on a priori and in situ characteristics. Lastly, we highlight a potential use case of this method through a simulated power-aware scheduler using historical jobs from a real scientific HPC system.

97 MATHEMATICS AND COMPUTING↗