Search NASA⌕ Search

SEARCH · Search NASA

Results for “Deterministic processes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Quasi-deterministic localization of Er emitters in thin film TiO 2 through submicron-scale crystalline phase control

With their shielded 4f orbitals, rare-earth ions (REIs) offer optical and electron spin transitions with good coherence properties even when embedded in a host crystal matrix, highlighting their utility as promising quantum emitters and memories for quantum information processing. Among REIs, trivalent erbium (Er 3+ ) uniquely has an optical transition in the telecom C-band, ideal for transmission over optical fibers, making it well suited for applications in quantum communication. The deployment of Er 3+ emitters into a thin film TiO 2 platform has been a promising step toward scalable integration; however, like many solid-state systems, the deterministic spatial placement of quantum emitters remains an open challenge. Here, we investigate laser annealing as a means to locally tune the optical resonance of Er 3+ emitters in TiO 2 thin films on Si. Using both nanoscale x-ray diffraction measurements and cryogenic photoluminescence spectroscopy, we show that tightly focused below-gap laser annealing can induce anatase to rutile phase transitions in a nearly diffraction-limited area of the films and improve local crystallinity through grain growth. As a percentage of Er:TiO 2 is converted to rutile, the Er 3+ optical transition blueshifts by 13 nm. We explore the effects of changing laser annealing time and show that the amount of optically active Er:rutile increases linearly with laser power. We additionally demonstrate local phase conversion on microfabricated Si structures, which holds significance for quantum photonics.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Optimized manufacturing process for multilayer two-dimensional focusing mirrors in laboratory X-ray applications

Recent advances in laboratory X-ray applications require high-performance optical components that achieve exceptional imaging resolution and beam uniformity within compact experimental setups. Montel mirrors have become a preferred solution due to their unique dual-reflection focusing mechanism and a space-efficient design. Here, in this study, we present an effective manufacturing process for producing Montel mirrors tailored to focus laboratory X-ray beams. The mirrors were fabricated from single-crystal silicon substrates, chosen for their high mechanical stability and compatibility with precision polishing techniques. Our approach begins with the integration of a deterministic chemo-mechanical polishing (CMP)-based pre-shaping step followed by ion beam figuring (IBF), significantly improving manufacturing efficiency. Subsequently, our custom-developed advanced metrology and IBF techniques were employed for fabricating an off-axis, elliptical cylinder Montel mirror system with a 6-mrad total slope, with stringent optical specifications. While post-IBF processes, including multilayer coating, dicing, and gluing, introduced minor surface errors, yet their impact on performance remained negligible. The Montel mirrors manufactured with the optimized process exhibited significantly improved beam uniformity and a reduced focal spot size. These findings validate our approach as a viable solution for high-precision Montel mirror fabrication and facilitate further advancements in laboratory X-ray applications.

36 MATERIALS SCIENCE↗
DOE OSTI2020

An active learning high-throughput microstructure calibration framework for solving inverse structure–process problems in materials informatics

Determining a process–structure–property relationship is the holy grail of materials science, where both computational prediction in the forward direction and materials design in the inverse direction are essential. Problems in materials design are often considered in the context of process–property linkage by bypassing the materials structure, or in the context of structure–property linkage as in microstructure-sensitive design problems. However, there is a lack of research effort in studying materials design problems in the context of process–structure linkage, which has a great implication in reverse engineering. In this paper, given a target microstructure, we propose an active learning high-throughput microstructure calibration framework to derive a set of processing parameters, which can produce an optimal microstructure that is statistically equivalent to the target microstructure. The proposed framework is formulated as a noisy multi-objective optimization problem, where each objective function measures a deterministic or statistical difference of the same microstructure descriptor between a candidate microstructure and a target microstructure. Furthermore, to significantly reduce the physical waiting wall-time, we enable the high-throughput feature of the microstructure calibration framework by adopting an asynchronously parallel Bayesian optimization to exploit high-performance computing resources. Case studies in additive manufacturing and grain growth are used to demonstrate the applicability of the proposed framework, where kinetic Monte Carlo (kMC) simulation is used as a forward predictive model, such that for a given target microstructure, the target processing parameters that produced this microstructure are successfully recovered.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Review of Onsite Temperature and Solar Forecasting Models to Enable Better Building Design and Operations

Advanced building controls and energy optimization for new constructions and retrofits rely on accurate weather data. Traditionally, most studies utilize airport weather information as the decision inputs. However, most buildings are in environments that are quite different than those at the airport miles away. Tree cover, adjacent buildings, and micro-climate effects caused by the larger surrounding area can all yield deviations in air temperature, humidity, solar irradiance, and wind that are large enough to influence design and operation decisions. In order to overcome this challenge, there are many prior studies on developing weather forecasting algorithms from micro-to meso-scales. Additionally, this paper reviews and complies knowledge on common weather data resources, data processing methodologies and forecasting techniques of weather information. Commonly used statistical, machine learning and physical-based models are discussed and presented as two major categories: deterministic forecasting and probabilistic forecasting. Finally, evaluation metrics for forecasting errors are listed and discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Integral Kernel Methods for Nonlinear Parabolic-Elliptic Systems

Nonlinear parabolic-elliptic systems arise in many physical, biological, and chemical phenomena such as chemotaxis, ion transport, self-gravitating particles, and Brownian vortices. Existing methods struggle with the strong coupling and high nonlinearity and nonlocality of some of these systems, especially the ill-conditioned, convection-dominated problems. To overcome numerical difficulties, current approaches rely on initial guesses, preconditioning, or iterative techniques with no convergence guarantees. They might suffer from poor scalability, large memory usage, and difficulty to parallelize. Inspired by the connection of parabolic-elliptic systems to stochastic processes, we introduce a novel meshless, monolithic, and fully explicit method that naturally encapsulates the elliptic and parabolic operators into a single step which updates each node deterministically with global information. By being fully quadrature-based, it avoids solving systems of discretized equations and does not utilize initial guesses or preconditioning, while requiring little memory and being easy to parallelize. We first derive the method in an integral kernel formulation with quadratic complexity in the number of integration nodes and then leverage kernel-independent fast multipole methods (FMM) to present a scalable algorithm with linear complexity. We provide numerical examples for the Poisson-Nernst-Planck equations in one, two, and three dimensions, together with the derivation of the integral kernel for each case. Furthermore, the examples demonstrate the fast convergence and scalability of the FMM-accelerated algorithm, as well as its suitability for convection-dominated problems, making it competitive against traditional PDE solvers.

PDE systems↗
DOE OSTI2020

SCALE Code System

The SCALE Code System is a widely used modeling and simulation suite for nuclear safety analysis and design that is developed, maintained, tested, and managed by the Reactor and Nuclear Systems Division (RNSD) of Oak Ridge National Laboratory (ORNL). SCALE provides a comprehensive, verified and validated, user-friendly tool set for criticality safety, reactor and lattice physics, radiation shielding, spent fuel and radioactive source term characterization, and sensitivity and uncertainty analysis. Since 1980, regulators, licensees, and research institutions around the world have used SCALE for safety analysis and design. SCALE provides an integrated framework with dozens of computational modules, including three deterministic and three Monte Carlo radiation transport solvers that are selected based on the desired solution strategy. SCALE includes current nuclear data libraries and problem-dependent processing tools for continuous-energy (CE) and multigroup (MG) neutronics and coupled neutron-gamma calculations, as well as activation, depletion, and decay calculations. SCALE includes unique capabilities for automated variance reduction for shielding calculations, as well as sensitivity and uncertainty analysis. SCALE’s graphical user interfaces assist with accurate system modeling, visualization of nuclear data, and convenient access to desired results.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Short-Term Probabilistic Solar Forecasting via Reinforcement Learning over ECMWF

In this paper, we present an innovative reinforcement learning approach for short-term solar forecasting, leveraging data from the European Centre for Medium-Range Weather Forecasts (ECMWF). The methodology begins with the application of the System Advisor Model (SAM) to transform various ECMWF numerical weather prediction members into predictive photovoltaic power generation. To enhance the precision of deterministic forecasting, we introduce a dynamic model selection algorithm based on Q-learning. This algorithm dynamically identifies and utilizes the most accurate ensemble member for forecasting purposes. Furthermore, we employ a support vector regression surrogate model with a Gaussian distribution to generate probabilistic forecasts, providing a holistic view of solar energy generation uncertainty. To expedite the training process and make it more practical for real-world applications, we integrate a rolling update workflow. This innovative workflow reduces the training period from months to a mere 19 days, making our method highly efficient. Numerical results of the case study show that in comparison to benchmark models, the proposed method improves the deterministic and probabilistic solar forecasting accuracy by up to 40.84% and 48.42%, respectively.

ensemble forecasting↗
DOE OSTI2023

A Primer on Nuclear "Recoil" Data

For many years the ENDF-6 format has existed to contain evaluated nuclear data. One primary driver for the format and the data is neutron transport calculations. Evaluated data can be processed by a code like NJOY into either continuous energy form (ACE format) for Monte Carlo codes like MCNP or into multi-group form (NDI tables) for deterministic codes like Partisn. The reaction cross sections are found in the MF 3 section of the ENDF-6 format. If the reaction produces one or more neutrons as outputs, then secondary neutron data must also be given in MF 4,5 or 6 sections of the format. Energy and angular distributions for the output neutrons must be given in one of several available formats. The most general formats are found in MF 6. MF 4 is for angular distributions, MF 5 is for Energy distributions, and MF 6 contains both. In recent years, more interest has developed in the other output particles (i.e., the “recoil” particles) from neutron induced reactions. This has been driven by interest in charged particle transport and in more specialized partial kermas. ( A separate total neutron kerma has been available for a long time.) Partial kermas are a breakdown of the Kinetic Energy Released into the MAterial by output particle or by neutron reaction. The sum of the partial kermas should be equal to the total kerma on a group-wise basis. The ENDF-6 format is general enough for these new data requirements. Ideally, evaluated data would exist for every output particle (including the secondary neutrons) from every neutron-induced reaction. In the MF 6 format section, data for multi-particle outputs may be entered using the LAW =1 option. This option explicitly allows energy and angular output distributions for each particle produced in the reaction. Such information should preserve the balance between partial kermas and the total kerma at the groupwise level as well as the individual particle averaged energies. For simpler 2-body reactions, LAW = 2 is available. This allows the evaluation to specify only enough data to specify the 2-body reaction fully. Such a simplification does not exist for 3 (or more) body breakups. A simplified form of LAW 2, i.e., LAW 3, also exists to generate approximate recoil output distributions in the absence of full data. However, evaluated data does not generally exist at this fine granularity for reactions involving more than 2 output particles ( e.g., the 3-body break-up reaction). When the multi-body detailed output distribution data is not available, LAW=6 may be employed in NJOY. LAW 6 produces approximate output distributions for all the particles produced in the reaction. Just like in the 2-body case, the smaller particles will generally carry off more energy. At any particular energy, the balance between the sum of the partial kermas and the total kerma will not necessarily be preserved. However, the average energy of each output particle from a reaction is preserved.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Experimental Results for Large Particle Separation from Non-Newtonian Slurries Using Tapered Bump Arrays

Lateral displacement arrays are useful for separating particles such as blood cells and sand from carrier fluids. These arrays consist of staggered posts, which allow smaller particles to follow streamlines and larger particles to flow around the posts and migrate to one side. This migration increases the particle concentration in one direction and depletes the particle concentration in the other direction allowing particle separation to occur. Experiments were conducted to separate large particles in non-Newtonian yield stress slurries using tapered bump arrays. The non-Newtonian slurry used was composed of a bentonite kaolin blend with the inclusion of larger diameter particles. These experiments were conducted to evaluate the performance of particle separation using a tapered array of staggered posts as configured in a bump array for non-Newtonian yield stress slurries, an application that has not been explored experimentally. A theory for large particle separation was developed for slurries that exhibit Bingham or Cross rheology. The results of these experiments are described. This information could be applied in industrial settings such as separation of particles from nuclear waste slurries including those to be processed at the Hanford site, where removing large particles from waste streams is important to processing.

slurry, solids removal, deterministic lateral disp↗
DOE OSTI2023

Comparing Experimental Results for Large Particle Separation from Non-Newtonian Slurries Using Full and Tapered Bump Arrays

To separate particles from carrier fluids arrays of staggered posts inserted into the flow stream can be employed. The smaller particles follow the flow stream while the larger particles move laterally to one side. During flow, the concentration of particulate increases in one direction and decreases in the other crosswise direction. This technique separates the particles from the carrier fluid. Experiments using a slurry with non-Newtonian rheology were conducted to evaluate large particle separation from the non-Newtonian carrier fluid using bump arrays. The bentonite kaolin clay slurry with non-Newtonian rheology was spiked with large diameter inert glass particles. Experiments with flow through lateral displacement arrays evaluated the performance of particle separation using two array configurations: a full array with all posts and a tapered array with posts removed in a triangular portion of the array past the rows of anticipated particle of separation. The posts are staggered posts to promote particle segregation to one side of the flow channel. Using this type of array for removing particles from non-Newtonian yield stress slurries is novel and we present unique results. In this paper, the performance of full and tapered arrays are compared. These results have many industrial applications including removing particles from slurries of nuclear waste. Large particle removal is an important step in waste processing.

slurry, solids removal, deterministic lateral disp↗
DOE OSTI2023

Predicting Deposition Rate and Closing the Loop on Aerosol Jet Printing with In‐Line Light Scattering Measurements

Aerosol jet printing is a compelling noncontact, digital manufacturing technology for flexible, hybrid, and conformal electronics, but batch‐to‐batch variability and process drift inhibit systematic study and translation to production environments. Emerging measurement techniques for the aerosol volume fraction, a key parameter governing deposition rate, have shown promise for real‐time response, including a recent demonstration of human‐in‐the‐loop control. By integrating improved light scattering measurements with custom software, a robust environment for real‐time monitoring is established and fully automated closed‐loop control over the deposition rate during printing is enabled. The physical basis for scattering measurements as a feedback source is examined and the quantitative insight this provides for ink development and fundamental process studies is highlighted. Three candidate process variables for closed‐loop control, namely the atomizer voltage, carrier gas flow rate, and print speed, are then evaluated. The atomizer voltage demonstrates the best extended duration validity because it addresses atomization variability directly, but carrier gas flow rate and print speed provide faster and more deterministic responses. This methodology is then demonstrated for electrical properties using a silver nanoparticle ink, maintaining 98% of printed patterns within 10% of the mean resistance value over 3 h of printing.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Status of the NEAMS and ARC fast reactor tools integration to the NEAMS Workbench

The Workbench initiative was launched in FY-2017 within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program to facilitate the transition from conventional tools to high-fidelity tools. The NEAMS Workbench provides a common user interface for model creation, real-time validation, execution, output processing, and visualization for integrated codes. The integration of the Argonne Reactor Computation (ARC) suite of codes into the NEAMS Workbench through the PyARC module was initiated in FY-2017. The ARC codes, which focus on fast reactor multiphysics analysis, contain both legacy codes like DIF3D and REBUS-3 that were developed with over 30 years of experience, and newer NEAMS additions like MC 2 -3, PERSENT, and PROTEUS. Recent work expended this integration to other tools to support the U.S. fast reactor community such as DASSH for sub-channel thermal-hydraulics, Griffin for high-fidelity deterministic transport calculations, and OpenMC for Monte Carlo simulations (with Shift integration planned for FY-2023). The integration of the “extended ARC” suite of codes into the NEAMS Workbench interface relies on the PyARC and PyGriffin modules to handles the pre- and post-processing of these codes input, and the runtime environment. The PyARC module together with the NEAMS Workbench interface are both released under Open Source Software licenses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Automation for Electric Vehicle Battery Pack Disassembly

Battery‐electric vehicles (EVs) are growing exponentially. The demand for these batteries is expected to increase sevenfold by 2035. The EV batteries reach their end of life when the capacity fades to 70%–80% of new, with some being removed from the primary applications with even lower levels of degradation. These batteries can be used in less demanding applications. The disassembly process is currently manual, slow, unsafe, and expensive. Automation is needed to increase the throughput. EV battery packs feature various continually changing designs and form factors, which limit the usefulness of deterministically programmed robotic solutions. The conceptual robotic disassembly of EV batteries has attracted the attention of researchers. However, while many approaches have been proposed, practical implementations are lacking. Here, we review proposed concepts for EV battery disassembly and describe the selected approach, with elements of partial solutions validated in a laboratory setting, including the selection of commercial solutions, the development of custom end effectors, and methodologies for detection, localization, and classification of fasteners. The computer vision tasks employed an overhead 2D camera to detect the type of battery pack and approximate localization of fasteners, and a 3D camera mounted on the robotic arm for precise localization (position and tilt) and classification.

Islam, Abu [Rochester Inst. of Technology, Rochest↗
DOE OSTI2022

Separating Oil-Water Mixtures Using Bump Arrays

Particle separation is an important process step across many fields. One technique being applied for separating solids such as blood components or sand particles from carrier fluids is the use of arrays of aligned posts called deterministic lateral arrays to bump particles to one side in the flow stream to enhance separation. This technique may be useful for separation of deformable particles. The ability to efficiently separate two-phase industrial (oil/water) mixtures is key for future use of valuable resources. Over 1 trillion gallons of petroleum production water could be reclaimed annually for reuse in the drought-ridden western US states. The ability to reclaim this petroleum production water may be critical for the Central High Plains (Colorado, Kansas, Oklahoma, Texas, and New Mexico). Trends in just the High Plains area already lost 20 to 25% of the irrigated farming area due to insufficient ground water storage to irrigate, and farmland losses are expected to grow to 40%. Proving this technology is key to reuse of petroleum production water for crop irrigation or to replace water from currently failing aquifers in rich agricultural lands of the Central High Plains. We conducted experiments applying mesofluidic separation for flowing two-phase (oil/water) mixtures. Experiments were conducted using oils of differing viscosities with water as the carrier fluid; separation was achieved over a range of oil-water concentrations. We describe the results of these experiments in this paper.

oil-water separation, micelle, droplet separation,↗
DOE OSTI2022

Introduction to an MCGIDI Mini-App and Performance Comparisons with XSBench

In high-performance Monte Carlo (MC) radiation transport codes, cross section lookups often account for the majority of computational expens. In response to this observation, a number of nuclear data mini-apps have been developed to profile and optimize the lookup process. A review of these mini-apps can be found in Ref. In contrast to a fully fledged MC code, nuclear data mini-apps do not feature particle tracking; instead, the cross section lookup process is considered in isolation, a simplification that allows for easier implementation and evaluation of various lookup schemes and techniques. GIDI+, as described on its public repository1, is ...a collection of C++ libraries for accessing evaluated and processed nuclear data stored in the Generalized Nuclear Database Structure (GNDS). In addition to reading GNDS files, GIDI+ has functions to sum and collapse multi-group data as needed by deterministic transport codes, and to sample GNDS data as needed by Monte Carlo transport codes. Certain modes of Mercury, a LLNL-developed MC radiation transport code, utilize GIDI+ for cross section lookups. Specifically, Mercury uses the MCGIDI library contained within GIDI+ to perform lookups on GPUs. A mini-app exercising MCGIDI’s cross section lookup capabilities would prove useful for optimization, which in turn could improve the performance of client codes such as Mercury. Such a mini-app could also be used to assess the performance of MCGIDI compared to other nuclear data mini-apps. In this document, we introduce a nuclear data mini-app built with the MCGIDI library. The MCGIDI mini-app (MCGIDI-MA) was developed to closely resemble the methodology present in XSBench, a nuclear data mini-app developed at Argonne National Laboratory. The remainder of this section provides an overview on XSBench. Section 2 describes MCGIDI-MA and its usage. Section 3 contains performance results of MCGIDI-MA on LLNL’s Lassen and Quartz compute platforms, as well as comparisons to XSBench performance where appropriate. In Section 4, we present a summary of our findings.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Benchmark Solutions for Radiation Transport in Stochastic Media with Inhomogeneous Material Statistics

Accurately solving implicit Monte Carlo (IMC) thermal photon transport problems with mixed material cells is important in realistic applications. The production IMC package at LLNL treats mixed material cells arising from ALE remap and hydrodynamics using the same approximate model. The new Imp IMC thermal photon transport package currently under development has both a material interface reconstruction (MIR) algorithm and a Levermore-Pomraning (LP) stochastic medium algorithm for treating mixed material cells. Existing stochastic medium algorithms for treating mixed material cells in IMC lack a complete theoretical basis. The IMC LP algorithm implementation has been demonstrated to reproduce published deterministic LP solutions for the particular case of spatially homogeneous material statistics. Realistic simulations will include spatially inhomogeneous material statistics (material mean chord lengths). In a previous investigation, the LP-model for transport in binary stochastic media in rod geometry was generalized to accommodate spatially varying material chord lengths, i.e., the mixing statistics were allowed to be nonhomogeneous. Analytical solutions were obtained and used to produce a verifi cation suite for the Imp IMC Levermore-Pomraning implementation for different spatial variations of the chord lengths. However, the accuracy of the LP model when the mixing statistics are nonhomogeneous has not been assessed and leaves open the question of whether local accuracy is improved or further degraded when chord lengths are not uniform. This shortcoming is rectifi ed here by developing benchmark analytic solutions for transport in binary Markovian stochastic mixtures in rod geometry with nonhomogeneous mixing statistics, using spatially varying chord lengths considered in the previous investigation based on the LP model. Methods for sampling a nonhomogeneous Poisson process (NHPP) are first described and used to construct individual realizations of the binary mixtures in rod geometry. Analytic solutions are then obtained for the forward and backward directed fluxes on a given realization, now viewed as a deterministic medium with alternating layers of the two materials with known interface locations. Finally, material averaged scalar fluxes are obtained using these sampling schemes with spatially linear and quadratic chord lengths and used to assess the accuracy of the previously obtained LP-model results.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

A parallel discrete dislocation dynamics/kinetic Monte Carlo method to study non-conservative plastic processes

Non-conservative processes play a fundamental role in plasticity and are behind important macroscopic phenomena such as creep, dynamic strain aging, loop raft formation, etc. In the most general case, vacancy-induced dislocation climb is the operating unit mechanism. While dislocation/vacancy interactions have been modeled in the literature using a variety of methods, the approaches developed rely on continuum descriptions of both the vacancy population and its fluxes. However, there are numerous situations in physics where point defect populations display heterogeneous concentrations and/or non-smooth kinetics. Here, a kinetic Monte Carlo (kMC) approach for modeling vacancy transport in response to arbitrary stress fields is used. Vacancies are treated as point particles and are coupled to the dislocation substructure representing a deformed material via an advection term defined by the local stress gradients. The stress fields and the dislocation substructure are evolved using a discrete dislocation dynamics (DDD) module. To extend the coupled model to the treatment of large systems, we have implemented it in the massively-parallel DDD code ParaDiS. To avoid numerical incompatibilities associated with merging deterministic (DDD) and stochastic (kMC) integration algorithms, we cast the entire elasto-plastic-diffusive problem within a single stochastic framework, taking advantage of a parallel kMC algorithm to evolve the system as a single event-driven process. The large-scale implementation enables the study of the evolution of a variety of dislocation-defect scenarios governed by non-conservative transport kinetics. After carrying out an exhaustive numerical and computational analysis of our parallel algorithm, we show results that emphasize situations where inhomogeneous vacancy dynamics are of relevance, and compare discrete kinetics to continuum solutions for several cases.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Approximating Nash Equilibrium in Day-ahead Electricity Market Bidding with Multi-agent Deep Reinforcement Learning

In this paper, a day-ahead electricity market bidding problem with multiple strategic generation company (GEN-CO) bidders is studied. The problem is formulated as a Markov game model, where GENCO bidders interact with each other todevelop their optimal day-ahead bidding strategies. Considering unobservable information in the problem, a model-free and data-driven approach, known as multi-agent deep deterministic policy gradient (MADDPG), is applied for approximating the Nash equilibrium (NE) in the above Markov game. The MADDPG algorithm has the advantage of generalization due to the automatic feature extraction ability of the deep neural networks. The algorithm is tested on an IEEE 30-bus system with three competitive GENCO bidders in both an uncongested caseand a congested case. Comparisons with a truthful bidding strategy and state-of-the-art deep reinforcement learning methods including deep Q network and deep deterministic policy gradient (DDPG) demonstrate that the applied MADDPG algorithm can find a superior bidding strategy for all the market participants with increased profit gains. In addition, the comparison with a conventional model-based method shows that the MADDPG algorithm has higher computational efficiency, which is feasible for real-world applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗