Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed Computing Resources”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

FURTHER EVALUATION OF BOOTSTRAP RESAMPLING AS A TOOL FOR RADIO-INTERFEROMETRIC IMAGING FIDELITY ASSESSMENT

We report on a broader evaluation of statistical bootstrap resampling methods as a tool for pixel-level calibration and imaging fidelity assessment in radio interferometry. Pixel-level imaging fidelity assessment is a challenging problem, important for the value it holds in robust scientific interpretation of interferometric images, enhancement of automated pipeline reduction systems needed to broaden the user community for these instruments, and understanding leading-edge direction-dependent calibration and imaging challenges for future telescopes such as the Square Kilometre Array. This new computational approach is now possible because of advances in statistical resampling for data with long-range dependence and the available performance of contemporary high-performance computing resources. We expand our earlier numerical evaluation to span a broader domain subset in simulated image fidelity and source brightness distribution morphologies. As before, we evaluate the statistical performance of the bootstrap resampling methods against direct Monte Carlo simulation. We find that both model-based and subsample bootstrap methods continue to show significant promise for the challenging problem of interferometric imaging fidelity assessment when evaluated over the broader domain subset. We report on their measured statistical performance and guidelines for their use and application in practice. We also examine the performance of the underlying polarization self-calibration algorithm used in this study over a range of parallactic angle coverage.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Sample-Efficient Adaptive Calibration of Quantum Networks Using Bayesian Optimization

All physical systems employed for quantum information tasks must act as unbiased carriers of encoded quantum states. Ensuring such indistinguishability of information carriers is a major challenge in many quantum information applications, including advanced quantum communication protocols. For photons, the workhorses of quantum communication networks, it is difficult to obtain and maintain their indistinguishability because of environment-induced transformations and loss imparted by communication channels, especially in noisy scenarios. Conventional strategies to mitigate these transformations often require hardware or software overhead that is restrictive (e.g., adding noise), infeasible (e.g., on a satellite), or time-consuming for deployed networks. In this work we propose and develop resource-efficient Bayesian optimization techniques to rapidly and adaptively calibrate the indistinguishability of individual photons for quantum networks using only information derived from their measurement. To experimentally validate our approach, we demonstrate the optimization of Hong-Ou-Mandel interference between two photons-a central task in quantum networking- finding rapid, efficient, and reliable convergence towards maximal photon indistinguishability in the presence of high loss and shot noise. We expect our resource-optimized and experimentally friendly methodology will allow fast and reliable calibration of indistinguishable quanta, a necessary task in distributed quantum computing, communications, and sensing, as well as for fundamental investigations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

I/O load balancing for big data HPC applications

High Performance Computing (HPC) big data problems require efficient distributed storage systems. However, at scale, such storage systems often experience load imbalance and resource contention due to two factors: the bursty nature of scientific application I/O; and the complex I/O path that is without centralized arbitration and control. For example, the extant Lustre parallel file system-that supports many HPC centers-comprises numerous components connected via custom network topologies, and serves varying demands of a large number of users and applications. Consequently, some storage servers can be more loaded than others, which creates bottlenecks and reduces overall application I/O performance. Existing solutions typically focus on per application load balancing, and thus are not as effective given their lack of a global view of the system. In this paper, we propose a data-driven approach to load balance the I/O servers at scale, targeted at Lustre deployments. To this end, we design a global mapper on Lustre Metadata Server, which gathers runtime statistics from key storage components on the I/O path, and applies Markov chain modeling and a minimum-cost maximum-flow algorithm to decide where data should be placed. Evaluation using a realistic system simulator and a real setup shows that our approach yields better load balancing, which in turn can improve end-to-end performance.

Paul, Arnab K.↗

Optimizing the Weather Research and Forecasting Model with OpenMP Offload and Codee

Currently, the Weather Research and Forecasting model (WRF) utilizes shared memory (OpenMP) and distributed memory (MPI) parallelisms. To take advantage of GPU resources on the Perlmutter supercomputer at NERSC, we port parts of the computationally expensive routine Fast Spectral Bin Microphysics (FSBM) to NVIDIA GPUs using OpenMP device offloading directives. To facilitate this process, we explore a workflow for optimization which uses both runtime profilers and a static code inspection tool Codee to refactor the subroutine. We observe an 2.24x overall speedup for the CONUS-12km storm test case.

Wichitrnithed, Chayanon (Namo) [Odin Institute]↗

Distribution System Parameter and Topology Estimation Applied to Resolve Low-Voltage Circuits on Three Real Distribution Feeders

Accurate distribution secondary low-voltage circuit models are needed to enhance overall distribution system operations and planning, including effective monitoring and coordination of distributed energy resources located in the secondary circuits. We present a full-scale demonstration across three real feeders of a computationally efficient approach for estimating the secondary circuit topologies and parameters using historical voltage and power measurements provided by smart meters. The method is validated against several secondary configurations, and compares favorably to satellite imagery and the utility secondary model. Feeder-wide results show how much parameters can vary from simple assumptions. In conclusion, model sensitivities are tested, demonstrating only modest amounts of data and resolutions of data measurements are needed for accurate parameter and topology results.

42 ENGINEERING↗

rvGAHP: push-based job submission using reverse SSH connections. In: WORKS '17 Proceedings of the 12th Workshop on Workflows in Support of Large-Scale Science, Article No. 3

Computational science researchers running large-scale scientific workflow applications often want to run their workflows on the largest available compute systems to improve time to solution. Workflow tools used in distributed, heterogeneous, high performance computing environments typically rely on either a push-based or a pull-based approach for resource provisioning from these compute systems. However, many large clusters have moved to two-factor authentication for job submission, making traditional automated push-based job submission impossible. On the other hand, pull-based approaches such as pilot jobs may lead to increased complexity and a reduction in node-hour efficiency. In this paper, we describe a new, efficient approach based on HTCondor-G called reverse GAHP (rvGAHP) that allows us to push jobs using reverse SSH submissions with better efficiency than pull-based methods. We successfully used this approach to perform a large probabilistic seismic hazard analysis study using SCEC's CyberShake workflow in March 2017 on the Titan Cray XK7 hybrid system at Oak Ridge National Laboratory.

Callaghan, Scott↗

Adaptive Mesh Refinement in the Fastlane

Adaptive Mesh Refinement (AMR) allows us to dramatically reduce memory usage by dynamically distributing resources to areas of physical significance.

97 MATHEMATICS AND COMPUTING↗

A Power Application Developer’s Guide to the Common Information Model: An Introduction for Power Systems Engineers and Application Developers – CIM17v40

A key issue in creating the next generation of energy management system (EMS) and advanced distribution management system (ADMS) platforms will be the ability to represent and exchange power system network model data in a consistent manner. To this end, the Common Information Model (CIM) stands out as the only standardized vocabulary (or ontology) for defining power system network models and asset data in a comprehensive, consistent manner across the generation-transmission-distribution boundary. The CIM is freely available to use and extend. The CIM is maintained by the UCAiug (informally known as the CIM User’s Group) under an Apache 2.0 license. The CIM Users Group collaborates with the IEC and other standards communities for the development of technical and informative specifications. Although portions of the information model are referred to by the corresponding IEC standards naming, it is not necessary to purchase any of the IEC standards to use the CIM information model. This document provides a roadmap for power system engineers and application developers not familiar with semantic modeling to start using the CIM for modeling, simulation, optimization, and development of advanced power applications. The key classes needed for defining power system topology and equipment are explained systematically. Key focus areas include modeling of lines, transformers, generators, switching equipment, loads, and distributed energy resources (DERs).

97 MATHEMATICS AND COMPUTING↗

Efficient Topology Assessment for Integrated Transmission and Distribution Network with 10,000+ Inverter-based Resources

The renewable energy proliferation calls upon the grid operators and planners to systematically evaluate the potential impacts of distributed energy resources (DERs). Considering the significant differences between various inverter-based resources (IBRs), especially the different capabilities between grid-forming inverters and grid-following inverters, it is crucial to develop an efficient and effective assessment procedure besides available co-simulation framework with high computation burdens. This paper presents a streamlined graph-based topology assessment for the integrated power system transmission and distribution networks. Graph analyses were performed based on the integrated graph of modified miniWECC grid model and IEEE 8500-node test feeder model, high performance computing platform with 40 nodes and total 2400 CPUs has been utilized to process this integrated graph, which has 100,000+ nodes and 10,000+ IBRs. The node ranking results not only verified the applicability of the proposed method, but also revealed the potential of distributed grid forming (GFM) and grid following (GFL) inverters interacting with the centralized power plants.

Graph Analysis, Topology evaluation, Infrastructur↗

Discrimination strategies for inequivalent classes of multipartite entangled states

How can one discriminate different inequivalent classes of multiparticle entanglement experimentally? We present an approach for the discrimination of an experimentally prepared state from the equivalence class of another state. We consider two possible measures for the discrimination strength of an observable. The first measure is based on the difference of expectation values, the second on the relative entropy of the probability distributions of the measurement outcomes. The interpretation of these measures and their usefulness for experiments with limited resources are discussed. In the case of graph states, the stabilizer formalism is employed to compute these quantities and to find sets of observables that result in the most decisive discrimination.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Stationary electron velocity distribution function in crossed electric and magnetic fields with collisions

Analytical studies and numerical simulations show that the electron velocity distribution function in a Hall thruster discharge with crossed electric and magnetic fields is not Maxwellian. This is due to the fact that the mean free path between collisions is greater than both the Larmor radius and the characteristic dimensions of the discharge channel. However in numerical models of Hall thrusters, a hydrodynamic approach is often used to describe the electron dynamics, because discharge simulation in a fully kinetic approach requires large computing resources and is time consuming. A more accurate modeling of the electron flow in the hydrodynamic approximation requires taking into account the non-Maxwellian character of the distribution function and finding its moments, an approach that reflects the properties of electrons drifting in crossed electric and magnetic fields better than the commonly used Euler or Navier-Stokes approximations. In the present paper, an expression for the electron velocity distribution function in rarefied spatially homogeneous stationary plasma with crossed electric and magnetic fields and predominance of collisions with heavy particles is derived in the relaxation approximation. The main moments of the distribution function including longitudinal and transversal temperatures, the components of the viscous stress tensor, and of the heat flux vector are calculated. Distinctive features of the hydrodynamic description of electrons with a strongly non-equilibrium distribution function and the prospects for further development of the proposed approach for calculating the distribution function in spatially inhomogeneous plasma are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Quantum Reinforcement Learning for Volt-VAR Control in Power Distribution Systems

Volt-VAR control (VVC) is crucial in active distribution networks for optimizing voltage profiles and minimizing network losses. While traditional deep reinforcement learning (DRL) algorithms exhibit promise for VVC, they often require extensive computational resources to handle such a high-dimensional problem. As a potential solution, quantum reinforcement learning (QRL) algorithms integrate the computational capabilities of quantum computing into the DRL framework. However, existing QRL algorithms struggle with complex VVC problems due to the limitations of current quantum hardware. To bridge this gap, this paper proposes an innovative QRL algorithm featuring an end-to-end architecture that integrates a classical autoencoder, variational quantum circuits (VQCs), and classical post-processing layers. This design efficiently compresses high-dimensional grid states, enabling VQCs to leverage quantum advantages while producing multiple control device outputs tailored for VVC tasks. Numerical studies on three representative distribution systems verify the effectiveness and scalability of the proposed QRL algorithm, and demonstrate its enhanced performance over classical approaches with only approximately 1% of the parameters. Additionally, the robustness of our developed algorithm is validated through noisy quantum environments.

97 MATHEMATICS AND COMPUTING↗

Playas Grid Reliability and Distributed Energy Research

The future looks bright for solar and renewable energies in the United States. Recent studies claim that by 2050, solar power could supply a third of all electricity demand in the country’s western states. Technology advances, soft policy changes, and increased energy consciousness will all have to happen to achieve this goal. The New Mexico Institute of Mining and Technology (NMT) and the Department of Homeland Security (DHS) perform various training and research activities at this site. Given its unique nature, Playas was chosen to test Micro-Grids and other examples of renewable distributed energy resources (DER). Several proposed distributed energy sources (DERs) were not implemented as planned including the Micro-Grid. However, Micro-Grid design and computer modeling were completed and these results are included in this report. As part of this research, four PV (solar) generating systems were installed with remote Internet based communication and control capabilities. These systems have been integrated into and can interact with the local grid So that (for example) excess power produced by the solar arrays can be exported to the utility grid. Energy efficient LED lighting was installed in several buildings to further reduce consumption of utility-supplied power. By combining reduced lighting costs; lowering HVAC loads; and installing smart PV generating equipment with energy storage (battery banks) these systems can greatly reduce electrical usage drawn from an older rural electrical cooperative (Co-Op) while providing clean dependable power. Several additional tasks under this project involved conducting research to develop methods of producing electricity from organic materials (i.e. biofuels, biomass. etc.), the most successful being the biodiesel reactor. Improvements with Proton Exchange Membranes (PEM) for fuels cells were demonstrated and advances in Dye Sensitized Solar Cells (DSSC) were also shown. The specific goals of the project include: 1) Instrumentation of the power distribution system with distributed energy resources, demand-side control and intelligent homes within the town of Playas, NM, 2) Creation of models (power flow and dynamic) of the Playas power distribution system, 3) Validation of the models through comparison of predicted behavior to data collected from instrumentation, and 4) Utilization of the models and test grid to characterize the impact of new devices and approaches (e.g., distributed generation and load management) on the local distribution system as well as the grid at large. In addition to the above stated objectives, the research also focused on three critical challenges facing renewable distributed energy platforms: 1) hydrogen from biomass, 2) improved catalyst support systems for electrolysis membranes and fuel cell systems, and 3) improved manufacturing methodologies of low cost photovoltaics. The following sections describe activities performed during this project. The various tasks were focused on establishing Playas as a “…theoretical and experimental test bed…” through which components of a modern/smart grid could be characterized. On a broader scale, project efforts were aimed at development of tools and gathering of experience/expertise that would accelerate progress toward implementation of a modern grid.

09 BIOMASS FUELS↗

Federated Access from DOE Labs to Distributed Storage in the EIC Era of Computing

The Electron Ion Collider (EIC) collaboration and future experiment is a unique scientific ecosystem within Nuclear Physics as the experiment starts right off as a crosscollaboration between Brookhaven National Lab (BNL) & Jefferson Lab (JLab). As a result, this muti-lab computing model tries at best to provide services accessible from anywhere by anyone who is part of the collaboration. While the computing model for the EIC is not finalized, it is anticipated that the computational and storage resources will be made accessible to a wide range of collaborators across the world. The use of federated ID seems to be a critical element to the strategy of providing such services, allowing seamless access to each lab site computing resources. However, providing Federated access to a Federated storage is not a trivial matter and has its share of technical challenges. In this contribution, we focus on the steps we took towards the deployment of a distributed object storage system that integrates with Amazon S3 and Federated ID. We will first cover for and explain the first stage storage solutions provided to the EIC during the detector design phase. Our initial test deployment consisted of Lustre storage using MinIO, hence providing an S3 interface. High Availability load balancers were added later to provide the initial scalability it lacked. Performance of that system will be shown. While this embryonic solution worked well, it had many limitations. Looking ahead, the Ceph object storage is considered a top-of-the-line solution in the storage community - since the Ceph Object Gateway is compatible with the Amazon S3 API out of the box, our next phase will use a native S3 storage. Our Ceph deployment will consist of erasure coded storage nodes to maximize storage potential along with multiple Ceph Object Gateways for redundant access. We will compare performance of our next stage implementations. Finally, we will present how to leverage OpenID Connect with the Ceph Object Gateway’s to enable Federated ID access. We hope this contribution will serve the community needs as we move forward with cross-lab collaborations and the need for Federated ID access to distributed compute facilities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Measurement-Based Adaptive Voltage Regulation Method Considering Topology Changes

This paper proposes an online adaptive data-driven distributed energy resource (DER) dispatch optimization method for voltage control considering topology changes. By using a local sensitivity factor (LSF)-enabled voltage control, traditional DER control can be reformulated into a linear programming (LP) problem, leading to faster computation speeds. Power injection alteration and topology changes are two common operational changes in the distribution network that can affect the LSF and voltage control performance. To address this issue, a robust estimation method is developed to adjust the sensitivity matrix at each time step for the time-varying power injection changes. When topology changes occur, only the allocated predominant LSF submatrices are updated based on measurement data, allowing for a fast adaptation to the system reconfiguration. Results obtained from a real distribution feeder in Southern California demonstrate its robustness as compared to traditional volt-var control and constant LSF matrix dispatch control methods.

DERs↗

Quantum Distributed Unit Commitment: An Application in Microgrids

The dawn of quantum computing brings on a revolution in the way combinatorially complex power system problems such as Unit Commitment are solved. The Unit Commitment problem complexity is expected to increase in the future because of the trend toward the increase of penetration of intermittent renewables. Even though quantum computing has proven effective for solving a host of problems, its applications for power systems’ problems have been rather limited. Here, in this paper, a quantum unit commitment is innovatively formulated and the quantum version of the decomposition and coordination alternate direction method of multipliers (ADMM) is established. The above is achieved by devising quantum algorithms and by exploiting the superposition and entanglement of quantum bits (qubits) for solving subproblems, which are then coordinated through ADMM to obtain feasible solutions. The main contributions of this paper include: 1) the innovative development of a quantum model for Unit Commitment; 2) development of decomposition and coordination-supported framework which paves the way for the utilization of limited quantum resources to potentially solve the large-scale discrete optimization problems; 3) devising the novel quantum distributed unit commitment (QDUC) to solve the problem in a larger scale than currently available quantum computers are capable of solving. The QDUC results are compared with those from its classical counterpart, which validate the efficacy of quantum computing.

97 MATHEMATICS AND COMPUTING↗