Search NASA⌕ Search

SEARCH · Search NASA

Results for “PanDA”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Towards an Introspective Dynamic Model of Globally Distributed Computing Infrastructures

Large-scale scientific collaborations like ATLAS, Belle II, CMS, DUNE, and others involve hundreds of research institutes and thousands of researchers spread across the globe. These experiments generate petabytes of data, with volumes soon expected to reach exabytes. Consequently, there is a growing need for computation, including structured data processing from raw data to consumer-ready derived data, extensive Monte Carlo simulation campaigns, and a wide range of end-user analysis. To manage these computational and storage demands, centralized workflow and data management systems are implemented. However, decisions regarding data placement and payload allocation are often made disjointly and via heuristic means. A significant obstacle in adopting more effective heuristic or AI-driven solutions is the absence of a quick and reliable introspective dynamic model to evaluate and refine alternative approaches. In this study, we aim to develop such an interactive system using real-world data. By examining job execution records from the PanDA workflow management system, we have pinpointed key performance indicators such as queuing time, error rate, and the extent of remote data access. The dataset includes five months of activity. Additionally, we are creating a generative AI model to simulate time series of payloads, which incorporate visible features like category, event count, and submitting group, as well as hidden features like the total computational load—derived from existing PanDA records and computing site capabilities. These hidden features, which are not visible to job allocators, whether heuristic or AI-driven, influence factors such as queuing times and data movement.

kilic, Ozgur Ozan [Brookhaven National Laboratory ↗

Charmonium dissociation in matter: perspectives from CERN to JLab

The J/{Psi}-meson dissociation in nuclear matter remains one of the most surprising problems in physics. In 2000 the NA50 Collaboration at CERN reported anomalous results on J/{Psi} absorption that was considered as evidence of Quark-Gluon Plasma formation. On the other hand, there may be other mechanisms which produce an increase in J/{Psi} absorption in a hot dense medium due to the modification of the charm mesons. Our detailed calculations were one of the first indications that the CERN data can indeed be well explained by a mechanism different from QGP formation. For further clarification we proposed to study the modification of charm in nuclei through antiproton annihilation, which is now part of the PANDA project at FAIR GSI. The experiment on charmonium dissociation in nuclei is under discussion at JLab as part of its 12 GeV upgrade.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

THE PHOTOMETRIC PROPERTIES OF A VAST STELLAR SUBSTRUCTURE IN THE OUTSKIRTS OF M33

We have surveyed approximately 40 deg{sup 2} surrounding M33 with Canada-France-Hawaii Telescope MegaCam/MegaPrime in the g and i filters out to a maximum projected radius from this galaxy of 50 kpc, as part of the Pan-Andromeda Archaeological Survey (PAndAS). Our observations are deep enough to resolve the top {approx}4 mag of the red giant branch population in this galaxy. We have previously shown that the disk of M33 is surrounded by a large, irregular, low surface brightness substructure. Here, we quantify the stellar populations and structure of this feature using the PAndAS data. We show that the stellar populations of this feature are consistent with an old population with ([Fe/H]) {approx} -1.6 dex and an interquartile range in metallicity of {approx}0.5 dex. We construct a surface brightness map of M33 that traces this feature to {mu}{sub V} {approx_equal} 33 mag arcsec{sup -2}. At these low surface brightness levels, the structure extends to projected radii of {approx}40 kpc from the center of M33 in both the northwest and southeast quadrants of the galaxy. Overall, the structure has an 'S-shaped' appearance that broadly aligns with the orientation of the H I disk warp. We calculate a lower limit to the integrated luminosity of the structure of -12.7 {+-} 0.5 mag, comparable to a bright dwarf galaxy such as Fornax or Andromeda II and slightly less than 1% of the total luminosity of M33. Further, we show that there is tentative evidence for a distortion in the distribution of young stars near the edge of the H I disk that occurs at similar azimuth to the warp in H I. The data also hint at a low-level, extended stellar component at larger radius that may be an M33 halo component. We revisit studies of M33 and its stellar populations in light of these new results and discuss possible formation scenarios for the vast stellar structure. Our favored model is that of the tidal disruption of M33 in its orbit around M31.

79 ASTRONOMY AND ASTROPHYSICS↗

A BAYESIAN APPROACH TO LOCATING THE RED GIANT BRANCH TIP MAGNITUDE. I

We present a new approach for identifying the tip of the red giant branch (TRGB) which, as we show, works robustly even on sparsely populated targets. Moreover, the approach is highly adaptable to the available data for the stellar population under study, with prior information readily incorporable into the algorithm. The uncertainty in the derived distances is also made tangible and easily calculable from posterior probability distributions. We provide an outline of the development of the algorithm and present the results of tests designed to characterize its capabilities and limitations. We then apply the new algorithm to three M31 satellites: Andromeda I, Andromeda II, and the fainter Andromeda XXIII, using data from the Pan-Andromeda Archaeological Survey (PAndAS), and derive their distances as 731{sup (+5)+18}{sub (-4)-17} kpc, 634{sup (+2)+15}{sub (-2)-14} kpc, and 733{sup (+13)+23}{sub (-11)-22} kpc, respectively, where the errors appearing in parentheses are the components intrinsic to the method, while the larger values give the errors after accounting for additional sources of error. These results agree well with the best distance determinations in the literature and provide the smallest uncertainties to date. This paper is an introduction to the workings and capabilities of our new approach in its basic form, while a follow-up paper shall make full use of the method's ability to incorporate priors and use the resulting algorithm to systematically obtain distances to all of M31's satellites identifiable in the PAndAS survey area.

79 ASTRONOMY AND ASTROPHYSICS↗

The large-scale structure of the halo of the Andromeda galaxy. I. Global stellar density, morphology and metallicity properties

We present an analysis of the large-scale structure of the halo of the Andromeda galaxy, based on the Pan-Andromeda Archeological Survey (PAndAS), currently the most complete map of resolved stellar populations in any galactic halo. Despite the presence of copious substructures, the global halo populations follow closely power-law profiles that become steeper with increasing metallicity. We divide the sample into stream-like populations and a smooth halo component (defined as the population that cannot be resolved into spatially distinct substructures with PAndAS). Fitting a three-dimensional halo model reveals that the most metal-poor populations ([Fe/H]<−1.7) are distributed approximately spherically (slightly prolate with ellipticity c/a = 1.09 ± 0.03), with only a relatively small fraction residing in discernible stream-like structures (f {sub stream} = 42%). The sphericity of the ancient smooth component strongly hints that the dark matter halo is also approximately spherical. More metal-rich populations contain higher fractions of stars in streams, with f {sub stream} becoming as high as 86% for [Fe/H]>−0.6. The space density of the smooth metal-poor component has a global power-law slope of γ = –3.08 ± 0.07, and a non-parametric fit shows that the slope remains nearly constant from 30 kpc to ∼300 kpc. The total stellar mass in the halo at distances beyond 2° is ∼1.1 × 10{sup 10} M {sub ☉}, while that of the smooth component is ∼3 × 10{sup 9} M {sub ☉}. Extrapolating into the inner galaxy, the total stellar mass of the smooth halo is plausibly ∼8 × 10{sup 9} M {sub ☉}. We detect a substantial metallicity gradient, which declines from ([Fe/H]) = –0.7 at R = 30 kpc to ([Fe/H]) = –1.5 at R = 150 kpc for the full sample, with the smooth halo being ∼0.2 dex more metal poor than the full sample at each radius. While qualitatively in line with expectations from cosmological simulations, these observations are of great importance as they provide a prototype template that such simulations must now be able to reproduce in quantitative detail.

79 ASTRONOMY AND ASTROPHYSICS↗

Supercomputers, Clouds and Grids powered by BigPanDA for Brain studies

The PanDA WMS - Production and Distributed Analysis Workload Management System - has been developed and used by the ATLAS experiment at the LHC (Large Hadron Collider) for all data processing and analysis challenges. BigPanDA is an extension of the PanDA WMS to run ATLAS and non-ATLAS applications on Leadership Class Facilities and supercomputers, as well as traditional grid and cloud resources. The success of the BigPanDA project has drawn attention from other compute intensive sciences such as biology. In 2017, a pilot project was started between BigPanDA and the Blue Brain Project (BBP) of the Ecole Polytechnique Federal de Lausanne (EPFL) located in Lausanne, Switzerland. This proof of concept project is aimed at demonstrating the efficient application of the BigPanDA system to support the complex scientific workflow of the BBP, which relies on using a mix of desktop, cluster and supercomputers to reconstruct and simulate accurate models of brain tissue.

Computer Science↗

ATLAS BigPanDA monitoring

BigPanDA monitoring is a web application that provides various processing and representation of the Production and Distributed Analysis (PanDA) system objects states. Analysing hundreds of millions of computation entities, such as an event or a job, BigPanDA monitoring builds different scales and levels of abstraction reports in real time mode. Provided information allows users to drill down into the reason of a concrete event failure or observe the broad picture such as tracking the computation nucleus and satellites performance or the progress of a whole production campaign. PanDA system was originally developed for the ATLAS experiment. Currently, it manages execution of more than 2 million jobs distributed over 170 computing centers worldwide on daily basis. BigPanDA is its core component commissioned in the middle of 2014 and now is the primary source of information for ATLAS users about the state of their computations and the source of decision support information for shifters, operators and managers. In this work, we describe the evolution of the architecture, current status and plans for the development of the BigPanDA monitoring.

47 OTHER INSTRUMENTATION↗

AI-assisted detector design for the EIC (AID(2)E)

Artificial Intelligence is poised to transform the design of complex, large-scale detectors like ePIC at the future Electron Ion Collider. Featuring a central detector with additional detecting systems in the far forward and far backward regions, the ePIC experiment incorporates numerous design parameters and objectives, including performance, physics reach, and cost, constrained by mechanical and geometric limits. This project aims to develop a scalable, distributed AI-assisted detector design for the EIC (AID(2)E), employing state-of-the-art multiobjective optimization to tackle complex designs. Supported by the ePIC software stack and using G EANT 4 simulations, our approach benefits from transparent parameterization and advanced AI features. The workflow leverages the PanDA and iDDS systems, used in major experiments such as ATLAS at CERN LHC, the Rubin Observatory, and sPHENIX at RHIC, to manage the compute intensive demands of ePIC detector simulations. Tailored enhancements to the PanDA system focus on usability, scalability, automation, and monitoring. Ultimately, this project aims to establish a robust design capability, apply a distributed AI-assisted workflow to the ePIC detector, and extend its applications to the design of the second detector (Detector-2) in the EIC, as well as to calibration and alignment tasks. Additionally, we are developing advanced data science tools to efficiently navigate the complex, multidimensional trade-offs identified through this optimization process.

97 MATHEMATICS AND COMPUTING↗

Adapter Python IO (Adapter) v1.0

The Adapter Python IO software, in short Adapter or the Adapter software, encapsulates certain Python IO capabilities used for loading in and writing out data when performing analytical Python code runs. More specificcally, it provides a Python API to load data tables from various formats such as XLSX (MS Excel), CSV, and database, into Python code as Pandas DataFrames, as well as to write out tables into a database or CSV files. The Adapter software standardizes a way to point the code to one or multiple input files of one or multiple formats. Therefore, its main feature is the ability to convert data tables identified in one main and, optionally, one or more additional input files, into database tables and Pandas DataFrames for downstream usage in any compatible software. In addition to the loading capability, an instance of the Adapter IO object has the capability to write data out. If the write capability is invoked, all loaded tables are written as either a single database or a set of CSV files, or both, to a location specified in the dedicated input table.

Grahovac, Milica↗

Towards scalable dataframe systems

Dataframes are a popular abstraction to represent, prepare, and analyze data. Despite the remarkable success of dataframe libraries in R and Python, dataframes face performance issues even on moderately large datasets. Moreover, there is significant ambiguity regarding dataframe semantics. In this paper we lay out a vision and roadmap for scalable dataframe systems. To demonstrate the potential in this area, we report on our experience building Modin, a scaled-up implementation of the most widely-used and complex dataframe API today, Python's pandas. With pandas as a reference, we propose a simple data model and algebra for dataframes to ground discussion in the field. Given this foundation, we lay out an agenda of open research opportunities where the distinct features of dataframes will require extending the state of the art in many dimensions of data management. We discuss the implications of signature dataframe features including flexible schemas, ordering, row/column equivalence, and data/metadata fluidity, as well as the piecemeal, trial-and-error-based approach to interacting with dataframes.

97 MATHEMATICS AND COMPUTING↗

A Modular Framework for Integrating and Visualizing Telemetry for Mars 2020 Rover Mechanism Operations

The analysis of mechanism telemetry requires a wide variety of tools to quickly and effectively assess spacecraft state, capture long-term trends in system performance, and identify and track anomalous events. Such analysis often requires spacecraft telemetry to first be transformed into derived fields and aggregated statistics before operators can begin their analysis. In past missions, aspects of this process have been automated, but operators were expected to use their own tools and procedures to understand and visualize the data, which led to redundant and inconsistent tools and processes. The Mech Data Tools Python library (MDT) was developed to provide a flexible, unified tool set for operators to extract and analyze mechanism telemetry over the life of the Mars 2020 surface mission. MDT consists of a set of configurable components that implement standard interfaces for ingesting input and producing output. Components can be chained together to form a data processing pipeline. Data are ingested from several sources within the greater Mars 2020 cloud infrastructure and stored in pandas DataFrames, which allows users to leverage the data manipulation capabilities present within the widely-used pandas library. Visualization capabilities are provided through the Plotly library, which generates interactive plots for users to interpret. Following the beginning of Mars 2020 surface operations, usage of MDT has spread to all mechanism-focused subsystems and has demonstrated great utility in analyzing early surface activities. This paper describes MDT’s evolution from heritage mechanism telemetry tools, the critical architecture decisions and challenges faced over MDT’s two years of development, and current applications of MDT in support of mechanism operations.

Wolsieffer, Ben↗

Pypromice: A Python Package for Processing Automated Weather Station Data

The pypromice Python package is for processing and handling observation datasets from automated weather stations (AWS). It is primarily aimed at users of AWS data from the Geological Survey of Denmark and Greenland (GEUS), which collects and distributes in situ weather station observations to the cryospheric science research community. Functionality in pypromice is primarily handled using two key open-source Python packages, xarray (Hoyer & Hamman, 2017) and pandas (The pandas development team, 2020). A defined processing workflow is included in pypromice for transforming original AWS observations (Level 0, L0) to a usable, CF-convention-compliant dataset (Level 3, L3) (Figure 1). Intermediary processing levels (L1,L2) refer to key stages in the workflow, namely the conversion of variables to physical measurements and variable filtering (L1), cross-variable corrections and user-defined data flagging and fixing (L2), and derived variables (L3). Information regarding the station configuration is needed to perform the processing, such as instrument calibration coefficients and station type (one-boom tripod or two-boom mast station design, for example), which are held in a toml configuration file. Two example configuration files are provided with pypromice , which are also used in the package’s unit tests. More detailed documentation of the AWS design, instrumentation, and processing steps are described in Fausto et al. (2021).

pypromice↗

Development of FARICH detector for particle identification system at accelerators

Aerogel has been successfully used as a radiator in Cherenkov detectors. In 2004, a multilayer aerogel providing Cherenkov ring focusing was proposed and produced. FARICH (Focusing Aerogel Rich Imaging CHerenkov) detectors such as ARICH for Belle-II (KEK, Japan), Forward RICH for PANDA detector (FAIR, Germany), and FARICH for the Super Charm-Tau factory project (BINP, Novosibirsk) have been developed based on this aerogel. Prototypes of FARICH detector based on MRS APD and Philips DPC photosensors were developed and tested in the framework of this project. An angular resolution for Cherenkov rings of 3.6 mrad was achieved.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗

Further Progress in Noise Source Identification in High Speed Jets via Causality Principle

To locate noise sources in high-speed jets, the sound pressure fluctuations p/, measured at far field locations, were correlated with each of density p, axial velocity u, radial velocity v, puu and pvv fluctuations measured from various points in fully expanded, unheated plumes of Mach number 0.95, 1.4 and 1.8. The velocity and density fluctuations were measured simultaneously using a recently developed, non-intrusive, point measurement technique based on molecular Rayleigh scattering (Seasholtz, Panda, and Elam, AIAA Paper 2002-0827). The technique uses a continuous wave, narrow line-width laser, Fabry-Perot interferometer and photon counting electronics. The far field sound pressure fluctuations at 30 to the jet axis provided the highest correlation coefficients with all flow variables. The correlation coefficients decreased sharply with increased microphone polar angle, and beyond about 60 all correlation mostly fell below the experimental noise floor. Among all correlations < puu; p/> showed the highest values. Interestingly, , in all respects, were very similar to . The and correlations with 90deg microphone fell below the noise floor. By moving the laser probe at various locations in the jet it was found that the strongest noise source lies downstream of the end of the potential core and extends many diameters beyond. Correlation measurement from the lip shear layer showed a Mach number dependency. While significant correlations were measured in Mach 1.8 jet, values were mostly below the noise floor for subsonic Mach 0.95 jet. Various additional analyses showed that fluctuations from large organized structures mostly contributed to the measured correlation, while that from small scale structures fell below the noise floor.

Panda, J.↗

Progress in Interferometric Rayleigh Scattering to Measure Fluctuations Spectra of Velocity and Temperature in High Speed Flows

A new, spectrally-resolved, Rayleigh scattering setup at NASA Ames is further developed to measure fluctuations in velocity and temperature. Using a combination of a continuous-wave laser, a stabilized Fabry-Perot interferometer (FPI), an EMCCD camera, and a photo-multiplier tube, the setup was demonstrated to provide fairly accurate measurements of time-averaged velocity, temperature, density and spectrum of density fluctuations in a high-speed free jet (Panda & White, 2018). This paper describes further progress in fast measurement of the Rayleigh-Brillouin spectrum via a 16-anode linear-array of photo-multiplier tube and a multi-channel, photo-electron counter. Rayleigh scattered light from a 0.4mm long probe volume was directly imaged through the FPI and was imaged on the linear array. Synchronous photo-electron counting over a series of short, contiguous gates provided time-evolution of the fringes at a 10 kHz sampling rate. Sample spectra collected from a Mach 0.98 jet show spectral content floating on high noise-floor. Efforts to collect longer time series of data and different schemes of extracting velocity and temperature information are now in progress.

Panda, J.↗

An adaptive model-free robotic force control strategy for hydrodynamic real-time hybrid simulation of floating offshore wind turbines

Real-time hybrid simulation (RTHS) - a cyber-physical testing approach - promises to enhance the simulation fidelity of the model-scale experiments used to prototype floating offshore wind turbines (FOWTs). In hydrodynamic RTHS (hydro-RTHS), actuators emulate aerodynamic forces on model-scale FOWT specimens subjected to physical waves in a hydrodynamic laboratory. Robotic arms are promising candidates for actuation in hydro-RTHS due to their compact multi-degree-of-freedom (DOF) capabilities. Unlike classical RTHS for seismic applications, which typically relies on displacement control, hydro-RTHS requires 6-DOF force control on newly designed floating prototypes in a model-scale setting, which presents significant challenges, including modeling uncertainties, directional asymmetry, configuration drift, bandwidth limitations, and time-varying delays. To mitigate these constraints without extensive pre-test calibration, this study proposes an adaptive model-free robotic force control strategy that combines task-space explicit force control with a secondary joint-space pose-keeping task. The Adaptive Feedforward Compensator (AFC) is integrated into the force control loop to compensate for time-varying delay. Experimental testing was conducted using a Franka Emika Panda robotic arm with a 1:50 scale FOWT specimen under operational wind and wave conditions. Results demonstrate stable and consistent 6-DOF force tracking. Effective delay compensation was observed, with low-frequency delay reductions ranging from 71.4% to 91.8% and improvements in low-frequency surge force tracking of 25.0% to 52.1%. This study enhances robotic actuation performance in hydro-RTHS and introduces a force control strategy that supports reliable robotic operation in uncertain floating environments. Future work will explore disturbance-observer mechanisms to further enhance wave rejection capabilities under extreme wind and wave conditions.

17 WIND ENERGY↗

In-depth analysis on parallel processing patterns for high-performance Dataframes

The Data Science domain has expanded monumentally in both research and industry communities during the past decade, predominantly owing to the Big Data revolution. Artificial Intelligence (AI) and Machine Learning (ML) are bringing more complexities to data engineering applications, which are now integrated into data processing pipelines to process terabytes of data. Typically, a significant amount of time is spent on data preprocessing in these pipelines, and hence improving its efficiency directly impacts the overall pipeline performance. The community has recently embraced the concept of Dataframes as the de-facto data structure for data representation and manipulation. However, the most widely used serial Dataframes today (R, pandas) experience performance limitations while working on even moderately large data sets. We believe that there is plenty of room for improvement by taking a look at this problem from a high-performance computing point of view. In a prior publication, we presented a set of parallel processing patterns for distributed dataframe operators and the reference runtime implementation, Cylon. In this paper, we are expanding on the initial concept by introducing a cost model for evaluating the said patterns. Furthermore, we evaluate the performance of Cylon on the ORNL Summit supercomputer.

97 MATHEMATICS AND COMPUTING↗