Search NASA⌕ Search

Engineering topics

Neubauer, Mark

Publications and source records attributed to Neubauer, Mark.

hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware

We present hls4ml, a free and open-source platform that translates machine learning (ML) models from modern deep learning frameworks into high-level synthesis (HLS) code that can be integrated into full designs for field-programmable gate arrays (FPGAs) or application-specific integrated circuits (ASICs). With its flexible and modular design, hls4ml supports a large number of deep learning frameworks and can target HLS compilers from several vendors, including Vitis HLS, Intel oneAPI and Catapult HLS. Together with a wider eco-system for software-hardware co-design, hls4ml has enabled the acceleration of ML inference in a wide range of commercial and scientific applications where low latency, resource usage, and power consumption are critical. In this paper, we describe the structure and functionality of the hls4ml platform. The overarching design considerations for the generated HLS code are discussed, together with selected performance results.

FOS: Computer and information sciences↗

Physics Community Needs, Tools, and Resources for Machine Learning

Machine learning (ML) is becoming an increasingly important component of cutting-edge physics research, but its computational requirements present significant challenges. In this white paper, we discuss the needs of the physics community regarding ML across latency and throughput regimes, the tools and resources that offer the possibility of addressing these needs, and how these can be best utilized and accessed in the coming years.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Graph Neural Networks for Charged Particle Tracking on FPGAs

The determination of charged particle trajectories in collisions at the CERN Large Hadron Collider (LHC) is an important but challenging problem, especially in the high interaction density conditions expected during the future high-luminosity phase of the LHC (HL-LHC). Graph neural networks (GNNs) are a type of geometric deep learning algorithm that has successfully been applied to this task by embedding tracker data as a graph—nodes represent hits, while edges represent possible track segments—and classifying the edges as true or fake track segments. However, their study in hardware- or software-based trigger applications has been limited due to their large computational cost. In this paper, we introduce an automated translation workflow, integrated into a broader tool called hls4ml , for converting GNNs into firmware for field-programmable gate arrays (FPGAs). We use this translation tool to implement GNNs for charged particle tracking, trained using the TrackML challenge dataset, on FPGAs with designs targeting different graph sizes, task complexites, and latency/throughput requirements. This work could enable the inclusion of charged particle tracking GNNs at the trigger level for HL-LHC experiments.

Elabd, Abdelrahman↗

"Experimental Research at the Energy Frontier in High Energy Physics" (Final Technical Report)

Recent developments in particle physics and cosmology raise the exciting prospect that we are on the threshold of a major step forward in our understanding of the universe. This proposal describes a research program at the University of Illinois in experimental high-energy physics on the ATLAS experiment at CERN’s Large Hadron Collider (LHC). Our group actively collaborates with the Theory Group and other experimental efforts within the Office of Science frontiers (energy, intensity, and cosmic) to search broadly in the ATLAS data to maximize our potential for scientifc discovery. The thrust of this proposal is to search for new physics using ATLAS data. Emphasis is placed on novel use of the Higgs boson as a tool to search for new particles and interactions and development of fast particle tracking systems for use in triggering. We propose to continue our strong role in FTK commissioning and operations. To maximize the impact and vitality of the proposed physics program through the HL-LHC running, we will lead firmware efforts in the HWTT Phase-II TDAQ upgrade, leveraging our expertise acquired through development of fast tracking hardware and firmware for the FTK system.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Charged Particle Tracking via Edge-Classifying Interaction Networks

Recent work has demonstrated that geometric deep learning methods such as graph neural networks (GNNs) are well suited to address a variety of reconstruction problems in high-energy particle physics. In particular, particle tracking data are naturally represented as a graph by identifying silicon tracker hits as nodes and particle trajectories as edges, given a set of hypothesized edges, edge-classifying GNNs identify those corresponding to real particle trajectories. In this work, we adapt the physics-motivated interaction network (IN) GNN toward the problem of particle tracking in pileup conditions similar to those expected at the high-luminosity Large Hadron Collider. Assuming idealized hit filtering at various particle momenta thresholds, we demonstrate the IN’s excellent edge-classification accuracy and tracking efficiency through a suite of measurements at each stage of GNN-based tracking: graph construction, edge classification, and track building. The proposed IN architecture is substantially smaller than previously studied GNN tracking architectures; this is particularly promising as a reduction in size is critical for enabling GNN-based tracking in constrained computing environments. Furthermore, the IN may be represented as either a set of explicit matrix operations or a message passing GNN. Efforts are underway to accelerate each representation via heterogeneous computing resources towards both high-level and low-latency triggering applications.

accelerator physics↗

COFFEA - Columnar Object Framework For Effective Analysis [Slides]

The COFFEA Framework provides a new approach to HEP analysis, via columnar operations, that improves time-to-insight, scalability, portability, and reproducibility of analysis. It is implemented with the Python programming language and commodity big data technologies such as Apache Spark and NoSQL databases. To achieve this suite of improvements across many use cases, COFFEA takes a factorized approach, separating the analysis implementation and data delivery scheme. All analysis operations are implemented using the NumPy or awkward-array packages which are wrapped to yield user code whose purpose is quickly intuited. Various data delivery schemes are wrapped into a common front-end which accepts user inputs and code, and returns user defined outputs. We will present published results from analysis of CMS data using the COFFEA framework along with a discussion of metrics and the user experience of arriving at those results with columnar analysis.

97 MATHEMATICS AND COMPUTING↗

The Case for Columnar Analysis (a Two-Part Series) [PowerPoint]

This talk provides prologue terminology and technology. Part I covers analyzer experience including user experience, code samples, domain of applicability, and scalability. Part II discusses technical underpinnings including theoretical motivation, the Coffea framework, factorized data delivery, package ecosystem, performance, and future directions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine Learning in High Energy Physics Community White Paper

Machine learning is an important applied research area in particle physics, beginning with applications to high-level physics analysis in the 1990s and 2000s, followed by an explosion of applications in particle and event identification and reconstruction in the 2010s. In this document we discuss promising future research and development areas in machine learning in particle physics with a roadmap for their implementation, software and hardware resource requirements, collaborative initiatives with the data science community, academia and industry, and training the particle physics community in data science. The main objective of the document is to connect and motivate these areas of research and development with the physics drivers of the High-Luminosity Large Hadron Collider and future neutrino experiments and identify the resource needs for their implementation. Additionally we identify areas where collaboration with external communities will be of great benefit.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Research on the ATLAS Experiment at the University of Illinois: Final Report

The goal of particle physics is to understand the Universe at its most fundamental level, including the constituents of matter and their interactions, and the nature of space and time itself. The quest to understand the fundamental building blocks of nature, and their interactions, is one of the most ambitious and enduring of human endeavors. Recent developments in particle physics and cosmology raise the exciting prospect that we are on the threshold of a major step forward in this pursuit. Facilities such as CERN's Large Hadron Collider (LHC) provide a unique window into the subatomic world to pursue this understanding. Mark Neubauer and his research group at the University of Illinois were supported over a nine-month period (07/01/2017 through 03/31/2018) to perform high-energy particle physics research on the ATLAS experiment at the LHC. The primary focus of this research was to search for physics beyond the standard model through an analysis of high-energy proton-proton collision data from the ATLAS experiment, with an emphasis on the Higgs boson as a sensitive tool for this search, and development of fast particle tracking systems for use the ATLAS trigger system.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

High Energy Physics at the University of Illinois

Experimental and theoretical research in elementary particle physics and astronomy at the University of Illinois Urbana-Champaign is presented via a series of reprints of published papers.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗