Connecting HEPCloud with quantum applications using the Rigetti platform
Explore the source record for details and available documents.
Engineering topics
Publications and source records attributed to Norman, A..
Explore the source record for details and available documents.
We describe the power distribution systems and grounding schemes built for the near and far detectors of the NOvA long-baseline neutrino experiment. They are used to power the avalanche photodiodes and their thermoelectric coolers, the front-end boards that read out, digitize and time stamp the signals from the avalanche photodiodes, and the data concentrator modules used to receive and format the data from the front-end boards before sending them to a farm of computers used to build the events. Furthermore, the system powers 344,064 readout channels in the far detector and 20,192 channels in the near detector.
The Deep Underground Neutrino Experiment (DUNE) will employ a set of Liquid Argon Time Projection Chambers (LArTPC) with a total mass of 40 kt as the main components of its Far Detector. In order to validate this technology and characterize the detector performance at full scale, an ambitious experimental program (called “protoDUNE”) has been initiated which includes a test of the large-scale prototypes for the single-phase and dual-phase LArTPC technologies, which will run in a beam at CERN. The total raw data volume that is slated to be collected during the scheduled 3-month beam run is estimated to be in excess of 2.5 PB for each detector. This data volume will require that the protoDUNE experiment carefully design the DAQ, data handling and data quality monitoring systems to be capable of dealing with challenges inherent with peta-scale data management while simultaneously fulfilling the requirements of disseminating the data to a worldwide collaboration and DUNE associated computing sites. Here in this paper, we present our approach to solving these problems by leveraging the design, expertise and components created for the LHC and Intensity Frontier experiments into a unified architecture that is capable of meeting the needs of protoDUNE.
The need for computing in the HEP community follows cycles of peaks and valleys mainly driven by conference dates, accelerator shutdown, holiday schedules, and other factors. Because of this, the classical method of provisioning these resources at providing facilities has drawbacks such as potential overprovisioning. As the appetite for computing increases, however, so does the need to maximize cost efficiency by developing a model for dynamically provisioning resources only when needed. To address this issue, the HEPCloud project was launched by the Fermilab Scientific Computing Division in June 2015. Its goal is to develop a facility that provides a common interface to a variety of resources, including local clusters, grids, high performance computers, and community and commercial Clouds. Initially targeted experiments include CMS and NOvA, as well as other Fermilab stakeholders. In its first phase, the project has demonstrated the use of the “elastic” provisioning model offered by commercial clouds, such as Amazon Web Services. In this model, resources are rented and provisioned automatically over the Internet upon request. In January 2016, the project demonstrated the ability to increase the total amount of global CMS resources by 58,000 cores from 150,000 cores - a 25 percent increase - in preparation for the Recontres de Moriond. In March 2016, the NOvA experiment has also demonstrated resource burst capabilities with an additional 7,300 cores, achieving a scale almost four times as large as the local allocated resources and utilizing the local AWS s3 storage to optimize data handling operations and costs. NOvA was using the same familiar services used for local computations, such as data handling and job submission, in preparation for the Neutrino 2016 conference. In both cases, the cost was contained by the use of the Amazon Spot Instance Market and the Decision Engine, a HEPCloud component that aims at minimizing cost and job interruption. This paper describes the Fermilab HEPCloud Facility and the challenges overcome for the CMS and NOvA communities.
One of the main goals of the Dept. of Energy funded SciDAC-Data project is to analyze the more than 410,000 high energy physics datasets that have been collected, generated and defined over the past two decades by experiments using the Fermilab storage facilities. These datasets have been used as the input to over 5.6 million recorded analysis projects, for which detailed analytics have been gathered. The analytics and meta information for these datasets and analysis projects are being combined with knowledge of their part of the HEP analysis chains for major experiments to understand how modern computing and data delivery is being used. We present the first results of this project, which examine in detail how the CDF, D0, NOvA, MINERvA and MicroBooNE experiments have organized, classified and consumed petascale datasets to produce their physics results. The results include analysis of the correlations in dataset/file overlap, data usage patterns, data popularity, dataset dependency and temporary dataset consumption. The results provide critical insight into how workflows and data delivery schemes can be combined with different caching strategies to more efficiently perform the work required to mine these large HEP data volumes and to understand the physics analysis requirements for the next generation of HEP computing facilities. In particular we present a detailed analysis of the NOvA data organization and consumption model corresponding to their first and second oscillation results (2014-2016) and the first look at the analysis of the Tevatron Run II experiments. We present statistical distributions for the characterization of these data and data driven models describing their consumption
The SciDAC-Data project is a DOE funded initiative to analyze and exploit two decades of information and analytics that have been collected by the Fermilab Data Center on the organization, movement, and consumption of High Energy Physics data. The project will analyze the analysis patterns and data organization that have been used by the NOvA, MicroBooNE, MINERvA and other experiments, to develop realistic models of HEP analysis workflows and data processing. The SciDAC-Data project aims to provide both realistic input vectors and corresponding output data that can be used to optimize and validate simulations of HEP analysis. These simulations are designed to address questions of data handling, cache optimization and workflow structures that are the prerequisites for modern HEP analysis chains to be mapped and optimized to run on the next generation of leadership class exascale computing facilities. We will address the use of the SciDAC-Data distributions acquired from Fermilab Data Center’s analysis workflows and corresponding to around 71,000 HEP jobs, as the input to detailed queuing simulations that model the expected data consumption and caching behaviors of the work running in HPC environments. In particular we describe in detail how the Sequential Access via Metadata (SAM) data handling system in combination with the dCache/Enstore based data archive facilities have been analyzed to develop the radically different models of the analysis of HEP data. We present how the simulation may be used to analyze the impact of design choices in archive facilities.
The NOvA experiment at Fermilab is a long-baseline neutrino experiment designed to study ν e appearance in a ν μ beam. Over the last few years there has been intense work to streamline the computing infrastructure in preparation for data, which started to flow in from the far detector in Fall 2013. Major accomplishments for this effort include migration to the use of off-site resources through the use of the Open Science Grid and upgrading the file-handling framework from simple disk storage to a tiered system using a comprehensive data management and delivery system to find and access files on either disk or tape storage. NOvA has already produced more than 6.5 million files and more than 1 PB of raw data and Monte Carlo simulation files which are managed under this model. In addition, the current system has demonstrated sustained rates of up to 1 TB/hour of file transfer by the data handling system. NOvA pioneered the use of new tools and this paved the way for their use by other Intensity Frontier experiments at Fermilab. Most importantly, the new framework places the experiment's infrastructure on a firm foundation, and is ready to produce the files needed for first physics.
The Intensity Frontier refers to a diverse set of particle physics experiments using high- intensity beams. In this paper I will focus the discussion on the computing requirements and solutions of a set of neutrino and muon experiments in progress or planned to take place at the Fermi National Accelerator Laboratory located near Chicago, Illinois. In addition, the experiments face unique challenges, but also have overlapping computational needs. In principle, by exploiting the commonality and utilizing centralized computing tools and resources, requirements can be satisfied efficiently and scientists of individual experiments can focus more on the science and less on the development of tools and infrastructure.
During operations, NOvA produces between 5,000 and 7,000 raw files per day with peaks in excess of 12,000. These files must be processed in several stages to produce fully calibrated and reconstructed analysis files. In addition, many simulated neutrino interactions must be produced and processed through the same stages as data. To accommodate the large volume of data and Monte Carlo, production must be possible both on the Fermilab grid and on off-site farms, such as the ones accessible through the Open Science Grid. To handle the challenge of cataloging these files and to facilitate their off-line processing, we have adopted the SAM system developed at Fermilab. SAM indexes files according to metadata, keeps track of each file's physical locations, provides dataset management facilities, and facilitates data transfer to off-site grids. To integrate SAM with Fermilab's art software framework and the NOvA production workflow, we have developed methods to embed metadata into our configuration files, art files, and standalone ROOT files. A module in the art framework propagates the embedded information from configuration files into art files, and from input art files to output art files, allowing us to maintain a complete processing history within our files. Embedding metadata in configuration files also allows configuration files indexed in SAM to be used as inputs to Monte Carlo production jobs. Further, SAM keeps track of the input files used to create each output file. Parentage information enables the construction of self-draining datasets which have become the primary production paradigm used at NOvA. In this study we will present an overview of SAM at NOvA and how it has transformed the file production framework used by the experiment.
The NO$\nu$A collaboration has constructed a 14,000 ton, fine-grained, low-Z, total absorption tracking calorimeter at an off-axis angle to an upgraded NuMI neutrino beam. This detector, with its excellent granularity and energy resolution and relatively low-energy neutrino thresholds, was designed to observe electron neutrino appearance in a muon neutrino beam, but it also has unique capabilities suitable for more exotic efforts. In fact, if sufficient cosmic ray background rejection can be demonstrated, NO$\nu$A will be capable of a competitive indirect dark matter search for low-mass Weakly-Interacting Massive Particles (WIMPs). The cosmic ray muon rate at the NO$\nu$A far detector is approximately 100 kHz and provides the primary challenge for triggering and optimizing such a search analysis. The status of the NO$\nu$A upward-going muon trigger and a first look at the triggered sample is presented.
The NO$\nu$A collaboration has constructed a 14,000 ton, fine-grained, low-Z, total absorption tracking calorimeter at an off-axis angle to an upgraded NuMI neutrino beam. This detector, with its excellent granularity and energy resolution and relatively low-energy neutrino thresholds, was designed to observe electron neutrino appearance in a muon neutrino beam, but it also has unique capabilities suitable for more exotic efforts. In fact, if an efficient upward-going muon trigger with sufficient cosmic ray background rejection can be demonstrated, NO$\nu$A will be capable of a competitive indirect dark matter search for low-mass WIMPs. The cosmic ray muon rate at the NO$\nu$A far detector is about 100 kHz and provides the primary challenge for triggering and optimizing such a search analysis. The status of the NO$\nu$A upward-going muon trigger is presented.
The NOνA experiment is a long baseline neutrino experiment designed to make precision measurements of the oscillation probabilities for ν{sub µ} → ν{sub e} and ν{sub µ} → ν{sub µ} for both neutrinos and anti-neutrinos. These measurements will provide new information on the neutrino mass hierarchy, improve our knowledge of whether θ{sub 23} is non-maximal and possibility provide information on the CP violating phase δ{sub CP} of the PMNS neutrino mixing matrix. We present the observations of the first neutrino event in the NOνA far and near detectors along with data obtained during the first year of detector commissioning and operations. We use the data to demonstrate the detector’s ability to identify electron and muon neutrino events and to reject cosmic ray induced backgrounds at a level of 4 × 10{sup 7}:1. New estimates for the signal and background sensitivities of the NOνA experiment during the first year of full detector running are presented.
We present a case that passivated contacts based on a thin tunneling oxide layer, combined with a transport layer with properly selected work function and band offsets, can lead to high efficiency c-Si solar cells. Passivated contacts contribute to cell efficiency as well as design flexibility, process robustness, and a simplified process flow. Material choices for the transport layer are examined, including transparent n-type oxides and n+-doped poly-Si. SiO2/n+-poly-Si full-area, induced-junction back surface field contacts to n-FZ and n-Cz Si are incorporated into high efficiency cells with deep, passivated boron emitters.
The NOνA experiment is a neutrino oscillation experiment designed to measure parameters related to the neutrino mixing matrix, mass hierarchy and CP violation. The experiment measures neutrino and anti-neutrino interactions from the NuMI beam line at Fermilab in a Near Detector and a Far Detector located 810 kilometers away. Making these measurements requires precise synchronization of 344,064 channels in the Far Detector to an absolute wall time with a channel to channel variation of less then 10 ns. The experiment must correlate the presence of the relatively narrow neutrino beam in the detector with data readout. This paper will discuss the performance of the NOνA timing system during the first few months of operation at the Far Detector.
The NOvA far detector, due to its surface proximity, large size, good timing resolution, large energy dynamic range, and continuous readout, is sensitive to the detection of magnetic monopoles over a large range of velocities and masses. In order to record candidate magnetic monopole events with high efficiency we have designed a software-based trigger to make decisions based on the data recorded by the detector. The decisions must be fast, have high efficiency, and a large rejection factor for the over 100,000 cosmic rays that course through the detector every second. In this paper we briefly describe the simulation of magnetic monopoles, including the detector response, and then discuss the algorithms applied to identify magnetic monopole candidates. We also present the results of trigger efficiency and purity tests using simulated samples of magnetic monopoles with overlaid cosmic backgrounds and electronic noise.
Abstract not provided
Explore the source record for details and available documents.