Engineering topics

Boone, Kyle (ORCID:0000000258286211)

Publications and source records attributed to Boone, Kyle (ORCID:0000000258286211).

2 records

DOE OSTI2022

The Astronomy Commons Platform: A Deployable Cloud-based Analysis Platform for Astronomy

Abstract We present a scalable, cloud-based science platform solution designed to enable next-to-the-data analyses of terabyte-scale astronomical tabular data sets. The presented platform is built on Amazon Web Services (over Kubernetes and S3 abstraction layers), utilizes Apache Spark and the Astronomy eXtensions for Spark for parallel data analysis and manipulation, and provides the familiar JupyterHub web-accessible front end for user access. We outline the architecture of the analysis platform, provide implementation details and rationale for (and against) technology choices, verify scalability through strong and weak scaling tests, and demonstrate usability through an example science analysis of data from the Zwicky Transient Facility’s 1Bn+ light-curve catalog. Furthermore, we show how this system enables an end user to iteratively build analyses (in Python) that transparently scale processing with no need for end-user interaction. The system is designed to be deployable by astronomers with moderate cloud engineering knowledge, or (ideally) IT groups. Over the past 3 yr, it has been utilized to build science platforms for the DiRAC Institute, the ZTF partnership, the LSST Solar System Science Collaboration, and the LSST Interdisciplinary Network for Collaboration and Computing, as well as for numerous short-term events (with over 100 simultaneous users). In a live demo instance, the deployment scripts, source code, and cost calculators are accessible. 4 4 http://hub.astronomycommons.org/

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

The HST See Change Program. I. Survey Design, Pipeline, and Supernova Discoveries*

The See Change survey was designed to make z > 1 cosmological measurements by efficiently discovering high-redshift Type Ia supernovae (SNe Ia) and improving cluster mass measurements through weak lensing. This survey observed twelve galaxy clusters with the Hubble Space Telescope (HST) spanning the redshift range z = 1.13–1.75, discovering 57 likely transients and 27 likely SNe Ia at z ~ 0.8–2.3. As in similar previous surveys, this proved to be a highly efficient use of HST for supernova observations; the See Change survey additionally tested the feasibility of maintaining, or further increasing, the efficiency at yet higher redshifts, where we have less detailed information on the expected cluster masses and star formation rates. Furthermore, we find that the resulting number of SNe Ia per orbit is a factor of ~8 higher than for a field search, and 45% of our orbits contained an active SN Ia within 22 rest-frame days of peak, with one of the clusters by itself yielding 6 of the SNe Ia. We present the survey design, pipeline, and supernova discoveries. Novel features include fully blinded supernova searches, the first random forest candidate classifier for undersampled IR data (with a 50% detection threshold within 0.05 mag of human searchers), real-time forward-modeling photometry of candidates, and semi-automated photometric classifications and follow-up forecasts. We also describe the spectroscopic follow-up, instrumental in measuring host galaxy redshifts. The cosmology analysis of our sample will be presented in a companion paper.

79 ASTRONOMY AND ASTROPHYSICS↗