Search NASA⌕ Search

Engineering topics

Zahn, Oliver

Publications and source records attributed to Zahn, Oliver.

Full covariance of CMB and lensing reconstruction power spectra

CMB and lensing reconstruction power spectra are powerful probes of cosmology. However, they are correlated, since the CMB power spectra are lensed, and the lensing reconstruction is constructed using CMB multipoles. This paper discusses how we perform a full analysis of the auto- and cross-covariances, including polarization power spectra and minimum-variance lensing estimators, and compare with simulations of idealized future CMB-S4 observations. Covariances sourced by fluctuations in the unlensed CMB and instrumental noise can largely be removed by using a realization-dependent subtraction of lensing reconstruction noise, leaving a relatively simple covariance model that is dominated by lensing-induced terms and well described by a small number of principal components. The correlations between the CMB and lensing power spectra will be detectable at the level of $\sim 5σ$ for a CMB-S4 mission, and neglecting them could underestimate some parameter error bars by several tens of percent. However, we found that the inclusion of external priors or data sets to estimate parameter error bars can make the impact of the correlations almost negligible.

79 ASTRONOMY AND ASTROPHYSICS↗

Kira: Processing Astronomy Imagery Using Big Data Technology

Scientific analyses commonly compose multiple single-process programs into a dataflow. An end-to-end dataflow of single-process programs is known as a many-task application. Typically, HPC tools are used to parallelize these analyses. In this work, we investigate an alternate approach that uses Apache Spark-a modern platform for data intensive computing-to parallelize many-task applications. We implement Kira, a flexible and distributed astronomy image processing toolkit, and its Source Extractor (Kira SE) application. Using Kira SE as a case study, we examine the programming flexibility, dataflow richness, scheduling capacity and performance of Apache Spark running on the Amazon EC2 cloud. By exploiting data locality, Kira SE achieves a 4.1× speedup over an equivalent C program when analyzing a 1TB dataset using 512 cores on the Amazon EC2 cloud. Furthermore, Kira SE on the Amazon EC2 cloud achieves a 1.8× speedup over the C program on the NERSC Edison supercomputer. A 128-core Amazon EC2 cloud deployment of Kira SE using Spark Streaming can achieve a second-scale latency with a sustained throughput of 800 MB/s. Our experience with Kira demonstrates that data intensive computing platforms like Apache Spark are a performant alternative for many-task scientific applications.

97 MATHEMATICS AND COMPUTING↗