DOE OSTI · 2504202
Aspen Open Jets: unlocking LHC data for foundation models in particle physics
Abstract
Foundation models are deep learning models pre-trained on large amounts of data which are capable of generalizing to multiple datasets and/or downstream tasks. This work demonstrates how data collected by the CMS experiment at the Large Hadron Collider can be useful in pre-training foundation models for HEP. Specifically, we introduce the AspenOpenJets (AOJs) dataset, consisting of approximately 178 M high p T jets derived from CMS 2016 Open Data. We show how pre-training the OmniJet-α foundation model on AOJs improves performance on generative tasks with significant domain shift: generating boosted top and QCD jets from the simulated JetClass dataset. In addition to demonstrating the power of pre-training of a jet-based foundation model on actual proton–proton collision data, we provide the ML-ready derived AOJs dataset for further public use.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Amram, Oz [Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)] (ORCID:0000000237653123), Anzalone, Luca [Univ. of Bologna (Italy); National Inst. of Nuclear Physics (INFN), Bologna (Italy)] (ORCID:0000000203998836), Birk, Joschka [Univ. of Hamburg (Germany)] (ORCID:0000000219310127), Faroughy, Darius A. [Rutgers Univ., Piscataway, NJ (United States)] (ORCID:0000000240275477), Hallin, Anna [Univ. of Hamburg (Germany)] (ORCID:000000021551814X), Kasieczka, Gregor [Univ. of Hamburg (Germany); Deutsches Elektronen-Synchrotron (DESY), Hamburg (Germany). Center for Data and Computing in Natural Science (CDCS)] (ORCID:0000000334572755), Krämer, Michael [RWTH Aachen Univ. (Germany)] (ORCID:0000000230896827), Pang, Ian [Rutgers Univ., Piscataway, NJ (United States)] (ORCID:0000000282257269), Reyes-Gonzalez, Humberto [RWTH Aachen Univ. (Germany)] (ORCID:0000000332835208), Shih, David [Rutgers Univ., Piscataway, NJ (United States)] (ORCID:0000000334083871). 2025-07-07. Aspen Open Jets: unlocking LHC data for foundation models in particle physics. https://doi.org/10.1088/2632-2153%2Fade58f
Cite the original work for its findings. Save a collection to share your selection of sources.