Search NASASearch

DOE OSTI · 2584386

The neurobench framework for benchmarking neuromorphic computing algorithms and systems

Yik, Jason [Harvard Univ., Cambridge, MA (United States); et al.] (ORCID:0009000958600619)·Van den Berghe, Korneel·den Blanken, Douwe·Bouhadjar, Younes (ORCID:0000000343678236)·Fabre, Maxime·Hueber, Paul·Ke, Weijie·Khoei, Mina A.·Kleyko, Denis (ORCID:0000000260326155)·Pacik-Nelson, Noah (ORCID:0000000256152260)·Pierro, Alessandro (ORCID:000000025682627X)·Stratmann, Philipp (ORCID:0000000167919159)·Sun, Pao-Sheng Vincent·Tang, Guangzhi·Wang, Shenqi·Zhou, Biyan·Ahmed, Soikat Hasan·Vathakkattil Joseph, George (ORCID:0000000267570660)·Leto, Benedetto (ORCID:0009000788915051)·Micheli, Aurora·Mishra, Anurag Kumar·Lenz, Gregor·Sun, Tao (ORCID:0000000289678760)·Ahmed, Zergham·Akl, Mahmoud·Anderson, Brian·Andreou, Andreas G. (ORCID:000000033826600X)·Bartolozzi, Chiara (ORCID:0000000334656449)·Basu, Arindam (ORCID:0000000310358770)·Bogdan, Petrut·Bohte, Sander·Buckley, Sonia (ORCID:0000000328099287)·Cauwenberghs, Gert·Chicca, Elisabetta (ORCID:0000000255188990)·Corradi, Federico (ORCID:0000000258688077)·de Croon, Guido (ORCID:0000000182651496)·Danielescu, Andreea (ORCID:0000000174602467)·Daram, Anurag·Davies, Mike·Demirag, Yigit (ORCID:0000000189902075)·Eshraghian, Jason (ORCID:0000000258324054)·Fischer, Tobias (ORCID:000000032183017X)·Forest, Jeremy (ORCID:0000000284865559)·Fra, Vittorio (ORCID:0000000191752838)·Furber, Steve (ORCID:0000000265243367)·Furlong, P. Michael (ORCID:0000000195038498)·Gilpin, William·Gilra, Aditya (ORCID:0000000286281864)·Gonzalez, Hector A. (ORCID:0000000173121389)·Indiveri, Giacomo (ORCID:0000000271091689)·Joshi, Siddharth (ORCID:0000000292019678)·Karia, Vedant·Khacef, Lyes (ORCID:000000024009174X)·Knight, James C. (ORCID:0000000305770074)·Kriener, Laura (ORCID:0000000152759199)·Kubendran, Rajkumar·Kudithipudi, Dhireesha (ORCID:0000000344625224)·Liu, Shih-Chii (ORCID:000000027557045X)·Liu, Yao-Hong (ORCID:0000000232566741)·Ma, Haoyuan·Manohar, Rajit·Margarit-Taulé, Josep Maria (ORCID:000000034477035X)·Mayr, Christian·Michmizos, Konstantinos·Muir, Dylan R. (ORCID:000000033856826X)·Neftci, Emre·Nowotny, Thomas (ORCID:000000024451915X)·Ottati, Fabrizio·Ozcelikkale, Ayca (ORCID:0000000189782990)·Panda, Priyadarshini·Park, Jongkil·Payvand, Melika (ORCID:000000015400067X)·Pehle, Christian·Petrovici, Mihai A. (ORCID:0000000326320427)·Posch, Christoph·Renner, Alpha (ORCID:0000000207244169)·Sandamirskaya, Yulia·Schaefer, Clemens J. S.·van Schaik, André (ORCID:000000016140017X)·Schemmel, Johannes (ORCID:0000000314404375)·Schmidgall, Samuel·Schuman, Catherine (ORCID:0000000242648097)·Seo, Jae-sun·Sheik, Sadique·Shrestha, Sumit Bam·Sifalakis, Manolis (ORCID:0000000209492094)·Sironi, Amos·Stewart, Kenneth·Stewart, Matthew·Stewart, Terrence C.·Timcheck, Jonathan (ORCID:0000000220712668)·Tömen, Nergis (ORCID:0000000339161859)·Urgese, Gianvito (ORCID:0000000326727593)·Verhelst, Marian (ORCID:0000000334959263)·Vineyard, Craig M. (ORCID:0000000247876160)·Vogginger, Bernhard (ORCID:0000000190425405)·Yousefzadeh, Amirreza (ORCID:0000000229675090)·Zohora, Fatima Tuz·Frenkel, Charlotte·Reddi, Vijay Janapa

Abstract

Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it difficult to accurately measure technological advancements, compare performance with conventional methods, and identify promising future research directions. This article presents NeuroBench, a benchmark framework for neuromorphic algorithms and systems, which is collaboratively designed from an open community of researchers across industry and academia. NeuroBench introduces a common set of tools and systematic methodology for inclusive benchmark measurement, delivering an objective reference framework for quantifying neuromorphic approaches in both hardware-independent and hardware-dependent settings. For latest project updates, visit the project website (neurobench.ai).

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yik, Jason [Harvard Univ., Cambridge, MA (United States); et al.] (ORCID:0009000958600619), Van den Berghe, Korneel, den Blanken, Douwe, Bouhadjar, Younes (ORCID:0000000343678236), Fabre, Maxime, Hueber, Paul, Ke, Weijie, Khoei, Mina A., Kleyko, Denis (ORCID:0000000260326155), Pacik-Nelson, Noah (ORCID:0000000256152260), Pierro, Alessandro (ORCID:000000025682627X), Stratmann, Philipp (ORCID:0000000167919159), Sun, Pao-Sheng Vincent, Tang, Guangzhi, Wang, Shenqi, Zhou, Biyan, Ahmed, Soikat Hasan, Vathakkattil Joseph, George (ORCID:0000000267570660), Leto, Benedetto (ORCID:0009000788915051), Micheli, Aurora, Mishra, Anurag Kumar, Lenz, Gregor, Sun, Tao (ORCID:0000000289678760), Ahmed, Zergham, Akl, Mahmoud, Anderson, Brian, Andreou, Andreas G. (ORCID:000000033826600X), Bartolozzi, Chiara (ORCID:0000000334656449), Basu, Arindam (ORCID:0000000310358770), Bogdan, Petrut, Bohte, Sander, Buckley, Sonia (ORCID:0000000328099287), Cauwenberghs, Gert, Chicca, Elisabetta (ORCID:0000000255188990), Corradi, Federico (ORCID:0000000258688077), de Croon, Guido (ORCID:0000000182651496), Danielescu, Andreea (ORCID:0000000174602467), Daram, Anurag, Davies, Mike, Demirag, Yigit (ORCID:0000000189902075), Eshraghian, Jason (ORCID:0000000258324054), Fischer, Tobias (ORCID:000000032183017X), Forest, Jeremy (ORCID:0000000284865559), Fra, Vittorio (ORCID:0000000191752838), Furber, Steve (ORCID:0000000265243367), Furlong, P. Michael (ORCID:0000000195038498), Gilpin, William, Gilra, Aditya (ORCID:0000000286281864), Gonzalez, Hector A. (ORCID:0000000173121389), Indiveri, Giacomo (ORCID:0000000271091689), Joshi, Siddharth (ORCID:0000000292019678), Karia, Vedant, Khacef, Lyes (ORCID:000000024009174X), Knight, James C. (ORCID:0000000305770074), Kriener, Laura (ORCID:0000000152759199), Kubendran, Rajkumar, Kudithipudi, Dhireesha (ORCID:0000000344625224), Liu, Shih-Chii (ORCID:000000027557045X), Liu, Yao-Hong (ORCID:0000000232566741), Ma, Haoyuan, Manohar, Rajit, Margarit-Taulé, Josep Maria (ORCID:000000034477035X), Mayr, Christian, Michmizos, Konstantinos, Muir, Dylan R. (ORCID:000000033856826X), Neftci, Emre, Nowotny, Thomas (ORCID:000000024451915X), Ottati, Fabrizio, Ozcelikkale, Ayca (ORCID:0000000189782990), Panda, Priyadarshini, Park, Jongkil, Payvand, Melika (ORCID:000000015400067X), Pehle, Christian, Petrovici, Mihai A. (ORCID:0000000326320427), Posch, Christoph, Renner, Alpha (ORCID:0000000207244169), Sandamirskaya, Yulia, Schaefer, Clemens J. S., van Schaik, André (ORCID:000000016140017X), Schemmel, Johannes (ORCID:0000000314404375), Schmidgall, Samuel, Schuman, Catherine (ORCID:0000000242648097), Seo, Jae-sun, Sheik, Sadique, Shrestha, Sumit Bam, Sifalakis, Manolis (ORCID:0000000209492094), Sironi, Amos, Stewart, Kenneth, Stewart, Matthew, Stewart, Terrence C., Timcheck, Jonathan (ORCID:0000000220712668), Tömen, Nergis (ORCID:0000000339161859), Urgese, Gianvito (ORCID:0000000326727593), Verhelst, Marian (ORCID:0000000334959263), Vineyard, Craig M. (ORCID:0000000247876160), Vogginger, Bernhard (ORCID:0000000190425405), Yousefzadeh, Amirreza (ORCID:0000000229675090), Zohora, Fatima Tuz, Frenkel, Charlotte, Reddi, Vijay Janapa. 2025-02-11. The neurobench framework for benchmarking neuromorphic computing algorithms and systems. https://doi.org/10.1038/s41467-025-56739-4

Cite the original work for its findings. Save a collection to share your selection of sources.