DOE OSTI · 1984057
Scalable Second Order Optimization for Machine Learning
Abstract
Many machine learning (ML) training tasks are essentially optimization processes that would at first glance appear eminently parallelizable and scalable. However, effective acceleration of these tasks with scalable parallel hardware has proven to be elusive. While standard methods for machine learning, e.g., stochastic gradient descent (SGD) for DNNs, tend to be resource efficient, they appear to be fundamentally sequential in nature.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Lumsdaine, Andrew. 2022-05-01. Scalable Second Order Optimization for Machine Learning. https://doi.org/10.2172/1984057. https://searchnasa.com/record/osti%3A1984057/scalable-second-order-optimization-for-machine-learning
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Search NASA by Indiciae: BibTeX · RIS.