Optimization for Classical Machine Learning Problems on the GPU
Year: 2022
Type: conference-paper
Abstract: Constrained optimization problems arise frequently in classical machine learning. There exist frameworks addressing constrained optimization, for instance, CVXPY and GENO. However, in contrast to deep learning frameworks, GPU support is limited. Here, we extend the GENO framework to also solve constrained optimization problems on the GPU. The framework allows the user to specify constrained optimization problems in an easy-to-read modeling language. A solver is then automatically generated from this specification. When run on the GPU, the solver outperforms state-of-the-art approaches like CVXPY combined with a GPU-accelerated solver such as cuOSQP or SCS by a few orders of magnitude.
Authors: Sören Laue, Mark Blacher, Joachim Giesen
Institution: Friedrich Schiller University Jena
Language: English
Subfield: Numerical Analysis
Field: Mathematics
Domain: Physical Sciences
Open Access status: diamond
Awards: G4443650897, G8909796238
OpenAlex ID: W4283801112
