On the equivalence of Occam algorithms
Year: 2025
Type: article
Abstract: Blumer et al. (1987, 1989) showed that any concept class that is learnable by Occam algorithms is PAC learnable. Board and Pitt (1990) showed a partial converse of this theorem: for concept classes that are closed under exception lists, any class that is PAC learnable is learnable by an Occam algorithm. However, their Occam algorithm outputs a hypothesis whose complexity is δ -dependent, which is an important limitation. In this paper, we show that their partial converse applies to Occam algorithms with δ -independent complexities as well. Thus, we provide a posteriori justification of various theoretical results and algorithm design methods which use the partial converse as a basis for their work.
Source: Information and Computation
Author: Zaman Keinath-Esmail
Institution: University of Oxford
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $2,840
OpenAlex ID: W7093341878