Year: 2011
Type: conference-paper
Abstract: We propose a method to improve traditional character-based PPM text compression algorithm [1] for natural languages. Consider a text file as a sequence of alternating words and non-words, the basic idea of our algorithm is to encode nonwords and prefixes of words using character-based context models and encode suffixes of words using dictionary models. By using dictionary models, the algorithm can encode multiple characters as a whole, and thus enhance the compression efficiency. The advantages of the proposed algorithm are: 1) it does not require any text preprocessing, 2) it does not need any explicit codeword to identify switch between context and dictionary models, 3) it can be applied to any character-based PPM algorithms without incurring much additional computational cost.
Source: DCC
DOI: 10.1109/dcc.2011.63
Authors: Yichuan Hu, Jianzhong Zhang, Farooq Khan, Ying Li
Institutions: University of Pennsylvania, Samsung (South Korea)
Language: English
Subfield: Theoretical Computer Science
Field: Mathematics
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2138972643