LIPT: a lossless text transform to improve compression
Year: 2002
Type: conference-paper
Abstract: We propose an approach to develop a dictionary based reversible lossless text transformation, called LIFT (length index preserving transform), which can be applied to a source text to improve the existing algorithm's ability to compress. In LIFT, the length of the input word and the offset of the words in the dictionary are denoted with alphabets. Our encoding scheme makes use of the recurrence of same length words in the English language to create context in the transformed text that the entropy coders can exploit. LIFT also achieves some compression at the preprocessing stage and retains enough context and redundancy for the compression algorithms to give better results. Bzip2 with LIFT gives 5.24% improvement in average BPC over Bzip2 without LIPT, and PPMD with LIPT gives 4.46% improvement in average BPC over PPMD without LIFT, for our test corpus.
Authors: F.S. Awan, A. Mukherjee
Institution: University of Central Florida
Language: English
Subfield: Theoretical Computer Science
Field: Mathematics
Domain: Physical Sciences
Keywords: lossless text compression, entropy coding, bzip2
Open Access status: green
Funder: National Science Foundation
OpenAlex ID: W1696088198
