Work

Scan, Attend and Read: End-to-End Handwritten Paragraph Recognition with MDLSTM Attention

Year: 2017
Type: conference-paper
Abstract: We present an attention-based model for end-to-end handwriting recognition. Our system does not require any segmentation of the input paragraph. The model is inspired by the differentiable attention models presented recently for speech recognition, image captioning or translation. The main difference is the implementation of covert and overt attention with a multi-dimensional LSTM network. Our principal contribution towards handwriting recognition lies in the automatic transcription without a prior segmentation into lines, which was critical in previous approaches. Moreover, the system is able to learn the reading order, enabling it to handle bidirectional scripts such as Arabic. We carried out experiments on the well-known IAM Database and report encouraging results which bring hope to perform full paragraph transcription in the near future.
Authors: Theodore Bluche, Jeroome Louradour, Ronaldo Messina
Language: English
Open Access status: green
OpenAlex ID: W2336035754
FWCI: 5.931
Cites: 36
Cited by: 276
Related to: 10