Publications des agents du Cirad

Cirad

Towards electronic SMS dictionary construction: an alignment-based approach

Lopez C., Bestandji R., Roche M., Panckhurst R.. 2014. In : Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Hrafn Loftsson, B. Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC'14): ISO Workshop on interopable semantic annotation, 2014, may 26-31, Reykjavik, Iceland. Paris : ELRA, p. 2833-2838. International Conference on Language Resources and Evaluation. 9, 2014-05-26/2014-05-31, Reykjavik (Islande).

In this paper, we propose a method for aligning text messages (entitled AlignSMS) in order to automatically build an SMS dictionary. An extract of 100 text messages from the 88milSMS corpus (Panckhurst el al., 2013, 2014) was used as an initial test. More than 90,000 authentic text messages in French were collected from the general public by a group of academics in the south of France in the context of the sud4science project (http://www.sud4science.org). This project is itself part of a vast international SMS data collection project, entitled sms4science (http://www.sms4science.org, Fairon et al. 2006, Cougnon, 2014). After corpus collation, pre-processing and anonymisation (Accorsi et al., 2012, Patel et al., 2013), we discuss how "raw" anonymised text messages can be transcoded into normalised text messages, using a statistical alignment method. The future objective is to set up a hybrid (symbolic/statistic) approach based on both grammar rules and our statistical AlignSMS method.

Documents associés

Communication de congrès

Agents Cirad, auteurs de cette publication :