Publications des agents du Cirad


Classification des items inconnus de 88milSMS : aide à l'identification automatique de la créativité scripturale

Lopez C., Roche M., Panckhurst R.. 2015. Tranel, 63 : p. 71-86.

The sud4science LR project 1 aimed at studying a fairly recent form of written communication: SMS (Short Message Service). The first step of the project was to collect a large number of text messages from the general public. We initially gathered 93'085 SMS and our final corpus, entitled 88milSMS , contains over 88'000 SMS. 2 In this article, we propose a novel approach (which is also applicable to other textual data) for classifying unknown items in 88milSMS , based on two steps: 1) Classification of SMS in relation to 5 European languages (French, Spanish, English, German, Italian), 2) Classification of unknown items accordi ng to predefined classes (schedules, items containing special character(s), number(s), words without accents, or with repeated characters, etc.). We are then able to make a distinction between the truly "original" items which are widely used compared to those that are rarely used in the corpus. Based on examples mined in the different classes, we present a preliminary analysis of the obtained resource.

Mots-clés : communication; linguistique; analyse de données; logiciel; méthode statistique; classification (information); information; langage

Documents associés

Article (b-revue à comité de lecture)

Agents Cirad, auteurs de cette publication :