Publications des agents du Cirad

Cirad

Animal disease surveillance: How to represent textual data for classifying epidemiological information

Valentin S., Decoupes R., Lancelot R., Roche M.. 2023. Preventive Veterinary Medicine, 216 : 9 p..

DOI: 10.1016/j.prevetmed.2023.105932

The value of informal sources in increasing the timeliness of disease outbreak detection and providing detailed epidemiological information in the early warning and preparedness context is recognized. This study evaluates machine learning methods for classifying information from animal disease-related news at a fine-grained level (i.e., epidemiological topic). We compare two textual representations, the bag-of-words method and a distributional approach, i.e., word embeddings. Both representations performed well for binary relevance classification (F-measure of 0.839 and 0.871, respectively). Bag-of-words representation was outperformed by word embedding representation for classifying sentences into fine-grained epidemiological topics (F-measure of 0.745). Our results suggest that the word embedding approach is of interest in the context of low-frequency classes in a specialized domain. However, this representation did not bring significant performance improvements for binary relevance classification, indicating that the textual representation should be adapted to each classification task.

Mots-clés : épidémiologie; classification; maladie des animaux; surveillance épidémiologique; analyse de données; santé animale; apprentissage machine

Documents associés

Article (a-revue à facteur d'impact)

Agents Cirad, auteurs de cette publication :