Publications des agents du Cirad

Cirad

Pl@ntNet-300K : a plant image dataset with high label ambiguity and along tailed distribution

Garcin C., Joly A., Bonnet P., Lombardo J.C., Affouard A., Chouet M., Servajean M., Lorieul T., Salmon J.. 2021. In : Vanschoren J. (ed.), Yeung S. (ed.). Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1 (NeurIPS Datasets and Benchmarks 2021). s.l. : s.n., p. 1-19. Conference on Neural Information Processing Systems (NeurIPS 2021). 35, 2021-12-06/2021-12-14, (France).

This paper presents a novel image dataset with high intrinsic ambiguity specifically built for evaluating and comparing set-valued classifiers. This dataset, built from the database of Pl@ntnet citizen observatory, consists of 306,146 images covering 1,081 species. We highlight two particular features of the dataset, inherent to the way the images are acquired and to the intrinsic diversity of plants morphology: i) The dataset has a strong class imbalance, meaning that a few species account for most of the images. ii) Many species are visually similar, making identification difficult even for the expert eye.These two characteristics make the present dataset well suited for the evaluation of set-valued classification methods and algorithms. Therefore, we recommend two set-valued evaluation metrics associated with the dataset (mean top-k accuracy and mean average-k accuracy) and we provide the results of a baseline approach based on a deep neural network trained with the cross-entropy loss.

Documents associés

Communication de congrès

Agents Cirad, auteurs de cette publication :