Show simple item record

Mean Normalized Retrieval Order (MNRO): a new content-based image retrieval performance measure

dc.contributor.authorChatzichristofis, Savvas A.
dc.contributor.authorIakovidou, Chryssanthi
dc.contributor.authorBoutalis, Yiannis S.
dc.contributor.authorAngelopoulou, Elli
dc.description.abstractThe results of a content based image retrieval system can be evaluated by several performance measures, each one employing different evaluation criteria. Many of the methods used in the field of information retrieval have been adopted for use in image retrieval systems. This paper reviews the most widely used performance measures for retrieval evaluation with particular emphasis on the assumptions made during their design. More specifically, it focuses on the design principles of the commonly used Mean Average Precision (MAP) and Average Normalized Modified Retrieval Rank (ANMRR), pinpointing their limitations. It also proposes a new performance measure for image retrieval systems, the Mean Normalized Retrieval Order (MNRO), whose effectiveness is demonstrated through a wide range of experiments. Initial experiments were conducted on artificially produced query trials and evaluations. Experiments on a large database demonstrate the ability of MNRO to take into account the generality of the queries during the retrieval procedure. Furthermore, the results of a case study show that the proposed performance measure is closer to human evaluations, in comparison to MAP and ANMRR. Lastly, in order to encourage researchers and practitioners to use the proposed performance measure, we present the experimental results produced by a large number of state of the art descriptors applied on three well-known benchmarking databases.en_UK
dc.relation.ispartofseriesMultimedia Tools and Applications;Volume 70, Issue 3
dc.rights© Springer Science+Business Media, LLC 2012en_UK
dc.subjectImage retrieval performance measuresen_UK
dc.subjectMean Average Precisionen_UK
dc.subjectAverage Normalized Modified Retrieval Ranken_UK
dc.titleMean Normalized Retrieval Order (MNRO): a new content-based image retrieval performance measureen_UK

Files in this item


This item appears in the following Collection(s)

Show simple item record

© Springer Science+Business Media, LLC 2012
Except where otherwise noted, this item's license is described as © Springer Science+Business Media, LLC 2012