Evaluating Content Based Image Retrieval Techniques with the One Million Images CLIC Test Bed

Pattern recognition and image recognition methods are commonly developed and tested using testbeds, which contain known responses to a query set. Until now, testbeds available for image analysis and content-based image retrieval (CBIR) have been scarce and small-scale. Here we present the one million images CEA-List Image Collection (CLIC) testbed that we have produced, and report on our use of this testbed to evaluate image analysis merging techniques. This testbed will soon be made publicly available through the EU MUSCLE Network of Excellence.

• Pierre-Alain Moëllic
• Patrick Hède
• Gr egory Grefenstette
• Christophe Millet

• CBIR
• CLIC
• evaluation
• image indexing and retrieval
• testbed.

[1] http://www1.cs.columbia.edu/CAVE/
[2] http://wang.ist.psu.edu/docs/related/
[3] http://vismod.media.mit.edu/vismod/imagery/VisionTexture/vistex.html
[4] M.Flickners, H.Sawhney, W.Niblack, J.Ashley. "Query by image and
video content: the Qbic system". IEEE Computer, September 1995.
[5] C.Carson, S.Belongie, H.Greenspan, J.Malik. "Blobworld : Image
segmentation using expectation-maximization and its application to
image querying". February 1999.
[6] J.Smith, S.Chang "Querying by color regions using the visualseek
content-based visual query system". Intelligence Multimedia
Information Retrieval AAAI Press, 1997.
[7] James Z. Wang, Jia Li, Gio Wied erhold, ``SIMPLIcity: Semantics-
Sensitive Integrated Matching for Picture Libraries,'' IEEE Transactions
on Pattern Analysis and Machine Intelligence, vol. 23, no. 9, pp. 947-
963, 2001.
[8] N. Boujemaa, J. Fauqueur, M. Ferecatu "IKONA: Interactive Generic
and Specific Image Retrieval". International workshop on Multimedia
Content-Based Indexing and Retrieval, 2001, Rocquencourt, France.
[9] M.Joint, P.A. Mo├½llic, P. Hède, P. Adam. "PIRIA: A General Tool for
Indexing, Search and Retrieval of Multimedia Content". SPIE.Electronic
Imaging, Vol. 5298, Algorithms and Systems III, Session 3, San Jose
2004.
[10] Chen-Chin Chiang, Wen-Kai Tai, Mau-Tsuen Yang, "A novel method
for detecting lips, eyes and faces in real time". Real-Time Imaging 9, pp. 277-287, 2003.