Project 3: Object categorization with a “bag of keypoints”

 

 

Description

         Implement a bag of ‘words’ approach  described in “Visual Categorization with Bags of Keypoints” G.Cruska, C. R. Dance, L.Fan, J.Willamowski,C. Bray.

         Test it on 4 categories: airplanes, faces, cars side, and motorbikes.

         Optional: train the system to detect the above categories against general background.  

Results

The detection results should be presented as a confusion matrix:

 

Airplanes

Faces

Cars

Motorbikes

Airplanes

How many of the planes are classified as planes

How many of the faces are classified as planes

Faces

How many of the planes are classified as faces

How many of the faces are classified as faces

Cars

How many of the planes are classified as cars

How many of the faces are classified as cars

Motorbikes

How many of the planes are classified as motorbikes

How many of the faces are classified as motorbikes

Obviously the best results will produce diagonal confusion matrix.

 

Data sets

The system should be trained and tested on the above 4 categories from  Caltech 101 objects data set.  You can download the background images (optional) from here.

 

SVM Package

Matlab version

C version

 

K-Means

Use MATLAB function kmeans(…)  for the codebook construction.

 

Useful Links

Class lecture on object detection

 "Distinctive image features from scale-invariant keypoints" by David Lowe

SVM tutorial

SVM slides

Status

Claimed by Ran and Elran