Evaluation Metrics

Object person tracking evaluation

This evaluation is performed using ViPER-PE.

Parameter file


Properties file


See the ViPER-PE web site for the documentation about the file format of the performance evaluation parameters and results. (http://viper-toolkit.sourceforge.net/ )

Concept detection (Precision and Recall)

The two annotations are compared without keeping temporal information of the concepts. Only the detection inside a video is important. No matches among instances of the same concept are performed.
In other words, for each concept the total number of instances in each annotation is used.

precision_recall.jpg
where:
  • C_i: i-th concept
  • AA_instances_i: number of instances of the i-th concept in the automatic annotation
  • GT_instances_i: number of instances of the i-th concept in the ground-truth reference annotation
For problems or suggestions: contact Roberto Vezzani - Webmaster: Roberto Vezzani - ©2007