PTB-TIR: A Thermal Infrared Pedestrian Tracking Benchmark

Published in IEEE Transactions on Multimedia, 2020

Thermal infrared (TIR) pedestrian tracking is one of the important components among numerous applications of computer vision, which has a major advantage: it can track pedestrians in total darkness. The ability to evaluate the TIR pedestrian tracker fairly, on a benchmark dataset, is significant for the development of this field. However, there is not a benchmark dataset. In this paper, we develop a TIR pedestrian tracking dataset for the TIR pedestrian tracker evaluation. The dataset includes 60 thermal sequences with manual annotations. Each sequence has nine attribute labels for the attribute based evaluation. In addition to the dataset, we carry out the large-scale evaluation experiments on our benchmark dataset using nine publicly available trackers. The experimental results help us understand the strengths and weaknesses of these trackers. In addition, in order to gain more insight into the TIR pedestrian tracker, we divide its functions into three components: feature extractor, motion model, and observation model. Then, we conduct three comparison experiments on our benchmark dataset to validate how each component affects the tracker’s performance. The findings of these experiments provide some guidelines for future research.

Download paper here and Code and Dataset

Citation

If you use the code or dataset, please consider citing our paper.

@article{PTB-TIR,
  title={PTB-TIR: A thermal infrared pedestrian tracking benchmark},
  author={Liu, Qiao and He, Zhenyu and Li, Xin and Zheng, Yuan},
  journal={IEEE Transactions on Multimedia},
  volume={22},
  number={3},
  pages={666--675},
  year={2019}
}