S3A Person Tracking datasets and resources

Updated: 18 November 2015
Contact people: Teo de Campos and Qingju Liu

This page includes data that enables the reproduction of results of the papers below, and it is indexed with DOI 10.15126/surreydata.00807708

Before downloading any material from this page, please ensure that you have filled in the registration form and agreed to its terms.

Dataset


Head Tracking Data Format

Data description for the above two sequences, which are both in Matlab format:
Each mat file contains two parts:
1 allTimeStamp: time stamp for each depth frame, with or without a person being tracked
2 headPoses: head tracking results, each row represents one frame in the folloing format
 	[time_stamp person_ID good_head x y z  Qr Qx Qy Qz]

Related publications


Person tracking using audio and depth cues

PDF

The four sequences in VML Kinect and binural recordings were used.

Bibtex entry

@InProceedings{liu_etal_iccvw2015,
  author = 	 {Qingju Liu and Teofilo {de Campos} and Wenwu Wang and Philip Jackson and Adrian Hilton},
  title = 	 {Person tracking using audio and depth cues},
  booktitle = 	 {Proceedings of the {ICCV} Workshop on {3D} Reconstruction and Understanding with Video and Sound},
  year = 	 {2015},
  address = 	 {Santiago, Chile},
  month = 	 {December 17},
  publisher = 	 {{IEEE}},
  url = 	 {www.vis.uky.edu/~song/AVS},
  doi = 	 {10.1109/ICCVW.2015.97}
}

Demos

Single speaker tracking



Two speakers tracking


Identity Association using PHD Filters in Multiple Head Tracking with Depth Sensors

PDF

Sequence 3 (VML_MF_rectangle) in VML recordings and Sequence 1 (VisLab_random) in VisLab Kinect recordings were used.

Source code

Bibtex entry

@InProceedings{liu_etal_icassp2016,
  author = 	 {Qingju Liu and Teofilo {de Campos} and Wenwu Wang and Adrian Hilton},
  title = 	 {Identity Association using PHD Filters in Multiple Head Tracking with Depth Sensors},
  booktitle = 	 {Proceedings of the {ICASSP}},
  year = 	 {2016},
  address = 	 {Shanghai, China},
  month = 	 {20-25 March},
  publisher = 	 {{IEEE}},
  doi = 	 {10.1109/ICASSP.2016.7471928},
  url = 	 {http://www.icassp2016.org/Papers/ViewPapers_MS.asp?PaperNum=3519},
}

Multiple Speaker Tracking in Spatial Audio via PHD Filtering and Depth-Audio Fusion

All VML sequences were used.

Bibtex entry

@Article{liu_etal_journal2017,
  author = 	 {Qingju Liu and Wenwu Wang and Teofilo {de Campos} and Philip Jackson and Adrian Hilton},
  title = 	 {Multiple Speaker Tracking in Spatial Audio via PHD Filtering and Depth-Audio Fusion},
  journal =      {Preprint under review},
  year = 	 {2017},
}

Demo