Pandora Dataset

Head and Shoulder Pose Estimation

The dataset

Pandora has been specifically created for head center localization, head pose and shoulder pose estimation and is inspired by the automotive context. A frontal fixed device acquires the upper body part of the subjects, simulating the point of view of camera placed inside the dashboard. Subjects also perform driving-like actions, such as grasping the steering wheel, looking to the rear-view or lateral mirrors, shifting gears and so on.

Shoulder and Head angles

in addition to the head pose annotation, Pandora contains the ground truth data of the shoulder pose expressed as yaw, pitch and roll. Subjects perform wide head (70 roll, 100 pitch and 125 yaw) and shoulder (70 roll, 60 pitch and 60 yaw) movements.

Challenging camouflage

Garments as well as various objects are worn or used by the subjects to create head and/or shoulder occlusions. For example, people wear prescription glasses, sun glasses, scarves, caps, and manipulate smartphones, tablets or plastic bottles.



Pandora features



Deep oriented: Pandora contains more than 250k full resolution RGB (1920x1080 pixels) and depth images (512x424) with the corresponding annotation; 110 annotated sequences using 10 male and 12 female actors. Each subject has been recorded five times.

Time-of-Flight data: a Microsoft Kinect One device is used to acquire depth data, with a better quality than other datasets created with the first Kinect version, as reported in the paper.

Data: each frame of the dataset is composed of the RGB appearance image, the corresponding depth map, the 3D coordinates of the skeleton joints corresponding to the upper body part, including the head center and the shoulders positions. For convenience's sake, the 2D coordinates of the joints on both color and depth frames are provided as well as the head and shoulder pose angles with respect to the camera reference frame. Shoulder angles are obtained through the conversion to Euler angles of a corresponding rotation matrix.

Click here to see readme file about Pandora data.

Accepted at CVPR 2017!


The paper "POSEidon: Face-from-Depth for Driver Pose Estimation " has been accepted in CVPR 2017, that will take place at the Hawaii Convention Center from July 21 to July 26, 2017 in Honolulu, Hawaii.

DOWNLOAD

To download the dataset, we require to send an email. This will help us to keep in touch in case errors are found or as updates become available.
Dataset download (about 300 GB) is provided through SFTP connection, so please install a free SFTP client like FileZilla.

Human face is very personal, we only send the data to approved researchers. You need to be a representative for your organization (students are not accepted) and use your official email address in the organization in order to request for the Pandora dataset.
To obtain a copy of the dataset, please send an email to guido.borghi[at]unimore[dot]it stating:
1. Your name, title and affilation 2. Your intended use of the data 3. The following statement:
You are hereby given permission to copy this data in electronic or hardcopy form for your own scientific use and to distribute it for scientific use to colleagues within your research group. Inclusion of rendered images or video made from this data in a scholarly publication (printed or electronic) is also permitted. In this case, credit must be given to the publication. However, the data may not be included in the electronic version of a publication, nor placed on the Internet. These restrictions apply to any representations (other than images or video) derived from the data, including but not limited to simplifications, remeshing, and the fitting of smooth surfaces. The making of physical replicas this data is prohibited, and the data may not be distributed to students in connection with a class. For any other use, including distribution outside your research group, written permission is required. Any commercial use of the data is prohibited. Commercial use includes but is not limited to sale of the data, derivatives, replicas, images, or video, inclusion in a product for sale, or inclusion in advertisements (printed or electronic), on commercially-oriented web sites, or in trade shows.


An email will be sent to you with the instruction to get the dataset.

POSEidon Framework


Click here to view details about POSEidon: Face-from-Depth for Driver Pose Estimation.

[Work in progress]


THANKS FOR YOUR SUPPORT




Contact Information

Dipartimenti di Ingegneria Enzo Ferrari (DIEF)
Via Pietro Vivarelli, 10
guido.borghi[at]unimore.it
marco.venturelli[at]unimore.it

Acknowledgments

Special thanks to: Francesca, Chiara, Claretta, Sara, Silvia, Rebecca, Giorgia, Patrizia, Marcella, Chiara, Silvia, Giulia, Riccardo, Elia, Lorenzo, Niccolo, Andrea, Roberto, Fabrizio and Federico

Citations

We believe in open research and we are happy if you find this data useful.
If you use it, please cite our work.

							@inproceedings{borghi17cvpr,
							  title = {POSEidon: Face-from-Depth for Driver Pose Estimation},
							  author = {Borghi, Guido and Venturelli, Marco and Vezzani, Roberto and Cucchiara, Rita},
							  booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
							  year = {2017}
							}
							

Created by BlackTie.co - Copyright 2014