Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added new SSP-3D Dataset to DagsHub #19

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
37 changes: 37 additions & 0 deletions SSP-3D/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# SSP-3D_Sports_Shape_and_Pose_Datatset

### Paper: [Synthetic Training for Accurate 3D Human Pose and Shape Estimation in the Wild](https://arxiv.org/pdf/2009.10013v2.pdf)
### DagsHub Repository: [SSP-3D_Sports_Shape_and_Pose_Datatset](https://dagshub.com/Rutam21/SSP-3D_Sports_Shape_and_Pose_Datatset)

![DagsHub Hacktoberfest Cover](https://user-images.githubusercontent.com/66431403/192983164-b3d6d556-ac69-4fb8-8aef-726a4386406a.png)

## About
SSP-3D is an evaluation dataset consisting of 311 images of sportspersons in tight-fitted clothes, with a variety of body shapes and poses. The images were collected from the [Sports-1M dataset](https://cs.stanford.edu/people/karpathy/deepvideo/). SSP-3D is intended for use as a benchmark for body **shape** prediction methods. Pseudo-ground-truth 3D shape labels (using the SMPL body model) were obtained via multi-frame optimisation with shape consistency between frames (as described in the paper above). The figure above shows a few samples from the SSP-3D dataset (under 'Optimised Pose and Shape') as well as a comparison with pre-optimised body predictions (using [VIBE](https://github.com/mkocabas/VIBE)), which demonstrates the improvement in body model fit achieved using optimisation.

## Data
Since SSP-3D **[This Dataset is already uploaded in this repository.]** is a small dataset, the zip file containing all the necessary data is a part of this [repository](https://github.com/akashsengupta1997/SSP-3D). Unzipping it will reveal a folder with images, a folder with silhouette annotations and a file called `labels.npz`. This file contains arrays with filenames, SMPL pose parameters, SMPL shape parameters, genders, 2D joint annotations, camera translations and bounding boxes for each image.

## Code
We provide a python3 script `visualisation.py` that demonstrates how to project/render/visualise all the relevant data. To run the script, you will need to install the relevant libraries: `pip install requirements.txt`. If you have trouble install `pyrender`, please take a look at the [docs](https://pyrender.readthedocs.io/en/latest/install/index.html).

Additionally, please download the [SMPL male and female models](http://smpl.is.tue.mpg.de). You will need to convert the SMPL model files to be compatible with python3 by removing any chumpy objects. To do so, please follow the instructions [here](https://github.com/vchoutas/smplx/tree/master/tools). Rename the models to `SMPL_MALE.pkl` and `SMPL_FEMALE.pkl`. Finally, set `SSP_3D_PATH` in `config.py` to the SSP-3D root directory path. Set `SMPL_MODEL_DIR` to the path of the directory with the SMPL models.

After completing set-up, run `python visualisation.py`.

## Metrics
This dataset is intended for use as a body shape evaluation benchmark. If you decide to use this dataset, we recommend you report the following metrics:
- mIOU: mean Intersection-over-Union between target silhouette and predicted SMPL silhouette.
- PVE-T-SC (mm): per-vertex error in a neutral pose (T-pose) after after scale-correction (to account for scale vs camera depth ambiguity).
- An example of how to compute this metric given predicted in `metrics.py`.

## Citations
If you find this dataset useful for your research, please cite the following publication:
```
@InProceedings{STRAPS2018BMVC,
author = {Sengupta, Akash and Budvytis, Ignas and Cipolla, Roberto},
title = {Synthetic Training for Accurate 3D Human Pose and Shape Estimation in the Wild},
booktitle = {British Machine Vision Conference (BMVC)},
month = {September},
year = {2020}
}
```