Gazing at Social Interactions Between Foraging and Decision Theory

Alessandro D'Amelio¹, Giuseppe Boccignone¹
¹ PHuSe Lab - Dipartimento di Informatica, Università degli Studi di Milano

Paper D'Amelio, A., & Boccignone, G. (2021). Gazing at social interactions between foraging and decision theory. Frontiers in Neurorobotics, 15, 31.

Requirements

pip install -r requirements.txt

Executing the demo

To simulate from the model:

1. Do speaker identification and build face maps:

#sh build_face_maps.sh path/to/video vidName path/to/output
sh build_face_maps.sh data/videos/012.mp4 012 speaker_detect/output/

2. Run the follwing command (it is assumed that low-level saliency maps (see Credits) are already computed, if you want to compute it on your own, you may want to use something like this)

python3 start_simulation.py

Credits

• Data: FindWhoToLookAt --->Repo, Paper

• Speaker Detection Pipeline: SyncNet ---> Repo, Paper

• Space-time Visual Saliency Detection: Code, Paper

Reference

If you use this code, please cite the paper:

@article{d2021gazing,
  title={Gazing at social interactions between foraging and decision theory},
  author={D'Amelio, Alessandro and Boccignone, Giuseppe},
  journal={Frontiers in Neurorobotics},
  volume={15},
  pages={31},
  year={2021},
  publisher={Frontiers}
}