The BAD Dataset for Failure Detection in HRI
Bremers, A., Parreira, M.T., Fang, X., Friedman, N., Ramirez-Aristizabal, A., Pabst, A., Spasojevic, M., Kuniavsky, M. and Ju, W., 2023. The Bystander Affect Detection (BAD) Dataset for Failure Detection in HRI. arXiv preprint arXiv:2303.04835.
Read our paper Download a preview of the BAD Dataset Request access to the full BAD Dataset by contacting QDRA dataset of bystander facial reactions to human and robot failures.
We introduce the Bystander Affect Detection dataset – a dataset of videos of bystander reactions to videos of failures. This dataset includes 2452 human reactions to failure, collected in contexts that approximate “in-the-wild” data collection – including natural variances in webcam quality, lighting, and background.
Our video dataset may be requested for use in related research projects. As the dataset contains facial video data of our participants, access can be requested along with the presentation of a research protocol or data use agreement that protects participants.
This project is part of a collaborative research effort between Cornell Tech (PI: Associate Professor Wendy Ju) and Accenture Labs.
Read our paper here: link.
Request access to the BAD dataset by sending a message via the button “Contact Owner” through the Qualitative Data Repository (best accessible through Google Chrome): link.
Dataset characteristics
The BAD Dataset covers:
- 54 globally sampled participants
- reactions to 46 stimulus videos
Dataset preview
We provide a preview of the dataset by sharing the individual reaction videos to one stimulus video. This sample contains 53 reactions to QID106, which was a video of a man playing guitar with a part of the guitar breaking off. The full BAD dataset contains the reaction videos to all 46 stimulus videos.
Download the dataset preview here: link.
How to cite our work
Our paper has now been published at IROS:
Bremers, A., Parreira, M.T., Fang, X., Friedman, N., Ramirez-Aristizabal, A., Pabst, A., Spasojevic, M., Kuniavsky, M. and Ju, W., 2023. The Bystander Affect Detection (BAD) Dataset for Failure Detection in HRI. 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Detroit, MI, USA, 2023, pp. 11443-11450, doi: 10.1109/IROS55552.2023.10342442.
Our BAD dataset can be cited using its Qualitative Data Repository citation:
Bremers, Alexandra; Fang, Xuanyu; Friedman, Natalie; Ju, Wendy. 2023. “Data for: The Bystander Affect Detection (BAD) Dataset for Failure Detection in HRI”. Qualitative Data Repository. https://doi.org/10.5064/F6TAWBGS. QDR Main Collection. V1
For questions, please contact us! E-mail Alexandra Bremers: awb227@cornell.edu