MoviE Text Audio QA (MetaQA)[1] contains more than 400K questions for both single and multi-hop reasoning, and provides more realistic text and audio versions. MetaQA serves as a comprehensive extension of WikiMovies., in English language. Containing 400,000+ in Text, MP3 file format.
This dataset can be downloaded via the link.
Year | Type | 1-hop | 2-hop | 3-hop | Reported by | Official Repo | |||
---|---|---|---|---|---|---|---|---|---|
F1 | Acc | F1 | Acc | F1 | Acc | ||||
2021 | IR-based | - | 97.3 | - | 99.9 | - | 98.9 | He. et al | Repo |
2020 | IR-based | - | 97.5 | - | 98.8 | - | 94.8 | Saxena. et al | Repo |
2020 | IR-based | - | 97.0 | - | 95.1 | - | 75.2 | Qiu. et al | - |
2020 | IR-based | - | 98.8 | - | 93.7 | - | - | Sun. et al | - |
2019 | IR-based | - | 97.0 | - | 99.9 | - | 91.4 | Sun. et al | - |
2018 | IR-based | - | 97.0 | - | 94.8 | - | 77.7 | Sun. et al | Repo |
2017 | IR-based | - | 97.5 | - | 89.9 | - | 62.5 | Zhang. et al | - |
2016 | IR-based | - | 96.2 | - | 82.7 | - | 48.9 | H. Miller. et al | - |
[1] Zhang, Yuyu, Hanjun Dai, Zornitsa Kozareva, Alexander J. Smola, and Le Song. Variational reasoning for question answering with knowledge graph. In Thirty-Second AAAI Conference on Artificial Intelligence. 2018.