Skip to content

Latest commit

 

History

History
32 lines (19 loc) · 2.14 KB

metaqa.md

File metadata and controls

32 lines (19 loc) · 2.14 KB

MetaQA

MoviE Text Audio QA (MetaQA)[1] contains more than 400K questions for both single and multi-hop reasoning, and provides more realistic text and audio versions. MetaQA serves as a comprehensive extension of WikiMovies., in English language. Containing 400,000+ in Text, MP3 file format.

This dataset can be downloaded via the link.

Leaderboard

Year Type 1-hop 2-hop 3-hop Reported by Official Repo
F1 Acc F1 Acc F1 Acc
2021 IR-based - 97.3 - 99.9 - 98.9 He. et al Repo
2020 IR-based - 97.5 - 98.8 - 94.8 Saxena. et al Repo
2020 IR-based - 97.0 - 95.1 - 75.2 Qiu. et al -
2020 IR-based - 98.8 - 93.7 - - Sun. et al -
2019 IR-based - 97.0 - 99.9 - 91.4 Sun. et al -
2018 IR-based - 97.0 - 94.8 - 77.7 Sun. et al Repo
2017 IR-based - 97.5 - 89.9 - 62.5 Zhang. et al -
2016 IR-based - 96.2 - 82.7 - 48.9 H. Miller. et al -

References

[1] Zhang, Yuyu, Hanjun Dai, Zornitsa Kozareva, Alexander J. Smola, and Le Song. Variational reasoning for question answering with knowledge graph. In Thirty-Second AAAI Conference on Artificial Intelligence. 2018.

Go back to the README