WebQuestionsSP[1] is the annotated version of WebQuestions, which contains questions that require a 1 or 2-hop relation path to arrive at the answer entity. More specifically, about 40% of the questions require a 2-hop relation to reach the answer. Freebase is its backgound KB. Originally, it splits into 3,298 questions as train set and 1,639 questions as test set.
This dataset can be downloaded via the link.
| Year | Type | F1 | Acc | Reported by | Official Repo |
|---|---|---|---|---|---|
| 2022 | IR-based | - | 83.2 | Zhang. et al | Repo |
| 2021 | IR-based | - | 68.6 | Feng. et al | Repo |
| 2021 | IR-based | - | 74.3 | He. et al | Repo |
| 2020 | SP-based | 72.0 | - | Hua. et al | Repo |
| 2020 | SP-based | 63.7 | - | Zhu. et al | - |
| 2020 | SP-based | 74.0 | - | Lan. et al | Repo |
| 2020 | IR-based | - | 68.4 | Han. et al | Repo |
| 2020 | IR-based | - | 66.6 | Saxena. et al | Repo |
| 2019 | IR-based | - | 68.1 | Sun. et al | - |
| 2019 | IR-based | - | 67.2 | Xiong. et al | Repo |
| 2019 | SP-based | 82.9 | - | Saha. et al | - |
| 2019 | SP-based | 60.3 | - | Bhutani. et al | - |
| 2019 | SP-based | - | 82.6 | Chen. et al | - |
| 2018 | IR-based | - | 66.4 | Sun. et al | Repo |
| 2017 | SP-based | 69.0 | - | Liang. et al | Repo |
| 2016 | SP-based | 66.8 | - | Yih. et al | - |
| 2016 | IR-based | - | 46.7 | H. Miller. et al | - |
[1] Yih, Wen-tau, Matthew Richardson, Christopher Meek, Ming-Wei Chang, and Jina Suh. The value of semantic parse labeling for knowledge base question answering. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 201-206. 2016.