Skip to content

Latest commit

 

History

History
26 lines (19 loc) · 2 KB

complexwebquestions.md

File metadata and controls

26 lines (19 loc) · 2 KB

ComplexWebQuestions

ComplexWebQuestions[1] is a famous extension of the WebQuestions dataset, introduced to solve the second issue of few complex multi-relational questions in the WebQuestions. It is created by adding more constraints and multi-hop relations into the SPARQL queries from WebQuestionsSP, and then automatically generating questions via templates and Amazon Mechanic Turk.

This dataset can be downloaded via the link.

Leaderboard

Year Type F1 Acc Reported by Official Repo
2021 IR-based - 47.4 Feng. et al Repo
2021 IR-based - 48.8 He. et al Repo
2020 SP-based 40.4 - Lan. et al Repo
2019 SP-based 33.9 - Bhutani. et al -
2019 SP-based 31.6 - Sun. et al -
2019 IR-based - 45.9 Sun. et al -
2018 IR-based - 32.8 Sun. et al Repo
2016 IR-based - 21.1 H. Miller. et al -

References

[1] Talmor, Alon, and Jonathan Berant. The web as a knowledge-base for answering complex questions. arXiv preprint arXiv:1803.06643 (2018).

Go back to the README