Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add rewrite task #9

Open
Tracked by #8
faneshion opened this issue Feb 4, 2024 · 1 comment
Open
Tracked by #8

add rewrite task #9

faneshion opened this issue Feb 4, 2024 · 1 comment
Assignees
@youngbeauty250
Labels
enhancement New feature or request
Milestone
Version 0.1

Comments

@faneshion
Copy link
Collaborator

faneshion commented Feb 4, 2024 •
edited
Loading

The rewrite task is to convert each input question into a list of queries, which are more friendly to search systems.
@faneshion faneshion mentioned this issue Feb 4, 2024
Open
6 tasks
@faneshion faneshion added the enhancement New feature or request label Feb 4, 2024
@faneshion faneshion added this to the Version 0.1 milestone Feb 6, 2024
@faneshion faneshion changed the title add query rewriting benchmark add query rewriting task Feb 23, 2024
@faneshion faneshion changed the title add query rewriting task add rewrite task Feb 23, 2024
@youngbeauty250
Copy link
Collaborator

There is almost no direct evaluation for rewriting. Most of it is done indirectly using search metrics such as NDCG and Recall and answer metrics such as Accuracy to assess rewriting. So what do we do with the results of external searches?

@youngbeauty250 youngbeauty250 self-assigned this Feb 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@youngbeauty250 youngbeauty250

Labels
enhancement New feature or request
Projects
None yet
Milestone
Version 0.1
Development

No branches or pull requests
2 participants
@faneshion @youngbeauty250