Evaluate a Question Quality

[JolanThomassin]

We tried using LLM to check how good our questions were, wanting to see if they were suitable for use or not.

The aim here is to see if we can find a method to check how good a question or a sentence is.

Issue posted by @rngadam in #47 (comment)

[JolanThomassin]

The QnA appears to be good, but occasionally, the questions are off-topic. The QnA generation seems to be functioning correctly; however, the issue lies with the initial document we receive. I'll attempt to obtain a full page instead of a smaller chunk to check if we can get better results.

[rngadam]

The QnA appears to be good, but occasionally, the questions are off-topic. The QnA generation seems to be functioning correctly; however, the issue lies with the initial document we receive. I'll attempt to obtain a full page instead of a smaller chunk to check if we can get better results.

the approach should instead use score to filter scores