-
Notifications
You must be signed in to change notification settings - Fork 10
what do we want to do in this situation? #522
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
To follow up on the discussion from yesterday - this is always a problem with free text, what do we do when a user writes a Synonym? In our discussion, I mentioned embeddings, but these also have a side-effect of antonyms usually have similar contexts surrounding them so that could also be dangerous - this would also be true for a perplexity model. So in these cases "the safest" would be to allow a user to add their own extra meaning and check against those values. |
I want to add to this discussion because I have also encountered it a few times, where I have to translate to English and I end up writing a synonym e.g. "antyder" translated to "suggests" and I wrote "implies" resulting in a wrong answer. This can feel bad for a user, but I think maybe we should wait to see if the user does the association of word - translation a few times before having to type then there's less "recall" work, at least that is my intuition. Another point I wanted to add is that it might be fine to still say it wrong - at some point, I do get into the rhythm and then I do remember it is suggest rather than implies - so it might not be as negative as first expected. |
I agree with your observation that we maybe should wait for a bit. For myself, I have actually learned that opgive has the meaning of abandon besides the one (that I had guessed!) of give up exactly because of the typing exercise. The solution might be for now to make the message more mellow? Instead of "the correct answer is" we should say something like "the saved translation for this word is"...? |
But we don't say anything about being wrong - we just show the translation word. Only in the congratulations screen does it say incorrect words. |
in a typing exercise, I typed "give up", although the correct answer was "abandon" cf. to our bookmark. so i got "wrong" for the exercise, although I was actually right.
we have to think about the implications of this.
The text was updated successfully, but these errors were encountered: