Skip to content

what do we want to do in this situation? #522

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
mircealungu opened this issue Sep 9, 2024 · 4 comments
Open

what do we want to do in this situation? #522

mircealungu opened this issue Sep 9, 2024 · 4 comments

Comments

@mircealungu
Copy link
Member

mircealungu commented Sep 9, 2024

in a typing exercise, I typed "give up", although the correct answer was "abandon" cf. to our bookmark. so i got "wrong" for the exercise, although I was actually right.

image

we have to think about the implications of this.

@tfnribeiro
Copy link
Contributor

To follow up on the discussion from yesterday - this is always a problem with free text, what do we do when a user writes a Synonym?

In our discussion, I mentioned embeddings, but these also have a side-effect of antonyms usually have similar contexts surrounding them so that could also be dangerous - this would also be true for a perplexity model. So in these cases "the safest" would be to allow a user to add their own extra meaning and check against those values.

@tfnribeiro
Copy link
Contributor

I want to add to this discussion because I have also encountered it a few times, where I have to translate to English and I end up writing a synonym e.g. "antyder" translated to "suggests" and I wrote "implies" resulting in a wrong answer. This can feel bad for a user, but I think maybe we should wait to see if the user does the association of word - translation a few times before having to type then there's less "recall" work, at least that is my intuition.

Another point I wanted to add is that it might be fine to still say it wrong - at some point, I do get into the rhythm and then I do remember it is suggest rather than implies - so it might not be as negative as first expected.

@mircealungu
Copy link
Member Author

I agree with your observation that we maybe should wait for a bit.

For myself, I have actually learned that opgive has the meaning of abandon besides the one (that I had guessed!) of give up exactly because of the typing exercise. The solution might be for now to make the message more mellow? Instead of "the correct answer is" we should say something like "the saved translation for this word is"...?

@tfnribeiro
Copy link
Contributor

But we don't say anything about being wrong - we just show the translation word. Only in the congratulations screen does it say incorrect words.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants