New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add dynamic evaluation to LSTM baseline #21

Open

larocheh opened this issue Jun 27, 2018 · 0 comments

larocheh commented Jun 27, 2018

This approach is described here:

https://arxiv.org/abs/1709.07432

In our setting, we would like consider 2 ways of doing dynamic evaluation

Ignore the support set at evaluation time and only do dynamic evaluation when going over the query set
Do a pass on the support set with dynamic evaluation, before doing dynamic evaluation on query set. However, we only report the NLL for the query set.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment