Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How do you update the base_leaner's parameters #59

Open
xugy16 opened this issue Jul 1, 2022 · 3 comments
Open

How do you update the base_leaner's parameters #59

xugy16 opened this issue Jul 1, 2022 · 3 comments

Comments

@xugy16
Copy link

xugy16 commented Jul 1, 2022

Thank you for the code.

I have a question about the base_learner update.

  1. The base-learner is fast updated using 100 steps.
  2. then we return qry_logits and calculate the cross entropy loss for qry_set
  3. using sel.optimizer to update.

But what gradient is stored in base_learner? Because you use fast-model to calcualte qry loss

@yaoyao-liu
Copy link
Owner

Thanks for your interest in our work.

The fast model can be regarded as a function of the base learner. Thus, we can calculate the derivative of the query loss with respect to the base model. We update the base learner using Eq. 5 in our paper.

If you have any further questions, please feel free to contact me.

Best,

Yaoyao

@xugy16
Copy link
Author

xugy16 commented Jul 2, 2022

Really appreciate for the response.

So you are using 1st-Order MAML to update the classifier-head (base learner)?

@yaoyao-liu
Copy link
Owner

Yes. We use the first-order approximation MAML to update the FC classifier.

If you have any further questions, please do not hesitate to contact me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants