Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Explore fine tuning #9

Open
krosenfeld-IDM opened this issue Nov 26, 2024 · 2 comments
Open

Explore fine tuning #9

krosenfeld-IDM opened this issue Nov 26, 2024 · 2 comments

Comments

@krosenfeld-IDM
Copy link
Collaborator

No description provided.

@krosenfeld-IDM krosenfeld-IDM changed the title explore fine tuning Explore fine tuning Nov 26, 2024
@krosenfeld-IDM
Copy link
Collaborator Author

Can we use a fine-tuned model to help assess the final code? This would help us compare/assess various methodologies

Fine tune the model on the target version by providing code snippets. Maybe something like:

<code: method or class or example usage>
This code correctly <summary constructed from docstring>

It would be interesting to see whether we could also provide bad code examples.

@krosenfeld-IDM
Copy link
Collaborator Author

aiming for 50-100 examples. some with correct answers, some with incorrect answers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant