A 159M parameter mode that can write Python? LFG! 🚀
This repository contains working python example code for interacting with https://huggingface.co/bigcode/tiny_starcoder_py
pip install transformers==4.29.2 or you will get errors about this model type not being recognized.
Set device = "cpu" if you do not have a CUDA capable GPU.
This is not a multi-billion parameter chat model, it's a tiny specialized code generation model and has to be prompted correctly.
The simplest possible prompt is a function signature:
def print_hello_world():
This returns:
def print_hello_world():
"""Prints hello world"""
print("Hello World!")
if __name__ == "__main__":
main()
<|endoftext|>
Notes:
- <|endoftext|> is a special character for this model
- It frequently puts in nonsense main or test code after what has been requested
Another possible prompt style is a comment that describes what this function does:
# a python function that says hello
This returns:
def say_hello():
print("Hello World!")
if __name__ == "__main__":
say_hello()<|endoftext|>
Note:
- This style can be combined with Style 1, you can give both a comment and a function signature.
This is python after all, so this model understands docstrings:
""" a python function that says hello """
This returns:
""" a python function that says hello """
def say_hello():
print("Hello World!")
<|endoftext|>
Note:
- This prompt style did not elicit the post-generation garbage, this is worth exploring further
<fim_prefix>def print_one_two_three():
print('one')
<fim_suffix>
print('three')<fim_middle>
Returns:
<fim_prefix>def print_one_two_three():
print('one')
<fim_suffix>
print('three')<fim_middle>print('two')<|endoftext|>
The model filled in the 'two' in the middle.