Test prefill prompt with Anthropic models

[nkkko]

When using models that enable pre-filling, like Anthropic, we should try pre-filling the outputs:
https://docs.anthropic.com/en/docs/build-with-claude/prompt-engineering/prefill-claudes-response

This needs #10 to be solved first.

[nkkko]

/bounty $20

[algora-pbc]

💎 $20 bounty • Daytona

Steps to solve:

1. Start working: Comment /attempt #28 with your implementation plan
2. Submit work: Create a pull request including /claim #28 in the PR body to claim the bounty
3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

If no one is assigned to the issue, feel free to tackle it, without confirmation from us, after registering your attempt. In the event that multiple PRs are made from different people, we will generally accept those with the cleanest code.

Please respect others by working on PRs that you are allowed to submit attempts to.

e.g. If you reached the limit of active attempts, please wait for the ability to do so before submitting a new PR.

If you can not submit an attempt, you will not receive your payout.

Thank you for contributing to daytonaio/devcontainer-generator!

Add a bounty • Share on socials

Attempt	Started (GMT+0)	Solution
🟢 @madman024	Oct 10, 2024, 7:51:22 PM	WIP

[madman024]

/attempt #28
Hey, I've got a plan for implementing prefill support across our LLM providers, focusing on Anthropic's Claude models initially. Here's how we can tackle this:
Prefill Support Implementation Plan

Adding prefill support will give us way more control over our devcontainer.json generation. It'll help us:
Get more consistent, structured outputs
Skip unnecessary preambles
Guide the model to follow our exact formatting needs

Options

• Cancel my attempt