Implement Efficient Optimization of Context Window Content

[nkkko]

Is your feature request related to a problem? Please describe.
When generating the devcontainer.json, the current approach might not effectively utilize the context window of the selected LLM provider, which can lead to truncated or incomplete analysis of repository content. This is especially important with large repositories where including all files in the context window is impractical.

Describe the solution you'd like

• Implement a priority list to include critical files like README.md, contributing.md, and other key project files first.
• Use additional LLM requests to summarize larger files before including them in the context.
• Implement chunking of file content based on token limits to ensure efficient utilization of the LLM context window.
• Optimize the logic to dynamically adjust the context window content based on the length constraints of the selected LLM provider.

Additional context
This feature will enhance the accuracy and completeness of the generated devcontainer.json by ensuring that the most relevant information from the repository is analyzed within the allowed context window. This implementation should include:

1. Reading and integrating key files like README.md, contributing.md, etc., with the highest priority.
2. Summarizing larger files through additional LLM requests before including them in the context.
3. Efficiently chunking content per token limits specific to the LLM provider's context window.

Ensure thorough testing to confirm that the implementation correctly prioritizes, summarizes, and chunks content while efficiently using the context window.

[nkkko]

/bounty $20

[algora-pbc]

💎 $20 bounty • Daytona

Steps to solve:

1. Start working: Comment /attempt #11 with your implementation plan
2. Submit work: Create a pull request including /claim #11 in the PR body to claim the bounty
3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

If no one is assigned to the issue, feel free to tackle it, without confirmation from us, after registering your attempt. In the event that multiple PRs are made from different people, we will generally accept those with the cleanest code.

Please respect others by working on PRs that you are allowed to submit attempts to.

e.g. If you reached the limit of active attempts, please wait for the ability to do so before submitting a new PR.

If you can not submit an attempt, you will not receive your payout.

Thank you for contributing to daytonaio/devcontainer-generator!

Add a bounty • Share on socials