Feature: Add Bitdeer AI model api provider #9362
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
litellm/main.py
Outdated
| @@ -1666,6 +1666,7 @@ def completion( # type: ignore # noqa: PLR0915 | |||
| or custom_llm_provider == "mistral" | |||
| or custom_llm_provider == "openai" | |||
| or custom_llm_provider == "together_ai" | |||
| or custom_llm_provider == "bitdeerai" | |||
There was a problem hiding this comment.
Please just update __init__.py and register this as an openai_compatible_provider
There was a problem hiding this comment.
removed this, already add biteerai to openai_compatible_provider
litellm/main.py
Outdated
| or get_secret("BITDEERAI_API_BASE") | ||
| or "https://api-inference.bitdeer.ai/v1" | ||
| ) | ||
| model_response = openai_like_chat_completion.completion( |
There was a problem hiding this comment.
please use base_llm_http_handler.completion instead
There was a problem hiding this comment.
remove this, add to openai_compatible_provider
| ] | ||
|
|
||
| if sync_mode: | ||
| response = completion( |
There was a problem hiding this comment.
please mock these tests
There was a problem hiding this comment.
fixed, already add mock test
|
|
||
| @pytest.mark.asyncio | ||
| @pytest.mark.parametrize("sync_mode", [True, False]) | ||
| async def test_chat_completion_bitdeerai_stream(sync_mode): |
There was a problem hiding this comment.
same here - please mock this
There was a problem hiding this comment.
fixed, already add mock test
tests/test_bitdeerai.py
Outdated
|
|
||
| from litellm import completion, acompletion, embedding, aembedding, EmbeddingResponse | ||
|
|
||
| @pytest.mark.parametrize("sync_mode", [True, False]) |
There was a problem hiding this comment.
why does this file exist at the root?
There was a problem hiding this comment.
move thie file to local_testing folder
Title
Feature: Add Bitdeer AI model api provider
Relevant issues
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/litellm/directory, Adding at least 1 test is a hard requirement - see detailsmake test-unit)[https://docs.litellm.ai/docs/extras/contributing_code]Type
🆕 New Feature
Changes
Screenshots for test:
