-
Notifications
You must be signed in to change notification settings - Fork 5.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add llm integration with Intel Gaudi in llama-index-llms-gaudi #16308
Conversation
@jeanyu-habana can you run |
llama-index-integrations/llms/llama-index-llms-gaudi/llama_index/llms/gaudi/base.py
Outdated
Show resolved
Hide resolved
llama-index-integrations/llms/llama-index-llms-gaudi/llama_index/llms/gaudi/base.py
Outdated
Show resolved
Hide resolved
llama-index-integrations/llms/llama-index-llms-gaudi/llama_index/llms/gaudi/utils.py
Outdated
Show resolved
Hide resolved
llama-index-integrations/llms/llama-index-llms-gaudi/llama_index/llms/gaudi/utils.py
Show resolved
Hide resolved
Ran "make lint" and fixed errors. |
Done. |
@logan-markewich Would you be able take another look at the changes made and let me know if previous comments can be resolved? I'd appreciate it. |
We added some checks for unit tests 😅 Would it be possible to add some? Could be similar to what I did here |
Actually, seems you escape the check for now |
Description
This PR adds Intel Gaudi support to the list of llama_index llm integration. This enables users to run llm locally on Intel Gaudi using llama_index modules.
Fixes # (issue)
N/A
New Package?
None
Did I fill in the
tool.llamahub
section in thepyproject.toml
and provide a detailed README.md for my new integration or package?Version Bump?
Did I bump the version in the
pyproject.toml
file of the package I am updating? (Except for thellama-index-core
package)Type of Change
Please delete options that are not relevant.
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
Suggested Checklist:
make format; make lint
to appease the lint gods