Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

build(deps): Bump llama-cpp-python[server] from 0.2.79 to 0.2.88 #46

Closed
wants to merge 5 commits into from
Closed

build(deps): Bump llama-cpp-python[server] from 0.2.79 to 0.2.88 #46

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
3523c65
build(deps): Bump llama-cpp-python[server] from 0.2.79 to 0.2.88
dependabot[bot] Aug 14, 2024
69f414a
fix: update Vulkan flag
jeffmaury Aug 20, 2024
3ec5282
fix: llama.cpp vulkan now requires glslc
jeffmaury Aug 20, 2024
2728c6f
fix: add missing lib for Vulkan AMD64
jeffmaury Aug 20, 2024
687688d
fix: skip tests
jeffmaury Aug 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion chat/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
llama-cpp-python[server]==0.2.79
llama-cpp-python[server]==0.2.88
pip==24.2
15 changes: 13 additions & 2 deletions chat/vulkan/amd64/Containerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,13 +24,24 @@ RUN dnf install -y python3-dnf-plugin-versionlock && \
dnf install -y https://dl.fedoraproject.org/pub/epel/epel-release-latest-9.noarch.rpm && \
dnf install -y git cmake ninja-build gcc gcc-c++ && \
dnf copr enable -y ligenix/enterprise-sandbox epel-9-x86_64 && \
dnf install -y vulkan-headers vulkan-tools && \
dnf install -y vulkan-headers vulkan-tools vulkan-loader-devel && \
dnf clean all

WORKDIR /locallm
RUN git clone https://github.com/google/shaderc
WORKDIR shaderc
RUN ./utils/git-sync-deps
WORKDIR build
RUN cmake -GNinja \
-DCMAKE_BUILD_TYPE=Release \
-DSHADERC_SKIP_TESTS=ON \
-DCMAKE_INSTALL_PREFIX=/usr/local \
.. \
&& ninja install
WORKDIR /locallm
COPY requirements.txt ./
RUN pip install --upgrade pip
ENV CMAKE_ARGS="-DLLAMA_VULKAN=on"
ENV CMAKE_ARGS="-DGGML_VULKAN=on"
ENV FORCE_CMAKE=1
RUN pip install --target=/locallm --no-cache-dir --upgrade -r requirements.txt

Expand Down
13 changes: 12 additions & 1 deletion chat/vulkan/arm64/Containerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,9 +27,20 @@ https://dl.fedoraproject.org/pub/epel/epel-release-latest-9.noarch.rpm && \
dnf versionlock mesa-vulkan-drivers-23.3.3-101.el9.aarch64 && \
dnf install -y git cmake ninja-build gcc gcc-c++ vulkan-loader-devel vulkan-tools && \
dnf clean all
RUN git clone https://github.com/google/shaderc
WORKDIR shaderc
RUN ./utils/git-sync-deps
WORKDIR build
RUN cmake -GNinja \
-DCMAKE_BUILD_TYPE=Release \
-DSHADERC_SKIP_TESTS=ON \
-DCMAKE_INSTALL_PREFIX=/usr/local \
.. \
&& ninja install
WORKDIR /locallm
COPY requirements.txt ./
RUN pip install --upgrade pip
ENV CMAKE_ARGS="-DLLAMA_VULKAN=on"
ENV CMAKE_ARGS="-DGGML_VULKAN=on"
ENV FORCE_CMAKE=1
RUN pip install --target=/locallm --no-cache-dir --upgrade -r requirements.txt

Expand Down