Code

Compilade/cuda tq2 0#329

Code

Merged

Nexesenex merged 3 commits intoNexesenex:lcpp_pr_tq2_cudaNexesenex/croco.cpp:lcpp_pr_tq2_cudafrom ggml-org:compilade/cuda-tq2_0ggml-org/llama.cpp:compilade/cuda-tq2_0Copy head branch name to clipboardJan 17, 2025

+21-7

Commits

Commits on Jan 12, 2025

• ggml-cuda : slight optimizations for TQ2_0

  Show description for 946796f
  

  compilade

  and

  JohannesGaessler

  committed
  946796f

  Copy full SHA for 946796f

• ggml-metal : supports_op returns false for ternary types

  Show description for b6fc9f0
  compilade

  committed
  b6fc9f0

  Copy full SHA for b6fc9f0

• ggml-cuda : use i and j instead of i0 and i in vec_dot_tq2_0_q8_1

  compilade

  committed
  fbddb26

  Copy full SHA for fbddb26