Skip to content

Hybrid CUDA library tasks for single-token decode: parity, not a win — measured findings + llama.logitsLib switch#131

Open
mikepapadim wants to merge 1 commit into
beehive-lab:feat/mma_cudafrom
mikepapadim:feat/hybrid-decode-libs
Open

Hybrid CUDA library tasks for single-token decode: parity, not a win — measured findings + llama.logitsLib switch#131
mikepapadim wants to merge 1 commit into
beehive-lab:feat/mma_cudafrom
mikepapadim:feat/hybrid-decode-libs

Hybrid-library logits matvec experiment (llama.logitsLib=jit|gemmEx|l…

e23efe7
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs