Skip to content

llama : custom attention mask + parallel decoding + no context swaps#3228

Merged
ggerganov merged 57 commits into
masterfrom
custom-attention-mask
Sep 28, 2023
Merged

llama : custom attention mask + parallel decoding + no context swaps#3228
ggerganov merged 57 commits into
masterfrom
custom-attention-mask

server : avoid context swaps by shifting the KV cache

c5650ed
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs