Skip to content

fix: stop get_cache handing out the stored KV cache by reference - #2303

Open
jeojdi1 wants to merge 2 commits into
MemTensor:mainfrom
jeojdi1:fix/kv-cache-mutated-in-place-by-generate
Open

fix: stop get_cache handing out the stored KV cache by reference#2303
jeojdi1 wants to merge 2 commits into
MemTensor:mainfrom
jeojdi1:fix/kv-cache-mutated-in-place-by-generate

refactor: drop unused torch import from _copy_cache

a8b1bbf
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs