Skip to content

fix: stop merged KV caches being silently discarded on transformers >= 4.57 - #2314

Open
jeojdi1 wants to merge 1 commit into
MemTensor:mainfrom
jeojdi1:fix/merged-kv-cache-reports-zero-length
Open

fix: stop merged KV caches being silently discarded on transformers >= 4.57#2314
jeojdi1 wants to merge 1 commit into
MemTensor:mainfrom
jeojdi1:fix/merged-kv-cache-reports-zero-length

fix: stop merged KV caches being silently discarded on transformers >…

893d4b9
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar