All issues

Search results

Migrate qwen3 onto openinfer-kv-store (retire the remote-fetch state machine)

Status: Open.

#828 In pegainfer-project/pegainfer;

· xiaguan opened on Aug 2, 2026

kv-store: unified KV cache orchestration — design + migration tracking

Status: Open.

#824 In pegainfer-project/pegainfer;

· xiaguan opened on Aug 2, 2026

glm52: two NCCL copies in one process corrupt the TP4 prefill comm (missing libnccl.so symlink in shared lib dir)

Status: Open.

#810 In pegainfer-project/pegainfer;

· xiaguan opened on Aug 1, 2026

gemma4: define the KV cache contract for the two attention groups

Status: Open.

#807 In pegainfer-project/pegainfer;

· FeathBow opened on Jul 31, 2026

glm52: session-affinity / cache-aware decode routing for wide EP fleets

Status: Open.

#806 In pegainfer-project/pegainfer;

· xiaguan opened on Jul 31, 2026

GLM5.2 free-running EP: coordinate shutdown across rank engines

Status: Open.

#796 In pegainfer-project/pegainfer;

· xiaguan opened on Jul 31, 2026

GLM5.2: enable prefix caching with speculative decoding (persist drafter state)

enhancementNew feature or requestNew feature or request

Status: Open.

#792 In pegainfer-project/pegainfer;

· xiaguan opened on Jul 30, 2026

[tracing] Migrate router→engine trace join from X-Request-Id stash to upstream vllm-server trace_headers

Status: Open.

#790 In pegainfer-project/pegainfer;

· xiaguan opened on Jul 30, 2026

GLM5.2 P/D: apply backpressure when RDMA fetch staging memory is temporarily exhausted

staleAutomatically marked after inactivityAutomatically marked after inactivity

Status: Open.

#782 In pegainfer-project/pegainfer;

· xiaguan opened on Jul 29, 2026

GLM5.2 P/D: distribute TP4 prefill KV publishing beyond rank 0

staleAutomatically marked after inactivityAutomatically marked after inactivity

Status: Open.

#781 In pegainfer-project/pegainfer;

· xiaguan opened on Jul 29, 2026

qwen3: PerToken decode-graph memory grows linearly with batch bucket and is not budgeted

help wantedExtra attention is neededExtra attention is needed

hw:1-gpuNeeds one consumer GPU to verifyNeeds one consumer GPU to verify

qwen3Qwen3-4B model crate (pegainfer-qwen3-4b)Qwen3-4B model crate (pegainfer-qwen3-4b)

Status: Open.

#780 In pegainfer-project/pegainfer;

· xiaguan opened on Jul 29, 2026

design(pd): integrate OpenInfer P/D workers with Dynamo

staleAutomatically marked after inactivityAutomatically marked after inactivity

Status: Open.

#778 In pegainfer-project/pegainfer;

· xiaguan opened on Jul 28, 2026