Skip to content

feat: add official vLLM Router frontend - #340

Closed
cquil11 wants to merge 19 commits into
NVIDIA:mainfrom
SemiAnalysisAI:agent/native-router-frontends
Closed

cquil11 wants to merge 19 commits into
NVIDIA:mainfrom
SemiAnalysisAI:agent/native-router-frontends

refactor: rename per-GPU launch mode to per-rank

d6b2f91
Select commit
Loading
Failed to load commit list.
Sign in for the full log view