Skip to content

fix(trtllm): forward routing.priority to the engine, mapped into range - #30

Open
sopwg612 wants to merge 2 commits into
feat-deepinfra-runtime-07-09from
feat-trtllm-routing-priority-v2
Open

fix(trtllm): forward routing.priority to the engine, mapped into range#30
sopwg612 wants to merge 2 commits into
feat-deepinfra-runtime-07-09from
feat-trtllm-routing-priority-v2