Pinned Loading

1. uw-syfi/vibe-serve uw-syfi/vibe-serve Public

   Can AI Agents Build Bespoke LLM Serving Systems?

   Python 69 13

2. mstar-project/mstar mstar-project/mstar Public

   A high-performance, universal serving framework for any-to-any models.

   Python 10

3. vox-serve/vox-serve vox-serve/vox-serve Public

   A Streaming-Native Serving Engine for TTS/STS Models

   Python 70 8

4. uw-syfi/Murmur uw-syfi/Murmur Public

   Murmur: An Efficient Inference System for Long-Form ASR

   Python 8 2

5. efeslab/LiteASR efeslab/LiteASR Public

   [EMNLP Main '25] LiteASR: Efficient Automatic Speech Recognition with Low-Rank Approximation

   Python 154 5

6. efeslab/fiddler efeslab/fiddler Public

   [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration

   Python 267 36