Popular repositories Loading

1. PonyExl3 PonyExl3 Public

   Convert and Run Exl3 format LLM quant on Apple Silicon.

   Python 46 1

2. exllamav3 exllamav3 Public

   Forked from turboderp-org/exllamav3

   An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs

   Python