Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

3. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python

4. sglang-omni sglang-omni Public

   Forked from sgl-project/sglang-omni

   SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.

   Python

5. nano-vllm nano-vllm Public

   Forked from GeeeekExplorer/nano-vllm

   Nano vLLM

   Python

6. mini-sglang mini-sglang Public

   Forked from sgl-project/mini-sglang

   A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

   Python