Pinned Loading

1. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

2. sglang-omni sglang-omni Public

   Forked from sgl-project/sglang-omni

   SGLang Omni: High-Performance Multi-Stage Pipeline Framework for Omni Models

   Python

3. freelens freelens Public

   Forked from freelensapp/freelens

   Free IDE for Kubernetes

   TypeScript

4. smg smg Public

   Forked from smg-project/smg

   Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat histor…

   Rust

5. genai-bench genai-bench Public

   Forked from sgl-project/genai-bench

   Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

   Python

6. TileRT TileRT Public

   Forked from tile-ai/TileRT

   Tile-Based Runtime for Ultra-Low-Latency LLM Inference

   Python