Pinned Loading

1. liteinfer liteinfer Public

   Python 3

2. variantGPT variantGPT Public

   Jupyter Notebook

3. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python 14.4k 2.7k

4. sgl-project/SpecForge sgl-project/SpecForge Public

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python 1.1k 318

5. SpecForge SpecForge Public

   Forked from sgl-project/SpecForge

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python