Labels

• API models

  API models

• bug

  bug

• correctness

  correctness

  Everything related to the generation correctness

• dependencies

  dependencies

  Pull requests that update a dependency file

• documentation

  documentation

  Linked to documentation and examples

• enhancement

  enhancement

• examples

  examples

  Linked to usage examples

• exllamav2

  exllamav2

• grammar

  grammar

• help wanted

  help wanted

• impact/user

  impact/user

• interface

  interface

  Related to improving the user interface

• JSON

  JSON

• llama.cpp

  llama.cpp

  Related to the `llama.cpp` integration

• mamba

  mamba

• mlxlm

  mlxlm

• numba

  numba

• optimization

  optimization

  Related to performance optimizations

• prompting

  prompting

• question

  question

• regex

  regex

• run-benchmarks

  run-benchmarks

• structured generation

  structured generation

  Linked to structured generation

• tests

  tests

  Linked to library tests

• tokenization

  tokenization

• transformers

  transformers

  Linked to the `transformers` integration

• transformers vision

  transformers vision

• vLLM

  vLLM

  Things involving vLLM support