A high-throughput and memory-efficient inference and serving engine for LLMs

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

Go ahead and axolotl questions

Every Eval Ever is a shared schema and crowdsourced eval database. It defines a standardized metadata format for storing AI evaluation results — from leaderboard scrapes and research papers to local evaluation runs — so that results from different frameworks can be compared, reproduced, and reused.

A framework for few-shot evaluation of language models.

DeepEP: an efficient expert-parallel communication library

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling