Popular repositories Loading
Repositories
Showing 10 of 60 repositories
- MSLK Public
MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI training and inference, such as FP8 row-wise quantization and collective communications.
- spmd_types Public
This module defines a type system for distributed training code, based off of JAX's sharding in types, but adapted for the PyTorch ecosystem.
-
- autoparallel Public
An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.
Top languages
Loading…
Most used topics
Loading…