Repository navigation

All pull requests

Labels (9)Milestones (0)New pull request

Backport SFT correctness fixes and opt-in checkpoint improvements
#144Alvorecer721 opened Sep 7, 2026
1
Add quantile balancing MoE router
#135andresnowak opened Jun 24, 2026
Add token mapping script for datasets
#130stefantaga24 opened Jun 22, 2026
Top-K Logits Distillation
#90BlackSamorez opened Sep 30, 2025
NGC25.05 + Fix Xielu
#87TJ-Solergibert opened Jul 31, 2025
Update update upstream
#84AleHD opened Jun 25, 2025
Update upstream
#82AleHD opened Jun 25, 2025
1
Merge with upstream main (up to 4-5 June 2025) | Add some FP8 metric-tracking
#79dhia680 opened Jun 6, 2025Member
Data Mixture Modification Script
#74alexdremov opened May 27, 2025
2
Cherry-picking upstream commit 478dfe0 to fix checkpoint writing in NGC 25.03 onwards
#72lukasgd opened May 7, 2025
Adding CSCS' XIELU to Megatron-LM
#71rubber-duck-debug opened May 6, 2025
Minor sbatch fixes
#68henrique opened Apr 1, 2025
chore: Script to compute mixture with new dataset included
#63MaxiBoether opened Mar 20, 2025
feat: GPTDatasetFolder for easier definition of dataset-based mixtures
#58MaxiBoether opened Mar 11, 2025
1
Log all grad norms
#50dhia680 opened Feb 27, 2025Member
3
Process error file - v0
#49dhia680 opened Feb 27, 2025Member
Update fork
#34AleHD opened Feb 14, 2025
Slack bot
#16dhia680 opened Feb 10, 2025Member