Skip to content

Fix OOM in contrastive pair generation with streaming approach - #627

Open
Wert1996 wants to merge 1 commit into
huggingface:mainfrom
Wert1996:feature/streaming-contrastive-pairs
Open

Fix OOM in contrastive pair generation with streaming approach#627
Wert1996 wants to merge 1 commit into
huggingface:mainfrom
Wert1996:feature/streaming-contrastive-pairs

stream contrastive pairs for prevent memory explosion

0d780be
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs