Repository navigation

Multimodality support - #2232

Closed

OnePunchMonk wants to merge 14 commits into

Lightning-AI:mainfrom

OnePunchMonk:multimodality-support

Commits on Mar 15, 2026
- feat: Introduce a pre-flight validation script for LitGPT checkpoints and a new tokenizer utility.
  OnePunchMonk
  committed
  7ac6bc8
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  pre-commit-ci[bot]
  committed
  fb6f162
Commits on Mar 25, 2026
- fix(validate): address PR review comments
  OnePunchMonk
  committed
  3c5942c
- Merge branch 'main' into main
  OnePunchMonk
  authored
  fe32555
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  pre-commit-ci[bot]
  committed
  e4cb017
- fix(validate): correct type hint missing imports for python 3.9+
  OnePunchMonk
  committed
  3556730
Commits on Apr 8, 2026
- Merge branch 'Lightning-AI:main' into main
  OnePunchMonk
  authored
  e71a93f
Commits on Apr 9, 2026
- feat: vision multimodality
  OnePunchMonk
  committed
  6ff5bab
- feat: retain vision weights and add interactive image chat support
  OnePunchMonk
  committed
  d729598
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  
  pre-commit-ci[bot]
  authored and
  OnePunchMonk
  committed
  7342e26
Commits on Apr 12, 2026
- minor fixes
  OnePunchMonk
  committed
  5dd8a28
- Merge branch 'main' into multimodality-support
  OnePunchMonk
  authored
  d08ca89
Commits on Aug 16, 2026
- fix(convert_hf_checkpoint): don't load Gemma3 vision weights into a mismatched architecture
  OnePunchMonk
  committed
  6fadb6e
Commits on Aug 17, 2026
- fix(lora, adapter, adapter_v2): initialize vision_encoder/mm_projector on GPT subclasses
  OnePunchMonk
  committed
  e2cc8da

Navigation Menu

Repository navigation

Multimodality support - #2232

Multimodality support#2232
OnePunchMonk wants to merge 14 commits into
Lightning-AI:mainfrom
OnePunchMonk:multimodality-support

Commits on Mar 15, 2026

feat: Introduce a pre-flight validation script for LitGPT checkpoints and a new tokenizer utility.

[pre-commit.ci] auto fixes from pre-commit.com hooks

Commits on Mar 25, 2026

fix(validate): address PR review comments

Merge branch 'main' into main

[pre-commit.ci] auto fixes from pre-commit.com hooks

fix(validate): correct type hint missing imports for python 3.9+

Commits on Apr 8, 2026

Merge branch 'Lightning-AI:main' into main

Commits on Apr 9, 2026

feat: vision multimodality

feat: retain vision weights and add interactive image chat support

[pre-commit.ci] auto fixes from pre-commit.com hooks

Commits on Apr 12, 2026

minor fixes

Merge branch 'main' into multimodality-support

Commits on Aug 16, 2026

fix(convert_hf_checkpoint): don't load Gemma3 vision weights into a mismatched architecture

Commits on Aug 17, 2026

fix(lora, adapter, adapter_v2): initialize vision_encoder/mm_projector on GPT subclasses