Skip to content

[ci] Add Wan2.2-TI2V-5B SSIM regression test - #1772

Open
SuhaanCoding wants to merge 1 commit into
hao-ai-lab:mainfrom
SuhaanCoding:ssim-wan-ti2v
Open

[ci] Add Wan2.2-TI2V-5B SSIM regression test#1772
SuhaanCoding wants to merge 1 commit into
hao-ai-lab:mainfrom
SuhaanCoding:ssim-wan-ti2v

Conversation

@SuhaanCoding

@SuhaanCoding SuhaanCoding commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Adds fastvideo/tests/ssim/test_wan_ti2v_similarity.py for Wan-AI/Wan2.2-TI2V-5B-Diffusers. This was one of the open CI items: Wan2.2 TI2V had no SSIM coverage.
  • Two cases, since the checkpoint serves both workloads: T2V (FLASH_ATTN, TORCH_SDPA) and I2V (FLASH_ATTN). Prompts and image are the ones in basic_wan2_2_ti2v.py. 45 frames, 4 steps, REQUIRED_GPUS = 1. The full quality map is behind --ssim-full-quality, same as the Wan2.1 files.
  • Wires the file into the merge planner's Wan family and fixes the Wan coverage sentence in fastvideo/tests/ssim/README.md.

Notes

  • Only height, width, frames, steps and seed are pinned. Guidance, flow shift, fps and the negative prompt come from the preset, so the fast and full quality tiers condition the model the same way. (The Wan2.1 files pin an English negative prompt in the fast tier and inherit the Chinese one in full quality.)
  • For the I2V case the pipeline picks the output size from the image's aspect ratio, inside its fixed 480x832 pixel budget (InputValidationStage). With the example's portrait image that comes out at 544x704, so height and width only apply to the T2V case.
  • There is no GB200_reference_videos/Wan2.2-TI2V-5B-Diffusers yet.

Validation

  • ci_runner discovery: SSIMTask(task_id=0, test_file='./fastvideo/tests/ssim/test_wan_ti2v_similarity.py', required_gpus=1, model_id='Wan2.2-TI2V-5B-Diffusers')
  • test_merge_ci_plan.py and test_ci_test_collection.py: 31 passed
  • GB10 smoke, to check that the params run and are stable (GB10 is not a reference device): both cases generate. MS-SSIM between two runs is 1.000000 for T2V and I2V, with identical md5. Changing the seed from 1024 to 1025 drops it to 0.709, so the metric responds.
  • pre-commit: nothing in scope (fastvideo/tests/ is excluded). py_compile is clean.

@mergify mergify Bot added type: new-model New model support scope: infra CI, tests, Docker, build scope: docs Documentation labels Aug 28, 2026
@mergify

mergify Bot commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

Merge Protections

🔴 1 of 1 protections blocking · waiting on 👀 reviews and 🤖 CI

Protection Waiting on
🔴 PR merge requirements 👀 reviews and 🤖 CI

🔴 PR merge requirements

Waiting for

  • #approved-reviews-by>=1
  • check-success=fastcheck-passed
  • check-success=full-suite-passed
This rule is failing.
  • #approved-reviews-by>=1
  • check-success=fastcheck-passed
  • check-success=full-suite-passed
  • check-success~=pre-commit
  • title~=(?i)^\[(feat|feature|bugfix|fix|refactor|perf|ci|doc|docs|misc|chore|kernel|new.?model|skill|skills|infra)\]

@SuhaanCoding SuhaanCoding changed the title [new-model] Add Wan2.2-TI2V-5B SSIM regression test [ci] Add Wan2.2-TI2V-5B SSIM regression test Aug 28, 2026
@mergify mergify Bot added the type: ci CI/CD infrastructure label Aug 28, 2026
@SuhaanCoding
SuhaanCoding force-pushed the ssim-wan-ti2v branch 2 times, most recently from 932d7d5 to 84f3147 Compare August 28, 2026 02:33
Adds fastvideo/tests/ssim/test_wan_ti2v_similarity.py covering both workloads
the checkpoint serves: text-to-video, and image-to-video when an image is
passed. CI-friendly params (45 frames, 4 steps, 480x832 for the text case; the
image case derives its size from the image inside the pipeline's fixed pixel
budget) with the registered preset defaults behind --ssim-full-quality.
Runs on one GPU so the lane's lease broker can pack it next to other
one-GPU tasks; the Wan2.1 files' 2-GPU sequence-parallel path is already
covered by them.

Wires the file into the merge planner's Wan family (and its contract test) so
Wan changes select it once this is on main, and fixes the Wan coverage
sentence in the SSIM README.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

scope: docs Documentation scope: infra CI, tests, Docker, build type: ci CI/CD infrastructure type: new-model New model support

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants