Code

Support SFT using ZeRO#654

Code

Merged

zRzRzRzRzRzRzR merged 25 commits intomainTHUDM/CogVideo:mainfrom CogVideoX_devTHUDM/CogVideo:CogVideoX_devCopy head branch name to clipboardJan 20, 2025

+1,631-273

Commits

Commits on Jan 8, 2025

• feat(dataset): pad short videos by repeating last frame

  Show description for 0776600
  OleehyO

  committed
  0776600

  Copy full SHA for 0776600

Commits on Jan 9, 2025

• fix: remove copying first video frame as conditioning image

  OleehyO

  committed
  f6d722c

  Copy full SHA for f6d722c

Commits on Jan 11, 2025

• fix: pad latent frames to match patch_size_t requirements

  OleehyO

  committed
  e213b6c

  Copy full SHA for e213b6c

• feat: add SFT support with ZeRO optimization strategies

  Show description for caa24bd
  OleehyO

  committed
  caa24bd

  Copy full SHA for caa24bd

• Merge remote-tracking branch 'upstream/CogVideoX_dev' into dev

  OleehyO

  committed
  2f275e8

  Copy full SHA for 2f275e8

• add comment as #653

  zRzRzRzRzRzRzR

  committed
  7dc8516

  Copy full SHA for 7dc8516

Commits on Jan 12, 2025

• feat: support DeepSpeed ZeRO-3 and optimize peak memory usage

  Show description for fdb9820
  OleehyO

  committed
  fdb9820

  Copy full SHA for fdb9820

• Rename lora training scripts as ddp

  OleehyO

  committed
  795dd14

  Copy full SHA for 795dd14

• docs: add SFT support documentation in multilingual README

  OleehyO

  committed
  f516938

  Copy full SHA for f516938

• Add pydantic dependency

  OleehyO

  committed
  3252614

  Copy full SHA for 3252614

• Merge remote-tracking branch 'upstream/main' into dev

  OleehyO

  committed
  30ba108

  Copy full SHA for 30ba108

• fix: normalize image tensors in I2VDataset

  OleehyO

  committed
  b362663

  Copy full SHA for b362663

• chore: update default training configurations

  OleehyO

  committed
  70c899f

  Copy full SHA for 70c899f

• Merge remote-tracking branch 'upstream/CogVideoX_dev' into dev

  OleehyO

  committed
  86a0226

  Copy full SHA for 86a0226

• add pipeline

  zRzRzRzRzRzRzR

  committed
  1534bf3

  Copy full SHA for 1534bf3

Commits on Jan 13, 2025

• fix: correct LoRA loading and resolution dimensions

  Show description for 4f1cc66
  OleehyO

  committed
  4f1cc66

  Copy full SHA for 4f1cc66

• Merge remote-tracking branch 'upstream/CogVideoX_dev' into dev

  OleehyO

  committed
  954ba28

  Copy full SHA for 954ba28

• chore: code cleanup and parameter optimization

  Show description for 455b44a
  OleehyO

  committed
  455b44a

  Copy full SHA for 455b44a

• add comment of bash scripts

  zRzRzRzRzRzRzR

  committed
  78275b0

  Copy full SHA for 78275b0

• fix: correct do_validation argument parsing

  OleehyO

  committed
  4878edd

  Copy full SHA for 4878edd

Commits on Jan 14, 2025

• zero_to_bf16

  zRzRzRzRzRzRzR

  committed
  7993670

  Copy full SHA for 7993670

• move to tools

  zRzRzRzRzRzRzR

  committed
  4615479

  Copy full SHA for 4615479

• Merge remote-tracking branch 'upstream/CogVideoX_dev' into dev

  OleehyO

  committed
  0e78f20

  Copy full SHA for 0e78f20

Commits on Jan 16, 2025

• deps: upgrade diffusers to >=0.32.1

  OleehyO

  committed
  bf9c351

  Copy full SHA for bf9c351

• docs: enhance CLI demo documentation

  OleehyO

  committed
  bf73742

  Copy full SHA for bf73742