Code

All inpaint#456

Code

Open

pkuhxy wants to merge 160 commits intoPKU-YuanGroup:mainPKU-YuanGroup/Open-Sora-Plan:mainfrom yunyangge:all_inpaintyunyangge/Open-Sora-Plan:all_inpaintCopy head branch name to clipboard

+62,375-14,438

Commits

Commits on May 1, 2024

• union model

  LinB203

  committed
  a5d41c0

  Copy full SHA for a5d41c0

Commits on May 2, 2024

• update dataset, train_t2v, mask_loss

  LinB203

  committed
  f07d166

  Copy full SHA for f07d166

• load pretrained weight

  LinB203

  committed
  c6a486c

  Copy full SHA for c6a486c

Commits on May 5, 2024

• fix dataset

  LinB203

  committed
  680edcd

  Copy full SHA for 680edcd

• inference any res.

  LinB203

  committed
  e746242

  Copy full SHA for e746242

• inference any res.

  LinB203

  committed
  92220bf

  Copy full SHA for 92220bf

• update

  LinB203

  committed
  b3fa7a5

  Copy full SHA for b3fa7a5

Commits on May 18, 2024

• check 3d attn

  LinB203

  committed
  2ac285c

  Copy full SHA for 2ac285c

Commits on May 23, 2024

• fix init bug

  LinB203

  committed
  c7866d4

  Copy full SHA for c7866d4

• add temp embed

  LinB203

  committed
  3a63b51

  Copy full SHA for 3a63b51

Commits on May 25, 2024

• fixed train log

  LinB203

  committed
  c051120

  Copy full SHA for c051120

Commits on May 28, 2024

• update dev3d

  LinB203

  committed
  86a3346

  Copy full SHA for 86a3346

Commits on May 29, 2024

• support 2+1d

  LinB203

  committed
  11b0884

  Copy full SHA for 11b0884

• remove rand

  LinB203

  committed
  1b31355

  Copy full SHA for 1b31355

Commits on May 30, 2024

• fix ema

  LinB203

  committed
  c2ad2c0

  Copy full SHA for c2ad2c0

• fix ema log & test train/test

  LinB203

  committed
  cac33a4

  Copy full SHA for cac33a4

Commits on May 31, 2024

• 训练推理适配npu

  apprivoiser

  committed
  046af98

  Copy full SHA for 046af98

Commits on Jun 1, 2024

• check gpu

  LinB203

  committed
  87ee95f

  Copy full SHA for 87ee95f

Commits on Jun 2, 2024

• udit

  LinB203

  committed
  3b3c34d

  Copy full SHA for 3b3c34d

Commits on Jun 3, 2024

• support train image

  LinB203

  committed
  7a1b6dc

  Copy full SHA for 7a1b6dc

• del random image

  LinB203

  committed
  7194f80

  Copy full SHA for 7194f80

• sample image

  LinB203

  committed
  9ebe0cd

  Copy full SHA for 9ebe0cd

Commits on Jun 5, 2024

• fix dataset and model on npu

  apprivoiser

  committed
  d105f40

  Copy full SHA for d105f40

Commits on Jun 6, 2024

• support panda70m-dataset

  stepbystep88

  committed
  f682a18

  Copy full SHA for f682a18

Commits on Jun 7, 2024

• support panda70m-dataset

  stepbystep88

  committed
  0fa2c06

  Copy full SHA for 0fa2c06

Commits on Jun 9, 2024

• add cfg/snr/noise offset

  LinB203

  committed
  a728ba7

  Copy full SHA for a728ba7

• update train_t2v and model

  LinB203

  committed
  5322144

  Copy full SHA for 5322144

Commits on Jun 10, 2024

• fix bugs of data preprocessing when set fixed seed

  stepbystep88

  committed
  787ad61

  Copy full SHA for 787ad61

Commits on Jun 12, 2024

• fix precision-problem of deepspeed on npu

  stepbystep88

  committed
  b97dcc5

  Copy full SHA for b97dcc5

• update udit

  LinB203

  committed
  477e033

  Copy full SHA for 477e033

• fix random video

  LinB203

  committed
  2a2c52e

  Copy full SHA for 2a2c52e

• Merge remote-tracking branch 'origin/hw_onging' into hw_onging

  Show description for 4a15be8
  stepbystep88

  committed
  4a15be8

  Copy full SHA for 4a15be8

• support 3d vae & Chinese & prodigy

  LinB203

  committed
  c458f2a

  Copy full SHA for c458f2a

• fix eval prompt

  LinB203

  committed
  50416f3

  Copy full SHA for 50416f3

Commits on Jun 13, 2024

• Merge remote-tracking branch 'origin/hw_onging' into hw_onging

  Show description for 6cb40e6
  stepbystep88

  committed
  6cb40e6

  Copy full SHA for 6cb40e6

• make sure contiguous when performing concat or communication

  stepbystep88

  committed
  f050f89

  Copy full SHA for f050f89

• fix t5 mismatch

  LinB203

  committed
  b7a51f2

  Copy full SHA for b7a51f2

• fix noise offset

  LinB203

  committed
  9591a7b

  Copy full SHA for 9591a7b

• fix vae decoder for image

  LinB203

  authored
  a56889e

  Copy full SHA for a56889e

• del umt5

  LinB203

  committed
  a59766c

  Copy full SHA for a59766c

• change folder of scritps

  stepbystep88

  committed
  003d68a

  Copy full SHA for 003d68a

• Merge remote-tracking branch 'origin/hw_onging' into hw_onging

  stepbystep88

  committed
  4343ddf

  Copy full SHA for 4343ddf

• set default env:SAMPLE_SAVE_PATH for sample scripts

  stepbystep88

  committed
  0802761

  Copy full SHA for 0802761

Commits on Jun 14, 2024

• support imageudit on npu

  apprivoiser

  committed
  80bb326

  Copy full SHA for 80bb326

Commits on Jun 16, 2024

• stable loss

  LinB203

  committed
  895aed8

  Copy full SHA for 895aed8

• fix folder

  SHYuanBest

  committed
  aa01e93

  Copy full SHA for aa01e93

Commits on Jun 17, 2024

• support zp group when using deepspeed

  stepbystep88

  committed
  e8157e5

  Copy full SHA for e8157e5

• Merge remote-tracking branch 'origin/hw_onging' into hw_onging

  stepbystep88

  committed
  ce31e4e

  Copy full SHA for ce31e4e

• fix import of npu

  stepbystep88

  committed
  1f45901

  Copy full SHA for 1f45901

Commits on Jun 18, 2024

• bind cores to stable the host cost

  stepbystep88

  committed
  e397f10

  Copy full SHA for e397f10

• rope

  LinB203

  committed
  de2ef86

  Copy full SHA for de2ef86

• pass use_rope

  LinB203

  committed
  c84811b

  Copy full SHA for c84811b

• fix rope scaling

  LinB203

  committed
  6f92952

  Copy full SHA for 6f92952

Commits on Jun 19, 2024

• support uditultra on npu

  apprivoiser

  committed
  4441716

  Copy full SHA for 4441716

• support uditultra on npu

  apprivoiser

  committed
  1f58d6b

  Copy full SHA for 1f58d6b

• support process Chinese

  LinB203

  committed
  4e5cd02

  Copy full SHA for 4e5cd02

• fix uditultra pad

  LinB203

  committed
  ec2813b

  Copy full SHA for ec2813b

• fix bug on pad

  apprivoiser

  committed
  fed6809

  Copy full SHA for fed6809

Commits on Jun 20, 2024

• inpaint

  yunyangge

  committed
  bdb107f

  Copy full SHA for bdb107f

Commits on Jun 21, 2024

• optimize rope for npu

  stepbystep88

  committed
  9b4ac0c

  Copy full SHA for 9b4ac0c

• Merge remote-tracking branch 'origin/hw_onging' into hw_onging

  Show description for bdb2ea2
  stepbystep88

  committed
  bdb2ea2

  Copy full SHA for bdb2ea2

• Merge remote-tracking branch 'peking/hw_onging' into hw_onging

  Show description for 9a8fddb
  apprivoiser

  committed
  9a8fddb

  Copy full SHA for 9a8fddb

• use SingletonMeta for saving caption_list

  stepbystep88

  committed
  149d521

  Copy full SHA for 149d521

• video ip

  yunyangge

  committed
  dc3ec48

  Copy full SHA for dc3ec48

• support opensora3d sp

  apprivoiser

  committed
  06412d4

  Copy full SHA for 06412d4

• Merge remote-tracking branch 'peking/hw_onging' into hw_onging

  apprivoiser

  committed
  8aba594

  Copy full SHA for 8aba594

• video ip

  yunyangge

  committed
  5357c3b

  Copy full SHA for 5357c3b

Commits on Jun 22, 2024

• inpaint

  yunyangge

  committed
  d4a85e2

  Copy full SHA for d4a85e2

• Merge branch 'PKU-YuanGroup:hw_onging' into hw_onging

  yunyangge

  authored
  1b82e33

  Copy full SHA for 1b82e33

Commits on Jun 24, 2024

• fix mix-precision with deepspeed zero mode

  stepbystep88

  committed
  a708903

  Copy full SHA for a708903

• fix precision problem for vae decode when using npu

  stepbystep88

  committed
  df3bcd3

  Copy full SHA for df3bcd3

• video ip

  yunyangge

  committed
  e807518

  Copy full SHA for e807518

• Merge branch 'hw_onging' of https://github.com/yunyangge/Open-Sora-Plan into hw_onging

  yunyangge

  committed
  fb4ff32

  Copy full SHA for fb4ff32

Commits on Jun 27, 2024

• merge

  LinB203

  committed
  bb147dc

  Copy full SHA for bb147dc

• fix pad bug

  LinB203

  committed
  275f04a

  Copy full SHA for 275f04a

Commits on Jul 1, 2024

• vip ok

  yunyangge

  committed
  314b266

  Copy full SHA for 314b266

• opensora3d on npu & fix dataset bug

  apprivoiser

  committed
  219a302

  Copy full SHA for 219a302

Commits on Jul 2, 2024

• Merge remote-tracking branch 'upstream/hw_onging' into hw_onging

  yunyangge

  committed
  0c1faf9

  Copy full SHA for 0c1faf9

Commits on Jul 5, 2024

• check video training

  LinB203

  committed
  9377199

  Copy full SHA for 9377199

• fix video training

  LinB203

  committed
  bd2de8b

  Copy full SHA for bd2de8b

• fix grad

  LinB203

  committed
  226c421

  Copy full SHA for 226c421

• video ip for image-video joint training

  yunyangge

  committed
  b73ac09

  Copy full SHA for b73ac09

Commits on Jul 6, 2024

• vip_lzy

  liuzy233

  committed
  964d8ba

  Copy full SHA for 964d8ba

Commits on Jul 8, 2024

• support opensora (3d dit)

  LinB203

  committed
  527d529

  Copy full SHA for 527d529

• Merge remote-tracking branch 'upstream/hw_onging' into hw_onging

  yunyangge

  committed
  83776a4

  Copy full SHA for 83776a4

• video ip training from scratch

  yunyangge

  committed
  48bd8fd

  Copy full SHA for 48bd8fd

Commits on Jul 9, 2024

• inpaint dataset

  yunyangge

  committed
  a95fb1c

  Copy full SHA for a95fb1c

• gitignore

  yunyangge

  committed
  6db6ea1

  Copy full SHA for 6db6ea1

• gitignore

  yunyangge

  committed
  97d1bc0

  Copy full SHA for 97d1bc0

Commits on Jul 10, 2024

• inpaint for 3ddit

  yunyangge

  committed
  dd7acfb

  Copy full SHA for dd7acfb

• Merge branch 'new_hw_onging' into hw_onging

  yunyangge

  committed
  be3c554

  Copy full SHA for be3c554

• merge

  yunyangge

  committed
  e8ed550

  Copy full SHA for e8ed550

• Merge remote-tracking branch 'origin/hw_onging' into hw_onging

  yunyangge

  committed
  33255a3

  Copy full SHA for 33255a3

• Merge branch 'hw_onging' of github.com:yunyangge/Open-Sora-Plan into hw_onging

  liuzy233

  committed
  57deae4

  Copy full SHA for 57deae4

Commits on Jul 11, 2024

• inpaint on npu

  

  wwzhuo

  committed
  4736d8f

  Copy full SHA for 4736d8f

• Merge branch 'hw_onging' of https://github.com/yunyangge/Open-Sora-Plan into hw_onging

  

  wwzhuo

  committed
  75c9687

  Copy full SHA for 75c9687

• Merge pull request PKU-YuanGroup#334 from yunyangge/hw_onging

  Show description for 1703bda
  LinB203

  authored
  1703bda

  Copy full SHA for 1703bda

• pull npu code

  yunyangge

  committed
  75ab2a8

  Copy full SHA for 75ab2a8

• Merge remote-tracking branch 'origin/hw_onging' into hw_onging

  yunyangge

  committed
  928cf73

  Copy full SHA for 928cf73

Commits on Jul 14, 2024

• merge latest train script

  LinB203

  committed
  9ba71b5

  Copy full SHA for 9ba71b5

• merge latest train script

  LinB203

  committed
  8b7c285

  Copy full SHA for 8b7c285

Commits on Jul 15, 2024

• video ip

  yunyangge

  committed
  304538c

  Copy full SHA for 304538c

• Merge remote-tracking branch 'upstream/hw_onging' into hw_onging

  yunyangge

  committed
  875168d

  Copy full SHA for 875168d

• refine group sampler

  LinB203

  committed
  c3b74ec

  Copy full SHA for c3b74ec

• dynamic training (joint image)

  LinB203

  committed
  4bb88ee

  Copy full SHA for 4bb88ee

Commits on Jul 16, 2024

• joint sp training

  LinB203

  committed
  a74bd1a

  Copy full SHA for a74bd1a

• fix define dataset

  LinB203

  committed
  80b05a6

  Copy full SHA for 80b05a6

Commits on Jul 17, 2024

• videoip

  yunyangge

  committed
  5b73bea

  Copy full SHA for 5b73bea

• Merge remote-tracking branch 'upstream/hw_onging' into hw_onging

  yunyangge

  committed
  d8cb735

  Copy full SHA for d8cb735

Commits on Jul 18, 2024

• clean script and fix collate

  LinB203

  committed
  e4d7741

  Copy full SHA for e4d7741

• foward 1.1 docs

  LinB203

  committed
  fd64693

  Copy full SHA for fd64693

• t2v train readme

  LinB203

  committed
  a1bc585

  Copy full SHA for a1bc585

• inf readme

  LinB203

  committed
  9431de4

  Copy full SHA for 9431de4

Commits on Jul 19, 2024

• check training

  LinB203

  committed
  3206651

  Copy full SHA for 3206651

Commits on Jul 20, 2024

• update model and fix dit rope

  LinB203

  committed
  b9b6f2f

  Copy full SHA for b9b6f2f

• sparse1d on dit

  LinB203

  committed
  ccfc2b4

  Copy full SHA for ccfc2b4

• fix group sparse attn

  LinB203

  committed
  82fb2aa

  Copy full SHA for 82fb2aa

Commits on Jul 21, 2024

• update sparse

  LinB203

  committed
  06751c9

  Copy full SHA for 06751c9

• update udit mlp

  LinB203

  committed
  6b60a61

  Copy full SHA for 6b60a61

Commits on Jul 23, 2024

• inpaint all in one

  yunyangge

  committed
  5ae27bd

  Copy full SHA for 5ae27bd

• sparse 2d

  LinB203

  committed
  71a4746

  Copy full SHA for 71a4746

• video ip clip loss

  yunyangge

  committed
  df19bae

  Copy full SHA for df19bae

Commits on Jul 25, 2024

• train inpaint_only and vip_only

  yunyangge

  committed
  a4514fc

  Copy full SHA for a4514fc

Commits on Jul 27, 2024

• inpaint all in one

  yunyangge

  committed
  f7876e9

  Copy full SHA for f7876e9

Commits on Jul 28, 2024

• reconstitution

  yunyangge

  committed
  341d66a

  Copy full SHA for 341d66a

Commits on Jul 30, 2024

• fix sparse attn

  LinB203

  committed
  549196d

  Copy full SHA for 549196d

Commits on Aug 4, 2024

• update model

  LinB203

  committed
  6994d33

  Copy full SHA for 6994d33

Commits on Aug 6, 2024

• sample

  yunyangge

  committed
  d0a9adc

  Copy full SHA for d0a9adc

Commits on Aug 9, 2024

• fix ema bug

  yunyangge

  committed
  5005882

  Copy full SHA for 5005882

• Merge branch 'anyres' into hw_onging

  yunyangge

  committed
  68db27d

  Copy full SHA for 68db27d

• fix dataset

  yunyangge

  committed
  40652d4

  Copy full SHA for 40652d4

Commits on Aug 17, 2024

• gitignore

  yunyangge

  committed
  680ff7f

  Copy full SHA for 680ff7f

• Merge branch 'hw_onging' into anyres

  yunyangge

  committed
  44222ec

  Copy full SHA for 44222ec

Commits on Aug 20, 2024

• update

  LinB203

  committed
  36a71cb

  Copy full SHA for 36a71cb

Commits on Aug 21, 2024

• fix resume dataloader

  LinB203

  committed
  48efa5e

  Copy full SHA for 48efa5e

• fix accumulate

  LinB203

  committed
  d014ddc

  Copy full SHA for d014ddc

Commits on Aug 22, 2024

• add WFVAE (PKU-YuanGroup#402)

  qqingzheng

  authored
  44d56fe

  Copy full SHA for 44d56fe

• 8.22

  LinB203

  committed
  ba11c85

  Copy full SHA for ba11c85

Commits on Aug 26, 2024

• 8.26 update

  LinB203

  committed
  fd673e4

  Copy full SHA for fd673e4

• Merge remote-tracking branch 'origin/anyres' into anyres

  yunyangge

  committed
  c84a932

  Copy full SHA for c84a932

Commits on Aug 27, 2024

• inpaint

  yunyangge

  committed
  a6c2223

  Copy full SHA for a6c2223

• Merge remote-tracking branch 'origin/anyres' into anyres

  yunyangge

  committed
  b1df92a

  Copy full SHA for b1df92a

• with npu

  LinB203

  committed
  f34ac83

  Copy full SHA for f34ac83

Commits on Aug 28, 2024

• inpaint sparse

  yunyangge

  committed
  62f799c

  Copy full SHA for 62f799c

• Merge remote-tracking branch 'origin/anyres' into anyres

  yunyangge

  committed
  9e9b971

  Copy full SHA for 9e9b971

• inpaint sample

  yunyangge

  committed
  85145b3

  Copy full SHA for 85145b3

Commits on Aug 31, 2024

• fix resume

  LinB203

  committed
  600f11c

  Copy full SHA for 600f11c

• fix npu bug

  

  yunyangge

  committed
  2749c40

  Copy full SHA for 2749c40

• Merge branch 'anyres' of https://github.com/yunyangge/Open-Sora-Plan into anyres

  

  yunyangge

  committed
  ce97e73

  Copy full SHA for ce97e73

Commits on Sep 1, 2024

• lossless t chunk for wfvae (PKU-YuanGroup#418)

  qqingzheng

  authored
  b73851e

  Copy full SHA for b73851e

• t chunk (PKU-YuanGroup#419)

  Show description for 72b5202
  qqingzheng

  authored
  72b5202

  Copy full SHA for 72b5202

Commits on Sep 2, 2024

• inpaint on npu

  

  yunyangge

  committed
  bafa1e5

  Copy full SHA for bafa1e5

• resume

  

  yunyangge

  committed
  5940041

  Copy full SHA for 5940041

• Anyres (PKU-YuanGroup#421)

  Show description for 3113560
  

  yunyangge

  and

  LinB203

  authored
  3113560

  Copy full SHA for 3113560

• lossless chunk inference (PKU-YuanGroup#422)

  Show description for 140ca6e
  qqingzheng

  authored
  140ca6e

  Copy full SHA for 140ca6e

Commits on Sep 3, 2024

• Remove redundant transpose operations on npu, transpose ratio 8.7%->3.8%

  apprivoiser

  committed
  d583432

  Copy full SHA for d583432

Commits on Sep 4, 2024

• vae npu

  

  yunyangge

  committed
  c648817

  Copy full SHA for c648817

• Merge branch 'anyres' of https://github.com/yunyangge/Open-Sora-Plan into anyres

  

  yunyangge

  committed
  9a4f5f4

  Copy full SHA for 9a4f5f4

• init all_inpaint

  pkuhxy

  committed
  6f6e504

  Copy full SHA for 6f6e504

Commits on Sep 25, 2024

• 9.25

  pkuhxy

  committed
  94ba650

  Copy full SHA for 94ba650