Code

[WIP] Add FSDP2 #797

Code

Draft

mreso wants to merge 2 commits intomainmeta-llama/llama-cookbook:mainfrom feature/fsdp2meta-llama/llama-cookbook:feature/fsdp2Copy head branch name to clipboard

+714-535

Commits

Commits on Oct 28, 2024

• Fix deprecation warning in checkpointing util

  mreso

  committed
  24bd6de

  Copy full SHA for 24bd6de

Commits on Oct 29, 2024

• [WIP] enabled fsdpv2 checkpointing, peft+full-vision enabled for fsdpv2, refactoring

  mreso

  committed
  6d5b221

  Copy full SHA for 6d5b221