Code

Fix checkpointing for hybrid sharding#7

Code

Merged

epwalsh merged 1 commit intomainallenai/OLMo-core:mainfrom shanea/hybrid-shard-fixallenai/OLMo-core:shanea/hybrid-shard-fixCopy head branch name to clipboardApr 10, 2024

+1-1

Commits

Commits on Apr 10, 2024

• Pass process group to mark_as_sharded

  2015aroras

  committed
  bcb17ca

  Copy full SHA for bcb17ca