Skip to content

Commit

Permalink
[Docker] Add patches for one-hot, expand_as, and etc ops (#21)
Browse files Browse the repository at this point in the history
In this PR, we update the dockerfile and image to include:
1. support one hot op.
2. support expand as.
3. some minor updates.

As the result, it is highly recommended to install the patched PyTorch.
  • Loading branch information
jc-bytedance authored Apr 3, 2024
1 parent 6f26ab3 commit c6981e6
Show file tree
Hide file tree
Showing 3 changed files with 854 additions and 60 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ We are refactoring our [internal LLM training system](https://arxiv.org/abs/2402

### From Source

#### Install a Patched Version of PyTorch (optional)
#### Install a Patched Version of PyTorch

```bash
bash patches/build_pytorch_w_patch.sh
Expand Down Expand Up @@ -60,4 +60,4 @@ The veScale Project is under the Apache License v2.0.
## Acknowledgement

veScale team would like to sincerely acknowledge the assistance of and collaboration with
the [PyTorch DTensor team](https://github.com/pytorch/pytorch/tree/main/torch/distributed/_tensor).
the [PyTorch DTensor team](https://github.com/pytorch/pytorch/tree/main/torch/distributed/_tensor).
Loading

0 comments on commit c6981e6

Please sign in to comment.