Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set up CI #87

Merged
merged 10 commits into from
Apr 24, 2024
Merged

Set up CI #87

merged 10 commits into from
Apr 24, 2024

Conversation

zou3519
Copy link
Contributor

@zou3519 zou3519 commented Apr 10, 2024

[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 10, 2024
ghstack-source-id: 13b391e7e7007601d2a3b861150c242e529da571
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 10, 2024
Copied from torchvision.

ghstack-source-id: 49241f213ff78d2e37d2e979719eb3365180f794
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 10, 2024
Copied from torchvision.

ghstack-source-id: 03d55556d16c59e4b83de3b8d9926996de55b2f8
Pull Request resolved: #87
[ghstack-poisoned]
@zou3519 zou3519 mentioned this pull request Apr 11, 2024
zou3519 added a commit that referenced this pull request Apr 11, 2024
Copied from torchvision.

ghstack-source-id: f6e39ce07bb04a92f08c6d5b9fedf60628f56cf0
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 11, 2024
Copied from torchvision.

ghstack-source-id: 88f3d0996ab3ab1a581e9c42d81d5e2747142317
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: 81b6c2dbb0c123a7671ef2cf51d14e2866c79d6f
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: 8ed228d9dbc8ad6e979edec691ccfd85c4e43347
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: 48e2c2cd98d904a9fe0a487fe818016e8d28f360
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: e089ccf7cf3e06526f1082c22f453f983a7ce46f
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: 2158902438d9fef846d5fa1b93033135612879a9
Pull Request resolved: #87
@zou3519 zou3519 marked this pull request as ready for review April 19, 2024 02:37
@zou3519 zou3519 requested review from albanD and drisspg April 19, 2024 15:11
runner: ["linux.12xlarge"]
gpu-arch-type: ["cpu"]
include:
- python-version: 3.8
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

3.11 above?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did 3.8 for coverage

eval "$($(which conda) shell.bash hook)" && conda deactivate && conda activate ci

echo '::group::Install testing utilities'
pip install --progress-bar=off pytest pytest-mock pytest-cov expecttest numpy
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

uv?

set +x && eval "$($(which conda) shell.bash hook)" && set -x

# Setup the OS_TYPE environment variable that should be used for conditions involving the OS below.
case $(uname) in
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you planning to extend CI to other platforms? Because this file seems a lot more general than what we use it for right now?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe, I'm not sure. Leaving it just in case


echo '::group::Install PyTorch'
# TODO: Can we maybe have this as environment variable in the job template? For example, `IS_RELEASE`.
if [[ (${GITHUB_EVENT_NAME} = 'pull_request' && (${GITHUB_BASE_REF} = 'release'*)) || (${GITHUB_REF} = 'refs/heads/release'*) ]]; then
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we plan to have "releases"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe? We could set up an example binary release for this

- python-version: 3.8
runner: linux.g5.4xlarge.nvidia.gpu
gpu-arch-type: cuda
gpu-arch-version: "11.8"
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe 12.1?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure this is possible, it depends on what github runners are offered to the pytorch org

Copy link

@drisspg drisspg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some nits

@zou3519
Copy link
Contributor Author

zou3519 commented Apr 24, 2024

Re the comments about the github workflows: these are not copy-paste-able for OSS developers because the github workflow only works if you're in the pytorch org. Because of that I'm fine with not having the cleanest setup for now

@zou3519 zou3519 merged commit f5d8e55 into gh/zou3519/2/base Apr 24, 2024
3 checks passed
zou3519 added a commit that referenced this pull request Apr 24, 2024
Copied from torchvision.

ghstack-source-id: 2158902438d9fef846d5fa1b93033135612879a9
Pull Request resolved: #87
@zou3519 zou3519 deleted the gh/zou3519/2/head branch April 24, 2024 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants