Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CMB Release Process #129

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions docs/community-model-build-release-cadence.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
# Community Model Build Release Cadence

## Scope

This document is targeted to help explain the release cadence of the Community Model Build.

## Problem statement

When we build the new versions of the [granite-lab][hf_granite] model, we don't know the release cycle of "tagging" the versions. We have the repository, and there is a git system like tagging, but this doesn't set the expectations for the releases.

Check failure on line 9 in docs/community-model-build-release-cadence.md

View workflow job for this annotation

GitHub Actions / markdown-lint

Reference links and images should use a label that is defined

docs/community-model-build-release-cadence.md:9:39 MD052/reference-links-images Reference links and images should use a label that is defined [Missing link or image reference definition: "hf_granite"] [Context: "[granite-lab][hf_granite]"] https://github.com/DavidAnson/markdownlint/blob/v0.34.0/doc/md052.md
At the original culmination of this project, it was understood that the community releases would happen "when they happen," but from now on, we will have an opportunity to figure out a standard process.

Check failure on line 10 in docs/community-model-build-release-cadence.md

View workflow job for this annotation

GitHub Actions / markdown-lint

Hard tabs

docs/community-model-build-release-cadence.md:10:1 MD010/no-hard-tabs Hard tabs [Column: 1] https://github.com/DavidAnson/markdownlint/blob/v0.34.0/doc/md010.md
We are concerned that if a user says they want to use only the "1.0.0" (major release) of the model and update it only in a "6-month cycle," for example, we have no option for this. On the other hand, a group of people may only want to run "main" (any release) and not care. This document helps determine this process.

Check failure on line 11 in docs/community-model-build-release-cadence.md

View workflow job for this annotation

GitHub Actions / markdown-lint

Hard tabs

docs/community-model-build-release-cadence.md:11:1 MD010/no-hard-tabs Hard tabs [Column: 1] https://github.com/DavidAnson/markdownlint/blob/v0.34.0/doc/md010.md

## Proposed solution

There are two options to help resolve these use cases. First, we create a “stream” version, where someone can go to huggingface.com/instructlab/granite-7b-lab-stream and access the safe sensors whenever the Community Model Build Release team deems it necessary to release a new version. This will resolve the issue of the “main” release cycle and ideally give the developer persona the cutting-edge changes they desire. We can build out a `gguf` release of the version and distribute this to huggingface and Ollama too.
The second option is to have a “timely” (this is open discussion at this writing) release that we tag releases on https://huggingface.co/instructlab/granite-7b-lab with specific release candidates built off of a collection of releases like this: https://github.com/instructlab/taxonomy/tree/cmb-run-2024-08-26. We can announce via the users mailing list the “timely” releases with the collections of the release branches, and if we don’t have any, we can announce that we will be skipping that versioned release.

Check failure on line 16 in docs/community-model-build-release-cadence.md

View workflow job for this annotation

GitHub Actions / markdown-lint

Bare URL used

docs/community-model-build-release-cadence.md:16:115 MD034/no-bare-urls Bare URL used [Context: "https://huggingface.co/instruc..."] https://github.com/DavidAnson/markdownlint/blob/v0.34.0/doc/md034.md

Check failure on line 16 in docs/community-model-build-release-cadence.md

View workflow job for this annotation

GitHub Actions / markdown-lint

Bare URL used

docs/community-model-build-release-cadence.md:16:247 MD034/no-bare-urls Bare URL used [Context: "https://github.com/instructlab..."] https://github.com/DavidAnson/markdownlint/blob/v0.34.0/doc/md034.md


Check failure on line 18 in docs/community-model-build-release-cadence.md

View workflow job for this annotation

GitHub Actions / markdown-lint

Multiple consecutive blank lines

docs/community-model-build-release-cadence.md:18 MD012/no-multiple-blanks Multiple consecutive blank lines [Expected: 1; Actual: 2] https://github.com/DavidAnson/markdownlint/blob/v0.34.0/doc/md012.md
## Next steps

Get consensus on if this is an issue from the community side (maybe we can just release and ignore the versioned releases).
If this is an issue build out granite-7b-lab-stream on huggingface.
Determine the date that the versioned release will happen.
Build a release process and documentation around both release cycles.

hf_granite: https://huggingface.co/instructlab/granite-7b-lab

Check failure on line 26 in docs/community-model-build-release-cadence.md

View workflow job for this annotation

GitHub Actions / markdown-lint

Bare URL used

docs/community-model-build-release-cadence.md:26:13 MD034/no-bare-urls Bare URL used [Context: "https://huggingface.co/instruc..."] https://github.com/DavidAnson/markdownlint/blob/v0.34.0/doc/md034.md


Check failure on line 28 in docs/community-model-build-release-cadence.md

View workflow job for this annotation

GitHub Actions / markdown-lint

Multiple consecutive blank lines

docs/community-model-build-release-cadence.md:28 MD012/no-multiple-blanks Multiple consecutive blank lines [Expected: 1; Actual: 2] https://github.com/DavidAnson/markdownlint/blob/v0.34.0/doc/md012.md

Check failure on line 29 in docs/community-model-build-release-cadence.md

View workflow job for this annotation

GitHub Actions / markdown-lint

Multiple consecutive blank lines

docs/community-model-build-release-cadence.md:29 MD012/no-multiple-blanks Multiple consecutive blank lines [Expected: 1; Actual: 3] https://github.com/DavidAnson/markdownlint/blob/v0.34.0/doc/md012.md
Loading