Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Code for Creating VLMs using New Language Backbones #41

Open
wants to merge 39 commits into
base: main
Choose a base branch
from
Open

Code for Creating VLMs using New Language Backbones #41

wants to merge 39 commits into from
+965 −78

Commits on May 7, 2024

  1. Added more configs

    @RylanSchaeffer
    RylanSchaeffer committed May 7, 2024
    Configuration menu
    Copy the full SHA
    e54ab45 View commit details
    Browse the repository at this point in the history

  2. Working on adding Phi3, Gemma, Llama

    @RylanSchaeffer
    RylanSchaeffer committed May 7, 2024
    Configuration menu
    Copy the full SHA
    4dfc1ad View commit details
    Browse the repository at this point in the history

  3. Working on Phi3 Instruct Prompter

    @RylanSchaeffer
    RylanSchaeffer committed May 7, 2024
    Configuration menu
    Copy the full SHA
    ea936dd View commit details
    Browse the repository at this point in the history

  4. Working on Phi and Gemma

    @RylanSchaeffer
    RylanSchaeffer committed May 7, 2024
    Configuration menu
    Copy the full SHA
    fcd5b37 View commit details
    Browse the repository at this point in the history

  5. Working on Llama

    @RylanSchaeffer
    RylanSchaeffer committed May 7, 2024
    Configuration menu
    Copy the full SHA
    7fbf902 View commit details
    Browse the repository at this point in the history

  6. Working on adding Gemma, Phi, Materialize.py

    @RylanSchaeffer
    RylanSchaeffer committed May 7, 2024
    Configuration menu
    Copy the full SHA
    083d45c View commit details
    Browse the repository at this point in the history

  7. Working on implementing Gemma, Phi 3, Llama 3

    @RylanSchaeffer
    RylanSchaeffer committed May 7, 2024
    Configuration menu
    Copy the full SHA
    3eb29db View commit details
    Browse the repository at this point in the history

  8. Working on Updating Registry

    @RylanSchaeffer
    RylanSchaeffer committed May 7, 2024
    Configuration menu
    Copy the full SHA
    712b8aa View commit details
    Browse the repository at this point in the history

  9. Working on adding more VLMs

    @RylanSchaeffer
    RylanSchaeffer committed May 7, 2024
    Configuration menu
    Copy the full SHA
    a705803 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Added Sidd's fix

    @RylanSchaeffer
    RylanSchaeffer committed May 8, 2024
    Configuration menu
    Copy the full SHA
    5e83d18 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'TRI-ML:main' into main

    @RylanSchaeffer
    RylanSchaeffer authored May 8, 2024
    Configuration menu
    Copy the full SHA
    df33e98 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Improving READMEs

    @RylanSchaeffer
    RylanSchaeffer committed May 10, 2024
    Configuration menu
    Copy the full SHA
    6efe16c View commit details
    Browse the repository at this point in the history

  2. Figured out how to debug code

    @RylanSchaeffer
    RylanSchaeffer committed May 10, 2024
    Configuration menu
    Copy the full SHA
    abe0453 View commit details
    Browse the repository at this point in the history

  3. Debugging Gemma

    @RylanSchaeffer
    RylanSchaeffer committed May 10, 2024
    Configuration menu
    Copy the full SHA
    b453c59 View commit details
    Browse the repository at this point in the history

  4. Ready to start training Mistral VLMs

    @RylanSchaeffer
    RylanSchaeffer committed May 10, 2024
    Configuration menu
    Copy the full SHA
    f4acf23 View commit details
    Browse the repository at this point in the history

  5. Renaming files and working on Llama3

    @RylanSchaeffer
    RylanSchaeffer committed May 10, 2024
    Configuration menu
    Copy the full SHA
    623576d View commit details
    Browse the repository at this point in the history

  6. Working on Llama 3 implementation

    @RylanSchaeffer
    RylanSchaeffer committed May 10, 2024
    Configuration menu
    Copy the full SHA
    5ba680e View commit details
    Browse the repository at this point in the history

  7. Working on other tokenizers

    @RylanSchaeffer
    RylanSchaeffer committed May 10, 2024
    Configuration menu
    Copy the full SHA
    a458166 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Working on model configs

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    291e749 View commit details
    Browse the repository at this point in the history

  2. Updated more configurations

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    d28937d View commit details
    Browse the repository at this point in the history

  3. Preparing more configs

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    30b81c5 View commit details
    Browse the repository at this point in the history

  4. Updated README_RYLAN

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    6146745 View commit details
    Browse the repository at this point in the history

  5. Fixed one incorrect command

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    2f79a34 View commit details
    Browse the repository at this point in the history

  6. Added Llama 3 and Gemma tokenizer

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    c000ffe View commit details
    Browse the repository at this point in the history

  7. Shaping the model registry

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    50b891f View commit details
    Browse the repository at this point in the history

  8. Added more models to the registry

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    62d44c8 View commit details
    Browse the repository at this point in the history

  9. Finished filling out the registry

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    2f27b11 View commit details
    Browse the repository at this point in the history

  10. Working on the registry and model configurations

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    f01850d View commit details
    Browse the repository at this point in the history

  11. Finished prismatic model configs

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    a6c008d View commit details
    Browse the repository at this point in the history

  12. Fixing bugs with configurations.

    @RylanSchaeffer
    RylanSchaeffer committed May 13, 2024
    Configuration menu
    Copy the full SHA
    d23c81d View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Correcting incorrect paths

    @RylanSchaeffer
    RylanSchaeffer committed May 15, 2024
    Configuration menu
    Copy the full SHA
    b43fb30 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. Debugging loadg

    @RylanSchaeffer
    RylanSchaeffer committed May 17, 2024
    Configuration menu
    Copy the full SHA
    4df230f View commit details
    Browse the repository at this point in the history

  2. Loaded model in fp16

    @RylanSchaeffer
    RylanSchaeffer committed May 17, 2024
    Configuration menu
    Copy the full SHA
    c63d4ce View commit details
    Browse the repository at this point in the history

  3. Enabled gradients through vision backbone

    @RylanSchaeffer
    RylanSchaeffer committed May 17, 2024
    Configuration menu
    Copy the full SHA
    39439f8 View commit details
    Browse the repository at this point in the history

  4. Debugging weird errorg

    @RylanSchaeffer
    RylanSchaeffer committed May 17, 2024
    Configuration menu
    Copy the full SHA
    5495e17 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Implementing Llama 3 Base

    @RylanSchaeffer
    RylanSchaeffer committed May 30, 2024
    Configuration menu
    Copy the full SHA
    a7f67c8 View commit details
    Browse the repository at this point in the history

  2. Caught another missing Llama 3 base

    @RylanSchaeffer
    RylanSchaeffer committed May 30, 2024
    Configuration menu
    Copy the full SHA
    48cacc9 View commit details
    Browse the repository at this point in the history

  3. Added missing Llama 3 base prompt builder

    @RylanSchaeffer
    RylanSchaeffer committed May 30, 2024
    Configuration menu
    Copy the full SHA
    0edda6d View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. Merge branch 'TRI-ML:main' into main

    @RylanSchaeffer
    RylanSchaeffer authored Jul 4, 2024
    Configuration menu
    Copy the full SHA
    95e3097 View commit details
    Browse the repository at this point in the history