Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding LLaVA-Phi-Mini-3 #12

Closed
wants to merge 5 commits into from
Closed

Adding LLaVA-Phi-Mini-3 #12

wants to merge 5 commits into from

Commits on Apr 25, 2024

  1. Add files via upload

    It works, but the prompt template apparently is not correct. Maybe wait for an official update from HF for apply_chat_template?
    
    air@MacBook-Air-van-Air mlx-vlm % python3.10 -m mlx_vlm.generate --model xtuner/llava-phi-3-mini-hf --max-tokens 100 --temp 0.0                       
    model-00002-of-00002.safetensors: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3.31G/3.31G [11:01<00:00, 5.01MB/s]
    model-00001-of-00002.safetensors: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4.99G/4.99G [13:49<00:00, 6.01MB/s]
    Fetching 11 files: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 11/11 [13:49<00:00, 75.41s/it]
    Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4.99G/4.99G [13:49<00:00, 10.5MB/s]
    ==========
    Image: http://images.cocodataset.org/val2017/000000039769.jpg 
    
    Prompt: <s><|user|>
    <image>
    What are these?<|end|>
    <|assistant|>
    
    These are two cats sleeping on a pink couch.<|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|><|end|>
    ==========
    Prompt: 0.969 tokens-per-sec
    Generation: 1.355 tokens-per-sec
    s-smits authored Apr 25, 2024
    Configuration menu
    Copy the full SHA
    1c7ab4a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4fdce5c View commit details
    Browse the repository at this point in the history
  3. Update README.md

    s-smits authored Apr 25, 2024
    Configuration menu
    Copy the full SHA
    ad3eac5 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2024

  1. Configuration menu
    Copy the full SHA
    51f0680 View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. rename model folder

    Blaizzy committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    56f8fdc View commit details
    Browse the repository at this point in the history