Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(datasets): Added the Experimental SafetensorsDataset #898

Open
wants to merge 20 commits into
base: main
Choose a base branch
from
Open

feat(datasets): Added the Experimental SafetensorsDataset #898

wants to merge 20 commits into from

Commits on Oct 18, 2024

  1. added the skeleton for the Safetensors experimental dataset 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    26f714d View commit details
    Browse the repository at this point in the history

  2. implemented the save() and load() funcs 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    c2a980e View commit details
    Browse the repository at this point in the history

  3. updated the default backend 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    58a258d View commit details
    Browse the repository at this point in the history

  4. implemented the describe() and exists() funcs 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    3723b02 View commit details
    Browse the repository at this point in the history

  5. imported the dataset to main pkg 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    843e815 View commit details
    Browse the repository at this point in the history

  6. fixed how data is passed to load() 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    9a54930 View commit details
    Browse the repository at this point in the history

  7. fixed save() to access the file path 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    8a5d522 View commit details
    Browse the repository at this point in the history

  8. added a release() func 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    1bd4117 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. added the docstrings for the dataset 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    eba18df View commit details
    Browse the repository at this point in the history

  2. fixed lint issues 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    98bb719 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2024

  1. added unit tests 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    5d0e347 View commit details
    Browse the repository at this point in the history

  2. added a few more unit tests 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    58c1ac7 View commit details
    Browse the repository at this point in the history

  3. fixed broken unit test 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    3350161 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into feature/safetensors_dataset

    @MinuraPunchihewa
    MinuraPunchihewa authored Oct 20, 2024
    Configuration menu
    Copy the full SHA
    da6c32a View commit details
    Browse the repository at this point in the history

  5. fixed lint issues 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    aa6dd9c View commit details
    Browse the repository at this point in the history

  6. fixed use of insecure temp files 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    697f34f View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. added the dataset to the documentation 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    4c27e73 View commit details
    Browse the repository at this point in the history

  2. listed the dependencies for the dataset 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    7922ed8 View commit details
    Browse the repository at this point in the history

  3. fixed typo in dataset reference 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    3c59813 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Merge branch 'main' into feature/safetensors_dataset 

    Signed-off-by: Minura Punchihewa <[email protected]>
    @MinuraPunchihewa
    MinuraPunchihewa authored Oct 30, 2024
    Configuration menu
    Copy the full SHA
    8602809 View commit details
    Browse the repository at this point in the history