Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support MuParametrization and MuTransfer #64

Draft
wants to merge 7 commits into
base: main
Choose a base branch
from
Draft

Support MuParametrization and MuTransfer #64

wants to merge 7 commits into from

Commits on Dec 22, 2023

  1. add initial implementation of mup [to be checked]

    @NZ42
    NZ42 committed Dec 22, 2023
    Configuration menu
    Copy the full SHA
    b588300 View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2024

  1. update mup implementation based on othertea's review

    @NZ42
    NZ42 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    e843c24 View commit details
    Browse the repository at this point in the history

  2. integrate mureadout and sharedmureadout, document & edit mup config

    @NZ42
    NZ42 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    6877a53 View commit details
    Browse the repository at this point in the history

  3. add zero-initialization to the readout layer

    @NZ42
    NZ42 committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    4ff7462 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. refactor mup implementation, add coordinate checking test

    @NZ42
    NZ42 committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    0648a17 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. Update protein_lm/modeling/models/apt/__init__.py 

    Co-authored-by: othertea <[email protected]>
    @NZ99 @othertea
    NZ99 and othertea authored Feb 15, 2024
    Configuration menu
    Copy the full SHA
    3f84774 View commit details
    Browse the repository at this point in the history

  2. Update protein_lm/modeling/models/apt/model_pytorch.py 

    Co-authored-by: othertea <[email protected]>
    @NZ99 @othertea
    NZ99 and othertea authored Feb 15, 2024
    Configuration menu
    Copy the full SHA
    0ef23e6 View commit details
    Browse the repository at this point in the history