Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CNN scripts #563

Draft
wants to merge 53 commits into
base: master
Choose a base branch
from
Draft

CNN scripts #563

wants to merge 53 commits into from

Commits on Sep 13, 2022

  1. Add post_wrappers entry in common config

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    a62f5f2 View commit details
    Browse the repository at this point in the history

  2. Add config to train on atari, use post_wrappers

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    ec3755b View commit details
    Browse the repository at this point in the history

  3. Add config option for CNN reward net

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    2ad0864 View commit details
    Browse the repository at this point in the history

  4. Add config to train preference comparisons on Asteroids

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    70f17e5 View commit details
    Browse the repository at this point in the history

  5. Quell flake8 complaint

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    262a35a View commit details
    Browse the repository at this point in the history

  6. Add short-episode asteroids config

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    74fb856 View commit details
    Browse the repository at this point in the history

  7. Add config to train CNN policies

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    ea508ba View commit details
    Browse the repository at this point in the history

  8. Fix line length

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    8ac9ae5 View commit details
    Browse the repository at this point in the history

  9. Make names of short-episode asteroids configs consistent

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    a9d24ae View commit details
    Browse the repository at this point in the history

  10. Add docstring for common config

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    ad61105 View commit details
    Browse the repository at this point in the history

  11. Add tests for training RL + pref comp on image envs

    @dfilan
    dfilan committed Sep 13, 2022
    Configuration menu
    Copy the full SHA
    d90d734 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2022

  1. First draft of training CNNs with DAgger - with backup CNN implementa… 

    …tion visible in comments
    @dfilan
    dfilan committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    d92581c View commit details
    Browse the repository at this point in the history

  2. Delete commented-out alternate implementation of CnnPolicy

    @dfilan
    dfilan committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    8f0c7c0 View commit details
    Browse the repository at this point in the history

  3. Fix notebook bug I introduced

    @dfilan
    dfilan committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    e5be4ca View commit details
    Browse the repository at this point in the history

  4. Fix problem where transpose_obs had to be specified

    @dfilan
    dfilan committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    39c94ea View commit details
    Browse the repository at this point in the history

  5. Fix check for transposition in CnnPolicy

    @dfilan
    dfilan committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    209c61a View commit details
    Browse the repository at this point in the history

  6. Reorder asteroids envs

    @dfilan
    dfilan committed Sep 16, 2022
    Configuration menu
    Copy the full SHA
    e51eaa9 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2022

  1. Try to get AIRL/GAIL working for image envs

    @dfilan
    dfilan committed Sep 17, 2022
    Configuration menu
    Copy the full SHA
    c91caf2 View commit details
    Browse the repository at this point in the history

  2. Improve documentation of transpose_obs arg

    @dfilan
    dfilan committed Sep 17, 2022
    Configuration menu
    Copy the full SHA
    aae2711 View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2022

  1. Get procgen RL training working

    @dfilan
    dfilan committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    b3c9e3e View commit details
    Browse the repository at this point in the history

  2. Add right version of gym3 to get procgen working

    @dfilan
    dfilan committed Oct 5, 2022
    Configuration menu
    Copy the full SHA
    6214805 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2022

  1. Add all procgen environments

    @dfilan
    dfilan committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    ff17412 View commit details
    Browse the repository at this point in the history

  2. Remove awscli dependency

    @dfilan
    dfilan committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    97f16de View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2022

  1. Modify scripts to not deal with awscli

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    6db67fe View commit details
    Browse the repository at this point in the history

  2. No longer test deleted experiment

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    bc422c6 View commit details
    Browse the repository at this point in the history

  3. Improve wording

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    387783e View commit details
    Browse the repository at this point in the history

  4. Oops huggingface models were auto-loaded

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    8654008 View commit details
    Browse the repository at this point in the history

  5. Make imit_benchmark_config match with rollouts_from_policies config

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    dbcb836 View commit details
    Browse the repository at this point in the history

  6. Make script save things where it says it will save them

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    2b09223 View commit details
    Browse the repository at this point in the history

  7. Add seals/HalfCheetah-v0 config to eval_policy

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    3600703 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'master' into remove-awscli

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    cc248fd View commit details
    Browse the repository at this point in the history

  9. Fix merge conflict

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    593a29b View commit details
    Browse the repository at this point in the history

  10. Fix install stuff

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    b59e3a3 View commit details
    Browse the repository at this point in the history

  11. Fix merge error

    @dfilan
    dfilan committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    bcd3f6a View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2022

  1. Merge in master

    @dfilan
    dfilan committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    801c4d9 View commit details
    Browse the repository at this point in the history

  2. Fix merge problem

    @dfilan
    dfilan committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    de5207b View commit details
    Browse the repository at this point in the history

  3. Fix merge conflict

    @dfilan
    dfilan committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    c319744 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2022

  1. Fix formatting, types

    @dfilan
    dfilan committed Oct 13, 2022
    Configuration menu
    Copy the full SHA
    2275b62 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2022

  1. Add procgen configs for eval_policy

    @dfilan
    dfilan committed Oct 17, 2022
    Configuration menu
    Copy the full SHA
    a0682f6 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'cnn_scripts' of github.com:HumanCompatibleAI/imitation … 

    …into cnn_scripts
    @dfilan
    dfilan committed Oct 17, 2022
    Configuration menu
    Copy the full SHA
    051426d View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2022

  1. Merge in master

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    be9391d View commit details
    Browse the repository at this point in the history

  2. Optionally add exploration wrapper before rolling out

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    4dfade3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'wrap_for_rollouts' into cnn_scripts

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    1151f48 View commit details
    Browse the repository at this point in the history

  4. Fix eval_policies config

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    8ed4722 View commit details
    Browse the repository at this point in the history

  5. Add epsilon-greedy exploration named config

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    6140879 View commit details
    Browse the repository at this point in the history

  6. Merge new explore_kwarg config from wrap_for_rollouts

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    65bef2c View commit details
    Browse the repository at this point in the history

  7. Fix exploration wrapper

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    6205c08 View commit details
    Browse the repository at this point in the history

  8. Fix implementation of wrapping rollouts in exploration wrapper

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    548dc2d View commit details
    Browse the repository at this point in the history

  9. [EMPTY] run pre-commit hooks

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    4fc8d86 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'wrap_for_rollouts' into cnn_scripts

    @dfilan
    dfilan committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    2bc4355 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2022

  1. Merge branch 'master' into cnn_scripts

    @dfilan
    dfilan committed Oct 27, 2022
    Configuration menu
    Copy the full SHA
    12f2b39 View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2022

  1. Merge branch 'master' into cnn_scripts

    @dfilan
    dfilan committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    daaac0c View commit details
    Browse the repository at this point in the history

  2. Remove extraneous CNN policy config

    @dfilan
    dfilan committed Nov 29, 2022
    Configuration menu
    Copy the full SHA
    8f1d6e5 View commit details
    Browse the repository at this point in the history