Code

Refactor Probe and Sweep#3

Code

Open

norabelrose wants to merge 10 commits intomainEleutherAI/mdl:mainfrom refactorEleutherAI/mdl:refactorCopy head branch name to clipboard

+981-204

Commits

Commits on Sep 26, 2023

• Prepare for gutting Sweep.run

  norabelrose

  committed
  06a9054

  Copy full SHA for 06a9054

• Refactor MVP

  norabelrose

  committed
  58d3dfe

  Copy full SHA for 58d3dfe

• Don't early stop too early

  norabelrose

  committed
  ffbfb93

  Copy full SHA for ffbfb93

• Better hparams

  norabelrose

  committed
  5ca1ec0

  Copy full SHA for 5ca1ec0

• Remove duplicate code in Sweep.run

  norabelrose

  committed
  2d6b815

  Copy full SHA for 2d6b815

• Backtracking in Probe.fit

  norabelrose

  committed
  2f8cb88

  Copy full SHA for 2f8cb88

• Sweep now calls preprocessor on test set

  norabelrose

  committed
  3e3518e

  Copy full SHA for 3e3518e

Commits on Sep 27, 2023

• MlpProbe now has a residual architecture

  norabelrose

  committed
  d08f398

  Copy full SHA for d08f398

• label smoothing

  norabelrose

  committed
  99488cc

  Copy full SHA for 99488cc

• remove gradscaler

  norabelrose

  committed
  71be6e7

  Copy full SHA for 71be6e7