Code

[DRAFT] prompt migration engine#808

Code

Draft

heyjustinai wants to merge 21 commits intomainmeta-llama/llama-cookbook:mainfrom prompt-migrationmeta-llama/llama-cookbook:prompt-migrationCopy head branch name to clipboard

+19,933

Commits

Commits on Jan 15, 2025

• added evaluator and formatter and main

  heyjustinai

  committed
  2570d16

  Copy full SHA for 2570d16

• add usage guide and init

  heyjustinai

  committed
  08e41d0

  Copy full SHA for 08e41d0

• add engine and eval dataset

  heyjustinai

  committed
  a3e96e4

  Copy full SHA for a3e96e4

• add .env settings and configure yml

  heyjustinai

  committed
  096249b

  Copy full SHA for 096249b

• placeholder readme

  heyjustinai

  committed
  263b8b5

  Copy full SHA for 263b8b5

• adding eval dataset

  heyjustinai

  committed
  43a2cbc

  Copy full SHA for 43a2cbc

• change eval dataset, include more robust judging, improved main

  heyjustinai

  committed
  b85811d

  Copy full SHA for b85811d

• minor changes in eval, deleted formatter

  heyjustinai

  committed
  90d16cd

  Copy full SHA for 90d16cd

• update dir

  heyjustinai

  committed
  4d75fe9

  Copy full SHA for 4d75fe9

Commits on Jan 16, 2025

• updated prompt migration to use benchmark and also mipro, added meta implementation

  heyjustinai

  committed
  e52e1d1

  Copy full SHA for e52e1d1

• update harness notebook

  heyjustinai

  committed
  1e4c6d2

  Copy full SHA for 1e4c6d2

• update harness notebook

  heyjustinai

  committed
  62b5367

  Copy full SHA for 62b5367

• beef up readme

  heyjustinai

  committed
  5730a84

  Copy full SHA for 5730a84

Commits on Jan 17, 2025

• added updated llama-mmlu-pro and added human-eva

  heyjustinai

  committed
  314b6a8

  Copy full SHA for 314b6a8

• harness runcode

  heyjustinai

  committed
  2776a35

  Copy full SHA for 2776a35

Commits on Jan 21, 2025

• updated readme

  heyjustinai

  committed
  0bec41f

  Copy full SHA for 0bec41f

• change gpu parallel size docs

  heyjustinai

  committed
  03f2b8e

  Copy full SHA for 03f2b8e

Commits on Jan 22, 2025

• attempt to fix json output format in eval

  heyjustinai

  committed
  becbe77

  Copy full SHA for becbe77

• <Replace this line with a title. Use 1 line only, 67 chars or less>

  Show description for a6f448f
  heyjustinai

  committed
  a6f448f

  Copy full SHA for a6f448f

• revert to previous changes

  heyjustinai

  committed
  4fd5f29

  Copy full SHA for 4fd5f29

• batching and parallelization, ran on baseline and lite

  heyjustinai

  committed
  eea9661

  Copy full SHA for eea9661