Skip to content

Commit

Permalink
More fixes to the mixtral readme and scripts
Browse files Browse the repository at this point in the history
  • Loading branch information
nvzhihanj committed Jan 7, 2025
1 parent d4987d1 commit 0dcdaa4
Show file tree
Hide file tree
Showing 4 changed files with 0 additions and 13 deletions.
10 changes: 0 additions & 10 deletions language/mixtral-8x7b/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,11 +13,6 @@ Please see the [new docs site](https://docs.mlcommons.org/inference/benchmarks/l

## Prepare environment

Copy the mlperf.conf file to this folder.
```
cp ../../mlperf.conf .
```

For a CPU-only run:

```
Expand Down Expand Up @@ -136,7 +131,6 @@ wget https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_1
```
python -u main.py --scenario Offline \
--model-path ${CHECKPOINT_PATH} \
--mlperf-conf mlperf.conf \
--user-conf user.conf \
--total-sample-count 15000 \
--device cpu \
Expand All @@ -149,7 +143,6 @@ For a GPU-based run:
```
python3 -u main.py --scenario Offline \
--model-path ${CHECKPOINT_PATH} \
--mlperf-conf mlperf.conf \
--user-conf user.conf \
--total-sample-count 15000 \
--dataset-path ${DATASET_PATH} \
Expand All @@ -162,7 +155,6 @@ python3 -u main.py --scenario Offline \
```
python -u main.py --scenario Server \
--model-path ${CHECKPOINT_PATH} \
--mlperf-conf mlperf.conf \
--user-conf user.conf \
--total-sample-count 15000 \
--device cpu \
Expand All @@ -184,7 +176,6 @@ mkdir -p "run_outputs" # The script will dump all the outputs to 'run_outputs'.
python -u main.py --scenario Offline \
--model-path ${CHECKPOINT_PATH} \
--accuracy \
--mlperf-conf mlperf.conf \
--user-conf user.conf \
--total-sample-count 15000 \
--dataset-path ${DATASET_PATH} \
Expand Down Expand Up @@ -221,7 +212,6 @@ OUTPUT_LOG_DIR=server-accuracy-logs
python -u main.py --scenario Server \
--model-path ${CHECKPOINT_PATH} \
--accuracy \
--mlperf-conf mlperf.conf \
--user-conf user.conf \
--total-sample-count 15000 \
--dataset-path ${DATASET_PATH} \
Expand Down
1 change: 0 additions & 1 deletion language/mixtral-8x7b/run_accuracy.sh
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@ mkdir -p "run_outputs"
python3 -u main.py --scenario Offline \
--model-path ${CHECKPOINT_PATH} \
--accuracy \
--mlperf-conf mlperf.conf \
--user-conf user.conf \
--total-sample-count 15000 \
--dataset-path ${DATASET_PATH} \
Expand Down
1 change: 0 additions & 1 deletion language/mixtral-8x7b/run_offline.sh
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,6 @@ DATASET_PATH="${DATASET_PATH:dataset/2024_06_06_mixtral_15k_v4.pkl}"

python -u main.py --scenario Offline \
--model-path ${CHECKPOINT_PATH} \
--mlperf-conf mlperf.conf \
--user-conf user.conf \
--total-sample-count 15000 \
--dataset-path ${DATASET_PATH} \
Expand Down
1 change: 0 additions & 1 deletion language/mixtral-8x7b/run_server.sh
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,6 @@ DATASET_PATH="${DATASET_PATH:dataset/2024_06_06_mixtral_15k_v4.pkl}"

python -u main.py --scenario Server \
--model-path ${CHECKPOINT_PATH} \
--mlperf-conf mlperf.conf \
--user-conf user.conf \
--total-sample-count 15000 \
--dataset-path ${DATASET_PATH} \
Expand Down

0 comments on commit 0dcdaa4

Please sign in to comment.