diff --git a/docs/submission/index.md b/docs/submission/index.md index 4c892379b..a75bc3259 100644 --- a/docs/submission/index.md +++ b/docs/submission/index.md @@ -12,8 +12,8 @@ hide: === "Non CM based benchmark" If you have not followed the `cm run` commands under the individual model pages in the [benchmarks](../index.md) directory, please make sure that the result directory is structured in the following way. ``` - └── System description ID - ├── cm_sut_info.json + └── System description ID(SUT Name) + ├── system_meta.json └── Benchmark └── Scenario ├── Performance @@ -25,7 +25,7 @@ hide: | ├── mlperf_log_detail.txt | ├── mlperf_log_accuracy.json | └── accuracy.txt - └── Test_ID + └── Compliance_Test_ID ├── Performance | └── run_x/#1 run for all scenarios | ├── mlperf_log_summary.txt @@ -38,18 +38,9 @@ hide: ├── verify_performance.txt └── verify_accuracy.txt #for TEST01 only ``` - - !!! tip - - - The `cm_sut_info.json` should contain the following keys - - `hardware_name` - - `implementation` - - `device` - - `framework` - - `run_config`
- Click here if you are submitting custom model in open division + Click here if you are submitting in open division * The `model_mapping.json` should be included inside the SUT folder which is used to map the custom model full name to the official model name. The format of json file is: