test-mlserver

Install dependencies

poetry install

Run app

poetry run app-start

Run load test

• Install k6
• Execute the following test scenarios

Rest tests

k6 run --vus 100 --duration 30s benchmarking/load-tests/scenarios/k6/rest_df.js

k6 run --vus 100 --duration 30s benchmarking/load-tests/scenarios/k6/rest_base64.js

Grpc tests

k6 run --vus 100 --duration 30s benchmarking/load-tests/scenarios/k6/grpc_df.js

k6 run --vus 100 --duration 30s benchmarking/load-tests/scenarios/k6/grpc_base64.js