Verification check for model - VLLM

[anandhu-eng]

For testing, vllm server was up with the command:

cm run script --tags=run,vllm-server --model=NousResearch/Hermes-2-Theta-Llama-3-8B --api_key=""

The client script:

cm run script --tags=run-mlperf,inference,_full --model=llama2-70b-99.9 --implementation=reference --device=cpu --quiet --api_server=http://0.0.0.0:8000 --adr.mlperf-implementation.tags=_repo.https://github.com/gateoverflow/inference --rerun