Which version of InternVL does TensorRT-llm 1.5 support ?

[spacegrass]

From TensorRT-LLM code

The image preprocess is internvl 1.2 version.
Form InternVL 1.5/2.0 the image preprocess like this:

So, does TensorRT-llm 1.5(the lastest version) support InternVL 2.0 model ?

[nv-guomingz]

Hi @spacegrass the latest code already declared the internvl2 supporting. Please refer to

https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/multimodal#internvl2

[spacegrass]

Hi @spacegrass the latest code already declared the internvl2 supporting. Please refer to

https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/multimodal#internvl2

--- We have use the script to convert hf-model 2 trt-llm model, I find the image process code in the tensorrt-llm main & 0.15.0 branch is the InternVL 1.2 version. the processed image shape is [1, 3, 448, 448], bute the InternVL 2.0 add dynamic split so the default shape is [3, 3, 448, 448]

[nv-guomingz]

@sunnyqgg could u please double confirm this issue?