Support response streaming in Plugins mode

[tamikomssi]

It would be much more convenient for the user's point of view to see the response generated immediately instead of waiting 1-2 min before seeing the answer. Moreover this would enable the use of gpt-4-1106-preview which is currently extremely slow compared to gpt-4 in plugins mode.

[danny-avila]

Thanks, this is something I want as well. The future of plugins/tools will see an overhaul soon where this will be revisited

[gloriousknight]

Hi, I would like to know in which version this feature will be added?

[berry-13]

#2041 (comment)

[gloriousknight]

Thanks.