Skip to content

OpenVINO™ Model Server 2024.0
Compare
Choose a tag to compare
@dkalinowski dkalinowski released this 06 Mar 14:23
· 3 commits to releases/2024/0 since this release
v2024.0
29e108f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

The 2024.0 includes new version of OpenVINO™ backend and several improvements in the serving functionality.

Changes and improvements

  • Updated OpenVINO™ Runtime backend to 2024.0. Link
  • Extended text generation demo to support multi batch size both with streaming and unary clients. Link to demo
  • Added support for REST client for servables based on MediaPipe graphs including python pipeline nodes. Link to demo
  • Added additional MediaPipe calculators which can be reused for multiple image analysis scenarios. Link to new calculators
  • Added support for models with a string input data type including tokenization extension. Link to demo
  • Security related updates in versions of included dependencies. 

Deprecation notices

Batch Size AUTO and Shape AUTO are deprecated and will be removed.
Use Dynamic Model Shape feature instead.

Breaking changes

No breaking changes.

Bug fixes

  • Improvements in error handling for invalid requests and incorrect configuration
  • Minor fixes in the demos and documentation

You can use an OpenVINO Model Server public Docker images based on Ubuntu via the following command:
docker pull openvino/model_server:2024.0 - CPU device support with the image based on Ubuntu22.04
docker pull openvino/model_server:2024.0-gpu - GPU and CPU device support with the image based on Ubuntu22.04
or use provided binary packages.
The prebuilt image is available also on RedHat Ecosystem Catalog

Assets 6
Loading