MediaPipe API Server

Get Started

pip install -r requirements.txt

Acquire ckpt for mmpose via https://github.com/open-mmlab/mmpose/tree/main/projects/rtmo and put it in ./ckpt. After that, select the corresponding configuration file, the default configuration is for "rtmo-t_8xb32-600e_body7-416x416-f48f75cb_20231219.pth"

Start server

python -m mediapipe_apiserver serve

Start Client

wscat -c 127.0.0.1:3000/v1/dummy
python ./playground/test_ws_client.py

TODO

• update requirements
• add mmpose support
  • add mmpose interface
  • make mmpose keypoints align with mediapipe keypoints
• add ZED-2 camera support
• raw image api, annotated image API
• client library
• add __enter__ to camera class that supports with context

Develope Guide

Requirements

• To use the ZED-2 camera, it's recommend to install the ZED SDK. See https://www.stereolabs.com/developers/release/.

• To use the Azure Kinect camera, please follow the instructions in the Azure Kinect SDK.

• A Websocket debug tool, such as wscat (Run npm -g install wscat to install).

Licenses

This project is licensed under the MIT License - see the LICENSE file for details.

This project uses MediaPipe, which is licensed under the Apache License 2.0.