DEV Community

Cover image for MiKaPo: Web-based Real-Time Motion Capture for MMD
Amyang
Amyang

Posted on

MiKaPo: Web-based Real-Time Motion Capture for MMD

https://mikapo.amyang.dev

https://github.com/AmyangXYZ/MiKaPo

Pose your MMD model in browser with any video!

Support face and body landmarks now.

Ollama support is under development in the electron build.

Built with mediapipe, babylonjs and react. MMD models are from https://aplaybox.com

The most challenging part is the bone control of MMD model, lots of rotation matrix calculation...

Image description
pose
face

Top comments (0)