Ani in Metaverse
A personal 3D avatar that mirrors your movement, gestures and speech in real time — entirely in the browser.
- Tammy Shane
A fun project done over a Christmas break: a personalised 3D avatar that tracks and mirrors user movements, gestures and speech-to-lip synchronisation, processed in real time in a web browser.
How it works
Webcam input is captured with MediaPipe and BlazePose, and the motion data is transferred to a VRM avatar created with GANverse3D and Blender, then rigged in Unity. The scene runs in Three.js — all processing happens live on the web, no install required.
