This animation is a Real-Time AI-Driven Digital Puppetry experience. It transforms your hand into a remote controller for a sophisticated 3D mechanical droid, blending computer vision with high-end 3D rendering.
Here is a breakdown of the experience from a user perspective:
Instead of using a mouse or keyboard, you are the controller. The system uses your webcam to track 21 distinct points on your hand.
The Follower: The Droid is “anchored” to your palm. As you move your hand through the air, the robot glides with you in 3D space with a slight, fluid delay that makes it feel like it has weight and momentum.
The Mechanical Response: When you pinch your fingers, you aren’t just clicking a button; you are physically manipulating the robot’s hydraulic “arm” length. It feels like you are stretching or compressing a physical object.
The robot isn’t just moving; it’s “reacting” to your anatomy:
Social Interaction (The Head): By spreading your fingers wide or closing them, you control the robot’s gaze. It creates a “living” effect—if you spread your fingers as if surprised, the robot turns its head to look around the room.
Dynamic Scaling: If you switch to the “Orb” or use the pinch gesture, the object changes size based on your hand’s tension. This provides visual haptic feedback—you “feel” the size of the object through the distance between your fingers.
The visual style is designed to look like a futuristic laboratory:
Realistic Materials: The robot isn’t a flat color. It uses Physical Based Rendering (PBR). You will see “Clearcoat” reflections (like a luxury car) and “Chrome” joints that glint as the robot moves.
Neon Feedback: The glowing “eyes” and core of the robot provide a neon contrast against the dark, moody background. When you change the color in the panel, the robot’s “soul” updates instantly, reflecting its glow onto the metallic armor.
The control panel follows modern Apple-style Glassmorphism design:
It stays out of the way, semi-transparent, allowing the 3D scene to remain the focus.
The Status Dot: A small “heartbeat” indicator in the corner tells you if the AI is “seeing” you. Red means it’s searching; Neon Green means you are successfully synced with the Droid.
Move Palm: Moves the Robot.
Pinch (Thumb to Index): Extends/Retracts Droid Arms.
Open/Close Hand: Rotates the Droid’s Head.
Color Picker: Changes the Droid’s energy glow.
It feels less like watching a video and more like holding a high-tech action figure that has come to life inside your screen.