Messay Gaming Kit
A New Gaming SDK That Sees the Player
In traditional games, the player is little more than a stream of commands sent through a controller. By enabling games to visually recognize the player, this SDK opens up entirely new possibilities. From controls driven by gaze and gestures to avatars that dynamically respond to the player's state, the possibilities are wide-ranging.
Features
No Extra Hardware
No additional hardware required. Track gestures and facial expressions using only the front-facing camera.

Motion Gestures
Recognize movements over time—such as waving, shaking your head, or nodding—as gestures.

User Recognition
Recognize the user's face, appearance, and position to trigger responsive character reactions.

Local Processing
All inference runs locally, keeping privacy-sensitive data securely on the device.

Platforms


Unity support is currently planned, with Unreal Engine and other platforms under consideration for future support.
Usecase

A New Gaming Platform Powered by Gaze and Gestures
Gaze & Gesture Gaming eXperience App
Coming Soon



Racing Game
Control the car with a steering wheel gesture!

Boxing Game
Move your body and dodge the punches!

Baseball
Swing the bat and go for a home run!

Breakout
Move the paddle left and right with your face and smash the blocks!

Electric Maze
Move your face and guide the pointer to the goal!

5-Sec Challenge
Can you open your eyes at exactly 5 seconds?

Doll Horror
Control the flashlight with your face and escape the doll room!


