AI Tetris Game Control

This solution features an innovative AI controller that translates real-time body movements into USB HID Keyboard signals, enabling an immersive Tetris experience.

Dual-Layer AI Architecture

  • Layer 1 (Pose Estimation): Real-time tracking of player skeletal landmarks.
  • Layer 2 (Gesture Recognition): A lightweight NN recognizes Left, Right, and Rotate commands. A Jump action triggers the Space key for a fast drop.

This design shows Nuvoton’s power in Endpoint AI, featuring high performance, low latency, and high integration. By combining AI inference and control logic on a single chip, it provides a cost-effective, highly interactive solution for motion-sensing HMI applications.

  • Feature
    TensorFlow Lite Micro architecture
    -
    Compatible with CNN, RNN, and LSTM
    Supports parallel CMOS sensor
    - 800x480 resolution TFT-LCD display
    - Using NuML Studio, NuEdgeWise, NuML Tool
  • Specifications
    M55M1 (32-bit Arm® Cortex®-M55)
    - Operating frequency up to 220 MHz
    Ethos-U55 220 MHz 256 MAC
    - Memory
      - 1.5 MB SRAM/ 2 MB Flash Memory
    Connectivity
      - Parallel Image Sensor, DMIC, USB, I2C, UART, Nu-Link
  • System Block Diagram

 AI Tetris Game Control