Commissioning and HMI Development for the Reachy Mini at TTZ Nürnberger Land

Abstract

The TTZ Nürnberger Land is acquiring a Reachy Mini from Pollen Robotics — a compact, open-source desktop robot specifically designed for exploring human-robot interaction (HRI). With six degrees of freedom in its head, a wide-angle camera, four microphones, an integrated speaker, and animated antennas, the Reachy Mini provides an expressive platform for intuitive and engaging interaction concepts.

The goal of this thesis is to commission the robot at TTZ and develop one or more HMI applications that showcase the system’s potential in the context of applied research and technology demonstration. The focus is on creating natural and engaging forms of interaction — for example through speech, gaze, gesture, or simple emotional expressions of the robot.

The work begins with an analysis of the available software interfaces and a complete setup of the robot. A concrete application scenario is then selected, prototypically implemented, and systematically evaluated. Possible scenarios include a visitor information and greeting system for the TTZ, an interactive demonstration system for technology presentations, or a research setup for studying interaction behaviour.

The open software architecture of the Reachy Mini — based on Python, a web-based dashboard, and integration with Hugging Face Spaces and modern AI models — enables a wide range of implementation options and is particularly well-suited for experimental and creative approaches in HRI research.

Type
Publication
Project, Bachelor’s or Master’s Thesis, TH Nürnberg — TTZ Nürnberger Land

Motivation

The Reachy Mini is one of the most accessible open-source platforms for exploring human-robot interaction. Its compact form factor, expressive head movement, and multimodal sensing (camera, microphones, speaker, antennas) make it ideal for studies and demonstrations where intuitive human-machine communication is at the forefront.

At TTZ Nürnberger Land, it is intended to serve as a lively research and demonstration platform — for technology presentations, visitor interaction, and experimental HRI research.

Work Packages

Commissioning

  • Assembly and setup of the hardware (Reachy Mini Wireless)
  • Installation and configuration of the software environment (Python, web dashboard)
  • Exploration of available APIs, Hugging Face Spaces, and development interfaces

Application Development

  • Selection and elaboration of a concrete HMI application scenario
  • Implementation of the interaction logic (speech, gesture, facial expression, camera feedback)
  • Integration of AI components (e.g. speech recognition, face detection)

Evaluation & Documentation

  • User study or structured evaluation of the developed application
  • Documentation of the system as a basis for follow-up projects at TTZ

Requirements

  • Basic knowledge of Python
  • Interest in human-robot interaction, AI, or service robotics
  • Creativity in designing interaction scenarios
  • Ideally, first experience with embedded systems, Raspberry Pi, or ROS

Depending on the focus and scope, the topic can be carried out as a project thesis, bachelor’s thesis, or master’s thesis.

Supervision

RoleNameE-Mail
SupervisorProf. Dr. Christian Pfitznerchristian.pfitzner@th-nuernberg.de

Location: TTZ Nürnberger Land / TH Nürnberg Georg Simon Ohm

Prof. Dr. Christian Pfitzner
Prof. Dr. Christian Pfitzner
Professor of Mobile Robotics

Professor of Mobile Robotics at TH Nürnberg Georg Simon Ohm, Faculty efi. Director of the TTZ Nürnberger Land. Research interests in autonomous navigation, drone technology and sensor fusion.