ADVANCED FACE & CONTROLLER /WINTER 2018

Short Description
An open software framework compatible with a wide variety of therapy robots for Windows and Android. Essentially, this is a more advanced and capable version of Fine Art Miracle's existing Hugo and Migo client face and host controller software, developed with the guidance of Fine Art Miracles. The primary focus of this project is to significantly improve both the client face and host controller software. The ultimate use case of this software is to teach and inspire children with autism and other special needs.
Client Face
Previously, the Hugo/Migo faces have the following features:
  1. Emotion Display ( Concerned | Surprise | Happy | Sad )
  2. Face Color Customization
  3. Speech to Text Voice
  4. Lip Sync Vocals

The tablet or phone face has been improved with the following features:
  1. More customizable faces / emotions
  2. Face tracking with eyes looking at user.
  3. Speech recognition for conversation logging
  4. Face design that works in portrait and landscape mode, adjustable aspect ratios

Host Controller
Previously, the host controller has the following features:
  1. Bluetooth discovery and connection of Client Face
  2. File Save, Load and Selection with speech phrase list
  3. Speech to text entry, adding and deleting with quick phrase selection
  4. Expression control / Face color control
  5. Pan/Tilt robot hardware control

The tablet host controller has been improved with the following features:
  1. Advanced Pallet Speech Selection user interface
  2. Ability to load custom “Speech Pallets” (In either JSON, XML, or CSV format)
  3. Ability to share custom “Speech Pallets” (via email or Google Sheets)
  4. Improved Emotion Control and generalized robot control
  5. Improved Speech Editing user interface​
Animated expressive robot face.
Animated robot face controller with button mappings.
Robot faces on various Android devices.
Robot face on soft foam robot prototype.
Testing Bluetooth compatibility with Arduino.