SCIPR | Articulab Summer & Fall 2017
The Sensing Curiosity in Play and Responding (SCIPR) project of the Articulab, led by Professor Justine Cassell and Post Doctoral Fellow Zhen Bai is aimed at developing technologies for fostering curiosity and exploration in elementary school students using virtual human agents and a set of curiosity-evoking augmented reality toys.
My work for the SCIPR project was divided into two parts: 
  1. Develop a Virtual Peer with a range of gestures and expressions
  2. Design a new game board layout using computer vision card tracking​

​Currently, a virtual agent controlled by a hidden human plays a custom card game developed by the OH! Lab called Outbreak with a group of up to 3 children. In the original game board design, everything in the card game is manually tracked and input into the system by a human observer. The Automatic SCIPR Game Tracker is designed to replace the human in tracking Gear Cards and Battery Tokens using fiducial marker computer vision technology, which will be linked with a real-time Artificially Intelligent Game Reasoner that makes gameplay decisions. 
Cute little 3D-printed player robot game character piece.
Picture
The Automatic Card Tracking System in action, simultaneously recognizing 27 fiducial marker positions and orientations at 5 FPS.