MaskBot: Real-time Robotic Projection Mapping with Head Motion Tracking

Miguel Altamirano Cabrera, Igor Usachev, Juan Heredia, Jonathan Tirado, Dzmitry Tsetserukou

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    1 Citation (Scopus)

    Abstract

    The projection mapping systems on the human face are limited by the process latency and the users' movement. The area of the projection is restricted by the position of the projectors and cameras. We are introducing MaskBot, a real-time projection mapping system guided by a 6 Degrees of Freedom (DoF) collaborative robot. The collaborative robot locates the projector and camera in front of the user's face to increase the projection area and reduce the system's latency. A webcam is used to detect the face orientation and to measure the robot-user distance. Based on this information we modify the projection size and orientation. MaskBot projects different images on the user's face, such as face modifications, make-up, and logos. In contrast to the existing methods, the presented system is the first that introduces a robotic projection mapping. One of the prospective applications is to acquire a dataset of adversarial images to challenge face detection DNN systems, such as Face ID.

    Original languageEnglish
    Title of host publicationSIGGRAPH Asia 2020 Emerging Technologies, SA 2020
    PublisherAssociation for Computing Machinery, Inc
    ISBN (Electronic)9781450381109
    DOIs
    Publication statusPublished - 4 Dec 2020
    EventSIGGRAPH Asia 2020 Emerging Technologies - International Conference on Computer Graphics and Interactive Techniques, SA 2020 - Virtual, Online, Korea, Republic of
    Duration: 4 Dec 202013 Dec 2020

    Publication series

    NameSIGGRAPH Asia 2020 Emerging Technologies, SA 2020

    Conference

    ConferenceSIGGRAPH Asia 2020 Emerging Technologies - International Conference on Computer Graphics and Interactive Techniques, SA 2020
    Country/TerritoryKorea, Republic of
    CityVirtual, Online
    Period4/12/2013/12/20

    Keywords

    • Motion Capture
    • Projection Mapping
    • Robotics
    • Tracking System

    Fingerprint

    Dive into the research topics of 'MaskBot: Real-time Robotic Projection Mapping with Head Motion Tracking'. Together they form a unique fingerprint.

    Cite this