ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition

Ilya Zakharkin, Arman Tsaturyan, Miguel Altamirano Cabrera, Jonathan Tirado, Dzmitry Tsetserukou

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Citations (Scopus)

Abstract

We present ZoomTouch, a breakthrough technology for multi-user and real-time control of robot from Zoom by DNN-based gesture recognition. The users can have a video conferencing in a digital world and at the same time to perform dexterous manipulations with tangible objects by remote robot. As the scenario, we proposed the remote robotic COVID-19 test Laboratory to substitute medical assistant working in protective gear in close proximity with infected cells and to considerably reduce the time to receive the test results. The proposed technology suggests a new type of reality, where multi-users can jointly interact with remote object, e.g. make a new building design, joint cooking in robotic kitchen, etc, and discuss/modify the results at the same time.

Original languageEnglish
Title of host publicationSIGGRAPH Asia 2020 Emerging Technologies, SA 2020
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450381109
DOIs
Publication statusPublished - 4 Dec 2020
Externally publishedYes
EventSIGGRAPH Asia 2020 Emerging Technologies - International Conference on Computer Graphics and Interactive Techniques, SA 2020 - Virtual, Online, Korea, Republic of
Duration: 4 Dec 202013 Dec 2020

Publication series

NameSIGGRAPH Asia 2020 Emerging Technologies, SA 2020

Conference

ConferenceSIGGRAPH Asia 2020 Emerging Technologies - International Conference on Computer Graphics and Interactive Techniques, SA 2020
Country/TerritoryKorea, Republic of
CityVirtual, Online
Period4/12/2013/12/20

Keywords

  • Gesture Recognition
  • Hand Tracking
  • Robotics
  • Teleoperation

Fingerprint

Dive into the research topics of 'ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition'. Together they form a unique fingerprint.

Cite this