SwarmPlay: Interactive tic-tac-toe board game with swarm of nano-UAVs driven by reinforcement learning

Ekaterina Karmanova, Valerii Serpiva, Stepan Perminov, Aleksey Fedoseev, Dzmitry Tsetserukou

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Citations (Scopus)

Abstract

Reinforcement learning (RL) methods have been actively applied in the field of robotics, allowing the system itself to find a solution for a task otherwise requiring a complex decision-making algorithm. In this paper, we present a novel RL-based Tic-tac-toe scenario, i.e. SwarmPlay, where each playing component is presented by an individual drone that has its own mobility and swarm intelligence to win against a human player. Thus, the combination of challenging swarm strategy and human-drone collaboration aims to make the games with machines tangible and interactive. Although some research on AI for board games already exists, e.g., chess, the SwarmPlay technology has the potential to offer much more engagement and interaction with the user as it proposes a multi-agent swarm instead of a single interactive robot. We explore user's evaluation of RL-based swarm behavior in comparison with the game theory-based behavior. The preliminary user study revealed that participants were highly engaged in the game with drones (70% put a maximum score on the Likert scale) and found it less artificial compared to the regular computer-based systems (80%). The affection of the user's game perception from its outcome was analyzed and put under discussion. User study revealed that SwarmPlay has the potential to be implemented in a wider range of games, significantly improving human-drone interactivity.

Original languageEnglish
Title of host publication2021 30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1269-1274
Number of pages6
ISBN (Electronic)9781665404921
DOIs
Publication statusPublished - 8 Aug 2021
Event30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021 - Virtual, Vancouver, Canada
Duration: 8 Aug 202112 Aug 2021

Publication series

Name2021 30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021

Conference

Conference30th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2021
Country/TerritoryCanada
CityVirtual, Vancouver
Period8/08/2112/08/21

Fingerprint

Dive into the research topics of 'SwarmPlay: Interactive tic-tac-toe board game with swarm of nano-UAVs driven by reinforcement learning'. Together they form a unique fingerprint.

Cite this