Multisensory analytics: Case of visual-auditory analysis of scalar fields

E. Malikova, V. Pilyugin, V. Adzhiev, G. Pasko, A. Pasko

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Citations (Scopus)

Abstract

A well-known definition of visualization is the mapping of initial data to a visual representation, which can be perceived and interpreted by humans. Human senses include not only vision, but also hearing, sense of touch, smell and others including their combinations. Visual analytics and its more general version that we call Multisensory Analytics are areas that consider visualization as one of its components. We present a particular case of the multisensory analytics with a hybrid visual-auditory representation of data to show how auditory display can be used in the context of data analysis. Some generalizations based on using real-valued vector functions for solving data analysis problems by means of multisensory analytics are proposed. These generalizations might be considered as a first step to formalization of the correspondence between the initial data and various sensory stimuli. An illustration of our approach with a case study of analysis of a scalar field using both visual and auditory data representations is given.

Original languageEnglish
Title of host publicationIVAPP
EditorsLars Linsen, Alexandru Telea, Jose Braz
PublisherSciTePress
Pages322-329
Number of pages8
ISBN (Electronic)9789897582288
DOIs
Publication statusPublished - 2017
Externally publishedYes
Event12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2017 - Porto, Portugal
Duration: 27 Feb 20171 Mar 2017

Publication series

NameVISIGRAPP 2017 - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications
Volume3

Conference

Conference12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2017
Country/TerritoryPortugal
CityPorto
Period27/02/171/03/17

Keywords

  • Multimedia coordinates
  • Multisensory data analysis
  • Scalar field
  • Scientific visualization
  • Sonification
  • Sound
  • Visual analytics

Fingerprint

Dive into the research topics of 'Multisensory analytics: Case of visual-auditory analysis of scalar fields'. Together they form a unique fingerprint.

Cite this