The Research Group is Moving!

During winter term 2021/22, we move to University of Bamberg. From Oct. 15, 2021, Fabian Beck holds a full professor position on Information Visualization.

New webpage of the research group: https://www.uni-bamberg.de/vis

Publications

Publications of the research group since 2016. For earlier publications, please visit Fabian Beck's Google Scholar or DBLP profile.

Talking Realities: Audio Guides in Virtual Reality Visualizations

Type of Publication: Article in Journal

Talking Realities: Audio Guides in Virtual Reality Visualizations

Author(s):
Latif, Shahid; Tarner, Hagen; Beck, Fabian
Title of Journal:
IEEE Computer Graphics and Applications
Publication Date:
2021
Language:
English
Keywords:
Data visualization, Virtual reality, Visualization, Speech synthesis, Data analysis
Digital Object Identifier (DOI):
doi:10.1109/MCG.2021.3058129
Fulltext:
Talking Realities: Audio Guides in Virtual Reality Visualizations (1.38 MB)
Link to complete version:
https://ieeexplore.ieee.org/document/9351649
Talk associated with this publication:
VIS YouTube Channel
Recording:
https://www.youtube.com/watch?v=aAnwF9B_Wso
Citation:
Download BibTeX

Abstract

Building upon the ideas of storytelling and explorable explanations, we introduce Talking Realities, a concept for producing data-driven interactive narratives in virtual reality. It combines an audio narrative with an immersive visualization to communicate analysis results. The narrative is automatically produced using template-based natural language generation and adapts to data and user interactions. The synchronized animation of visual elements in accordance with the audio connects the two representations. In addition, we discuss various modes of explanation ranging from fully guided tours to free exploration of the data. We demonstrate the applicability of our concept by developing a virtual reality visualization for air traffic data. Furthermore, generalizability is exhibited by sketching mock-ups for two more application scenarios in the context of information and scientific visualization.