Art der Publikation: Beitrag in Zeitschrift

Talking Realities: Audio Guides in Virtual Reality Visualizations

Autor(en):

Latif, Shahid; Tarner, Hagen; Beck, Fabian

Titel der Zeitschrift:

IEEE Computer Graphics and Applications

Veröffentlichung:

2021

Sprache:

English

Schlagworte:

Data visualization, Virtual reality, Visualization, Speech synthesis, Data analysis

Digital Object Identifier (DOI):

doi:10.1109/MCG.2021.3058129

Volltext:

Talking Realities: Audio Guides in Virtual Reality Visualizations (1,38 MB)

Link zum Volltext:

https://ieeexplore.ieee.org/document/9351649

Vortrag zu dieser Publikation:

VIS YouTube Channel

Aufzeichnung:

https://www.youtube.com/watch?v=aAnwF9B_Wso

Zitation:

Download BibTeX

Kurzfassung

Building upon the ideas of storytelling and explorable explanations, we introduce Talking Realities, a concept for producing data-driven interactive narratives in virtual reality. It combines an audio narrative with an immersive visualization to communicate analysis results. The narrative is automatically produced using template-based natural language generation and adapts to data and user interactions. The synchronized animation of visual elements in accordance with the audio connects the two representations. In addition, we discuss various modes of explanation ranging from fully guided tours to free exploration of the data. We demonstrate the applicability of our concept by developing a virtual reality visualization for air traffic data. Furthermore, generalizability is exhibited by sketching mock-ups for two more application scenarios in the context of information and scientific visualization.