Powered by MyCoRe

Titel:Bimodal Audiovisual Perception in Interactive Application Systems of Moderate Complexity
Autor:Dr.-Ing. Reiter, Ulrich [Autor]
[Dateien anzeigen]ASCII Text, Adobe PDF
[Details]15,99 MB in 3 Dateien
[ZIP-Datei erzeugen][PlugIn/Viewer Download]
Dateien vom 08.10.2009 / geändert 08.10.2009
URL für Lesezeichen:http://www.db-thueringen.de/servlets/DocumentServlet?id=14098
URN (NBN):urn:nbn:de:gbv:ilm1-2009000273
Status:Dokument veröffentlicht
Beitragende:Prof. Dr.-Ing. Brandenburg, Karlheinz [Betreuer/Doktorvater]
PhD Begault, Durand [Gutachter]
Prof. Dr.-Ing. Sporer, Thomas [Gutachter]
Stichwörter:audiovisual quality, Quality of Experience (QoE), interactive application, real-time simulation, MPEG-4, perceived quality, TANGA, subjective assessment
Dewey Decimal Classification:100 Philosophie und Psychologie » 150 Psychologie » 152 Sinneswahrnehmung, Bewegung, Emotionen, Triebe
Andere Dokumente dieser Kategorie
Evaluationstyp:Für die Langzeitarchivierung vorgesehen
The dissertation at hand deals with aspects of quality perception of interactive audiovisual application systems of moderate complexity as e.g. defined in the MPEG-4 standard. Because in these systems the available computing power is limited, it is decisive to know which factors influence the perceived quality. Only then can the available computing power be distributed in the most effective and efficient way for the simulation and display of audiovisual 3D scenes. Whereas quality factors for the unimodal auditory and visual stimuli are well known and respective models of perception have been successfully devised based on this knowledge, this is not true for bimodal audiovisual perception. For the latter, it is only known that some kind of interdependency between auditory and visual perception does exist. The exact mechanisms of human audiovisual perception have not been described. It is assumed that interaction with an application or scene has a major influence upon the perceived overall quality. The goal of this work was to devise a system capable of performing subjective audiovisual assessments in the given context in a largely automated way. By applying the system, first evidence regarding audiovisual interdependency and influence of interaction upon perception should be collected. Therefore this work was composed of three fields of activities: the creation of a test bench based on the available but (regarding the audio functionality) somewhat restricted MPEG-4 player, the preoccupation with methods and framework requirements that ensure comparability and reproducibility of audiovisual assessments and results, and the performance of a series of coordinated experiments including the analysis and interpretation of the collected data. An object-based modular audio rendering engine was co-designed and -implemented which allows to perform simple room-acoustic simulations based on the MPEG-4 scene description paradigm in real-time. Apart from the MPEG-4 player, the test bench consists of a haptic Input Device used by test subjects to enter their quality ratings and a logging tool that allows to journalize all relevant events during an assessment session. The collected data can be exported comfortably for further analysis using appropriate statistic tools. A thorough analysis of the well established test methods and recommendations for unimodal subjective assessments was performed to find out whether a transfer to the audiovisual bimodal case is easily possible. It became evident that - due to the limited knowledge about the underlying perceptual processes - a novel categorization of experiments according to their goals could be helpful to organize the research in the field. Furthermore, a number of influencing factors could be identified that exercise control over bimodal perception in the given context. By performing the perceptual experiments using the devised system, its functionality and ease of use was verified. Apart from that, some first indications for the role of interaction in perceived overall quality have been collected: interaction in the auditory modality reduces a human's ability of correctly rating the audio quality, whereas visually based (cross-modal) interaction does not necessarily generate this effect.

Zusammenfassung (dt.)

Hochschule/Fachbereich:Technische Universität Ilmenau » Fakultät für Elektrotechnik und Informationstechnik
Dokument erstellt am: 07.09.2009
Dateien geändert am: 08.10.2009
Datum der Promotion: 21.08.2009