Regular Full Paper (Including Dataset & Tools)

• Effect of Environmental Noise in Speech Quality Assessment Studies using Crowdsourcing - Rafael Zequeira Jiménez (Technische Universität Berlin, Germany), Babak Naderi (Quality and Usability Lab, Technische Universität Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)
• Classification of Viewing Abandonment Reasons for Adaptive Bitrate Streaming - Shoko Takahashi (NTT Corporation, Japan), Kazuhisa Yamagishi and Jun Okamoto (NTT, Japan)
• Objective and Subjective QoE Evaluation for Adaptive Point Cloud Streaming - Jeroen van der Hooft (Ghent University - imec, Belgium), Maria Torres Vega (Ghent University, Belgium), Christian Timmerer (Alpen-Adria-Universität Klagenfurt, Austria), Ali C. Begen (Ozyegin University & Networked Media, Turkey), Filip De Turck (Ghent University - imec, Belgium), Raimund Schatz (Alpen-Adria Universität Klagenfurt &amp, AIT Austrian Institute of Technology, Austria)
• Audio Impairment Recognition Using a Correlation-Based Feature Representation - Alessandro Ragano (University College Dublin & Insight Centre for Data Analytics, Ireland), Emmanouil Benetos (Queen Mary University of London, United Kingdom (Great Britain)), Andrew Hines (University College Dublin, Ireland)
• SMASH: a Supervised Machine Learning Approach to Adaptive Video Streaming over HTTP - Yusuf Sani (Western Gateway Building, Western Road & University College Cork, Ireland), Darijo Raca, Jason J Quinlan and Cormac J. Sreenan (University College Cork, Ireland)
• How deep is your encoder: an analysis of features descriptors for an autoencoder-based audio-visual quality metric - Helard Martinez and Andrew Hines (University College Dublin, Ireland), Mylene Farias (University of Brasilia, Brazil)
• Player Ready? A Model for Evaluating VR Game Interfaces - Ralf Bierig (Maynooth University, Ireland), Damien Mac Namara (Fury VR Ltd., Ireland)
• You Drive Me Crazy! Interactive QoE Assessment for Telepresence Robot Control - Hamed Z. Jahromi (University College Dublin, Ireland), Ivan Bartolec (University of Zagreb, Faculty of Electrical Engineering and Computing, Croatia), Edwin Gamboa (Technische Universität Ilmenau, Institute of Media Technology, Germany), Andrew Hines (University College Dublin, Ireland), Raimund Schatz (AIT Austrian Institute of Technology, Austria)
• Are You Still Watching? Streaming Video Quality and Engagement Assessment in the Crowd - Werner Robitza (Ilmenau University of Technology, Germany), Alexander Dethof (AVEQ GmbH, Austria), Steve Göring (Ilmenau University of Technology, Germany), Alexander Raake (Technische Universität Ilmenau, Germany), André Beyer (Crowdee GmbH, Germany), Tim Polzehl (Technische Universität Berlin & Berlin Institute of Technology, Germany)
• The impact of jerk on quality of experience and cybersickness in an immersive wheelchair application - Débora Pereira Salgado (Athlone Institute of Technology & Universidade Federal de Uberlândia, Ireland), Ronan Flynn (Athlone Institute of Technology, Ireland), Eduardo Lazaro Martins Naves (Universidade Federal de Uberlandia, Brazil), Niall Murray (Athlone Institute of Technology, Ireland)
• Impact of the Number of Votes on the Reliability and Validity of Subjective Speech Quality Assessment in the Crowdsourcing Approach - Babak Naderi (Quality and Usability Lab, Technische Universität Berlin, Germany), Tobias Hoßfeld (University of Würzburg, Germany), Matthias Hirth (Ilmenau University of Technology, Germany), Florian Metzger (University of Würzburg, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany), Rafael Zequeira Jiménez (Technische Universität Berlin, Germany)
• Cross data set performance consistency of objective quality assessment methods for light fields - Saeed Mahmoudpour (Vrije Universiteit Brussel(VUB) & Imec, Belgium), Peter Schelkens (Vrije Universiteit Brussel & Imec, Belgium)
• Application of Just-Noticeable Difference in Quality as Environment Suitability Test for Crowdsourcing Speech Quality Assessment Task - Babak Naderi (Quality and Usability Lab, Technische Universität Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)
• Generating Thermal Image Data Samples using 3D Facial Modelling Techniques and Deep Learning Methodologies - Muhammad Ali Farooq (National University of Ireland Galway (NUIG) & Xperi Corporation, Ireland), Peter Corcoran (National University of Ireland, Galway & National University of Ireland Galway, Ireland)
• Speech Quality Factors for Traditional and Neural-Based Low Bit Rate Vocoders - Wissam A Jassim (University College Dublin, Ireland), Jan Skoglund and Michael Chinen (Google, Inc., USA), Andrew Hines (University College Dublin, Ireland)
• PCQM: A full-reference quality metric for colored 3D point clouds - Gabriel Meynet (LIRIS, CNRS, Univ\. Lyon, France), Yana Nehmé (INSA Lyon, CNRS LIRIS, France), Julie Digne (LIRIS, CNRS, France), Guillaume Lavoué (LIRIS UMR 5205, Insa-Lyon, France)
• A color-based objective quality metric for point cloud contents - Irene Viola, Shishir Subramanyam and Pablo Cesar (CWI, The Netherlands)
• Impact of Tactile and Visual Feedback on Breathing Rhythm and User Experience in VR Exergaming - Robert Greinacher and Tanja Kojic (Technische Universität Berlin, Germany), Luis Meier (TU Berlin, Germany), Rudresha Gulaganjihalli Parameshappa (Technische Universität Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany), Jan-Niklas Voigt-Antons (Technische Universität Berlin, Germany)
• Visual Quality Assessment for Interpolated Slow-motion Videos based on a Novel Database - Hui Men, Vlad Hosu and Hanhe Lin (University of Konstanz, Germany), Andrés Bruhn (University of Stuttgart, Germany), Dietmar Saupe (University of Konstanz, Germany)
• Subjective Assessment of Stereoscopic Image Quality: The Impact of Visually Lossless Compression - Sanjida Sharmin Mohona, Domenic Au, Onoise Kio, Richard Robinson, Yuqian Hou, Laurie M. Wilcox and Robert S Allison (York University, Canada)
• On Versatile Video Coding at UHD with Machine-Learning-Based Super-Resolution - Kristian Fischer (Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Germany), Christian Herglotz (Friedrich-Alexander University Erlangen-Nürnberg (FAU), Germany), Andre Kaup (University of Erlangen-Nuremberg, Germany)
• "User Experience of Reading in Virtual Reality - Finding Values for Text Distance, Size and Contrast" - Tanja Kojic (Technische Universität Berlin, Germany), Danish Ali (TU Berlin, Germany), Robert Greinacher (Technische Universität Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany), Jan-Niklas Voigt-Antons (Technische Universität Berlin, Germany)
• Dataset Cleaning - A Cross Validation Methodology for Large Facial Datasets using Face Recognition - Viktor Varkarakis (National University of Ireland Galway, Ireland), Peter Corcoran (National University of Ireland, Galway & National University of Ireland Galway, Ireland)
• Testing a Quality of Experience (QoE) Model of Loudspeaker-based Spatial Speech Reproduction - Stefan Uhrig (Technische Universität Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany), Dawn Behne (Norwegian University of Science and Technology, Norway), Peter Svensson (NTNU, Norway), Andrew Perkis (Norwegian University of Science and Technology, Norway)
• Towards a Point Cloud Quality Assessment Model Using Local Binary Patterns - Rafael Diniz (University of Brasília, Brazil), Pedro Garcia Freitas (Samsung, Brazil), Mylene Farias (University of Brasilia, Brazil)
• Different Points of View: Impact of 3D Point Cloud Reduction on QoE of Rendered Images - Michael Seufert, Julian Kargl, Johannes Schauer, Andreas Nüchter and Tobias Hoßfeld (University of Würzburg, Germany)
• Personal Task Design Preferences of Crowdworkers - Matthias Hirth (Ilmenau University of Technology, Germany), Kathrin Borchert (University of Wuerzburg, Germany), Katrien De Moor (Norwegian University of Science and Technology (NTNU), Norway), Vanessa Borst and Tobias Hoßfeld (University of Würzburg, Germany)
• QoE Assessment of Enterprise Applications based on Self-motivated Ratings - Kathrin Borchert (University of Wuerzburg, Germany), Michael Seufert, Kathrin Hildebrand and Tobias Hoßfeld (University of Würzburg, Germany)
• Multi-episodic Perceived Quality of an Audio-on-Demand Service - Dennis Guse (TU Berlin, Germany), Oliver Hohlfeld (Brandenburg University of Technology, Germany), Anna Wunderlich (TU Berlin, Germany), Benjamin Weiss (Technische Universität Berlin & Carmeq GmbH, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)
• Don't Stop the Music: Crowdsourced QoE Assessment of Music Streaming with Stalling - Anika Schwind (University of Wuerzburg, Germany), Christian Moldovan, Tim Janiak, Nemo Dworschak and Tobias Hoßfeld (University of Würzburg, Germany)
• Textured Mesh vs Coloured Point Cloud: A Subjective Study for Volumetric Video Compression - Emin Zerman, Cagri Ozcinar, Pan Gao and Aljosa Smolic (Trinity College Dublin, Ireland)
• A generalized Hausdorff distance based quality metric for point cloud geometry - Alireza Javaheri (Instituto de Telecomunicações & Instituto Superior Técnico, Portugal), Catarina Brites (IST - IT, Portugal), Fernando Pereira (Instituto Superior Técnico - Instituto de Telecomunicações & Universidade de Lisboa, Portugal), João Ascenso (Instituto Superior Técnico & Instituto de Telecomunicações, Portugal)
• Synthetic Thermal Image Generation for Human-Machine Interaction in Vehicles - Richard Blythman (Xperi, Ireland), Paul Kielty and Mohamed Moustafa (National University of Ireland, Galway, Ireland), Michael J O'Byrne, Cian Ryan, Amr Elrasad and Eoin O'Connell (Xperi, Ireland), Joseph Lemley (National University of Ireland, Galway & Xperi, Ireland)
• Analyzing the Fullband E-model and Extending it for Predicting Bursty Packet Loss - Thilo Michael and Gabriel Mittag (Technische Universität Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)
• Investigation of auditory nerve model based analysis for vocoded speech synthesis - Sébastien Le Maguer and Naomi Harte (Trinity College Dublin, Ireland)
• Influence of Emotions on Eye Behavior in Omnidirectional Content - Wei Tang (University of Nantes, China), Shiyi Wu and Toinon Vigier (University of Nantes, France), Matthieu Perreira Da Silva (University of Nantes & IRCCyN, France)
• Development and Validation of Pictographic Scales for Rapid Assessment of Affective States in Virtual Reality - Christian Krüger and Tanja Kojic (Technische Universität Berlin, Germany), Luis Meier (TU Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany), Jan-Niklas Voigt-Antons (Technische Universität Berlin, Germany)
• Prenc - Predict Number Of Video Encoding Passes With Machine Learning - Steve Göring (Ilmenau University of Technology, Germany), Rakesh Rao Ramachandra Rao (TU Ilmenau, Germany), Alexander Raake (Technische Universität Ilmenau, Germany)
• "Bitstream-based Model Standard for 4K/UHD: ITU-T P.1204.3 - Model Details, Evaluation, Analysis and Open Source Implementation" - Rakesh Rao Ramachandra Rao (TU Ilmenau, Germany), Steve Göring (Ilmenau University of Technology, Germany), Peter List (Deutsche Telekom Laboratories, Germany), Werner Robitza (Ilmenau University of Technology, Germany), Bernhard Feiten and Ulf Wüstenhagen (Deutsche Telekom, Germany), Alexander Raake (Technische Universität Ilmenau, Germany)
• Evaluating the User in a Sound Localization Task in a Virtual Reality Application - Adrielle Nazar Moraes and Ronan Flynn (Athlone Institute of Technology, Ireland), Andrew Hines (University College Dublin, Ireland), Niall Murray (Athlone Institute of Technology, Ireland)
• Comparing emotional states induced by 360 videos via head-mounted display and computer screen - Jan-Niklas Voigt-Antons (Technische Universität Berlin, Germany), Eero Lehtonen (Aalto University, Finland), Andres Pinilla Palacios (Technische Universität Berlin, Germany), Danish Ali (TU Berlin, Germany), Tanja Kojic (Technische Universität Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)
• Towards a Perceived Audiovisual Quality Model for Immersive Content - Randy F Fela (FORCE Technology & Technical University of Denmark, Denmark), Nick Zacharov (FORCE Technology, Denmark), Soren Forchhammer (Technical University of Denmark, Denmark)
• Usability Assessment of a Wearable Video-Communication System - Sara Vlahovic (University of Zagreb, Faculty of Electrical Engineering and Computing, Croatia), Matija Mandurov (Delta Reality, Croatia), Mirko Suznjevic and Lea Skorin-Kapov (University of Zagreb, Faculty of Electrical Engineering and Computing, Croatia)
• Inclusion of End User Playback-Related Interactions in YouTube Video Data Collection and ML-Based Performance Model Training - Ivan Bartolec, Irena Orsolic and Lea Skorin-Kapov (University of Zagreb, Faculty of Electrical Engineering and Computing, Croatia)
• Investigating the Relationship of Mental Immersion and Physiological Measures during Cloud Gaming - Steven Schmidt and Stefan Uhrig (Technische Universität Berlin, Germany), Domenic Reuschel (TU Berlin, Germany)
• Can we still use PEAQ? A Performance Analysis of the ITU Standard for the Objective Assessment of Perceived Audio Quality - Pablo M Delgado and Jürgen Herre (International Audio Laboratories Erlangen, Germany)
• Affects of Perceived-actions within Virtual Environments on User Behavior on the Outside - Asim Hameed (University of Science and Technology (NTNU), Norway), Andrew Perkis (Norwegian University of Science and Technology, Norway)
• PointXR: A toolbox for visualization and subjective evaluation of point clouds in virtual reality - Evangelos Alexiou and Nanyang Yang (EPFL, Switzerland), Touradj Ebrahimi (Ecole Polytechnique Fédérale de Lausanne, Switzerland)
• Foveated Video Coding for Real-Time Streaming Applications - Oliver Wiedemann, Vlad Hosu, Hanhe Lin and Dietmar Saupe (University of Konstanz, Germany)
• Assessing Interactive Gaming Quality of Experience Using a Crowdsourcing Approach - Steven Schmidt (Technische Universität Berlin, Germany), Babak Naderi (Quality and Usability Lab, Technische Universität Berlin, Germany), Saeed Shafiee Sabet (Simula Research Laboratory & Technische Universität Berlin, Norway), Saman Zadtootaghaj (Quality and Usability Lab, Technischen Universität Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)
• Fusion of Digital Fingerprint Quality Assessment Metrics - Christophe Rosenberger (GREYC Laboratory, France), Christophe Charrier (Universite de Caen Basse-Normandie, France)
• Blind Image Quality Assessment with Visual Sensitivity Enhanced Dual-Channel Deep Convolutional Neural Network - Min Zhang, Wenjing Hou, Lei Zhang and Jun Feng (Northwest University, China)
• ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metric - Michael Chinen (Google, Inc., USA), Felicia S. C. Lim (Google LLC, USA), Jan Skoglund (Google, Inc., USA), Nikita Gureev (Google, USA), Feargus O'Gorman and Andrew Hines (University College Dublin, Ireland)
• Quality Enhancement of Gaming Content using Generative Adversarial Networks - Nasim Jamshidi Avanaki (TU Berlin, Germany), Saman Zadtootaghaj (Quality and Usability Lab, Technischen Universität Berlin, Germany), Nabajeet Barman (Kingston University, United Kingdom (Great Britain)), Steven Schmidt (Technische Universität Berlin, Germany), Maria G. Martini (Kingston University, United Kingdom (Great Britain)), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)

Short Papers (Including Demo/Industry & Dataset & Tools)

• Transformation of Mean Opinion Scores to Avoid Misleading of Ranked based Statistical Techniques - Babak Naderi (Quality and Usability Lab, Technische Universität Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)
• Let the Music Play: An Automated Test Setup for Blind Subjective Evaluation of Music Playback on Mobile Devices - Dominik Keller and Alexander Raake (Technische Universität Ilmenau, Germany), Markus Vaalgamaa and Erkki Paajanen (Huawei Technologies Oy (Finland) Co., Ltd., Finland)
• 5G and edge cloud are essential in enabling QoE for AR/VR - Bill Krogfoss (Nokia, USA), Pablo Pérez (Nokia Bell Labs, Spain), Jan Bouwen (Alcatel-Lucent, France)
• Assessing differences in flow state induced by an adaptive music learning software - Martin E Haug, Paavo L Camps, Tobias F Umland and Jan-Niklas Voigt-Antons (Technische Universität Berlin, Germany)
• Towards Analysing the Interaction between Quality and Storytelling for Event Video Recording - Eckhard Stoll (South Westphalia University of Applied Science, Germany), Stephan Breide (University of Applied Sciences, Germany), Alexander Raake (Technische Universität Ilmenau, Germany)
• An evaluation of the next-generation image coding standard AVIF - Nabajeet Barman and Maria G. Martini (Kingston University, United Kingdom (Great Britain))
• Matched Quality Evaluation of Temporally Downsampled Videos with Non-Integer Factors - Christian Herglotz and Geetha Ramasubbu (Friedrich-Alexander University Erlangen-Nürnberg (FAU), Germany), Andre Kaup (University of Erlangen-Nuremberg, Germany)
• Studying the Impact of the Content Selection Method on the Video QoE on Mobile Devices - Nikolas Wehner, Nils Mertinat, Michael Seufert and Tobias Hoßfeld (University of Würzburg, Germany)
• EEG-Based Assessment of Perceived Realness in Stylized Face Images - Milena T. Bagdasarian (Fraunhofer Heinrich Hertz Institute, Germany), Anna Hilsmann (Fraunhofer Institute for Telecommunications, Heinrich-Hertz-Institut, Germany), Peter Eisert (Fraunhofer HHI & Humboldt University, Germany), Gabriel Curio (Charité-Universitätsmedizin Berlin, Germany), Klaus-Robert Müller (Machine Learning Laboratory, Berlin Institute of Technology, Berlin, Germany), Thomas Wiegand (Fraunhofer HHI, Germany), Sebastian Bosse (Fraunhofer Heinrich Hertz Institute, Germany)
• Variation in QoE of passive gaming video streaming for different Packet Loss Ratios - Abdul Wahab and Nafi Ahmad (Queen Mary University of London, United Kingdom (Great Britain)), John Schormans (Queen Mary, University of London, United Kingdom (Great Britain))
• Quality Assessment of Gaming Videos Compressed via AV1 - Darkhan Ashimov (Kingston University, Kazakhstan), Maria G. Martini and Nabajeet Barman (Kingston University, United Kingdom (Great Britain))
• Influence of Gender and Viewing Frequency on Quality of Experience - Omer Nawaz and Markus Fiedler (Blekinge Institute of Technology, Sweden), Katrien De Moor (Norwegian University of Science and Technology (NTNU), Norway), Siamak Khatibi (Blekinge Institute of Technology, Sweden)
• "Influence of video delay on quality, presence, and sickness in viewport adaptive immersive streaming" - Carlos Cortés (Universidad Politécnica de Madrid, Spain), Pablo Pérez (Nokia Bell Labs, Spain), Jesús Gutiérrez and Narciso García (Universidad Politécnica de Madrid, Spain)
• Influence of Hand Tracking as a way of Interaction in Virtual Reality on User Experience - Jan-Niklas Voigt-Antons and Tanja Kojic (Technische Universität Berlin, Germany), Danish Ali (TU Berlin, Germany), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)
• Towards the Impact of Gamers Strategy and User Inputs on the Delay Sensitivity of the Cloud Games - Saeed Shafiee Sabet (Simula Research Laboratory & Technische Universität Berlin, Norway), Steven Schmidt (Technische Universität Berlin, Germany), Saman Zadtootaghaj (Quality and Usability Lab, Technischen Universität Berlin, Germany), Carsten Griwodz (Simula Research Laboratory, Norway), Sebastian Möller (Quality and Usability Lab, TU Berlin & DFKI, Berlin, Germany)
• Development and evaluation of a test setup to investigate distance differences in immersive virtual environments - Stephan Fremerey, Muhammad Sami Suleman, Abdul Haq Azeem Paracha and Alexander Raake (Technische Universität Ilmenau, Germany)
• Can visual scanpath reveal personal image memorability? Investigation of HMM tools for gaze patterns analysis - Waqas Ellahi (Université de Nantes, France), Toinon Vigier (University of Nantes, France), Patrick Le Callet (Université de Nantes, France)
• Seeing is Believing: The Effect of Video Quality on Quality of Experience in Virtual Reality - Aleksandra Zheleva (imec-mict-UGent, Belgium), Wouter Durnez and Klaas Bombeke (Imec-mict-UGent, Belgium), Glenn Van Wallendael (Ghent University - imec, Belgium), Lieven De Marez (Ghent University, Belgium)
• A QoE Evaluation of an Augmented Reality Procedure Assistance Application - Eoghan Hynes, Ronan Flynn, Brian Lee and Niall Murray (Athlone Institute of Technology, Ireland)
• The Virtual Memory Palace as an Interactive Mnemonic Learning Platform - Ralf Bierig and Linda Krueger (Maynooth University, Ireland)
• A QoE Evaluation of an Immersive Virtual Reality Autonomous Driving Experience - Guilherme D Gomes, Ronan Flynn and Niall Murray (Athlone Institute of Technology, Ireland)
• goDASH - GO accelerated HAS framework for rapid prototyping - Darijo Raca (University College Cork, Ireland), Maëlle Manifacier (Université Clermont Auvergne, France), Jason J Quinlan (University College Cork, Ireland)