ARTICONF Meeting Seville

The first face-to-face ARTICONF Meeting after the pandemic, hosted by Agilia, took place from September 21-24, 2021, in Seville, Spain. The consortium discussed the advancements and progress made this year and listed down strategies for validating and exploiting ARTICONF use cases through real-world testing and external collaboration amid pandemics. In addition, ARTICONF’s technical team addressed existing integration concerns and stressed to finalize the prototype in the coming months. The consortium further pledged to continue its ongoing efforts in disseminating ARTICONF scientific results at high-ranked venues.

,

FaRes-ML paper is Nominated for the Best New Streaming Innovation Award in the Streaming Media Readers’ Choice Awards 2021

The Fast Multi-Resolution and Multi-Rate Encoding for HTTP Adaptive Streaming Using Machine Learning paper from ATHENA lab is nominated for the Best New Streaming Innovation Award in the Streaming Media Readers’ Choice Awards 2021.

Voting can be done on the awards’ website. The voting is open until October 4. You can find the paper under the Best New Streaming Innovation Award section as following:

More information about the paper can be found here.

Final Review of the ASPIDE project

The H2020 project ASPIDE impressed the reviewers with the presented scientific achievements in Exascale computing and passed the final EC review with flying colors. The project officer and reviewers echoed the effort put together by the consortium partners for publicly demonstrating and sharing the ASPIDE tools while maintaining a robust scientific output at the highest level. The EC reviewers gave very positive input on the scientific tools developed within WP3, which Klagenfurt University led.

,

ADAPT Project – GOODIT’21 Conference Presentation

On 10 September 2021, ADAPT project was represented at the GOODIT´21 conference in Rome, Italy by Vladislav Kashanskii.

Here you find his presentation about “The ADAPT Project: Adaptive and Autonomous Data Performance Connectivity and Decentralized Transport Decision-Making Network” as pdf and video.

Andreas Leibetseder completed his PhD!

On August 30th 2021, Andreas Leibetseder successfully defended his thesis on “Extracting and Using Medical Expert Knowledge to Advance Video Analysis for Gynecologic Laparoscopy” under the supervision of Prof. Klaus Schöffmann. The defense was chaired by Prof. Hermann Hellwagner and the examiners were Prof. Oge Marques (Florida Atlantic University) and Prof. Mathias Lux (Klagenfurt University). Congratulations to Dr. Leibetseder for this great achievement!

Hadi
, ,

Paper accepted – On The Impact of Viewing Distance on Perceived Video Quality

Title: On The Impact of Viewing Distance on Perceived Video Quality

Link: IEEE Visual Communications and Image Processing (VCIP 2021) 5-8 December 2021, Munich, Germany

Authors: Hadi Amirpour (Alpen-Adria-Universität Klagenfurt), Raimund Schatz (AIT Austrian Institute of Technology, Austria), Mohammad Ghanbari (School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK), and Christian Timmerer (Alpen-Adria-Universität Klagenfurt)

Abstract: Due to the growing importance of optimizing quality and efficiency of video streaming delivery, accurate assessment of user perceived video quality becomes increasingly relevant. However, due to the wide range of viewing distances encountered in real-world viewing settings, actually perceived video quality can vary significantly in everyday viewing situations. In this paper, we investigate and quantify the influence of viewing distance on perceived video quality.  A subjective experiment was conducted with full HD sequences at three different stationary viewing distances, with each video sequence being encoded at three different quality levels. Our study results confirm that the viewing distance has a significant influence on the quality assessment. In particular, they show that an increased viewing distance generally leads to an increased perceived video quality, especially at low media encoding quality levels. In this context, we also provide an estimation of potential bitrate savings that knowledge of actual viewing distance would enable in practice.
Since current objective video quality metrics do not systematically take into account viewing distance, we also analyze and quantify the influence of viewing distance on the correlation between objective and subjective metrics. Our results confirm the need for distance-aware objective metrics when accurate prediction of perceived video quality in real-world environments is required.

Hadi
, ,

Paper accepted – Improving Per-title Encoding for HTTP Adaptive Streaming by Utilizing Video Super-resolution

Title: Improving Per-title Encoding for HTTP Adaptive Streaming by Utilizing Video Super-resolution

Link: IEEE Visual Communications and Image Processing (VCIP 2021) 5-8 December 2021, Munich, Germany

Authors: Hadi Amirpour (Alpen-Adria-Universität Klagenfurt), Hannaneh Barahouei Pasandi (Virginia Commonwealth University), Mohammad Ghanbari (School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK), and Christian Timmerer (Alpen-Adria-Universität Klagenfurt)

Abstract: In per-title encoding, to optimize a bitrate ladder over spatial resolution, each video segment is downscaled to a set of spatial resolutions and they are all encoded at a given set of bitrates. To find the highest quality resolution for each bitrate, the low-resolution encoded videos are upscaled to the original resolution, and a convex hull is formed based on the scaled qualities. Deep learning-based video super-resolution (VSR) approaches show a significant gain over traditional approaches and they are becoming more and more efficient over time.  This paper improves the per-title encoding over the upscaling methods by using deep neural network-based VSR algorithms as they show a significant gain over traditional approaches. Utilizing a VSR algorithm by improving the quality of low-resolution encodings can improve the convex hull. As a result, it will lead to an improved bitrate ladder. To avoid bandwidth wastage at perceptually lossless bitrates a maximum threshold for the quality is set and encodings beyond it are eliminated from the bitrate ladder. Similarly, a minimum threshold is set to avoid low-quality video delivery. The encodings between the maximum and minimum thresholds are selected based on one Just Noticeable Difference. Our experimental results show that the proposed per-title encoding results in a 24% bitrate reduction and 53% storage reduction compared to the state-of-the-art method.

, ,

Paper accepted – INTENSE: In-depth Studies on Stall Events and Quality Switches and Their Impact on the Quality of Experience in HTTP Adaptive Streaming

Title: INTENSE: In-depth Studies on Stall Events and Quality Switches and Their Impact on the Quality of Experience in HTTP Adaptive Streaming

Link: IEEE Access, A Multidisciplinary, Open-access Journal of the IEEE

[PDF]

Babak Taraghi (Christian Doppler Laboratory ATHENA, Alpen-Adria-Universität Klagenfurt), Minh Nguyen (Christian Doppler Laboratory ATHENA, Alpen-Adria-Universität Klagenfurt), Hadi Amirpour (Christian Doppler Laboratory ATHENA, Alpen-Adria-Universität Klagenfurt), Christian Timmerer (Christian Doppler Laboratory ATHENA, Alpen-Adria-Universität Klagenfurt)

Abstract: With the recent growth of multimedia traffic over the Internet and emerging multimedia streaming service providers, improving Quality of Experience (QoE) for HTTP Adaptive Streaming (HAS) becomes more important. Alongside other factors, such as the media quality, HAS relies on the performance of the media player’s Adaptive Bitrate (ABR) algorithm to optimize QoE in multimedia streaming sessions. QoE in HAS suffers from weak or unstable internet connections and suboptimal ABR decisions. As a result of imperfect adaptiveness to the characteristics and conditions of the internet connection, stall events and quality level switches could occur and with different durations that negatively affect the QoE. In this paper, we address various identified open issues related to the QoE for HAS, notably (i) the minimum noticeable duration for stall events in HAS;(ii) the correlation between the media quality and the impact of stall events on QoE; (iii) the end-user preference regarding multiple shorter stall events versus a single longer stall event; and (iv) the end-user preference of media quality switches over stall events. Therefore, we have studied these open issues from both objective and subjective evaluation perspectives and presented the correlation between the two types of evaluations. The findings documented in this paper can be used as a baseline for improving ABR algorithms and policies in HAS.

Keywords: Crowdsourcing; HTTP Adaptive Streaming; Quality of Experience; Quality Switches; Stall Events; Subjective Evaluation; Objective Evaluation.

Interns at ATHENA project (Summer 2021)

In July 2021, the ATHENA Christian Doppler Laboratory hosted three interns working on the following topics:

  • Kassian Fuger: Machine Learning and Video Encoding for HTTP Adaptive Streaming
  • Timo Pfeifer: HTTP Adaptive Streaming for Mobile Devices
  • Vanessa Fröhlich: Machine Learning and its Applications

At the end of the internship, the interns presented their work and the results in the form of a presentation, and they have obtained a certificate of internship. We believe that the joint work was useful both for the laboratory and for the interns themselves. We would like to thank the interns for their genuine interest, productive work,  and excellent feedback about our laboratory.

Kassian Fuger: “Those four weeks of the internship meant a lot for my future career path. The internship gave me a great view of what working with a smart and friendly team is like. Working on my tasks by myself taught me a lot and I learned and improved in every aspect of the internship and if something was unclear my supervisor was always there to help. I was well accepted into the team and we sometimes went for lunch together which was very nice and helped me to be confident around the team. Anyways spending a part of my summertime at ATHENA was super fun and good time investment. Being on the ATHENA team was a great experience and I think everyone can learn something there.”

Vanessa Fröhlich: “I really enjoyed the internship at ATHENA and would even be happy to do it a second time. It was a great experience working with the people there and getting to know certain things that I would have definitely not learned elsewhere. It was very interesting to work with a new type of programming! I also appreciated very much how I felt part of the team in the first days already and also enjoyed working independently but with the help of my supervisor Farzad whenever I needed something or was stuck with an exercise. I am very glad that I found this internship and can say that I have gained a lot of experience there. Thank you!”

We wish the interns every success in their journey through life and we hope to see them soon back at the University of Klagenfurt and ATHENA.

,

Special issue on Open Media Compression: Overview, Design Criteria, and Outlook on Emerging Standards

Special issue on Open Media Compression: Overview, Design Criteria, and Outlook on Emerging Standards

Proceedings of the IEEE, vol. 109, no. 9, Sept. 2021

By CHRISTIAN TIMMERER, Senior Member IEEE
Guest Editor
MATHIAS WIEN, Member IEEE
Guest Editor
LU YU, Senior Member IEEE
Guest Editor
AMY REIBMAN, Fellow IEEE Guest Editor

Abstract: Multimedia content (i.e., video, image, audio) is responsible for the majority of today’s Internet traffic and numbers are expecting to grow beyond 80% in the near future. For more than 30 years, international standards provide tools for interoperability and are both source and sink for challenging research activities in the domain of multimedia compression and system technologies. The goal of this special issue is to review those standards and focus on (i) the technology developed in the context of these standards and (ii) research questions addressing aspects of these standards which are left open for competition by both academia and industry.

Index Terms—Open Media Standards, MPEG, JPEG, JVET, AOM, Computational Complexity

C. Timmerer, M. Wien, L. Yu and A. Reibman, “Special issue on Open Media Compression: Overview, Design Criteria, and Outlook on Emerging Standards,” in Proceedings of the IEEE, vol. 109, no. 9, pp. 1423-1434, Sept. 2021, doi: 10.1109/JPROC.2021.3098048.

Read more