Vignesh V Menon
,

Accepted Paper at IEEE 23rd International Workshop on Multimedia Signal Processing – INCEPT: INTRA CU Depth Prediction for HEVC

Title: INCEPT: INTRA CU Depth Prediction for HEVC

IEEE 23rd International Workshop on Multimedia Signal Processing

October 06–08, 2021, Tampere, Finland

Authors: Vignesh V Menon (Alpen-Adria-Universitat Klagenfurt); Hadi Amirpour (Alpen-Adria-Universität Klagenfurt); Christian Timmerer (Alpen-Adria-Universität Klagenfurt, Austria); Mohammad Ghanbari (University of Essex, UK).

Abstract: High Efficiency Video Coding (HEVC) improves the encoding efficiency by utilizing sophisticated tools such as flexible Coding Tree Unit (CTU) partitioning. The Coding Unit (CU) can be split recursively into four equally sized CUs ranging from 64×64 to 8×8 pixels. At each depth level (or CU size), intra prediction via exhaustive mode search was exploited in HEVC to improve the encoding efficiency and result in a very high encoding time complexity. This paper proposes an Intra CU Depth Prediction (INCEPT) algorithm, which limits Rate-Distortion Optimization (RDO) for each CTU in HEVC by utilizing the spatial correlation with the neighboring CTUs, which is computed using a DCT energy-based feature. Thus, INCEPT reduces the number of candidate CU sizes required to be considered for each CTU in HEVC intra coding. Experimental results show that the INCEPT algorithm achieves a better trade-off between the encoding efficiency and encoding time saving (i.e., BDR/∆T) than the benchmark algorithms. While BDR/∆T is 12.35% and 9.03% for the benchmark algorithms, it is 5.49% for the proposed algorithm. As a result, INCEPT achieves a 23.34% reduction in encoding time on average while incurring only a 1.67% increase in bit rate than the original coding in the x265 HEVC open-source encoder.

Keywords: HEVC, Intra coding, CTU, CU, depth decision

,

Successful completion and demo of the Karl Popper Kolleg (KPK) Networked Autonomous Aerial Vehicles (NAV)

Robotics research in Klagenfurt enjoys international success

With a total of 9 contributions at this year’s ICRA, one of the flagship conferences in the field of robotics, the University of Klagenfurt has joined the league of the world’s most important robotics hubs. Among the contributors are the young researchers from the Karl Popper Doktorats- und Wissenschaftskolleg “Networked Autonomous Aerial Vehicles (NAV)”, which is currently celebrating its conclusion with a drone flight demonstration in Klagenfurt. Read more at the University Klagenfurt blog and here.

 

, ,

KWF/EFRE project “ONTIS” accepted

The project “ONTIS” (Ontology-based Interoperability of Systems) has been accepted in the EFRE call of KWF (Kärntner Wirtschaftsförderungs Fonds).

The ONTIS project targets the development of methodologies for automatically establishing interoperability between information systems through the combination of ontological expert knowledge and machine learning-based models. With the specific goal of improving the error-prone manual integration of ontological knowledge, ONTIS focuses on applying deep neural networks for processing natural language and visual concepts for automatic semantic annotation.

Project duration: 18 months

, ,

Paper accepted: Edge Assisted Adaptation Scheme for HTTP Adaptive Streaming

Conference info: IEEE LCN

Authors: Jesús Aguilar Armijo (Alpen-Adria-Universität Klagenfurt), Christian Timmerer (Alpen-Adria-Universität Klagenfurt) and Hermann Hellwagner (Alpen-Adria-Universität Klagenfurt)

Abstract: Mobile networks equipped with edge computing nodes enable access to information that can be leveraged to assist client-based adaptive bitrate (ABR) algorithms in making better adaptation decisions to improve both Quality of Experience (QoE) and fairness. For this purpose, we propose a novel on-the-fly edge mechanism, named EADAS (Edge Assisted Adaptation Scheme for HTTP Adaptive Streaming), located at the edge node that assists and improves the ABR decisions on-the-fly. EADAS proposes (i) an edge ABR algorithm to improve QoE and fairness for clients and (ii) a segment prefetching scheme. The results show a QoE increase of 4.6%, 23.5%, and 24.4% and a fairness increase of 11%, 3.4%, and 5.8% when using a buffer-based, a throughput-based, and a hybrid ABR algorithm, respectively, at the client compared with client-based algorithms without EADAS. Moreover, QoE and fairness among clients can be prioritized using parameters of the EADAS algorithm according to service providers’ requirements.

Keywords: Dynamic Adaptive Streaming over HTTP (DASH), Edge Computing, Network-Assisted Video Streaming, Quality of Experience (QoE).

, ,

Throwback on our special session at PCS’21

A Special Session on ‘Video Coding for Large Scale HTTP Adaptive Streaming Deployments‘ was organized by Christian Timmerer (Alpen-Adria-Universität Klagenfurt, Austria), Mohammad Ghanbari (University of Essex, UK), and Alex Giladi (Comcast, USA) on July 2 at the 35th Picture Coding Symposium (PCS) 2021. Read more about it here.

, , , ,

Master thesis at ITEC wins Dynatrace Outstanding IT-Thesis Award

With his master thesis about “Animating Characters using Deep Learning based Pose Estimation”, Fabian Schober won the “Dynatrace Outstanding IT-Thesis Award” (DO*IT*TA). The award brings attention to extraordinary theses, motivates creativity, and provides insight into modern technologies.
In his thesis, Fabian Schober focuses on animating 2D (video game) characters using the PoseNet pose estimation model. He delivers a proof of concept on how new machine learning technologies can assist in video game development. Read more at the University press release (German only).

,

Paper accepted: A Distributed Delivery Architecture for User Generated Content Live Streaming over HTTP

Conference info: The 46th IEEE Conference on Local Computer Networks (LCN) October 4-7, 2021

Authors: Farzad Tashtarian (Alpen-Adria-Universität Klagenfurt), Abdelhak Bentaleb (National University of Singapore), Reza Farahani (Alpen-Adria-Universität Klagenfurt), Minh Nguyen (Alpen-Adria-Universität Klagenfurt), Christian Timmerer (Alpen-Adria-Universität Klagenfurt), Hermann Hellwagner (Alpen-Adria-Universität Klagenfurt), and Roger Zimmermann (National University of Singapore)

Abstract: Live User Generated Content (UGC) has become very popular in today’s video streaming applications, in particular with gaming and e-sport. However, streaming UGC presents unique challenges for video delivery. When dealing with the technical complexity of managing hundreds or thousands of concurrent streams that are geographically distributed, UGCsystems are forces to made difficult trade-offs with video quality and latency. Read more

,

Paper accepted – CSDN: CDN-Aware QoE Optimization in SDN-Assisted HTTP Adaptive Video Streaming

Conference info: The 46th IEEE Conference on Local Computer Networks (LCN) October 4-7, 2021

Authors: Reza Farahani (Alpen-Adria-Universität Klagenfurt), Farzad Tashtarian (Alpen-Adria-Universität Klagenfurt), Hadi Amirpour (Alpen-Adria-Universität Klagenfurt), Christian Timmerer (Alpen-Adria-Universität Klagenfurt), Mohammad Ghanbari (School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK) and Hermann Hellwagner (Alpen-Adria-Universität Klagenfurt)

Abstract: With the increasing demand for video streaming applications, HTTP Adaptive Streaming (HAS) technology has become the dominant video delivery technique over the Internet. Current HAS solutions only consider either client- or server-side optimization, which causes many problems in achieving high-quality video, leading to sub-optimal users’ experience and network resource utilization. Recent studies have revealed that network-assisted HAS techniques, by providing a comprehensive view of the network, can lead to more significant gains in HAS system performance. Read more

, , , ,

Christian Doppler ‘pilot’ laboratory ATHENA to transition to a regular CD laboratory

Successful review of the first research phase: Christian Doppler ‘pilot’ laboratory ATHENA to transition to a regular CD laboratory two years after launch. Read more about it at ATHENA website and the press release at AAU website.

 

Hadi
, , ,

Hadi Amirpour appointed co-chair of IMEx

Hadi Amirpour has been appointed co-chair of Task Force 7 (TF7)
Immersive Media Experience (IMEx) at the 15th Qualinet meeting

Co-chairs:

 

TF7: Immersive Media Experiences (IMEx)

Immersive media applications are entering our daily lives starting from VR/AR/360° video applications to multi-sensory/multimedia experiences potentially addressing all human senses rather than focusing on hearing and seeing. The overall goal of providing Immersive Media Experiences (IMEx) to end-users is giving them the sensation of being part of the particular media which shall result in a worthwhile, informative user and quality of experience.

The actual objectives of this task force are as follows:

  • disseminating the white paper
  • working towards submission of the extended version
  • liaison with other communities (UX, sensory sciences) and standards developing organizations (JPEG, MPEG, EBU)
  • Identification of different QoE aspects of immersive experiences
  • QoE models and QoE assessment approaches for immersive experiences, addressing various audiovisual modalities; e.g. HDR, omnidirectional video, light fields, point clouds, and spatial audio.