Medical Multimedia Information Systems

, ,

A Webbing Journey @ A1 Austria eSports Festival 2022

On Saturday (June 18, 2022), Sebastian Uitz presented his game “A Webbing Journey” with his partner Manuel Santner at the A1 Austria eSports Festival in the Austria Center Vienna. The game didn’t fit into the Esports-themed event, but the 2 PCs prepared to play the game were constantly used by players of all ages. Especially the target audience (children 8-12) had so much fun, and the parents had to wait until the kids were done playing. The event was a great success as it was the biggest play session yet and resulted in tons of feedback that will be implemented and bugs that will be fixed until the next event.

,

Paper Accepted: Evaluation of Relevance-Driven Compression of Regular Cataract Surgery Videos

IEEE 35th International Symposium on Computer Based Medical Systems (CBMS), July 21-23, Shenzen, China

https://2022.cbms-conference.org

Authors: Natalia Mathá, Klaus Schoeffmann, Stephanie Sarny, Doris Putzgruber-Adamitsch and Yosuf El-Shabrawi

Abstract: In recent years, the utilization intensity and thus the demand for storing cataract surgery videos for different purposes has increased. Hospitals continuously improve their technical recording equipment, i.e., cameras, to enhance the post-operative processing efficiency of the recordings. However, afterward, the videos are stored on hospitals’ internal data servers in their original size, which leads to a massive storage consumption. In this paper, we propose a relevance-based compression scheme. First, we perform a user study with clinicians to define the relevance rates of regular cataract surgery phases. Then, we compress different phases based on the determined relevance rates, using different encoding parameters and two coding standards, namely H.264/AVC and AV1. Afterward, the medical experts evaluate the visual quality of the encoded videos. Our results show a storage-saving potential for H.264/AVC of up to 95.94% and up to 98.82% for AV1, excluding idle phases (no tools are visible).

 

 

,

Paper Accepted: DeepPyram: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videos

25th International Conference on Medical Image Computing and Computer Assisted Intervention, September 18-22, 2022, Singapore

https://conferences.miccai.org/2022/en/

Authors: Negin Ghamsarian, Mario Taschwer, Raphael Sznitman, Klaus Schoeffmann

Abstract: Semantic segmentation in cataract surgery has a wide range of applications contributing to surgical outcome enhancement and clinical risk reduction. However, the varying issues in segmenting the different relevant structures in these surgeries make the designation of a unique network quite challenging. This paper proposes a semantic segmentation network termed, DeepPyram, that can deal with these challenges using three novelties: (1) a Pyramid View Fusion module which provides a varying-angle global view of the surrounding region centering at each pixel position in the input convolutional feature map; (2) a Deformable Pyramid Reception module which enables a wide deformable receptive field that can adapt to geometric transformations in the object of interest; and (3) a dedicated Pyramid Loss that adaptively supervises multi-scale semantic feature maps. Compbined we show that these can effectively boost semantic segmentation performance, especially in the case of transparency, deformability, scalability, and blunt edges in objects. We demonstrate that our approach performs at a state-of-the-art level and outperforms a number of existing methods without imposing additional trainable parameters.

 

,

MMM’22 Community Leadership Award for Klaus Schöffmann

For his continuous support of the International Conference on MultiMedia Modeling (MMM) and his ongoing contributions to the MMM community, yesterday Assoc.Prof. Klaus Schöffmann was awarded with the MMM’22 Community Leadership Award at the Gala Dinner in Phu Quoc, Vietnam.

 

,

Largest International Video Search Competition Took Place on 11th VBS in Phu Quoc, Vietnam

Over two days (June 6-7, 2022) the 11th Video Browser Showdown (VBS) – www.videobrowsershowdown.org, co-organized by Klaus Schöffmann, took place in Phu Quoc, Vietnam. Sixteen teams participated  in about six hours of competition to solve video content search tasks in a large video dataset (V3C1+V3C2), comprising 2300 hours of video content (17235 video files). Eleven teams on site, together with 5 more teams online, accepted the challenge, competed with each other, and showcased their state-of-the-art video search systems to the conference public of MMM 2022 (http://mmm2022.org).  Congratulations to the winning teams of different search categories: vibro (Germany), CVHunter (Czech Republic), VISIONE (Italy).

, , ,

ITEC @ LNDF was a big success

This years´s “Lange Nacht der Forschung” took place on May 20, 2022. The LNDF is Austria´s most significant national research event to present the accomplishments to the broad public. ITEC was represented by three stations and involved in the station of Computer Games and Engineering, and it was a fantastic experience for everyone! We tried to make our research easily understandable for everyone.

 

Tutorial at ACM Multimedia 2022

We are happy that our tutorial on Open Challenges of Interactive Video Search and Evaluation (by Jakub Lokoc, Klaus Schöffmann, Werner Bailer, Luca Rossetto, and Björn Thor Jonsson) has been accepted for ACM Multimedia (ACMMM 2022), to be held in Lisbon, Portugal, in October 2022.

LSC 2022 will be Grand Challenge at ICMR 2022

The 5th Annual Lifelog Search Challenge (LSC 2022), co-organized by Klaus Schöffmann, will be this year’s grand challenge at the ACM International Conference on Multimedia Retrieval (ICMR 2022) in Newark, NJ, USA. More information here: https://www.icmr2022.org/program/challenges/

Klaus Schöffmann as Invited Speaker at IPTA 2022

Klaus Schöffmann will give an invited talk about Relevant Content Detection in Cataract Surgery Videos at the IEEE International Conference on Image Processing Theory, Tools and Applications (IPTA) on April 19, 2022, in Salzburg, Austria. More information here: https://ipta-conference.com/ipta22/index.php/invited-speakers

Klaus Schöffmann as Tutorial Speaker at IPTA 2022

Klaus Schöffmann will give a tutorial about Medical Video Processing at the IEEE International Conference on Image Processing Theory, Tools and Applications (IPTA) on April 19, 2022, in Salzburg, Austria. More information here: https://ipta-conference.com/ipta22/index.php/invited-speakers