Paper accepted @ ACM Multimedia 2026

Thin-Client Interactive Gaussian Adaptive Streaming over HTTP/3

 

ACM Multimedia 2026

November 10 – November 14, 2026

Rio de Janeiro, Brazil

[PDF]

Emanuele Artioli (AAU, Austria), Philipp Fößl (AAU, Austria), Shao-Yang Hung (National Tsinghua University, Taiwan), Philipp Fößl (AAU, Austria), Daniele Lorenzi (Bitmovin, Austria), Farzad Tashtarian (AAU, Austria),  Mahdi Dolati (Sharif University of Technology, Iran), Cheng-Hsin Hsu (National Tsinghua University, Taiwan), Christian Timmerer (AAU, Austria)

Abstract: Recent advancements in 3D Gaussian Splatting (3DGS) have enabled photorealistic rendering of complex scenes, yet widespread adoption on mobile and Extended Reality (XR) devices is hindered by substantial computational and bandwidth requirements. While existing solutions often focus on model compression for client-side rendering, they still demand significant GPU power, limiting applicability on resource-constrained hardware. We propose TIGAS (Thin-client Interactive Gaussian Adaptive Streaming), a remote rendering framework offloading rasterization to a backend. To bypass the prohibitive latencies connected to fluctuating network conditions, TIGAS streams view-dependent 2D projections to a lightweight web client over QUIC, minimizing head-of-line (HoL) blocking. A dedicated ABR algorithm adapts rendering quality to fluctuating network conditions, maintaining motion-to-photon latency within strict 6DoF interactive constraints. Furthermore, we discuss the integration of an experimental WebGPU super-resolution pipeline to analyze the trade-offs between perceptual quality enhancements and thin-client processing bottlenecks. We extensively evaluate TIGAS across multi-continental environments using 14 3DGS models and real 6DoF EyeNavGS movement traces. Powered by a backend rendering frames in under 10 milliseconds, TIGAS maintains latency within interactive thresholds while achieving an average SSIM of 0.88, serving both as a robust testbed for 3DGS streaming research and a capable delivery system.

Networking for the Future of Game Studies in Austria

From June 18-19, Dr. Felix Schniz participated in an Austria-wide networking event for scholars working in the field of game studies. Organized by the FG Game Studies, the event brought together researchers from various institutions across the country, including the University of Vienna’s Game Lab, departments of history and sports sciences in Innsbruck, as well as independent researchers.

The event clearly highlighted two main points: the interdisciplinary nature of game studies within larger academic frameworks, and the exemplary role of the University of Klagenfurt in national game research. As the only institution with a dedicated curriculum explicitly focused on games and a strong hybridisation of technical and humanities topics, the work of Dr. Felix Schniz and his colleagues contributing to the Master’s Program in Game Studies and Engineering was recognized as pioneering and set a strong precedent for the future development of game research in Austria.

In addition to exchanging best practices and discussing local and national strategies, the formation of an Austrian research network dedicated to game and play-related studies was also on the agenda. Dr. Felix Schniz expressed his intention to organize a future meeting to bring together interested members.

 

Hadi
,

Congratulations to Hadi Amirpourazarian: Completion of the Habilitation!

On 25.06.2026, Hadi Amirpourazarian defended his habilitation thesis, “The Predictive Video Encoding Using Visual Complexity Analysis”

Congratulations!

Committee members:

Prof. Wolfgang Faber (Chairperson), Prof. Eckehard Steinbach (External Member), Prof. Wilfried Elmenreich, Prof. Barbara Kaltenbacher, Katharina Stengg, Yuliia Lomonosova, Christoph Rauter

Felix @ Rock my Worlds of English Podcast

Dr Felix Schniz participated in the podcast “Rock my Worlds of English” to promote the Master’s Programme in Game Studies and Engineering.

The full podcast: https://open.spotify.com/episode/4f4wSWb8SD48yFIsTDnG1I?si=Ha53h2m8Txe1LZuiTjJ-EA

 

Hadi

Paper accepted at “Applied Soft Computing” Journal

Title: GNS-GAN: A novel GAN model based on gradient noise suppression

Authors: Hongyou Chen, Lingfeng Qu, Baodan Tian, Yutong He, Yong Fan, Hadi Amirpour, Christian Timmerer and Yao Xin

Journal: Applied Soft Computing

Abstract: Generative adversarial networks (GANs) are widely applicable generative models. However, ensuring stability in adversarial learning remains a significant challenge in current GAN training. Gradient noise, among other factors, significantly impacts the stability of adversarial learning in GAN training. To improve the stability of adversarial learning, a gradient noise suppression generative adversarial network model (GNS-GAN) is proposed. This novel GAN addresses gradient noise by establishing stochastic differential equations (SDEs) for gradient noise in both the discriminator and the generator. The factors affecting the stability of adversarial learning are then analyzed using the assumed gradient noise distribution. Subsequently, an adversarial learning method is designed for the discriminator and generator to suppress gradient noise, thereby completing the adversarial training of GNS-GAN. To verify the performance of GNS-GAN, the experimental results are compared and analyzed using CELEBA, BEDROOM, and CIFAR10 datasets. The FID (Fréchet Inception Distance) values are 23.04 for CELEBA, 18.04 for BEDROOM, and 26.59 for CIFAR10. The GNS-GAN model has stable training performances in the tested datasets. These results demonstrate that the novel GAN model enhances the stability of adversarial learning and the quality of the generated images.

Felix explores @ AAU´s Media Club

On 10 June 2026, Dr Felix Schniz hosted a session on the video game Bloodborne for AAU’s Media Club. Following this semester’s Media Club leitmotif of ‘the fantastic,’ Felix delved into the game’s depiction of arcane architecture, dream spaces, and the sublime in virtual realms. With 15 attendees and even guests from Salzburg on campus who came by just for this specific date, the session was a fantastic conclusion to this semester’s Media Club schedule.

,

Paper presented @ IEEE CBMS 2026

Last week, Francesco Marchetto and Klaus Schoeffmann presented their work on synthetic data generation for surgical image synthesis at IEEE CBMS 2026 (Computer-Based Medical Systems) conference in Limassol, Cyprus. Their paper, entitled “Hybrid Semantic Augmentation for Cataract Surgery Image Synthesis with GANs and Diffusion-based Models”, investigated how augmenting semantics in conditional generative models can be used to overcome the critical shortage of annotated training data in surgical AI.

The work introduced a student-teacher augmentation framework in which a trained generative model acts as a teacher to produce synthetic surgical images for a student model. Two augmentation strategies were evaluated: a naive mask re-generation approach that varies image appearance while preserving semantic layout, and a novel Hybrid Anatomy Injection strategy that procedurally generates new semantic masks by compositing surgical instruments onto real anatomical backgrounds. Experiments on the Cataract-1K dataset showed that the proposed semantic augmentation achieves up to 24% improvement in Fréchet Inception Distance over the baseline. By exposing the model to novel instrument-anatomy configurations never seen during training, the semantic augmentation breaks the performance plateau that texture-only variation cannot overcome, enabling the model to continue learning beyond the limits of the original data distribution. For diffusion-based models, which carry strong pretraining biases from large-scale natural image datasets, mask re-generation proves more effective: providing more examples of how surgical scenes look helps these models gradually adapt their pretrained priors to the target domain. Together, these strategies demonstrate that meaningful performance gains in surgical image synthesis can be achieved entirely without collecting new patient data, offering a practical and privacy-friendly path toward more capable generative models in clinical settings.

,

Paper accepted @ SIMULTECH 2026

Title: Can Swarms Be Trusted? Showcasing Swarm Intelligence and Privacy Preservation Through AR 

Conference: SIMULTECH 2026, Porto, Portugal, 18.-20.07.2026

Authors:  Melanie Schranz, M. Gojkovic, Horia Vulcu, Kseniia Harshina, 

Abstract: Swarm intelligence provides a robust approach for decentralized coordination in nowadays systems, yet its algorithmic principles, like local decision-making, role differentiation, and emergent global behavior are often difficult to convey to individuals without prior experience in swarm-based control. This creates practical barriers when deploying swarm-enabled solutions in domains such as shared electric vehicle charging, energy management, or mobility systems, where engineers, operators, and stakeholders must reliably understand how decentralized processes produce system-level outcomes. To address this challenge, we developed an Augmented Reality (AR) game that operationalizes a swarm model inspired by the Artificial Bee Colony algorithm and exposes key algorithmic elements, including information propagation, neighborhood interactions, and collective resource allocation—Swarm AR. The system also illustrates how decentralization can reduce data concentration, which may support privacy advantages under certain assumptions about information flow and system design, without requiring explicit protection mechanisms. A shared electric vehicle charging scenario serves as a use case to demonstrate load balancing and the necessity of distributed coordination. We evaluate the tool through a mixed-method user study using pre/post quantitative measures and qualitative analysis. Results indicate modest improvements in participants’ understanding of swarm coordination logic, decentralized decision processes, and emergent behavior relevant for infrastructure control. These findings suggest that AR-based interactive visualization can serve as an effective technical aid for communicating, validating, and reasoning about the operational characteristics of self-organizing systems, supporting informed engineering design and deployment of decentralized, privacy-aware coordination strategies.

Hadi
, ,

Special Session @ VCIP 2026

Title: Advances in Imaging, Perception, and Reasoning for High-Dimensional Visual Data

Conference: VCIP 2026

Abstract: Recent advances in visual sensing, computational imaging, neural representations, and multimodal learning are transforming the way visual data are acquired, processed, communicated, and understood. Modern visual systems increasingly rely on high-dimensional visual data that extend beyond conventional RGB images and videos to include event streams, light fields, hyperspectral and polarization imagery, LiDAR, time-of-flight sensing, neural scene representations, 3D Gaussian splats, and hybrid multimodal sensing modalities. These data capture rich spatial, temporal, geometric, spectral, and cross-modal information, enabling more robust visual processing under challenging conditions such as fast motion, low light, occlusion, missing modalities, and distribution shift. At the same time, the growing complexity and volume of high-dimensional visual data create new challenges in acquisition, restoration, compression, representation, quality assessment, perception, and reasoning. Emerging solutions increasingly integrate imaging, communication, perception, and multimodal intelligence to support reliable visual understanding and decision making. In line with these developments, we invite contributions on computational imaging and novel sensing systems, event-based and multimodal vision, high-dimensional visual restoration and enhancement, learned compression, implicit and neural representations, quality assessment, cross-modal fusion and alignment, robust visual perception, vision-language reasoning, trustworthy AI, and efficient visual communication for next-generation visual systems.

ORGANIZERS

  • Haowen Bai (Nanyang Technological University, SG)
  • Rui Zhao (Nanyang Technological University, SG)
  • Zeyu Xiao (National University of Singapore, SG)
  • Taewoo Kim (INSAIT, BG)
  • Hadi Amirpour (University of Klagenfurt, AT)
  • Tae Hyun Kim (Hanyang University, KR)
Hadi

Paper Accepted @ Springernature Scientific Reports

Title: An HEVC-based Known-Plaintext Attack for Video Selective Encryption

Authors: Lingfeng Qu, Chen Chen, Jinghan Xu, Yuan Yuan, Ningxiong Mao, Hadi Amirpour

Publication: Springer Nature