Predicting Encoding Energy from Low-Pass Anchors for Green Video Streaming

Authors: Zoha Azimi (AAU, Austria), Reza Farahani (AAU, Austria), Vignesh V Menon (Fraunhofer HHI, Berlin), Christian Timmerer (AAU, Austria)

Event: 1st International Workshop on Intelligent and Scalable Systems Across the Computing Continuum (ScaleSys ’25), November 18, 2025, Vienna, Austria, https://scalesys2025.itec.aau.at/

Abstract:  

Video streaming now represents the dominant share of Internet traffic, as ever-higher-resolution content is distributed across a growing range of heterogeneous devices to sustain user Quality of Experience (QoE). However, this trend raises significant concerns about energy efficiency and carbon emissions, requiring methods to provide a trade-off between energy and QoE. This paper proposes a lightweight energy prediction method that estimates the energy consumption of high-resolution video encodings using reference encodings generated at lower resolutions (so-called anchors), eliminating the need for exhaustive per-segment energy measurements, a process that is infeasible at scale. We automatically select encoding parameters, such as resolution and quantization parameter (QP), to achieve substantial energy savings while maintaining perceptual quality, as measured by the Video Multimethod Fusion Assessment (VMAF), within acceptable limits. We implement and evaluate our approach with the open-source VVenC encoder on 100 video sequences from the Inter4K dataset across multiple encoding settings. Results show that, for an average VMAF score reduction of only 1.68, which stays below the Just Noticeable Difference (JND)
threshold, our method achieves 51.22 % encoding energy savings and 53.54 % decoding energy savings compared to a scenario with no quality degradation.

 

Title: Data-Efficient Learning for Generalizable Surgical Video Understanding
Author: Sahar Nasirihaghighi

Venue: Doctoral Consortium MICCAI 2025, 23 – 27 September 2025, Daejeon, South Korea
Abstract: Advances in surgical video analysis are transforming operating rooms into intelligent, data-driven environments. Computer-assisted systems now support the full surgical workflow, from preoperative planning to intraoperative guidance and postoperative assessment. However, developing robust and generalizable models for surgical video understanding remains challenging due to (I) annotation cost and scarcity, (II) spatiotemporal complexity, and (III) domain gap across procedures and institutions. This doctoral research aims to bridge the gap between deep learning–based surgical video analysis in research and its real-world clinical deployment. To address the core challenge of recognizing surgical phases, actions, and events, critical for video-based analysis, I benchmarked state-of-the-art neural network architectures to identify the most effective designs for each task. I further improved performance by proposing novel architectures and integrating advanced modules. Given the high cost of expert annotations and the domain gap across surgical video sources, I focused on reducing reliance on labeled data. We developed semi-supervised frameworks that improve model performance across tasks by leveraging large amounts of unlabeled surgical video. We introduced novel semi-supervised frameworks, including DIST, SemiVTSurge, and ENCORE, that achieved state-of-the-art results on challenging surgical datasets by leveraging minimal labeled data and enhancing model training through dynamic pseudo-labeling. To support reproducibility and advance the field, we released two multi-task datasets: GynSurg, the largest gynecologic laparoscopy dataset, and Cataract-1K, the largest cataract surgery video dataset. Together, this work contributes to robust, data-efficient, and clinically scalable solutions for surgical video analysis, laying the foundation for generalizable AI systems that can meaningfully impact surgical care and training.

Title: GynSurg: A Comprehensive Gynecology Laparoscopic Surgery Dataset
Authors: Sahar Nasirihaghighi, Negin Ghamsarian, Leonie Peschek, Matteo Munari, Heinrich Husslein, Raphael Sznitman, Klaus Schoeffmann
Venue: ACM Multimedia 2025, 27 – 31 October 2025, Dublin, Ireland

Abstract: Recent advances in deep learning have transformed computer-assisted intervention and surgical video analysis, driving improvements not only in surgical training, intraoperative decision support, and patient outcomes, but also in postoperative documentation and surgical discovery. Central to these developments is the availability of large, high-quality annotated datasets. In gynecologic laparoscopy, surgical scene understanding and action recognition are fundamental for building intelligent systems that assist surgeons during operations and provide deeper analysis after surgery. However, existing datasets are often limited by small scale, narrow task focus, or insufficiently detailed annotations, limiting their utility for comprehensive, end-to-end workflow analysis. To address these limitations, we introduce GynSurg, the largest and most diverse multitask dataset for gynecologic laparoscopic surgery to date. GynSurg provides rich annotations across multiple tasks, supporting applications in action recognition, semantic segmentation, surgical documentation, and discovery of novel procedural insights. We demonstrate the dataset’s quality and versatility by benchmarking state-of-the-art models under a standardized training protocol. To accelerate progress in the field, we publicly release the GynSurg dataset and its annotations (https://ftp.itec.aau.at/datasets/GynSurge/).

1st Edition of the ScaleSys Workshop, International Workshop on Intelligent and Scalable Systems across the Computing Continuum @ The 15th International Conference on the Internet of Things

⭐ Keynotes:
Atakan Aral (University of Veinna), Scaling Brain-Inspired Edge Computing
Lauri Lovén (University of Oulu), Agentic Edge Intelligence: Past, Present and Future

 

On November 14, Dr Felix Schniz held a workshop for Master Students wishing to pursue an academic career related to game studies and game engineering. Invited by ÖH representatives, he focused on the first conference presentation, including topics such as abstract writing, conference etiquette, and publishing a conference paper.

On 14.11.2025, Farzad Tashtarian defended his habilitation thesis “Network-Assisted Adaptive Streaming: Toward Optimal QoE through System Collaboration”

Congratulations!

Committee members:
Prof. Martin Pinzger (Chairperson), Prof. Oliver Hohlfeld (external member), Prof. Bernhard Rinner, Prof. Angelika Wiegele, Prof. Chitchanok Chuengsatiansup, MSc Zoha Azimi Ourimi, Dr. Alice Tarzariol, Kateryna Taranov, and Gregor Lammer

Title: Agentic Edge Intelligence: A Research Agenda

Authors: Lauri Lovén, Reza Farahani, Ilir Murturi, Stephan Sigg, Schahram Dustdar

Abstract: Agentic AI is rapidly transforming autonomous decision-making, yet its deployment across the edge-cloud continuum remains poorly understood. This paper introduces the concept of agentic edge intelligence, an emerging paradigm in which autonomous agents operate across the computing continuum to negotiate computational resources, data, and services within dynamic digital marketplaces. We position this concept at the intersection of edge intelligence, multi-agent systems, and computational economics, where distributed decision-making replaces centralized orchestration. The paper outlines key research challenges, including scalability, interoperability, market stability, and ethical governance, and proposes a research agenda addressing theoretical, architectural, and societal dimensions. By integrating mechanism design with trustworthy AI and edge computing, the real-time AI economy envisions a self-organizing infrastructure for efficient, transparent, and equitable resource exchange in future digital ecosystems.

Venue: International Workshop on Intelligent Systems and Paradigms for Next Generation Computing Evolution (INSPIRE 2025) in conjunction with the 18th IEEE/ACM Utility and Cloud Computing Conference (UCC)

Title: Serverless Everywhere: A Comparative Analysis of WebAssembly Workflows Across Browser, Edge, and Cloud

Authors: Mario Colosi, Reza Farahani, Lauri Lovén, Radu Prodan, Massimo Villari

Abstract: WebAssembly (Wasm) is a binary instruction format that enables portable, sandboxed, and near-native execution across heterogeneous platforms, making it well-suited for serverless workflow execution on browsers, edge nodes, and cloud servers. However, its performance and stability depend heavily on factors such as startup overhead, runtime execution model (e.g., Ahead-of-Time (AOT) and Just-in-Time (JIT) compilation), and resource variability across deployment contexts. This paper evaluates a Wasm-based serverless workflow executed consistently from the browser to edge and cloud instances. The setup uses wasm32-wasi modules: in the browser, execution occurs within a web worker, while on Edge and Cloud, an HTTP shim streams frames to the Wasm runtime. We measure cold- and warm-start latency, per-step delays, workflow makespan, throughput, and CPU/memory utilization to capture the end-to-end behavior across environments. Results show that AOT compilation and instance warming substantially reduce startup latency. For workflows with small payloads, the browser achieves competitive performance owing to fully in-memory data exchanges. In contrast, as payloads grow, the workflow transitions into a compute- and memory-intensive phase where AOT execution on edge and cloud nodes distinctly surpasses browser performance.

Venue: International Workshop on Intelligent and Scalable Systems across the Computing Continuum (ScaleSys 2025) in conjunction with the 15th International Conference on the Internet of Things (loT 2025)

Title: Toward Sustainability-Aware LLM Inference on Edge Clusters

Authors: Kolichala Rajashekar, Nafiseh Sharghivand, Radu Prodan, Reza Farahani

Abstract: Large language models (LLMs) require substantial computational resources, leading to significant carbon emissions and operational costs. Although training is energy-intensive, the long-term environmental burden arises from inference, amplified by the massive global query volume. Cloud-based inference offers scalability but suffers from latency and bandwidth constraints due to centralized processing and continuous data transfer. Edge clusters instead can mitigate these limitations by enabling localized execution, yet they face trade-offs between performance, energy efficiency, and device constraints. This short paper presents a sustainability-aware LLM inference for edge clusters comprising NVIDIA Jetson Orin NX (8GB) and Nvidia Ada 2000 (16GB) devices. It aims to balance inference latency and carbon footprint through carbon- and latency-aware routing strategies, guided by empirical benchmarking of energy consumption and execution time across diverse prompts and batch (i.e., group of prompts) configurations. We compared baseline greedy strategies to carbon-aware and latency-aware strategies in prompt routing to specific hardware based on benchmarking information. Experimental evaluation shows that a batch size of four prompts achieves a trade-off between throughput, energy efficiency, while larger batches risk GPU memory saturation.

Venue: International Workshop on Intelligent and Scalable Systems across the Computing Continuum (ScaleSys 2025) in conjunction with the 15th International Conference on the Internet of Things (loT 2025)

 

 

On 22 October 2025, Dr Felix Schniz opened the newly founded Media Club of AAU with a spectacular guest lecture. Founded by the Department of English, the Media Club has been installed to offer students an extracurricular and multidisciplinary journey through a leitmotif every semester. Starting with “Dystopia” in Winter 2025, Felix Schniz took the audience onto a journey through the video game “Hellblade: Senua’s Sacrifice” and reminisced on technological and psychological facets of game design.