Logo image
Open Research University homepage
Surrey researchers Sign in
Demo Abstract: Semantic Communications for Immersive Multi-view Media Delivery
Conference presentation   Open access

Demo Abstract: Semantic Communications for Immersive Multi-view Media Delivery

Jingxuan Men, Carl Chinonso Udora, Ning Wang, Mahdi Boloursaz Mashhadi, Yi Ma and Mike Nilsson
IEEE International Conference on Computer Communications (INFOCOM) (London, UK, 19/05/2025–22/05/2025)
06/12/2024

Abstract

Our demonstration highlights the use of semantic communication to transmit stereo frame streams and its application in immersive media. Considering the limitations of traditional stereo compression with digital transmission under poor channel conditions, such as the cliff effect and high latency in computation and transmission, we employ the Deep Joint Source and Channel Coding (Deep JSCC) framework to transmit semantic information of stereo streams between the sender and receiver. To address channel instability, we propose a dynamic rate adjustment method that adapts to channel conditions while maintaining transmission efficiency and reconstruction quality. Furthermore, we extend this work to stereo stream applications, enabling the real-time synthesis of multiple novel view streams of the streamer. The overall design of this demo enables an immersive multi-view experience by transmitting rate-controlled semantic features from only two perspectives.

pdf
20250546165.44 MBDownloadView
Author's Accepted Manuscript Open Access

Metrics

Details

Logo image

Usage Policy