Abstract
Our demonstration highlights the use of semantic communication to transmit stereo frame streams and its application in immersive media. Considering the limitations of traditional stereo compression with digital transmission under poor channel conditions, such as the cliff effect and high latency in computation and transmission, we employ the Deep Joint Source and Channel Coding (Deep JSCC) framework to transmit semantic information of stereo streams between the sender and receiver. To address channel instability, we propose a dynamic rate adjustment method that adapts to channel conditions while maintaining transmission efficiency and reconstruction quality. Furthermore, we extend this work to stereo stream applications, enabling the real-time synthesis of multiple novel view streams of the streamer. The overall design of this demo enables an immersive multi-view experience by transmitting rate-controlled semantic features from only two perspectives.