Can Accurate Future Bandwidth Prediction Improve Volumetric Video Streaming Experience?

Muhammad Jalal Khan, Abdelhak Bentaleb, Saad Harous

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recently, the advancements in technologies have enabled volumetric media techniques to capture, encode, decode, and render videos in six degree-of-freedom (6DoF) in order to make the objects highly immersive, interactive, and expressive within the scene. This is enabled by using multiple cameras around the object(s). However, streaming 6DoF videos require a huge bandwidth and computational processing. As the end-user focuses on viewport-scenes, a large portion of the consumed bandwidth is mainly introduced due to unseen video-scenes. To fill this gap, it is imperative to predict the future head-movement (future viewport) of end-user in order to avoid the waste of network bandwidth and reduce computational processing power. In this paper, we propose a holistic architecture for the future viewport prediction using deep-neural-network (DNN)-based model. Specifically, our solution uses residual long-short-term-memory (RLSTM) architecture for accurate future viewport prediction. We confirm the effectiveness of our solution through trace-driven streaming experiments using a popular public dataset over four categories of DNN models: linear, dense, convolutional, and long-short-term-memory (LSTM). Experimental results show that our solution is able to achieve the lowest possible mean absolute error of ∼ 0.01 compared to its competitor.

Original languageEnglish
Title of host publication2021 International Wireless Communications and Mobile Computing, IWCMC 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1041-1047
Number of pages7
ISBN (Electronic)9781728186160
DOIs
Publication statusPublished - 2021
Event17th IEEE International Wireless Communications and Mobile Computing, IWCMC 2021 - Virtual, Online, China
Duration: Jun 28 2021Jul 2 2021

Publication series

Name2021 International Wireless Communications and Mobile Computing, IWCMC 2021

Conference

Conference17th IEEE International Wireless Communications and Mobile Computing, IWCMC 2021
Country/TerritoryChina
CityVirtual, Online
Period6/28/217/2/21

Keywords

  • 6DoF
  • Adaptive video streaming
  • DASH
  • HAS
  • HLS
  • Viewport prediction
  • Volumetric videos

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Signal Processing
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Can Accurate Future Bandwidth Prediction Improve Volumetric Video Streaming Experience?'. Together they form a unique fingerprint.

Cite this