Depth-Image-Based Rendering (DIBR)

• Depth-based image processing for 3D video rendering applications [1][2]
• Virtual view synthesis method and self-evaluation metrics for free viewpoint television and 3D video [3]
• DIBR based view synthesis for free-viewpoint television [4]
• Free-viewpoint depth image based rendering [5]
• Free-viewpoint rendering algorithm for 3D TV [6]
• View generation with 3D warping using depth information for FTV [7]
• View synthesis with depth information based on graph cuts for FTV [8]
• Symmetric bidirectional expansion algorithm to remove artifacts for view synthesis based DIBR [9]

References

[1] T. Zarb and C. J. Debono, “Depth-based image processing for 3D video rendering applications,” in Proc. IEEE Int. Conf. Syst. Signals Image Process., May 2014, pp. 215–218.
[2] Zarb, Terence, and Carl James Debono. "Broadcasting Free-Viewpoint Television Over Long-Term Evolution Networks." IEEE Systems Journal 10.2 (2016): 773-784.
[3] K. J. Oh, S. Yea, A. Vetro, and Y. S. Ho, “Virtual view synthesis method and self-evaluation metrics for free viewpoint television and 3D video,” Int. J. Imag. Syst. Technol., vol. 20, no. 4, pp. 378–390, Dec. 2010.
[4] X. Yang et al., “DIBR based view synthesis for free-viewpoint television,”
in Proc. 3DTV Conf., May 2011, pp. 1–4.
[5] S. Zinger, L. Do, andP. H. N. de With, “Free-viewpoint depth image based rendering,” J. Vis. Commun. Image Represent., vol. 21, no. 5/6, pp. 533–541, Jul. 2010.
[6] P. H. N. de With and S. Zinger, “Free-viewpoint rendering algorithm for 3D TV,” in Proc. 2nd Int. Workshop Adv. Commun.,May 2009, pp. 19–23.
[7] Y. Mori, N. Fukushima, T. Fujii, and M. Tanimoto, “View generation with 3D warping using depth information for FTV,” in Proc. 3DTV Conf., May 2008, pp. 229–232.
[8] A. T. Tran and K. Harada, “View synthesis with depth information based on graph cuts for FTV,” in Proc. 19th Korea-Japan Joint Workshop Frontiers Comput. Vis., Feb. 2013, pp. 289–294.
[9] H. Ding, Z. Li, and R. Hu, “Symmetric bidirectional expansion algorithm to remove artifacts for view synthesis based DIBR,” in Proc. Int. Conf. Multisensor Fus. Inf. Integr. Intell. Syst., Sep. 2014, pp. 1–4.

Depth-Image-Based Rendering (DIBR)

DIBR is a technique to synthesize a non-captured view (virtual) using some of the captured (reference) views of the 3D world.

Free Viewpoint Streaming

A DASH-based Free Viewpoint Video Streaming System [1]

• They have proposed a framework for adaptive free-viewpoint video streaming.
• They have developed an empirical rate-distortion model for MVD (multi-view-plus-depth) videos.
• They have developed two DIBR implementations which exploit graphics processing units (GPUs) to speed up the view synthesis process. The first implementation performs double warping view synthesis for an arbitrary camera arrangement. The second implementation performs horizontal pixel shifting for 1D parallel camera arrangements or rectified camera views. Both implementations use the OpenGL graphics API to perform the different stages of the view synthesis process.

Adaptive Streaming of Interactive Free Viewpoint Videos to Heterogeneous Clients [2]

• This is extended version of [1].
• They have predicted user's view request using a simple location estimation technique known as dead reckoning.
• They have developed a virtual view distortion model which is based on mathematical analysis. It stills needs some pre-measured rate-distortion points to find the model's parameters.    

References

[1] A. Hamza and M. Hefeeda. A DASH-based free-viewpoint video streaming system. In Proc. of the ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, pages 55–60, March 2014.
[2] Hamza, Ahmed, and Mohamed Hefeeda. "Adaptive streaming of interactive free viewpoint videos to heterogeneous clients." Proceedings of the 7th International Conference on Multimedia Systems. ACM, 2016.

DIBR for FVV

In [1], they have used Depth-Image-Based Rendering (DIBR) to synthesize a non-reference video from reference views (free-viewpoint application).

References
[1] S. Zinger, L. Do, and P. de With. Free-viewpoint depth image based rendering. Journal of Visual Communication and Image Representation, 21(5-6):533–541, 2010.