Fast and Effective Region-based Depth Map Upsampling with Application to Location Map-Free Reversible Data Hiding

Main Article Content

Kuo-Liang Chung
Yu-Ling Tseng
Tzu-Hsien Chan
Ching-Sheng Wang


In this paper, we rst propose a fast and eective region-based depth map upsampling method, and then propose a joint upsampling and location map-free reversible data hiding method, simpled called the JUR method. In the proposed upsampling method, all the missing depth pixels are partitioned into three disjoint regions: the homogeneous, semi-homogeneous, and non- homogeneous regions. Then, we propose the depth copying, mean value, and bicubic interpolation approaches to reconstruct the three kinds of missing depth pixels quickly, respectively. In the proposed JUR method, without any location map overhead, using the neighboring ground truth depth pixels of each missing depth pixel, achieving substantial quality, and embedding capacity merits. The comprehensive experiments have been carried out to not only justify the execution-time and quality merits of the upsampled depth maps by our upsampling method relative to the state-of-the-art methods, but also justify the embedding capacity and quality merits of our JUR method when compared with the state-of-the-art methods.

Bicubic interpolation, color plus depth video coding, depth map upsampling, depth no-synthesis-error, quality, reversible data hiding.

Article Details

How to Cite
Chung, K.-L., Tseng, Y.-L., Chan, T.-H., & Wang, C.-S. (2020). Fast and Effective Region-based Depth Map Upsampling with Application to Location Map-Free Reversible Data Hiding. Journal of Advances in Mathematics and Computer Science, 35(4), 24-45.
Original Research Article


Shao F, Jiang G, Yu M, Chen K, Ho YS. Asymmetric coding of multi-view video plus depth based 3D video for view rendering. IEEE Transactions on Multimedia. 2012;14(1):157-167.

Fehn C. Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV. Proc. SPIE. 2004;5291:93-104.

Ni Z, Shi QY, Ansari N, Su W. Reversible data hiding. IEEE Trans. Circuits Syst. Video Technol. 2006;16(3):354-362.

Durand F, Dorsey J. Fast bilateral ltering for the display of high-dynamic-range images. ACM Transactions on Graphics. 2002;21(3).

Kopf J, Cohen MF, Lischinski D, Uyttendaele M. Joint bilateral upsampling. ACM Transactions on Graphics. 2007;26(3). Art. ID 96 Kim J, Lee J, Han S, Kim D, Min J, Kim C. Trilateral lter construction for depth map upsampling. IEEE IVMSP Workshop. 2013;1-4.

Zhang B, Allebach JP. Adaptive bilateral lter for sharpness enhancement and noise removal. IEEE Transactions on Image Processing. 2008;17(5):664-678.

Jung SW. Enhancement of image and depth map using adaptive joint trilateral lter. IEEE Transactions on Circuits and Systems for Video Technology. 2013;23(2):258-269.

Dhara BC, Chanda B. Color image compression based on block truncation coding using pattern tting principle. Pattern Recognition. 2007;40(9):2408-2417.

Yang J, Wright J, Huang T, Ma Y. Image super-resolution via sparse representation. IEEE Transactions on Image Processing. 2010;19(11):2861-2873.

Ham B, Cho M, Ponce J. Robust image ltering using joint static and dynamic guidance. IEEE conference on computer vision and pattern Recognition. 2015;48234831.
The Middlebury Stereo Datasets. [Online].

He K, Sun J, Tang X. Guided image ltering. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2013;35(6):1397-1409.

Ferstl D, Reinbacher C, Ranftl R, Rther M, Bischof H. Image guided depth upsampling using anisotropic total generalized variation. IEEE International Conference on Computer Vision.

Li Y, Min D, Do MN, Lu J. Fast guided global interpolation for depth and motion. Proc. European Conference on Computer Vision, Speech and Signal Processing. 2016;717-733.

Tallon M. Upsampling and denoising of depth maps via joint segmentation," EUSIPCO 2012 (20th European Signal Processing Conference 2012). 2012;27-31.

Choi O, Jung S. A consensus-driven approach for structure and texture aware depth map upsampling. IEEE Transactions on Image Processing. 2014;23(8):3321-3335.

Xie J, Feris RS, Sun MT. Edge-guided single depth image super resolution. IEEE Transactions on Image Processing. 2016;25(1):428-438.

Zeyde R, Elad M, Protter M. On single image scale-up using sparse-representations. Proc.

International Conference on Curves and Surfaces. 2010;711-730.

Xie J, Chou CC, Feris R, Sun MT. Single depth image super resolution and denoising via coupled dictionary learning with local constraints and shock ltering. IEEE International Conference on Multimedia and Expo. 2014;1-6.

Konno Y, Tanaka M, Okutomi M, Yanagawa Y, Kinoshita K, Kawade M. Depth map upsampling by self-guided residual interpolation. International Conference on Pattern Recognition. 2016;1394-1399.

Wang L, Wu H, Pan C. Fast image upsampling via the displacement eld. IEEE Transactions on Image Processing. 2014;23(12):5123-5135.

Aodha OM, Campbell ND. Nair A. Brostow GJ. Patch based synthesis for single depth image super-resolution. IEEE European Conference on Computer Vision. 2012;71-84.

Chang Y, Kim S, Ho Y. Depth upsampling methods for high resolution depth map. 2018

International Conference on Electronics, Information, and Communication (ICEIC). 2018;1-4.

Chan D, Buisman H, Theobalt C, Thrum S. A noise-aware lter for real-time depth upsampling.

Workshop on Multi-camera and Multi-modal Sensor Fusion Algorithms and Applications.

Lee SB, Kwon S, Ho YS. Discontinuity adaptive depth upsampling for 3D video acquisition.
Electronic Letters. 2013;49(25):1612-1614.

Hui TW, Loy CC, Tang X. Depth map super-resolution by deep multi-scale guidance. Proc.

European Conference on Computer Vision. 2016;353-369.

Dong C, Loy CC, Tang X. Accelerating the super-resolution convolutional neural network.

Proc. European Conference on Computer Vision. 2016;391-407.

Kim B, Ponce J, Ham B. Deformable kernel networks for guided depth map upsampling; 2019.


Yi Guo, Ji Liu, Depth edge guided CNNs for sparse depth upsampling; 2020. arXiv:2003.10138 Keys RG. Cubic convolution interpolation for digital image processing. IEEE Transactions on Acoustics, Speech, Signal Processing. 1981;29:1153-1160.

Chung KL, Yang WJ, Yang WN. Reversible data hiding for depth maps using the depth no-synthesis-error model. Information Sciences. 2014;269(6):159-175.

Zhao Y, Zhu C, Chen Z, Yu L. Depth no-synthesis-error model for view synthesis in 3-D video. IEEE Transactions on Image Processing. 2011;20(8):2221-2228.

Witten IH, Neal RM, Cleary JG. Arithmetic coding for data compression. Communications of the ACM. 1987;30(6):520-540.

Shi X, Ou B, Qin Z. Tailoring reversible data hiding for 3D synthetic images. Signal Processing: Image Communication. 2018;64:46-58.

Cormen TH, Leiserson CE, Rivest RL, Stein C. Asymptotic notation in introduction to algorithms. 3rd ed. London, U.K.: MIT Press; 2009. sec. 3.1.

Fehn C, Kau P, Op de Beeck M, Ernst F, Ijsselsteijn W, Pollefeys M, Vangool L, Ofek E, Sexton I. An evolutionary and optimised approach on 3D-TV. International Broadcast Conference. 2002;357-365.

Watkins DS. Geometric approach to the least-squares problem in Fundamentals of matrix computations. New York: Wiley; 1991. Subsection 3.5.
Execution code.[ Accessed: 26 Jan. 2019]. [Online].

Wang Z, Bovik AC, Sheikh HR, Simoncelli EP. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing. 2004;13(4):600-612.
Experimental results. [Accessed: 26 Jan. 2019] [Online].

Yuan L, Jin X, Li Y, Yuan C. Depth map super-resolution via low-resolution depth guided joint trilateral up-sampling. J. of Visual Communication and Image Representation.