Abstract
3D audio real-time rendering is of great importance for virtual reality (VR) application, especially on mobile devices. However, the limited computational power makes it hard to implement fast generation of spatial sound using head-related transfer function (HRTF). To accelerate the procedure of head-related impulse response (HRIR) convolution, we propose an efficient rendering method using the parameterized HRTF. The HRIRs are preprocessed into the parameterized HRTFs with a delayed parameter, so as to realize the fast convolutions in 3D audio synthesis. We found our method could reduce the calculation time of 3D audio rendering significantly. The results were 0.9 times and 0.68 times on average the play duration of the MPEG standard sequences, with Qualcomm Snapdragon 821 and Samsung Exynos 7420. And the subjective test showed that the real-time rendered sounds had the similar audio quality and location perception to the 3D audio rendered with the raw HRIRs.
Y. Song—This work is supported by National Nature Science Foundation of China (No. 61671335, 61662010), National High Technology Research and Development Program of China (863 Program) No. 2015AA016306.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Sunder, K., He, J., Tan, E.L., Gan, W.S.: Natural sound rendering for headphones: integration of signal processing techniques. IEEE Signal Process. Mag. 32(2), 100–113 (2015)
Torres, J.C., Petraglia, M.R., Tenenbaum, R.A.: Low-order modeling of head-related transfer functions using wavelet transforms. In: Circuits and Systems, ISCAS 2004, p. III-513. IEEE Press (2004)
Zhang, J., Xia, R., Xu, C., Li, J., Yan, Y., Sakamoto, S.: Head-related transfer function modeling based on finite-impulse response. In: Intelligent Information Hiding and Multimedia Signal Processing (2013)
Lee, T., Oh, H.O., Seo, J., Park, Y.C., Youn, D.H.: Scalable multiband binaural renderer for MPEG-H 3D audio. IEEE J. Sel. Top. Signal Process. 9(5), 907–920 (2015)
Schissler, C., Nicholls, A., Mehra, R.: Efficient HRTF-based spatial audio for area and volumetric sources. IEEE Trans. Vis. Comput. Graph. 22(4), 1356–1366 (2016)
Iwaya, Y., Otani, M., Tsuchiya, T., Li, J.: Virtual auditory display on a smartphone for high-resolution acoustic space by remote rendering. In: Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP) (2015)
Phyo, K.K., Sunder, K., Gan, W.S.: Android framework implementation of 3D audio with range control. In: Audio Engineering Society Convention (2014)
Algazi, V.R., Duda, R.O., Thompson, D.M., Avendano, C.: The CIPIC HRTF database. In: 2001 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, pp. 99–102. IEEE Press (2001)
Qu, T., Xiao, Z., Gong, M., Huang, Y., Li, X., Wu, X.: Distance-dependent head-related transfer functions measured with high spatial resolution using a spark gap. IEEE Trans. Audio Speech Lang. Process. 17(6), 1124–1132 (2009)
Storek, D.: Rendering moving sound source for headphone-based virtual acoustic reality aspects of signal processing implementation. In: 2014 International Conference on Applied Electronics (AE), pp. 271–276. IEEE Press (2014)
Oppenheim, A.V., Schafer, R.W.: Discrete-Time Signal Processing. Prentice Hall International, Upper Saddle River (2009)
Belloch, J.A., Gonzalez, A., Martínez-Zaldívar, F.J., Vidal, A.M.: Real-time massive convolution for audio applications on GPU. J. Supercomput. 58(3), 449–457 (2011)
Katz, B.F., Noisternig, M.: A comparative study of interaural time delay estimation methods. J. Acoust. Soc. Am. 135, 3530–3540 (2014)
Wang, L., Yin, F., Chen, Z.: A hybrid compression method for head-related transfer functions. Appl. Acoust. 70(9), 1212–1218 (2009)
ITU-T Rec. P.800, Methods for Subjective Determination of Transmission Quality, International Telecommunication Union, Geneva (1996)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Song, Y., Tu, W., Hu, R., Wang, X., Chen, W., Yang, C. (2018). An Efficient Method Using the Parameterized HRTFs for 3D Audio Real-Time Rendering on Mobile Devices. In: Zeng, B., Huang, Q., El Saddik, A., Li, H., Jiang, S., Fan, X. (eds) Advances in Multimedia Information Processing – PCM 2017. PCM 2017. Lecture Notes in Computer Science(), vol 10736. Springer, Cham. https://doi.org/10.1007/978-3-319-77383-4_65
Download citation
DOI: https://doi.org/10.1007/978-3-319-77383-4_65
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-77382-7
Online ISBN: 978-3-319-77383-4
eBook Packages: Computer ScienceComputer Science (R0)