Sound Synthesis, Propagation, and Rendering: A Survey
arXiv:2011.05538
Abstract
Sound, as a crucial sensory channel, plays a vital role in improving the reality and immersiveness of a virtual environment, following only vision in importance. Sound can provide important clues such as sound directionality and spatial size. This paper gives a broad overview of research works on sound simulation in virtual reality, games, multimedia, computer-aided design. We first survey various sound synthesis methods, including harmonic synthesis, texture synthesis, spectral analysis, and physics-based synthesis. Then, we summarize popular sound propagation techniques, namely wave-based methods, geometric-based methods, and hybrid methods. Next, the sound rendering methods are reviewed. We further demonstrate the latest deep learning based sound simulation approaches. Finally, we point to some future directions of this field. To the best of our knowledge, this is the first attempt to provide a comprehensive summary of sound research in the field of computer graphics.
arXiv comment27 pages
References in corpus (9)
- Self-Supervised Generation of Spatial Audio for 360 Video
- Regression and Classification for Direction-of-Arrival Estimation with Convolutional Recurrent Neural Networks
- Scene-Aware Audio Rendering via Deep Acoustic Analysis
- Improving Reverberant Speech Training Using Diffuse Acoustic Simulation
- The Cone of Silence: Speech Separation by Localization
- Low-frequency Compensated Synthetic Impulse Responses for Improved Far-field Speech Recognition
- Receiver Placement for Speech Enhancement using Sound Propagation Optimization
- Interactive Sound Rendering on Mobile Devices using Ray-Parameterized Reverberation Filters
- Scene-aware Far-field Automatic Speech Recognition