Acoustic Simulation in Real World Scenes
Abstract
The objective of this project is to develop new approaches for acoustic modeling and rendering in reconstructed models of real-world scenes. Most prior work in computer vision and computer graphics has focused on visual reconstruction and rendering and recent advancements in interactive sound simulation and rendering are mostly limited to synthetic models. We need a new set of methods that can take into account properties of sound waves, which are quite different from light waves. These include watertight reconstruction of large or non-line-of-sight features that govern the propagation of sound. Moreover, we need improved methods to automatically classify the acoustic properties of different materials in terms of frequency-dependent absorption, scattering, and diffusion coefficients. We also need new, easy to use, and robust audio-visual sensors to capture different characteristics of the environment in the wild and process the visual and aural inputs. In order to faithfully reproduce the acoustic effects in real-world scenes, we also need faster methods to simulate late reverberation effects as well diffuse reflections and diffraction. The proposed research borrows ideas from computer vision, machine learning, signal processing, computer graphics, psycho-acoustics and scientific computing to address these challenges with respect to acoustic modeling and rendering. It includes development of new sensors, new methods for capturing the scenes and classifying the material properties and fast sound simulation on commodity processors. Furthermore, the use of sound sensors and reconstruction techniques can also be used to improve the performance of computer vision algorithms.
Document Details
- Document Type
- DoD Grant Award
- Publication Date
- Oct 15, 2018
- Source ID
- W911NF1810313
Entities
People
- Dinesh Manocha
Organizations
- Army Contracting Command
- United States Army
- University of Maryland