Teaser Image

Course Description

Physically based sound is an important emerging approach to computer synthesis of realistic synchronized sounds for physically based animation and real-time virtual environments. A major challenge for learning and implementing these sound techniques is the wide range of physically based models and sound phenomena involved, as well as the need for optimizations. Many publications on physically based animation and sound rendering assume mathematical background that many in the graphics community lack. The result is that learning physics-based sound techniques is unnecessarily difficult for many interested students and practitioners.

The main goal of this course is to make the principles and methods of physically based sound accessible to a broader computer-graphics audience. The course covers sound-source models for sonifying important phenomena from physics-based animation: rigid bodies, brittle fracture, thin-shells, cloth, deformable collisions and contact, fluids, and fire. Material related to rigid-body sound is covered in greater detail in the first half of the course, which addresses fundamental topics such as modeling modal vibrations and sound radiation from surfaces. Further readings are suggested throughout the course notes. Several recent SIGGRAPH papers also serve as supplemental notes for more advanced topics.

With supporting software and implementation short-cuts, attendees can start using physically based sound immediately after completing the course.

Course Materials

Topic Speaker Slides Course Notes, Code & Papers
Introduction James PDF, key Notes(PDF)
Modal Vibration Zheng PDF, key Notes(PDF)
Acoustic Transfer James PDF, key Notes(PDF)
Implementing Rigid-Body Sound Zheng CODE(github)
Acceleration Noise James PDF, key [Chadwick+ SIG2012] [Chadwick+ SCA2012]
Brittle Fracture Zheng PDF, key [Zheng & James 2010]
Thin Shells James PDF, key [Chadwick et al. 2009]
Liquids Langlois PDF, key [Zheng & James 2009] [Langlois et al. 2016]
Fire James PDF, key [Chadwick & James 2011]
Sound in VR Mehra PDF

Citation

bibtex
Doug L. James, Timothy R. Langlois, Ravish Mehra, and Changxi Zheng. 2016. Physically based sound for computer animation and virtual environments. In ACM SIGGRAPH 2016 Courses (SIGGRAPH '16). ACM, New York, NY, USA, , Article 22 , 8 pages. DOI: http://dx.doi.org/10.1145/2897826.2927375