Skip to main content

Topics in Sound Production (401-0-22)

Topic

VR Sound with Ambisonics

Instructors

Russell Laurence Gillespie

Meeting Info

Wirtz 215 Instruct Black Box 3: Wed 5:00PM - 7:50PM

Overview of class

In this course students will be introduced to the core concepts of ambisonic soundfield production. Coursework and assignments will provide practical experience in the capture of raw ambisonic recordings, mixing and composition in Reaper, then progress to the building of virtual audio environments in the Unity game engine. Students will create and present an ambisonic portfolio piece as a final project using the methods covered throughout the course.

Registration Requirements

Priority enrollment is reserved for students enrolled in the Sound Arts and Industries program with exceptions requiring instructor approval.

Learning Objectives


  • Understand core concepts of ambisonics, and the capture and playback of soundfield recordings

  • Develop a familiarity with the ambisonic production workflow in Reaper, building immersive environments from a variety of sound sources

  • Understand how game engines work with sound sources and how ambisonics can be implemented in Unity3D.

  • Gain experience with composing static and interactive soundfields in both 360° video environments and dynamically-rendered virtual spaces, using game objects as interactive elements.

Evaluation Method

All specific information about assignments, readings, class discussions, etc. will take place via Canvas. Please enable email alerts from Canvas and take note of announcements and other information that may be posted there. Grades are assigned via a point system. Each of you begin at zero and accrue points as the class progresses.



Grading (100 points):

  • (20 points, 5 each) Four production-based incremental assignments

    • Raw Ambisonic recording

    • Reaper workflow

    • Unity Audio Scene

    • Unity 360 video sound design


  • (15 points) Midterm project (Reaper composition)

  • (25 points) Final project (with Reaper and/or Unity3D)

  • (40 points, 4 per class) Attendance and participation


Four Assignments, due in weeks 2, 3, 6, and 8 respectively, will be based around the main areas we will cover: working with ambisonic soundfield recordings, creating ambisonic composite mixes using mono/stereo material, sound designing a 360° video, and creating a virtual soundscape using the Unity game engine. The specifics of each assignment will be published in the week the assignment is given. These projects are designed to build skills and reinforce the topics covered during each class section. Unless explicitly stated otherwise, these are due by the beginning of our class meeting time. A point will be deducted for each day (or part of a day) the assignment is late beyond that point.


A Midterm Project composed in Reaper will be due in week 4 that combines the recording, compositing, and mixing techniques explored in the first three weeks of class. This will serve to ensure students are proficient with the soundfield composition process as the basis for our transition into the Unity portion of the class.


A Final Project will be due at the final class period. Students will develop a final project proposal in dialogue with me, to be submitted by class time on Week 7. This project should synthesize the topics covered throughout the quarter into an outcome that reflects your individual goals for the course, and should be as "complete" a project as possible, so that it may serve you in other contexts, such as a portfolio of work. Significant thought should be put into how the project can best be shared with the rest of the class during the final presentation.


Attendance & Participation are crucial for our success in this class. We will move quickly, and our progress relies upon all parties remaining engaged with the material and each other in every session. In particular, any missed class time will have a major impact. Students are strongly encouraged to be in contact with me in advance of any absence and are expected to show initiative in remaining in sync with the pace of the class. Points are deducted for tardiness and/or partial absence. Please be on time and plan your other activities around class time.


Individual One-on-One Meetings with me will be scheduled in weeks 6 and 8. These provide an opportunity for us to check in about your progress in the class. Time slot sign-up for these meetings will take place via Canvas. Please note that, if you are having trouble keeping up in the class at any point, you should seek me out for consultation during my office hours or by making an appointment.

Class Materials (Required)

There are no textbooks or other materials-for-purchase required for this class. However, you are encouraged to obtain a method for backing up and transporting your data -typically a USB thumb drive or a small hard drive. Figuring out a method for data backup, and adhering to a disciplined backup plan, is strongly advised. Other class materials will either be checked out from the cage or supplied in-class.