ABSTRACT

Time is the core of multimedia. Modern applications are synchronous: dynamic (interactive, runtime), realtime (updates reected immediately), and online ( networked). Sound and audio, including spatial sound and augmented audio, are especially leveraged by such distributed capabilities, not just modulation of location of virtual sound sources, but parameterization of the entire source-sink cascade, including synthesis, directionalization, spatialization, and reception. This chapter reviews spatial sound in the context of interactive multimedia and virtual reality (VR) and augmented reality (AR). The theory and practice of spatial sound are surveyed, including psychoacoustic bases of spatial hearing and techniques for creating and displaying augmented audio. Whereware is explained as a class of location-and position-sensitive interfaces. Wearware and everyware refer respectively to portability of personal sound terminals, such as contemporary smartphones and tablets, and pervasiveness of public interfaces, such as speaker arrays.