The Psychoacoustics of Consonance and Dissonance ​

Unit 4 of the Sound module.

Objective ​

Explore the transition from individual sounds to their interactions. Understand how the collision of multiple pitches and their complex timbral spectra within the ear's critical bands generates the continuous spectrum of consonance and dissonance. Distinguish between the universal, biological hardware of sensory roughness and the learned, cognitive software of musical tension, and discover how timbre fundamentally dictates which intervals sound consonant.

Relevance to visual music theory ​

Consonance and dissonance are the auditory equivalents of visual harmony and visual tension. Understanding the psychoacoustic mechanics of roughness allows visual music artists to map auditory dynamics to visual narratives—translating the biological "grating" of dissonance into visual glitch, Moiré patterns, or high-frequency flicker, and the "fusion" of consonance into smooth geometric symmetries and stable color gradients.

Prerequisites and Unit Boundaries ​

This unit moves from the physics of single sound sources (Unit 3.3: Timbre) to the interaction of multiple sources. It relies heavily on the physiological hardware of the Critical Band introduced in Unit 3.2 (Hearing), applying it as the canvas upon which wave interference is painted. It does not address how human cultures have mathematically organized these consonant and dissonant intervals into playable scales and keyboards—that is the domain of Unit 3.5 (Tuning Systems). What you will carry forward from this unit:

  • The physics of beats and the Plomp-Levelt dissonance curve.
  • The distinction between sensory (biological) dissonance and musical (cognitive) dissonance.
  • The Sethares Insight: how the timbre of an instrument determines which intervals are consonant.
  • The visual analogues of auditory roughness (Moiré patterns and visual flicker).

I. The Physics of Interaction: Beats and Roughness ​

When two or more sound waves occupy the same physical space, they superimpose. The nature of this interference dictates whether the brain perceives the combination as smooth (consonant) or grating (dissonant).

1. Beat Frequency ​

When two pure sine tones of slightly different frequencies ($f_1$ and $f_2$) are played simultaneously, their waveforms alternately reinforce and cancel each other out. This creates a periodic variation in amplitude known as beats. $$ f_{\text{beat}} = |f_2 - f_1| $$ The human auditory system perceives these amplitude fluctuations in three distinct regimes, depending on the speed of the beats:

  1. Slow Beats (< ~15 Hz): Perceived as a pleasant, rhythmic pulsation or "wah-wah" effect. Musicians use this to tune instruments (e.g., a piano tuner listening for beats to slow down and stop as two strings reach unison).
  2. Roughness (~15–150 Hz): The beats become too fast for the brain to track as a distinct rhythmic pulse, but too slow to fuse into a single pitch. This creates a harsh, grating, and physically unpleasant sensation known as sensory roughness—the primary physical driver of dissonance.
  3. Fusion and Difference Tones (> ~150 Hz): The amplitude fluctuations become too fast for the auditory system's envelope detectors to resolve. The two tones fuse into a single, smooth, complex timbre. If the frequency difference is large enough, the non-linearities of the inner ear may also generate phantom "difference tones" ($f_2 - f_1$).

2. The Plomp-Levelt Dissonance Curve ​

In 1965, psychoacousticians R. Plomp and W.J.M. Levelt mapped the perceived dissonance of two pure tones as a function of their frequency difference. Their seminal Dissonance Curve revealed a universal biological law: Maximum perceived roughness occurs when the frequency difference between two pure tones is approximately 25% of the ear's critical band width.

Crucial Clarification: Many introductory texts state that maximum roughness occurs at a fixed difference of "30–40 Hz." This is incorrect. Because the critical band width changes with center frequency (narrower at low frequencies, wider at high frequencies), the absolute frequency difference (in Hz) that produces maximum roughness also changes. At 500 Hz, maximum roughness occurs at a much smaller Hz difference than at 5,000 Hz. The 25% rule is a relative metric, not an absolute one.

II. The Physiology of Perception: The Canvas of the Critical Band ​

The physical phenomenon of roughness is filtered through the biological hardware of the inner ear. As established in Unit 3.2, the cochlea does not process sound as a single mixed waveform; it acts as a mechanical spectrum analyzer, separating frequencies along the basilar membrane.

1. Neural Interference within the Critical Band ​

The critical band is the "frequency resolution" bandwidth of a specific section of the basilar membrane.

  • Outside the critical band: If two frequencies are far enough apart, they stimulate separate, non-overlapping groups of hair cells. The brain processes them as distinct, clear pitches. There is no neural interference, and thus no roughness (consonance).
  • Within the same critical band: If two frequencies are close enough to fall within the same critical band, their vibrations stimulate the same physical real estate on the basilar membrane. The hair cells cannot resolve the two distinct frequencies, resulting in neural interference. The brain interprets this physiological "traffic jam" as sensory roughness (dissonance).

2. Auditory Masking and Dissonance ​

Closely related to critical bands is masking, where the presence of one sound makes another less audible. This has a profound effect on perceived dissonance:

  • Simultaneous Masking: A louder tone can partially or completely mask a softer tone if they fall within the same critical band. Consequently, a highly dissonant interval played with vastly unequal amplitudes (e.g., a loud bass note and a very quiet, clashing high note) will sound less harsh than if both notes were played at equal volume. The louder tone effectively "hides" the neural interference of the quieter one.

3. The Role of the Auditory Cortex ​

While the cochlea and brainstem compute the raw data of roughness, the perception of consonance and dissonance is ultimately a cortical judgment. Neuroimaging studies (e.g., Blood et al., 1999) show that listening to consonant intervals activates reward and pleasure centers in the brain (such as the orbitofrontal cortex), while dissonant intervals activate areas associated with negative emotion and alertness (like the amygdala and parahippocampal gyrus). The ear provides the friction; the brain provides the feeling.

III. The Mathematics of Harmony: Simple vs. Complex Ratios ​

While roughness explains the mechanism of dissonance, mathematics explains why certain combinations avoid roughness altogether.

Periodic Waveform Alignment ​

Intervals with simple integer frequency ratios are perceived as highly consonant because their waveforms and their harmonics align periodically.

  • 2:1 Ratio (Octave): The higher tone vibrates exactly twice for every one vibration of the lower tone. Every single harmonic of the upper tone perfectly overlaps with a harmonic of the lower tone.
  • 3:2 Ratio (Perfect Fifth): The waveforms align perfectly every two cycles of the lower tone. Their harmonic series interlock like perfectly cut gears, leaving wide gaps between partials that avoid critical band clashes. Because the harmonics of these simple ratios align or separate cleanly, they do not produce beats or roughness. The auditory system processes this predictable, stable pattern with high metabolic efficiency, which we subjectively experience as "consonance." Conversely, complex ratios (e.g., 16:15, a minor second) mean the waveforms take many cycles to realign. Their numerous upper harmonics clash violently, falling within the same critical bands and generating intense sensory roughness.

Crucial Caveat: This "simple ratio = consonance" rule applies strictly to sounds with harmonic spectra (strings, winds, voice). As we will see in the next section, for inharmonic sounds, simple ratios can actually be highly dissonant.

IV. The Sethares Insight: Timbre-Dependent Consonance ​

This is arguably the most important concept bridging the physics of timbre (Unit 3.3) and the mathematics of tuning (Unit 3.5). For centuries, music theorists assumed that consonance was an absolute property of an interval (e.g., "the perfect fifth is consonant"). In his landmark work Tuning, Timbre, Spectrum, Harmony (1998), William Sethares proved mathematically that consonance is not a property of the interval alone, but of the relationship between the interval and the timbre of the instruments playing it.

The Sum of Pairwise Interactions ​

Real musical instruments do not play pure sine tones; they play complex tones consisting of many partials (harmonics or inharmonic overtones). Sethares demonstrated that the total dissonance of a complex interval is simply the sum of the Plomp-Levelt roughness interactions between every possible pair of partials across both tones: $$ D{\text{total}} = \sum \sum_ D(f_i, f_j) $$ where $D$ is the dissonance (roughness) between partial $i$ of the first tone and partial $j$ of the second tone.

The Consequences for Harmonic vs. Inharmonic Spectra ​

  1. Harmonic Spectra (Piano, Violin, Voice): Because the partials are exact integer multiples ($f, 2f, 3f...$), the intervals that minimize pairwise roughness are exactly the simple integer ratios: the octave (2:1), the fifth (3:2), and the major third (5:4). Western music theory is built on this specific timbre.
  2. Inharmonic Spectra (Bells, Gongs, FM Synthesis, Marimbas): If a sound has a stretched or compressed overtone series (e.g., partials at $f, 2.4f, 3.6f$), the octave (2:1) will cause massive critical band clashes between the upper partials. For a typical church bell, the "consonant" interval might be a ratio of 1 : 2.4, and the octave will sound noticeably dissonant!

The Visual Music Translation: Sethares' insight is the Rosetta Stone for audiovisual mapping. If you map a visual texture (e.g., a smooth, periodic sine-wave grating) to an audio timbre, the "consonant" visual transformations will be simple geometric symmetries (octaves/fifths). If you map a complex, aperiodic visual texture (e.g., Perlin noise, fractal geometry) to an audio timbre, the "consonant" visual transformations will be entirely different. Timbre and structure must co-evolve. This explains why Indonesian Gamelan tuning systems (slendro and pelog) are non-Western: they are mathematically optimized for the inharmonic spectra of their bronze metallophones.

V. Sensory Dissonance vs. Musical Dissonance ​

To fully understand harmony, we must separate the biological hardware from the cultural software. Musicologists and cognitive scientists distinguish between two entirely different phenomena that are often conflated under the word "dissonance."

1. Sensory (Psychoacoustic) Dissonance ​

This is the roughness and beating governed by critical bands and the Plomp-Levelt curve. It is a universal, biological, and pre-cognitive reflex. An infant, a person from an isolated indigenous tribe, and a Western classical musician will all experience the exact same physiological "grating" sensation when hearing a cluster of minor seconds played on a trumpet. It is an acoustic fact.

2. Musical (Cognitive/Cultural) Dissonance ​

This is a learned, context-dependent judgment of tension and stability within a specific musical grammar.

  • In Western tonal harmony, a dominant seventh chord is considered "dissonant" because the cultural rules dictate that it must resolve to the tonic.
  • In jazz, the exact same chord is considered a stable, "consonant" resting point.
  • In a horror film score, a smooth, pure major triad might be used in a specific context to create psychological "dissonance" (unease) because it violates the expected dark aesthetic.

The Role of Expectation (David Huron) ​

Cognitive scientist David Huron (Sweet Anticipation, 2006) argues that much of what we call musical dissonance is actually the violation of learned statistical expectations. The brain is a prediction machine. When a listener raised on Western music hears a tritone (the diabolus in musica), the brain predicts a resolution to a third or a sixth. When that resolution is delayed, the brain experiences a prediction error, which manifests as psychological tension. The tension is not just in the acoustic roughness of the tritone; it is in the denial of the expected future.

VI. Cross-Cultural Perspectives and Deliberate Roughness ​

Because sensory roughness is a biological reality, different cultures have developed vastly different aesthetic frameworks for how to treat it.

Deliberate Roughness: Gamelan Ombak ​

In the West, post-Renaissance tuning systems (like 12-TET, explored in Unit 3.5) were designed to minimize beating and roughness to allow for smooth modulation. In Indonesian Gamelan, the exact opposite is true. Paired metallophones are intentionally tuned a few Hertz apart. When played together, they create a slow, shimmering beat frequency known as ombak (meaning "wave"). This acoustic roughness is not an error to be corrected; it is the spiritual lifeblood of the music. The ombak is believed to give the sound a "shimmering" quality that invites the gods to descend. Here, sensory dissonance is elevated to the highest aesthetic and spiritual virtue.

Post-Stimulus Fatigue ​

Dissonance is not just an aesthetic concept; it has a measurable physiological toll. Prolonged exposure to harsh, high-frequency, or highly dissonant sounds (dense orchestral clusters, industrial noise) can cause a Temporary Threshold Shift (TTS). This is a measurable reduction in hearing sensitivity that can last for up to 16 hours as the outer hair cells in the cochlea recover from metabolic exhaustion. This biological "fatigue" explains why prolonged exposure to acoustically harsh environments (or highly dissonant avant-garde music) feels physically and mentally exhausting.

VII. Visual Analogies and Technological Applications ​

The Visual Analogue of Roughness: Moiré and Flicker ​

For the visual music artist, auditory roughness has a perfect physical analogue in optics and visual perception:

  • Temporal Analogue (Flicker): Auditory roughness (amplitude fluctuation at 15–150 Hz) is the exact temporal equivalent of visual flicker. If a light flashes at 5 Hz, you see a pleasant strobe (slow beats). If it flashes at 50 Hz, you experience visual roughness (epileptogenic, grating flicker). If it flashes at 200 Hz, it fuses into continuous light (fusion).
  • Spatial Analogue (Moiré Patterns): When two visual gratings (e.g., window screens or fine lines) of slightly different spatial frequencies or angles are overlaid, they create a Moiré pattern—a visual "beat" frequency. When the spatial difference is too dense for the eye's resolution (the visual critical band), the Moiré pattern breaks down into spatial aliasing or visual noise. Consonance is visual symmetry; sensory dissonance is visual Moiré.

Applications in Technology ​

  1. Audio Data Compression (MP3, AAC): These formats rely entirely on psychoacoustic masking models. By calculating the critical bands, the encoder identifies audio data that is masked by louder sounds and permanently deletes it. File sizes are reduced by up to 90% with minimal perceived loss, because the encoder is literally deleting the "dissonant" data that the ear cannot hear anyway.
  2. Active Noise Cancellation (ANC): Headphones use microphones to detect incoming low-frequency noise and generate an exact anti-phase (inverted) sound wave. This creates destructive interference, physically canceling the sound wave before it reaches the eardrum.
  3. Synthesizer Design: Modern physical modelling and FM synthesizers use Sethares' algorithms to dynamically alter the tuning of microtonal scales in real-time to match the evolving inharmonic spectrum of the synthesised patch, ensuring the instrument always plays "in tune" with its own timbre.

VIII. Summary ​

Key Takeaways ​

  1. Consonance and dissonance exist on a continuous spectrum, governed by the interplay of wave physics, cochlear physiology, and cognitive psychology.
  2. Sensory Roughness is the biological grating sensation caused when two frequencies fall within the same Critical Band, stimulating the same hair cells and causing neural interference. Maximum roughness occurs at ~25% of the critical band width.
  3. Simple integer ratios (2:1, 3:2) allow the harmonic series of two tones to align or separate cleanly, avoiding critical band clashes and resulting in beat-free consonance.
  4. The Sethares Insight: Consonance is not an absolute property of an interval; it is dictated by the timbre of the sound. For inharmonic spectra (bells, gongs), the "consonant" intervals are entirely different from those of harmonic instruments.
  5. Sensory vs. Musical Dissonance: Sensory dissonance is a universal biological reflex (roughness). Musical dissonance is a learned, cognitive judgment based on cultural expectations and the violation of predictive schemas (Huron).

IX. Closing Thoughts ​

Consonance and dissonance are not arbitrary rules invented by dead composers; they are emergent properties of the interaction between physical waves and the biological architecture of the human ear, filtered through the predictive machinery of the brain. By understanding the mathematics of ratios, the physics of interference, and the profound truth that timbre dictates harmony (Sethares), we gain a holistic view of musical tension. We see that the "rules" of Western harmony are merely the local bylaws governing a specific family of harmonic timbres. When we change the timbre, we change the geometry of consonance. In the final unit of this module (3.5), we will explore how human societies, armed with these psychoacoustic realities, developed the magnificent, compromised, and deeply mathematical systems of Tuning and Temperament to force the infinite continuum of frequency onto the finite grid of the keyboard.

X. Suggested Further Reading and Exploration ​

  • William A. Sethares, Tuning, Timbre, Spectrum, Harmony (2nd ed., 2005). The single most important book for understanding how timbre dictates consonance. Sethares provides the mathematical framework and software for generating custom tuning systems for custom timbres.
  • David Huron, Sweet Anticipation: Music and the Psychology of Expectation (2006). A brilliant, readable exploration of how expectation, prediction, and violation create the emotional experience of musical tension and release.
  • R. Plomp & W.J.M. Levelt, "Tonal Consonance and Critical Bandwidth" (Journal of the Acoustical Society of America, 1965). The foundational paper mapping the dissonance curve.
  • Richard Parncutt, Harmony: A Psychoacoustical Approach (1989). Extends the roughness model to full chords and explores the psychoacoustic roots of tonal harmony and chord roots.
  • Experiment (Visual Moiré): Take two identical window screens (or print two pages with fine, identical line grids). Overlay them and slowly rotate one. Watch the visual "beats" (Moiré patterns) slow down, speed up into visual "roughness," and fuse. You are watching the exact spatial equivalent of the Plomp-Levelt dissonance curve.
  • Experiment (Sensory Roughness): Using a sine-wave synthesiser (or a free tone generator app), play 440 Hz and 442 Hz. Listen to the slow 2 Hz beat. Slowly increase the second tone to 455 Hz, then 470 Hz. Map your subjective experience of the transition from "pulsing" to "grating roughness" to "smooth fusion." Then, repeat the experiment using rich sawtooth waves. Notice how the dissonance landscape explodes into complexity because dozens of upper harmonics are now clashing within multiple critical bands simultaneously.