Skip to main content
SpringerLink
Log in

See what I hear? Beat perception in auditory and visual rhythms

  • Research Article
  • Published:
Experimental Brain Research Aims and scope Submit manuscript

Abstract

Our perception of time is affected by the modality in which it is conveyed. Moreover, certain temporal phenomena appear to exist in only one modality. The perception of temporal regularity or structure (e.g., the ‘beat’) in rhythmic patterns is one such phenomenon: visual beat perception is rare. The modality-specificity for beat perception is puzzling, as the durations that comprise rhythmic patterns are much longer than the limits of visual temporal resolution. Moreover, the optimization that beat perception provides for memory of auditory sequences should be equally relevant to visual sequences. Why does beat perception appear to be modality specific? One possibility is that the nature of the visual stimulus plays a role. Previous studies have usually used brief stimuli (e.g., light flashes) to present visual rhythms. In the current study, a rotating line that appeared sequentially in different spatial orientations was used to present a visual rhythm. Discrimination accuracy for visual rhythms and auditory rhythms was compared for different types of rhythms. The rhythms either had a regular temporal structure that previously has been shown to induce beat perception in the auditory modality, or they had an irregular temporal structure without beat-inducing qualities. Overall, the visual rhythms were discriminated more poorly than the auditory rhythms. The beat-based structure, however, increased accuracy for visual as well as auditory rhythms. These results indicate that beat perception can occur in the visual modality and improve performance on a temporal discrimination task, when certain types of stimuli are used.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Averbach E, Coriell E (1961) Short-term memory in vision. Bell Syst Tech J 40:309–328

    Google Scholar 

  • Chen Y, Repp BH, Patel AD (2002) Spectral decomposition of variability in synchronization and continuation tapping: comparisons between auditory and visual pacing and feedback conditions. Hum Movement Sci 21:515–532

    Article  Google Scholar 

  • Collier GL, Logan G (2000) Modality differences in short-term memory for rhythms. Mem Cognition 28:529–538

    Article  CAS  Google Scholar 

  • Collier GL, Wright CE (1995) Temporal rescaling of simple and complex ratios in rhythmic tapping. J Exp Psychol Human 21:602–627

    Article  CAS  Google Scholar 

  • Cowan N (1984) On short and long auditory stores. Psychol Bull 96:341–370

    Article  PubMed  CAS  Google Scholar 

  • Crowder RG (1982) Decay of auditory memory in vowel discrimination. J Exp Psychol Learn Mem Cogn 8:153–162

    Article  PubMed  CAS  Google Scholar 

  • Darwin CJ, Turvey MT, Crowder RG (1972) An auditory analogue of the Sperling partial report procedure: evidence for brief auditory storage. Cognit Psychol 3:255–267

    Article  Google Scholar 

  • Drake C, Penel A, Bigand E (2000) Tapping in time with mechanically and expressively performed music. Music Percept 18:1–24

    Google Scholar 

  • Eriksen CW, Collins JF (1967) Some temporal characteristics of visual pattern perception. J Exp Psychol 74:476–484

    Article  PubMed  CAS  Google Scholar 

  • Essens PJ (1995) Structuring temporal sequences: comparison of models and factors of complexity. Percept Psychophys 57:519–532

    Article  PubMed  CAS  Google Scholar 

  • Essens PJ, Povel DJ (1985) Metrical and nonmetrical representations of temporal patterns. Percept Psychophys 37:1–7

    Article  PubMed  CAS  Google Scholar 

  • Ferrandez AM, Hugueville L, Lehéricy S et al (2003) Basal ganglia and supplementary motor area subtend duration perception: an fMRI study. NeuroImage 19:1532–1544

    Article  PubMed  CAS  Google Scholar 

  • Gault RH, Goodfellow LD (1938) An empirical comparison of audition, vision, and touch in the discrimination of temporal patterns and ability to reproduce them. J Gen Psychol 18:41–47

    Article  Google Scholar 

  • Glenberg AM, Jona M (1991) Temporal coding in rhythm tasks revealed by modality effects. Mem Cogn 19:514–522

    Article  CAS  Google Scholar 

  • Glenberg AM, Mann S, Altman L, Forman T (1989) Modality effects in the coding and reproduction of rhythms. Mem Cogn 17:373–383

    Article  CAS  Google Scholar 

  • Goldstone S, Lhamon WT (1972) Auditory-visual differences in human temporal judgment. Percept Motor Skills 34:623–633

    Article  PubMed  CAS  Google Scholar 

  • Grahn JA (2009) The role of the basal ganglia in beat perception: neuroimaging and neuropsychological investigations. Ann NY Acad Sci 1169:35–45

    Article  PubMed  Google Scholar 

  • Grahn JA, Brett M (2007) Rhythm perception in motor areas of the brain. J Cogn Neurosci 19:893–906

    Article  PubMed  Google Scholar 

  • Grahn JA, Brett M (2009) Impairment of beat-based rhythm discrimination in Parkinson’s disease. Cortex 45:54–61

    Article  PubMed  Google Scholar 

  • Grahn JA, Henry MJ, McAuley JD (2011) FMRI investigation of cross-modal interactions in beat perception: audition primes vision, but not vice versa. NeuroImage 54:1231–1243

    Article  PubMed  Google Scholar 

  • Grondin S (1993) Duration discrimination of empty and filled intervals marked by auditory and visual signals. Percept Psychophys 54:383–394

    Article  PubMed  CAS  Google Scholar 

  • Grondin S, Meilleur-Wells G, Ouellette C, Macar F (1999) Sensory effects on judgements of short time-intervals. Psychol Res 61:261–268

    Article  Google Scholar 

  • Guttman SE, Gilroy LA, Blake R (2005) Hearing what the eyes see: auditory encoding of visual temporal sequences. Psychol Sci 16:228–265

    Article  PubMed  Google Scholar 

  • Handel S, Buffardi L (1969) Using several modalities to perceive one temporal pattern. Q J Exp Psychol 21:37–41

    Google Scholar 

  • Holcombe AO (2009) Seeing slow and seeing fast: two limits on perception. Trends Cogn Sci 13:216–221

    Article  PubMed  Google Scholar 

  • Hove MJ, Spivey MJ, Krumhansl CL (2010) Compatibility of motion facilitates visuomotor synchronization. J Exp Psychol Human 36:1525–1534

    Article  Google Scholar 

  • Jäncke L, Loose R, Lutz K, Specht K, Shah NJ (2000) Cortical activations during paced finger-tapping applying visual and auditory pacing stimuli. Cog Brain Res 10:51–66

    Article  Google Scholar 

  • Jantzen KJ, Steinberg FL, Kelso JAS (2005) Functional MRI reveals the existence of modality and coordination-dependent timing networks. NeuroImage 25:1031–1042

    Article  PubMed  CAS  Google Scholar 

  • Large EW, Palmer C (2002) Perceiving temporal regularity in music. Cogn Sci 26:1–37

    Article  Google Scholar 

  • McAuley JD, Henry MJ (2010) Modality effects in rhythm processing: auditory encoding of visual rhythms is neither obligatory nor automatic. Atten Percept Psycho 72:1377–1389

    Article  Google Scholar 

  • Nettl B (2000) An ethnomusicologist contemplates universals in musical sound and musical culture. In: Wallin NL, Merker BH, Brown S (eds) The origins of music. MIT Press, Cambridge, MA, pp 463–472

    Google Scholar 

  • Parncutt R (1994) A perceptual model of pulse salience and metrical accent in musical rhythms. Music Percept 11:409–464

    Google Scholar 

  • Patel AD, Iversen JR, Chen Y, Repp BH (2005) The influence of metricality and modality on synchronization with a beat. Exp Brain Res 163:226–238

    Article  PubMed  Google Scholar 

  • Povel DJ, Essens PJ (1985) Perception of temporal patterns. Music Percept 2:411–440

    Google Scholar 

  • Povel DJ, Okkerman H (1981) Accents in equitone sequences. Percept Psychophys 30:565–572

    Article  PubMed  CAS  Google Scholar 

  • Repp BH, Penel A (2002) Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. J Exp Psychol Human 28:1085

    Article  Google Scholar 

  • Sakitt B (1976) Iconic memory. Psychol Rev 83:257–276

    Article  PubMed  CAS  Google Scholar 

  • Schubotz RI, Friederici AD, von Cramon DY (2000) Time perception and motor timing: a common cortical and subcortical basis revealed by fMRI. NeuroImage 11:1–12

    Article  PubMed  CAS  Google Scholar 

  • Schutz M, Kubovy MJ (2009) Causality and cross-modal integration. J Exp Psychol Hum Percept Perform 35:1791–1810

    Article  PubMed  Google Scholar 

  • Semjen A, Ivry RB (2001) The coupled oscillator model of between-hand coordination in alternate-hand tapping: a reappraisal. J Exp Psychol Human 27:251–265

    Article  CAS  Google Scholar 

  • Shih LYL, Kuo W-J, Yeh T-C et al (2009) Common neural mechanisms for explicit timing in the sub-second range. NeuroReport 20:897–901

    Article  PubMed  Google Scholar 

  • Sperling G (1960) The information available in brief visual presentation. Psychol Monogr 74:1–29

    Article  Google Scholar 

  • Stauffer CC, Haldemann J, Troche SJ, Rammsayer TH (2012) Auditory and visual temporal sensitivity: evidence for a hierarchical structure of modality-specific and modality-independent levels of temporal information processing. Psychol Res 76:20–31

    Article  PubMed  Google Scholar 

  • van Noorden L, Moelants D (1999) Resonance in the perception of musical pulse. J New Music Res 28:43–66

    Article  Google Scholar 

  • Wiener M, Turkeltaub P, Coslett HB (2010) The image of time: a voxel-wise meta-analysis. NeuroImage 49:1728–1740

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Brain and Mind Institute, University of Western Ontario, London, ON, N6A 5B7, Canada

    Jessica A. Grahn

Authors
  1. Jessica A. Grahn
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jessica A. Grahn.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Grahn, J.A. See what I hear? Beat perception in auditory and visual rhythms. Exp Brain Res 220, 51–61 (2012). https://doi.org/10.1007/s00221-012-3114-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00221-012-3114-8

Keywords

Search

Navigation