Research reportSimultaneously active pre-attentive representations of local and global rules for sound sequences in the human brain
Introduction
In everyday life, sounds are usually encountered within sequences of inter-related auditory events. Therefore, the sequential organization of sensory information is a key element of auditory perception. Organization is achieved through the formation of ‘links between parts of the sensory data’ (Bregman, 1990, p. 47 [4]), which gives rise to the segmentation of the auditory environment. The processes associating sounds according to various auditory organization principles could take place at different stages of information processing. Bregman’s [4] theory of auditory stream segregation assumes that several of the possible ways of linking sounds together are examined in parallel during the early, possibly pre-attentive phases of auditory information processing. We tested the hypothesis that both the local and global types of links are formed during the pre-attentive stages of auditory processing.
Regular sequences of sounds (i.e., non-random) can usually be characterized by more than one rule. One may classify these rules on the basis of their temporal scope. Local rules describe relations between temporally adjacent stimuli, global rules describe relations between temporally non-adjacent stimuli [4]. Simple sound sequences can be described in terms of both local and global rules. For example, the local rule for a sequence of two alternating tones (‘…ABABAB…’) would say that A is always followed by B and B is always followed by A. One possible global rule describing the same sequence would maintain that every second tone is A while every other is B.
Another categorization of rules can be made on the basis of whether a rule is concrete (i.e., enables extrapolating from a specific sound to another specific sound) or abstract (i.e., enables extrapolating from one class of sounds to another class of sounds; abstract rules define relationships between sets of sounds). In the above example of the two alternating tones, both rules are concrete as they apply to the two specific tones of the alternating sequence. An abstract rule describing (frequency) alternation, in general, would state that the two neighbors of a sound in the sequence have either both higher or both lower pitch than the sound itself.
Finally, a distinction which is relevant for theories of auditory information processing: a rule may apply to stimuli as integrated events (‘event-rules’) or only to certain sound features (‘feature-rules’). Local and global, concrete and abstract rules may apply either to integrated sound events or to levels of some sound feature(s). Our first pair of examples were event-rules; the abstract rule example was a feature rule. A global concrete feature rule, which also applies to simple alternation, is that the time from the onset of a tone to the onset of the next identical tone is constant at a given stimulus onset asynchrony (SOA) value.
The systematic formation of associations between sounds in regular sequences can be regarded as a neural representation of a rule. The question of what kind of rules are represented for a given sound sequence in the absence of focused attention by the human auditory system can be studied using an event-related brain potential (ERP) component termed the mismatch negativity (MMN) [14] (for recent reviews, see Refs. [28], [16]). MMN is elicited by sounds that violate some regularity of the preceding auditory stimulus sequence, whether or not the subject’s attention is focused on the auditory modality [13]. It has been established that the discriminative MMN-generating process involves an auditory sensory memory representation of the preceding regular sounds [12], [21], [16]. Winkler et al. [36] suggested that MMN elicitation results from the incoming sound mismatching the one(s) extrapolated from the preceding auditory stimulus sequence. Therefore, if a sound elicits the MMN, one can infer that some regularity in the preceding sound sequence was pre-attentively detected (this regularity being violated by the MMN-eliciting auditory stimulus). Thus MMN enables one to determine what rules are pre-attentively represented by the auditory system for a given sound sequence. The regularities which have been shown to be detected during the pre-attentive phase of auditory information processing range from simple repetition rules (e.g., Ref. [14]) to sensory trends [33] and regularities of complex sequential or spectro-temporal sound patterns (e.g., Refs. [18], [25]). MMNs elicited by violations of concrete as well as abstract rules (e.g., Refs. [14] and [23], respectively), event as well as feature rules (e.g., Refs. [37] and [8], respectively) have already been observed. However, no previous study has made a direct test of whether global rules can be represented nor did they distinguish between repeating patterns and the global structure of non-adjacent tones.
Section snippets
Experiments
The aim of the present study was to investigate whether (a) global rules can be pre-attentively extracted and (b) different kinds of rules (such as global and local, concrete and abstract) can be simultaneously represented by the pre-attentive auditory information processing system. The main test sequence (Experiment 1) was a simple alternation of two tones (see Fig. 1). As was described above, such a sequence can be characterized by several different rules, amongst them both local and global
General discussion
The aim of the present study was to determine (a) whether global rules (i.e., relations between temporally non-adjacent stimuli) can be represented pre-attentively and (b) whether different types of rules describing the same sound sequence are maintained simultaneously in the absence of focused attention.
The present results showed that global-rule representations of auditory stimulus sequences could be formed pre-attentively. This suggests that the auditory system is able to associate
Acknowledgements
This research was supported by the Hungarian National Research Fund (OTKA T022800) and the National Institutes of Health Grant (R55 DC04263).
References (40)
- et al.
Scalp distributions of event-related potentials: An ambiguity associated with analysis of variance models
Elecroencephalogr. Clin. Neurophysiol.
(1985) - et al.
Early selective attention effect on evoked potential reinterpreted
Acta Psychol.
(1978) - et al.
Storage of information in transient auditory memory
Cogn. Brain Res.
(1996) - et al.
Event-related potentials to repetition and change of auditory stimuli
Elecroencephalogr. Clin. Neurophysiol.
(1992) - et al.
Sequential effects in the ERP in discriminating two stimuli
Biol. Psychol.
(1983) - et al.
Temporal integration of auditory stimulus deviance as reflected by the mismatch negativity
Neurosci. Lett.
(1999) - et al.
Independent processing of changes in auditory single features and feature conjunctions in humans as indexed by the mismatch negativity
Neurosci. Lett.
(1999) - et al.
Activation of the pre-attentive change detection system by tone repetitions with fast stimulation rate
Cogn. Brian Res.
(2001) - et al.
Brain indices of automatic pattern processing
NeuroReport
(1994) - et al.
Separate memory-related processing for auditory frequency and patterns
Psychophysiology
(1999)
Event-related brain activity associated with auditory pattern processing
NeuroReport
Auditory Scene Analysis
Memory prerequisites of mismatch negativity in the auditory event related potentials (ERP)
J. Exp. Psychol. Learn. Mem. Cogn.
Automatic change detection: douse the auditory system use representations of individual stimulus features or gestalts?
Psychophysiology
Event-related potentials (ERPs) to interruptions of a steady rhythm
Psychophysiology
Storage of feature conjunctions in transient auditory memory
Psychophysiology
Responses of the human auditory cortex to changes in one vs. two stimulus features
Exp. Brain Res.
Selective attention and stimulus processing: Reflections in event related potentials, magnetoencephalogram and regional cerebral blood flow
The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive functions
Behav. Brain Sci.
Attention and Brain Function
Cited by (111)
The posterior auditory field is the chief generator of prediction error signals in the auditory cortex
2021, NeuroImageCitation Excerpt :The computed indices of prediction error and repetition suppression with both controls were also not statistically different in agreement with our previous findings categorizing the AC in lemniscal and non-lemniscal fields in anesthetized and awake rodents (Parras et al., 2017). Lower hierarchical regions in the auditory brain, such as the inferior colliculus and the auditory thalamus (Parras et al., 2020, 2017), and even higher hierarchical regions, like the medial prefrontal cortex, process both sequences equally (Casado-Román et al., 2020), being consistent with the human literature (Horváth et al., 2001; Mittag et al., 2016; Wiens et al., 2019). Both controls are processed as a regular succession of frequency alternations, which probably generate an alternation expectation, without discerning whether those alternations are random or regularly ascending or descending.
Involuntary sensory enhancement of gain- and loss-associated tones: A general relevance principle
2019, International Journal of Psychophysiology