Implicit variations of temporal predictability: Shaping the neural oscillatory and behavioural response
Introduction
The input to our senses has temporal structure. This structure can be a rhythm like in speech or music or an informative duration as when thunder followings lightening. Extracting this temporal structure can help predict the temporal occurrence of new input and prepare a response. Previous research has shown that the processing of sensory stimuli can be facilitated by temporal predictability, resulting in faster response times (Bueti et al., 2010, Cravo et al., 2011, Janssen and Shadlen, 2005, Rohenkohl et al., 2011, Rohenkohl and Nobre, 2011, Stefanics et al., 2010, Tomassini et al., 2016), as well as enhanced detection or discrimination performance (Cravo et al., 2013, Herrmann et al., 2016, Rohenkohl et al., 2012, Wilsch et al., 2014, , 2004).
A common way to induce temporal predictability is by manipulating the time interval between cue and target in a trial-based design, i.e. the foreperiod. Notably, most previous studies used either two discrete foreperiods (e.g. Cravo et al., 2011; but see Tomassini et al., 2016), or participants were made aware of the temporal contingencies by explicit temporal cues (e.g. Stefanics et al., 2010). Thus an overriding aim of the two studies presented here was to test whether temporal predictive processing occurs also in a more naturalistic paradigm, that uses probabilistic distributions of foreperiods, introduced implicitly. There were no temporally informative cues and participants were not informed of the manipulation or relevance of timing. While temporal predictability can of course be studied in any modality, we here chose an auditory pitch discrimination task and measured response times and electroencephalographic (EEG) activity to assess the behavioural and neural mechanisms of temporally predictive processing.
What are feasible hypotheses on a neural level when listeners are faced only with such probabilistic, highly implicit temporal predictability? Given the short time scale on which temporal predictions most often occur (in the range of hundreds of milliseconds to few seconds), M/EEG studies are most suited to observe underlying mechanisms. Accordingly, various correlates of temporally predictive processing have been revealed. In the time-domain, the best established neural correlate of temporal processing is the contingent negative variation, a slow negative potential that builds up over frontal brain areas during duration estimation (CNV; Herbst et al., 2014; Macar et al., 1999; Walter et al., 1964). Although studies have reported effects of temporal predictability on the CNV (Macar and Vidal, 2004, Praamstra and Pope, 2007), it is unclear whether such effects depend on the involvement of explicit timing processes or wheter they could be found in an implicit timing paradigm. Furthermore, temporal predictability affected N1 and P3 components of the event-releated potential in auditory studies (Lange, 2013, Volosin et al., 2016).
In the time-frequency domain, no unique neural substrate has been identified: as recently reviewed by Wiener and Kanai (2016), all established frequency bands of the human EEG (delta, theta, alpha, beta, gamma) have been found to carry information about temporal predictions. On the one hand, the variety of relevant frequency bands might be explained by different stimulation frequencies used in previous studies (either by deliberately presenting rhythmic stimuli, or by inducing a dominant rhythm through the stimulus and inter-stimulus intervals in trial-based studies). On the other hand, the frequencies at which effects are found likely depend on the sensory modality studied, as well as the task used (e.g. response time tasks, detection tasks, discrimination tasks).
Consensus is arising, however, that slow oscillations convey temporally predictive information, both in the delta (0.1–4 Hz) and theta (4–8 Hz) band (Cravo et al., 2013, Herbst and Landau, 2016, Herrmann et al., 2015, Herrmann et al., 2016, Parker et al., 2014, Stefanics et al., 2010, Wilsch et al., 2015). A putative mechanism governing temporally predictive processing might be the entrainment of these slow frequencies to the temporal structure of the stimulation, such that if the stimulus occurs at the predicted time point the system is in a particular, beneficial state (Schroeder and Lakatos, 2009). Previous evidence would thus predict that neural delta phase should become optimally aligned to occurrence of a relevant target event if participants can predict its onset. This should surface as enhanced delta phase coherence over trials in predictive compared to non-predictive blocks, potentially also for the highly implicit and probabilistic distribution of foreperiods employed here.
Complementary to neural phase alignment of slow oscillations, phasic changes in the power of alpha (8–12 Hz) and beta (15–30 Hz) oscillations reflect temporal predictions. Changes in alpha power have generally been subscribed to orienting of attention, mostly in space (Hanslmayr et al., 2007, Klimesch et al., 2007, Strauß et al., 2014, Wöstmann et al., 2016). Recent studies from the visual domain have shown that attention can also be oriented in time, i.e. to a cued time point, and that this orienting of attention is reflected by reduced alpha power over visual areas (Praamstra and Pope, 2007, Rohenkohl et al., 2012, Rohenkohl and Nobre, 2011). To our knowledge, no study so far has provided a direct link between alpha power and orienting of temporal attention in an auditory task. Changes in beta power have been related to temporal preparation directly, especially in the auditory domain, e.g. by the observation of higher beta power prior to a temporally predictable stimulus (Arnal, 2012, Kononowicz and Rijn, 2015, Todorovic et al., 2015). In sum, we were expecting to find differences in alpha and/or beta power during high (versus low) temporal predictability.
To study the behavioural and neural mechanisms of temporally predictive processing in a strictly implicit, probabilistic setting, we performed two independent experiments using an auditory foreperiod paradigm. Participants were instructed to perform a simple pitch discrimination task, while we implicitly introduced temporal regularities by varying foreperiods – the time interval between a cue and the target tone – between blocks. Foreperiods were drawn from three different probability distributions: a uniform distribution (non-predictive), and two Gaussian distributions with varying standard deviation (weakly and strongly predictive, respectively). The smaller the standard deviation of the probability distribution, the more predictable the foreperiod duration in that condition.
In Experiment I, we presented three blocks in fixed order, to maximize potential condition differences: Non-predictive, strongly predictive, and again non-predictive foreperiods. In Experiment II we chose a more fine-grained approach and employed non-predictive, weakly predictive, and strongly predictive blocks in random order to study how flexibly temporal regularities can be utilized.
We compared EEG activity prior to target onset for intervals with high versus low temporal predictability. Differences in response times across foreperiods and between conditions indicate that temporal predictability was utilized to perform the task. Several signatures of the neural data confirm the utilization of temporal predictability: we found condition differences in the cue- and target-evoked event related potentials, in delta ITC during the foreperiod (albeit in the opposite direction as predicted), and in alpha power prior to the target event (only in Experiment II).
Section snippets
Participants
A total of 46 healthy participants took part in the two studies: N =22 in Experiment I (mean age 26 years ±SD 2.9; 14 female, three left-handed, one both-handed), and N =24 in Experiment II (mean age 23.9±SD 2.2 years; 11 female, all right-handed). All participants reported normal hearing and no history of neurological disorders and were naïve with respect to the experimental manipulations. Participants gave informed consent and received payment for the experimental time (7 € per hour). The
Response time effects indicate utilization of implicit temporal predictability
As a result of the step-wise model comparison procedure, response times (RT) in Experiment I were best fitted by a linear mixed effect model with a quadratic foreperiod effect, a factor condition, and an interaction between foreperiod and condition (R2 =0.27). According to this model, there was a significant main effect of foreperiod (F(1, 8825) =7.14; p<0.001), no main effect of condition (F(1, 8825) =1.42; p=0.24), but an interaction between both factors (F(1, 8825) =3.20; p<0.05). As shown
Discussion
In two independent EEG experiments, we studied the neural and behavioural signatures of temporally predictive processing in a probabilistic and completely implicit foreperiod paradigm. Foreperiods (i.e. the interval between a cue and a tone) in an auditory pitch discrimination task were manipulated to yield different levels of temporal predictability. In Experiment I, we presented blocks with non-predictive, predictive, and again none-predictive foreperiods in fixed order. In Experiment II, we
Conclusions
Humans utilise temporal predictability even if it occurs strictly implicitly. The response time effects show that timing mechanisms are automatically engaged even if not explicitly necessitated by the task. Participants do extract probabilistic differences in the underlying temporal structure nevertheless. Neural signatures of temporally predictive processing occurred, firstly, at cue-related P2 evoked responses, which differed between predictive and non-predictive blocks. Secondly, contrary to
Acknowledgments
Research was supported by a Max Planck Research Group grant to JO, and a DFG grant (HE 7520/1-1) to SKH. The authors are grateful to Sung-Joo Lim, Lorenz Fiedler, and Malte Wöstmann for helpful discussions and to Steven Kalinke and Maria Goedicke for help with data acquisition.
References (68)
- et al.
Cortical oscillations and sensory predictions
Trends Cogn. Sci.
(2012) - et al.
Sub-second “temporal attention” modulates alpha rhythms. A high-resolution EEG study
Cogn. Brain Res.
(2004) - et al.
Paradox lost? Exploring the role of alpha oscillations during externally vs. internally directed attention and the implications for idling and inhibition hypotheses
Int. J. Psychophysiol.
(2003) - et al.
Differential roles for parietal and frontal cortices in fixed versus evolving temporal expectations: dissociating prior from posterior temporal probabilities with fMRI
NeuroImage
(2016) - et al.
A review of the evidence for P2 being an independent component process: age, sleep and modality
Clin. Neurophysiol.
(2004) - et al.
Revisiting the oddball paradigm. Non-target vs neutral stimuli and the evaluation of ERP attentional effects
Neuropsychologia
(1992) - et al.
Prestimulus oscillations predict visual perception performance between and within subjects
NeuroImage
(2007) - et al.
Rhythms for cognition: the case of temporal processing
Curr. Opin. Behav. Sci.
(2016) - et al.
Temporal expectations and neural amplitude fluctuations in auditory cortex interactively influence perception
NeuroImage
(2016) EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis
Brain Res. Rev.
(1999)
EEG alpha oscillations: the inhibition–timing hypothesis
Brain Res. Rev.
Single trial beta oscillations index time estimation
Neuropsychologia
Prestimulus EEG alpha activity reflects temporal expectancy
Neurosci. Lett.
Non-aging fore-periods and simple reaction time
Acta Psychol.
An ERP index of task relevance evaluation of visual stimuli
Brain Cogn.
Measuring personality in one minute or less: a 10-item short version of the Big Five Inventory in English and German
J. Res. Personal.
EEG activity during cognitive processing: influence of attentional factors
Int. J. Psychophysiol.
Low-frequency neuronal oscillations as instruments of sensory selection
Trends Neurosci.
Exploiting temporal predictability: event-related potential correlates of task-supportive temporal cue processing in auditory distraction
Brain Res.
Synchronisation signatures in the listening brain: a perspective from non-invasive neuroelectrophysiology
Hear. Res.
Digital filter design for electrophysiological data – a practical approach
J. Neurosci. Methods
Frequency tuning for temporal perception and prediction
Curr. Opin. Behav. Sci.
Predicting “When” Using the Motor System's Beta-Band Oscillations
Front. Human. Neurosci.
Fitting Linear Mixed-Effects Models Using lme4
J. Stat. Softw.
The Psychophysics Toolbox
Spat. Vision.
Encoding of Temporal Probabilities in the Human Brain
J. Neurosci.
Investigating evoked and induced electroencephalogram activity in task-related alpha power increases during an internally directed attention task
NeuroReport
Endogenous modulation of low frequency oscillations by temporal expectations
J. Neurophysiol.
Temporal Expectation Enhances Contrast Sensitivity by Phase Entrainment of Low-Frequency Oscillations in Visual Cortex
J. Neurosci.
Entrained neural oscillations in multiple frequency bands comodulate behavior
Proc. Natl. Acad. Sci.
Flicker-induced time dilation Does not modulate EEG correlates of temporal encoding
Brain Topogr.
Temporal Expectations and Neural Amplitude Fluctuations in Auditory Cortex Interactively Influence Perception
. NeuroImage.
Simultaneous Inference in General Parametric Models
Biom. J.
A representation of the hazard rate of elapsed time in macaque area LIP
Nat. Neurosci.
Cited by (20)
Endogenous modulation of delta phase by expectation–A replication of Stefanics et al., 2010
2022, CortexCitation Excerpt :A different set of studies have tested whether delta oscillations implement endogenous temporal predictions, independently from periodic input structures. These studies used foreperiod paradigms (Niemi & Näätänen, 1981; Woodrow, 1914) in which temporal predictions are conveyed by single time intervals and need to be initiated on each trial (Breska & Deouell, 2017; Cravo et al., 2011; Herbst & Obleser, 2017, 2018; Wilsch et al., 2015). Only very few studies reported enhanced delta phase consistency in a non-rhythmic context (Breska & Deouell, 2017, Daume et al., 2021; but see Obleser et al., 2017) and for temporal predictions evoked by the passage of time (Wilsch et al., 2015) using auditory stimuli, and one study reported enhanced phase consistency for temporally predicted visual stimuli in theta band (4–7 Hz, Cravo et al., 2011).
About time: Ageing influences neural markers of temporal predictability
2021, Biological PsychologyCitation Excerpt :This could also be interpreted as support for less efficient sensory gating in the elderly for isochronous sequences. Previously, similar findings were observed when investigating pitch discrimination with different foreperiods, thus manipulating temporal predictability (Herbst & Obleser, 2017). Secondly, effects related to formal structure (i.e., standard versus deviant tones) per age group were more complex than for temporal structure in the P50 and N100 components.
Implicit temporal predictability enhances pitch discrimination sensitivity and biases the phase of delta oscillations in auditory cortex
2019, NeuroImageCitation Excerpt :Furthermore, previous studies have shown that entrainment is subject to top-down modulation, as phase coherence of slow oscillations in anticipation of temporally predictive input scales with the strength of temporal predictions (Cravo et al., 2013; Breska and Deouell, 2017; Stefanics et al., 2010). As a means to experimentally separate endogenous delta oscillations from exogenous stimulus rhythms and the resulting entrainment of neural oscillations, studies have started to test whether the phase of an ongoing oscillation can be aligned in a top-down manner to an expected point in time, without an entraining stimulus structure (Cravo et al., 2011; Herbst and Obleser, 2017; Solís-Vivanco et al., 2018). To our knowledge, only one study in the visual domain reported an effect of increased phase coherence in single-interval temporal predictions (Cravo et al., 2011, theta band).
Rhythmicity facilitates pitch discrimination: Differential roles of low and high frequency neural oscillations
2019, NeuroImageCitation Excerpt :Indeed, we have hypothesized that children with developmental coordination disorder will show reduced beta and delta-beta entrainment (Trainor et al., 2018), and others have proposed that interpersonal auditory-motor synchronization (e.g., joint music performance) may involve beta coupling between brains (Novembre et al., 2017). It is important to note that our Rhythmic condition used the same repetitive isochronous intervals while the Arrhythmic condition used random intervals, and thus the perceptual facilitation effect could be caused by either rhythmicity or by memorizing the predictable fixed single interval or both (Breska and Deouell, 2017; Herbst and Obleser, 2017). Neurally, it has been shown that a predictable fixed single interval without rhythmicity can increase low-frequency phase clustering, so this index might reflect non-oscillatory neural ramping activity (e.g., contingent negative variation) rather than neural oscillation (Breska and Deouell, 2017, but see Obleser et al., 2017).
Neural tracking of continuous acoustics: properties, speech-specificity and open questions
2024, European Journal of NeuroscienceWhat is a Rhythm for the Brain? The Impact of Contextual Temporal Variability on Auditory Perception
2024, Journal of Cognition