Article Figures & Data
Figures
- Figure 1.
Grand average of difference ERPs (deviant-standard) plotted across 21 subjects for conditions (A) audio-only, (B) visual-only, (C) audiovisual, (D) cross-audio, and (E) cross-visual conditions. Stimulus onset is at 0 ms and the activity before that [−200 to 0 ms] corresponds to the prestimulus baseline. The topoplots indicate the distribution of the respective MMN and P300 peaks in the sensor space. The topoplot on the top-left displays the color code assigned to respective scalp channel locations used for plotting the ERPs in A–E. For a curious reader, ERP from each condition, deviant, and standard are plotted at midline sensors in Extended Data Figure 1-1, along with SNR calculations in Extended Data Table 1-2.
- Figure 2.
A, The topoplots correspond to the first four principal components (left to right) of the common spatial filter (Extended Data Figure 2-1) computed through PCA on the difference waveform of deviant minus standard trials together from all conditions. The λ values represent the fraction of variance explained by each principal component. The heatmaps on the left depict the time course of difference waveforms of individual participants after projection of the common spatial filter on the standard and deviant data of (B) audio-only, (C) visual-only, (D) audiovisual, (E) cross-audio, and (F) cross-visual conditions. On the right are the grand-averaged plots of the standard (blue), deviant (magenta), and difference (black) waveforms along with their shaded SEMs for (G) audio-only, (H) visual-only, (I) audiovisual, (J) cross-audio, and (K) cross-visual conditions.
- Figure 3.
The violin plots represent the (A) MMN peak latencies corresponding to the (C) MMN peak amplitudes (maximum magnitude of the difference waveforms on the negative y-axis) of each participant. Similarly, the (B) P300 peak latencies corresponding to the (D) P300s peak amplitudes are plotted for each participant. The colored dots represent each participant's peak amplitude and peak latency values in µV and ms, respectively. The white dot at the center of the gray box in each violin represents the median of the data, and the gray box itself represents the inter-quartile range. The horizontal lines represent a significant difference (p < 0.05) between any two conditions obtained through Bonferroni-corrected post hoc analysis.
- Figure 4.
eLORETA source localization results using time-locked analysis (99th percentile and above) representing the underlying (A) MMN and (B) P300 sources for audio, visual, audiovisual, cross-audio, and cross-visual modalities.
Tables
- Table 1.
The table lists the standard and the deviant stimuli used in our oddball paradigm for all the five sensory modality conditions
Condition Standard/frequent/repetitive Deviant/oddball/infrequent/nonrepetitive Unimodal audio (A) 261.6 Hz 523.3 Hz Unimodal visual (V) Blue square Red triangle Bimodal audiovisual (AV) 261.6 Hz and blue square 523.3 Hz and red triangle Cross-modal (audio deviant CrA) Blue square 523.3 Hz Cross-modal (visual deviant CrV) 261.6 Hz Red triangle Extended Data Table 1-1 has details on the accuracy of participants.
- Table 2.
Table shows the mean ± SD of the peak MMN amplitudes and their corresponding latencies across all the subjects for audio-only, visual-only, audiovisual (AV), cross-audio (CrA), and cross-visual (CrV) conditions
MMN Latency (ms) Amplitude (μV) Audio 180.81 ± 22.72 −10.91 ± 3.33 Visual 187.76 ± 31.38 −8.74 ± 3.06 AV 154.28 ± 28.88 −11.18 ± 3.19 CrA 142.90 ± 22.92 −11.37 ± 3.24 CrV 171.81 ± 15.19 −10.11 ± 3.49 - Table 3.
The table shows the mean ± SD of the peak P300 amplitudes and their corresponding latencies across all the subjects for audio-only, visual-only, audiovisual (AV), cross-audio (CrA), and cross-visual (CrV) conditions
P300 Latency (ms) Amplitude (μV) Audio 337.34 ± 24.45 12.13 ± 4.61 Visual 390.62 ± 24.53 10.87 ± 3.34 AV 330.38 ± 25.76 13.29 ± 3.87 CrA 328.81 ± 23.61 12.59 ± 4.12 CrV 312.24 ± 29.92 9.23 ± 3.50 - Table 4.
The table lists the brain areas underlying the peak MMN and P300 activations across the audio-only, visual-only, and audiovisual conditions
Condition MMN P300 Audio-only SFG, left superior frontal gyrus
PrG, left precentral gyrus
PrG, right precentral gyrus
PCL, left paracentral lobule
STG, right superior temporal gyrus
MTG, right middle temporal gyrus
aSTS, anterior superior temporal sulcus
SPL, right superior parietal lobule
SFG, right superior frontal gyrus
SFG, left superior frontal gyrus
MFG, right middle frontal gyrus
Visual only SFG, left superior frontal gyrus
pSTS, right posterior superior temporal sulcus
IPL, right inferior parietal lobule
SFG, right superior frontal gyrus
SFG, left superior frontal gyrus
Audiovisual MFG, left middle frontal gyrus
MTG, right middle temporal gyrus
Left fusiform gyrus
Left parahippocampal gyrus
pSTS, right posterior superior temporal sulcus
IPL, right inferior parietal lobule
MVOcC, left medioventral occipital cortex
LOcC, left lateral occipital cortex
SFG, right superior frontal gyrus
SFG, left superior frontal gyrus
MFG, right middle frontal gyrus
MFG, left middle frontal gyrus
Left cingulate gyrus
Cross-audio SFG, left superior frontal gyrus
MFG, left middle frontal gyrus
STG, right superior temporal gyrus
MTG, right middle temporal gyrus
IPL, right inferior parietal lobule
SFG, right superior frontal gyrus
SFG, left superior frontal gyrus
MFG, right middle frontal gyrus
Cross-visual SFG, right superior frontal gyrus
SFG, left superior frontal gyrus
MFG, left middle frontal gyrus
MFG, right middle frontal gyrus
SFG, right superior frontal gyrus
SFG, left superior frontal gyrus
Table 1-1
Counting accuracy of participants in different task conditions. Download Table 1-1, DOCX file.
Figure 1-1
Group averaged ERP plots of all conditions across midline channels – FPz, Fz, FCz, Cz, CPz, Pz, POz, Oz. Red-yellow hue represents averaged oddball trials along anterior to posterior axis and purple-cyan hue displays standard trials correspondingly. Download Figure 1-1, TIF file.
Table 1-2
The following table lists the signal-to-noise ratio (%) for each participant across all conditions. Please note the SNR was first computed for every channel and then averaged for each participant. Download Table 1-2, DOCX file.
Figure 2-1
A) Common-spatial filter projected on the difference of oddball-standard data (averaged across all participants) for different conditions. B) Condition-specific filter projected on the difference of oddball-standard data (averaged across all participants) for different conditions. Download Figure 2-1, TIF file.
In this issue
