Abstract
The ability to capture the most relevant information from everyday experiences without constantly learning unimportant details is vital to survival and mental health. While decreased activity of the medial prefrontal cortex (mPFC) is associated with failed or inflexible encoding of relevant events in the hippocampus, mechanisms used by the mPFC to discern behavioral relevance of events are not clear. To address this question, we chemogenetically activated excitatory neurons in the mPFC of male rats and examined its impact on local network activity and differential associative learning dependent on the hippocampus. Rats were exposed to two neutral stimuli in two environments whose contingency with an aversive stimulus changed systematically across days. Over 2 weeks of differential and reversal learning, theta band activity began to ramp up toward the expected onset of the aversive stimulus, and this ramping activity tracked the subsequent shift of the set (stimulus modality to environment) predictive of the aversive stimulus. With chemogenetic mPFC activation, the ramping activity emerged within a few sessions of differential learning, which paralleled faster learning and stronger correlations between the ramping activity and conditioned responses. Chemogenetic mPFC activity, however, did not affect the adjustment of ramping activity or behavior during reversal learning or set-shifting, suggesting that the faster learning was not because of a general enhancement of attention, sensory, or motor processing. Thus, the dynamics of the mPFC network activation during events provide a relevance-signaling mechanism through which the mPFC exerts executive control over the encoding of those events in the hippocampus.
Significance Statement
Although we now have a fair understanding of memory encoding, the real-time processes through which the brain controls the strength of memory encoding remain mostly unknown. Developing an understanding of these memory regulation processes is important because it informs a new strategy for memory enhancement, which is critically needed for the fast-growing elderly population facing memory handicaps. We discovered that activating one region of the brain, the medial prefrontal cortex (mPFC) facilitated rats to form memories of important events without increasing the learning of unimportant details. The memory enhancement was associated with improved responses of mPFC network to the important events. Manipulations of the mPFC, therefore, allow for tapping into intrinsic memory encoding processes to enhance event memories.
Introduction
The hippocampus and surrounding rhinal cortices are essential for the rapid encoding of complex spatial and temporal sequences of events that we encounter during everyday life (Squire, 1992; Eichenbaum, 2000). These early plastic changes within the hippocampal circuits subsequently induce gradual reorganization of neocortical circuits through which memory traces become consolidated (Squire, 1992; Nadel and Moscovitch, 1997; Frankland and Bontempi, 2005). Several lines of evidence, however, suggest that the strong activation of the neocortex, in particular, the prefrontal cortex (PFC), during events is also essential for successful memory encoding. In the human brain, the hippocampus and prefrontal cortex are coactivated during memory encoding, and the ability to later remember events is predicted by the magnitude of prefrontal activation during encoding (Brewer et al., 1998; Wagner et al., 1998; Kao et al., 2005; Kirchhoff et al., 2000; Otten et al., 2002). In rodents, transcriptional, structural, and functional remodeling occurs in the medial PFC (mPFC; Bero et al., 2014; Kitamura et al., 2017) and orbitofrontal cortex (OFC; Lesburguères et al., 2011) at the time of encoding, and the activation of the mPFC is necessary for gene expression leading to synaptic modifications in hippocampal neurons (Bero et al., 2014). These findings raise the possibility that the PFC controls the activity of the hippocampus during learning, thereby determining whether certain information is made into long-term storage.
The top-down control that the PFC exerts over hippocampal encoding processes bears a resemblance to its established role in executive control, which relies on flexible, context-specific use of goals and expectations (Miller and Cohen, 2001; Euston et al., 2012). In well-trained animals, a sizable proportion of neurons in the mPFC and OFC respond to environmental stimuli that predict upcoming rewards (Schoenbaum and Eichenbaum, 1995; Pratt and Mizumori, 2001; Hosokawa et al., 2007; Morrison and Salzman, 2009; Insel and Barnes, 2015) or aversive stimuli (Baeg et al., 2001; Gilmartin and McEchron, 2005; Hosokawa et al., 2007; Takehara-Nishiuchi and McNaughton, 2008; Morrison and Salzman, 2009). Some have proposed that the observed neural selectivity for behaviorally relevant stimuli may underlie the role of these regions in memory retrieval and memory-guided decision-making: the mPFC represents rules (a learned mapping of stimuli and adaptive behavior; Euston et al., 2012; Eichenbaum, 2017), whereas the OFC uses these rules according to the task state (the current location in a task; Wilson et al., 2014; Wikenheiser and Schoenbaum, 2016). A question remains open as to whether the same neural selectivity underlies the emeging role of the PFC in memory encoding.
To address this point, we used chemogenetic approaches to artificially generate the mPFC network state associated with encoding success and examined its impact on behavior in trace eyeblink conditioning. In this hippocampus-dependent memory paradigm, animals associate a neutral stimulus with a mildly aversive stimulus to the eyelid over a short temporal gap (Woodruff-Pak and Disterhoft, 2008; Takehara-Nishiuchi, 2018). In the present study, we used two neutral stimuli and systematically changed their contingency with the aversive stimulus across days. To determine the effect of the manipulation on the mPFC network responses to the stimuli, we also recorded local field potentials (LFPs) from the mPFC during the conditioning. We found that the mPFC network responses differentiated the behaviorally relevant stimulus (i.e., paired with the aversive stimulus) from the irrelevant stimulus (i.e., presented alone). Chemogenetic mPFC activation promoted the development of the selective network responses and in turn facilitated the initial formation of differential stimulus associations. It, however, did not affect subsequent adjustment of behavior and the network responses according to the changing stimulus contingency.
Materials and Methods
Subjects
Twenty-four male Long–Evans rats (Charles River Laboratories), 70 d old on arrival, were individually housed in transparent plastic cages in a home colony room and maintained on a 12 h reverse light/dark cycle (dark from 10:00–22:00) with ad libitum access to food and water. Their weight ∼1 week after their arrival ranged from 350 to 425 g. Behavioral experiments were performed during the dark cycle. Five rats were excluded because of insufficient expression of the transgene, leaving 19 rats for the analysis of behavioral data. Two additional rats were excluded because of misplaced electrodes, leaving 17 rats for the analysis of LFP data. One of these rats lost the head implant during the third stage of conditioning (see Behavioral analyses section). This rat was removed from behavioral and LFP analyses during the set-shift stage. Among the 19 rats included in the behavioral analysis, 10 rats were used for the analysis of c-Fos expression. In addition to the 24 rats that were purchased for this study, we reanalyzed c-Fos expression data collected from 15 rats in our previous study (Volle et al., 2016). All procedures were in accordance with the National Institutes of Health Guide for the Care and Use of Laboratory Animals (Publication No. 85-23, revised 1985), the Canadian Council on Animal’s Care, APA ethical standard, and approved by the University of Toronto Animal Care Committee.
Viral vectors
Recombinant adeno-associated virus (AAV) vectors encoding the Designer Receptors Exclusively Activated by Designer Drug (DREADD; Armbruster et al., 2007; Rogan and Roth, 2011) was a gift from Bryan Roth; University of North Carolina School of Medicine (Addgene viral prep #50476-AAV8). All rats received intracranial injection of pAAV8-CaMKIIa-hM3D(Gq)-mCherry, and the titer was 3 × 1012 vg/ml.
Surgery
Rats underwent two surgery protocols: they first received the viral vector (1) and then after at least a 5 week incubation period were implanted with LFP and electromyogram (EMG) electrodes (2).
Viral vector surgery (1). One week after their arrival at the facility, rats were anesthetized (1–2% isoflurane by volume in oxygen at a flow rate of 0.8 L/min; Fresenius Kabi) and placed in a stereotaxic frame. Skin was retracted and holes drilled in the skull bilaterally above the prelimbic region of the mPFC [anteroposterior (AP) = +3.2, mediolateral (ML) = ±0.5 from bregma; Paxinos and Watson, 2007)]. A 30 G stainless steel cannula was connected to a microsyringe (Hamilton) via polyethylene tubing and lowered to 3.5 mm below bregma. The viral vector (pAAV8-CaMKIIa-hM3D(Gq)-mCherry; 0.5 μl/side) was injected at a rate of 0.1 μl/min. The cannula was left in place for an additional 10 min following the microinjection to ensure the diffusion of the vector. The cannula was then slowly retracted, and the incision was sutured. The rats were treated with analgesic (carprofen, 5 mg/kg, s.c.) for 48 h after surgery and left in their home cage for 5 weeks.
Electrodes surgery (2). Bipolar LFP electrodes were fabricated by inserting two short pieces of stainless steel wire (791000, A-M Systems) into a 25 G stainless steel cannula (distance between electrodes tips was 0.7 mm). As described in the previous section (1), rats were anesthetized and placed in a stereotaxic frame. After craniotomy and removal of dura, an electrode was implanted in the prelimbic region of mPFC (AP = +3.2, ML = +0.6, DV = −3.9 mm from bregma) contralateral (right) to the conditioned eye. In addition, four Teflon-coated stainless-steel wires (791000, A-M Systems) were implanted subcutaneously in the upper left orbicularis oculi (eyelid muscle) to record EMG activity and deliver a periorbital shock. All electrode wires were attached to a connector cap (Ginder Scientific), and the connector cap was secured to the skull with stainless steel screws and dental acrylic resin. The rats were given an analgesic treatment [see Viral vector surgery (1)] and at least 7 d to recover from surgery before beginning daily conditioning sessions.
Histology
On the completion of behavioral testing, brain tissue was collected to conduct three experiments to address the following points: Experiment A, the location and spread of viral vector infection; Experiment B, the location of LFP electrodes; and Experiment C, the ex vivo validation of the cumulative impact of clozapine-N-oxide (CNO) treatment and trace eyeblink conditioning on the activity of mPFC neurons.
Tissue collection
Rats were subcutaneously injected with either CNO (0.1 mg/kg body weight) or 0.9% physiologic saline solution before the start of conditioning, using the same drug assignment the rats received during conditioning sessions. Five rats were injected with saline and five rats were injected with CNO. Following a 30 min wait, the rats underwent conditioning for 10 min. After conditioning, 50 min later, rats were deeply anesthetized with an excess amount of sodium pentobarbital (102 mg/kg; Euthansol, Merck), and the tips of the LFP electrodes were marked by electrolytic lesions (20 µA for 45 s, positive to electrode, negative to animal ground). They were perfused transcardially with chilled 0.9% physiologic saline solution, followed by chilled 4% paraformaldehyde (PFA). Brains were extracted and left submerged within 4% PFA at 4°C overnight, followed by PBS-30% sucrose solution (PBS-Suc) for 48 h. Coronal brain slices (40 μm) across the entire anterior–posterior extent of the medial prefrontal cortex were collected using a cryostat (CM3050S, Leica Biosystems). Every first, and second tissue section was stored in a separate tube filled with tissue storage buffer (TSB; PBS with sucrose and ethylene glycol solution), whereas every third tissue section was stored in PBS, all tubes aside from those stored in only PBS were then stored at −20°C. Each tube was used for Experiments A, B, and C.
Location and extent of viral infection
For Experiment A, sections were mounted on a glass slide and coverslipped with ProLong Diamond antifade mounting medium containing DAPI (ThermoFisher Scientific). Endogenous mCherry signal was used to determine the placement and extent of viral infection for each rat. Rats that received pAAV8-CaMKIIa-hM3D(Gq)-mCherry were included in subsequent analyses if robust mCherry expression was observed in the prelimbic region in at least one hemisphere.
Location of LFP electrodes
For Experiment B, tissue was mounted on a glass slide and stained with cresyl violet. It was subsequently examined under a light microscope, and the locations of the electrode tips were drawn on to templates from the stereotaxic atlas of the rat brain (Paxinos and Watson, 2007). All data from the two rats whose electrodes were not located in the prelimbic region were omitted from the analyses (1 saline-treated and 1 CNO-treated rat).
Immunostaining
For Experiment C, sections were removed from TSB, washed in PBS, and submerged in 20% goat serum (ab156046, Abcam) for 2 h at room temperature. The sections were then washed three times with PBS-0.1% Triton X-100 Detergent (PBS-T). Then, they were incubated with a primary antibody against c-Fos (rabbit, #2250, 1:400; Cell Signaling Technology) at 4°C overnight. Subsequently, the sections were washed three times using PBS-T and then incubated in a secondary anti-rabbit IgG antibody conjugated with AlexaFluor 488 (Goat, #111-545-003, 1:400; Jackson ImmunoResearch) for 2 h at room temperature. The sections were washed three times with PBS, and were mounted on glass slides and sealed with coverslips and ProLong Diamond antifade mounting medium containing DAPI, as in Experiment A.
Image acquisition
Images were collected from the immunostained tissue using an upright fluorescence microscope (Axio Imager, Z1, Zeiss) with a 20× objective. Areas of analysis consisted of a 0.35 × 0.35 mm region on the x–y scale. A section with the track of cannula used for the viral vector injection was identified. Then, an image was taken from an area adjacent to the injection track. Three images were collected from the prelimbic region from each rat.
Cell counting
Collected images were manually analyzed by two experimenters who were blind to the treatment condition with the help of FIJI (ImageJ) software. In each image, the number of DAPI-positive cells was marked and counted. Small, bright uniformly DAPI stained nuclei from putative glial cells were not included in the DAPI counts. The number of DAPI-positive cells that were also positive for c-Fos- or hM3Dq (detected as mCherry signal) were counted. The raw count was converted to a ratio for each image. The proportion of c-Fos expressing cells [P(c-Fos)] was calculated as the number of c-Fos expressing cells that were also DAPI-positive divided by the total number of DAPI-positive cells. In a separate cohort of six animals, we tested the possibility of a nonselective effect of CNO on c-Fos expression. Rats were transfected in the same manner previously described with either rAAV2/8-CamKIIa- eGFP or rAAV2/8-CamKIIa-hM3D (Gq)-mCherry (purchased from the vector core at the University of North Carolina) and randomly assigned to one of three groups: hM3Dq-Sal, hM3Dq-CNO, GFP-CNO. Animals were injected with either CNO or saline, immediately placed back into their home cages, and perfused 90 min after. P(c-Fos) in the prelimbic region of the mPFC was calculated in the same manner as our other experiment.
Behavioral analyses
Drug assignments
At least 6 weeks after the intracranial injection of pAAV8-CaMKIIa-hM3D(Gq)-mCherry, the rats were randomly assigned to receive subcutaneous injections of either CNO (Tocris Bioscience, catalog #4936) dissolved in 0.9% saline solution (0.1 mg/kg body weight, n = 10) or saline solution (n = 9) 30 min before daily conditioning sessions (starting from the second adaptation session). All rats received the same treatment for the entirety of the experiment.
Trace eyeblink conditioning
All rats were trained in trace eyeblink conditioning for 23 d each of which consisted of two conditioning epochs in two different conditioning environments (Contexts 1 and 2) in a sound and light-attenuating chamber. Context 1 consisted of a transparent, cylindrical, plastic container with P80 grit sandpaper covering the floor. The floor was kept at 15°C through the use of a hot/cold compress pack. Context 2 consisted of a striped black and white walled, rectangular, plastic container with paper towel covering the floor. The floor was kept at 25°C through the use of the hot/cold compress pack. Rats were counterbalanced such that half the animals underwent the first conditioning epoch in Context 1 and the other half in Context 2. In the second epoch, animals were placed into the opposite context from the first epoch.
For the first two sessions, rats were placed in the conditioning chamber for 50 min without any stimulus presentations to habituate them to the procedures and chamber. Starting on the third session, rats underwent 7 d of conditioning in each of the three learning stages of differential trace eyeblink conditioning. Rats were presented with the conditioned stimulus (CS), which was presented for 100 ms and consisted of an auditory stimulus (85 dB, 2.5 kHz pure tone) or a visual stimulus (white LED light blinking at 50 Hz). The unconditioned stimulus (US) was a 100 ms mild electrical shock to the eyelid (100 Hz square pulse). The auditory CS was delivered through a speaker in the chamber ceiling, and the visual CS was delivered through an LED light placed on the wall of the chamber. The US was delivered to the eyelid with a stimulus isolator (ISO-Flex, AMPI). The shock level was initiated at 0.3 mA and was adjusted individually and daily for each rat to induce an optimal unconditioned response (an eyeblink/head-turn response), which was monitored through web cameras mounted inside the chambers. Stimulus delivery was controlled by a RZ-5 recording system (Tucker-Davis Technologies) with a microcontroller (Arduino Mega).
Daily recording sessions consisted of two epochs of conditioning, each with 100 trials, separated by a 10 min rest period. The intertrial intervals were pseudorandomized between 20 and 40 s with a mean of 30 s. Each epoch included 50 presentations of the auditory CS and 50 presentations of the visual CS, pseudorandomized over the course of the 50 min recording. During the first stage (Differential Learning, Days 3–9), one of the CS (CS1; e.g., auditory CS) was paired with the US with a 500 ms stimulus-free interval between them, whereas the other type of CS (CS2; e.g., visual CS) was presented alone in both Contexts 1 and 2. During the second stage (Reversal Learning, Days 10–16), CS–US contingency was reversed in such a manner that rats received pairings of CS2 and US, whereas CS1 was presented alone, in both Contexts 1 and 2. During the third stage (Set-Shift, Days 17–23), both CS1 and CS2 were paired with the US in Context 1, whereas both CS were presented alone in Context 2.
During conditioning, eyeblink responses were monitored by recording EMG activity from the left upper orbicularis oculi muscle through two surgically implanted stainless steel wires. EMG activity was bandpass filtered between 0.3 and 3.0 kHz, digitized at 6102 Hz, and stored using a RZ-5 recording system (Tucker-Davis Technologies).
EMG analysis
All analyses were performed using custom code written in MATLAB (MathWorks) with the same procedure as that used in our previous studies (Volle et al., 2016; Morrissey et al., 2017). For each session per animal, the amplitude of the EMG signal during each 1 ms of time was calculated by subtracting the minimum signal from the maximum signal during that 1 ms window. EMG amplitude was averaged during a 300 ms window before CS presentation in each trial. The baseline was set as the median of averaged EMG amplitude plus 1 SD. EMG activity above the threshold was averaged together during the 300 ms pre-CS period (pre-value) and during a 200 ms window before US onset (CR value). The CR value was designed to capture the adaptive, anticipatory blinking responses that occur immediately before US onset. A trial was defined as a CR trial if the CR value was at least five times that of the pre-value. In some trials, the pre-value exceeded 10 times the threshold because the rats engaged in grooming, teeth grinding, or climbing immediately before CS onset (Morrissey et al., 2017). These trials were classified as “hyperactive” trials and discarded. The percentage of conditioned responses (CR%) for each animal in a given session was the ratio of CR trials relative to the total number of valid trials. The significance of differentiation of CR% between two CS types was tested with random permutation tests. In each rat, in each session, the differential index (DI_CR) was calculated as follows: DI_CR = abs(CR1% − CR2%)/(CR1% + CR2%), where CR1% and CR2% are the percentage of CR trials in CS1 and CS2 trials, respectively. Then, trial types were randomly reassigned to each trial, and DI_CR was calculated. This procedure was repeated 1000 times to construct sampling distributions. The DI_CR with the real trial label was considered significant when it fell in the 0.05% of upper tail of its corresponding distribution. The number of sessions needed for DI_CR to reach the significance was counted in each rat. To examine the temporal pattern of EMG activity in each learning stage, EMG amplitude was averaged across all valid trials in the final session of each learning stage, then across animals in each group. EMG amplitude was divided by the averaged amplitude during a 300 ms window before the CS onset for normalization.
Electrophysiological analyses
General procedures for LFP recording and analyses are the same as those used in our previous study (Volle et al., 2016). All analyses were conducted with custom codes written in MATLAB (MathWorks). These codes will be made available in response to reasonable requests sent to the corresponding author.
LFP recording
LFPs were measured as the voltage difference between the two tips of a bipolar electrode (the difference in the length was 0.7 mm) and continuously recorded during daily conditioning. LFPs were amplified by 1000 times, filtered between 1 and 400 Hz, and digitized at 2034 Hz with the same RZ-5 recording system used for the recording of EMG activity.
Preprocessing
To remove trials with movement artifact, a threshold was defined as the across-trial mean plus 4 SD of the raw LFP signals during a 500 ms period before CS onset. This threshold was selected based on visual inspection of several datasets. If LFP signals during a 500 ms period before CS onset exceeded this threshold in a trial, the trial was excluded from further analyses. All remaining trials, regardless of the presence of CR or not, were included in the analysis, and the results were pooled. Subsequently, the power spectrum density was calculated to ensure that its shape was consistent with those reported in previous studies (Paz et al., 2008; Insel et al., 2012; Volle et al., 2016).
Spectrogram
Time-frequency analyses were conducted on raw LFP data during the seven differential learning sessions by means of the Morlet wavelets method, using the ft_freqanalysis function from the FieldTrip toolbox (Oostenveld et al., 2011). To detect changes in oscillatory activity induced by CS presentation, the power in each frequency band was divided by the averaged power during a 1 s window before the CS presentation.
Amplitude of CS-evoked oscillatory activity
To detect CS-induced changes in oscillatory activity, we computed instantaneous amplitude by using the Hilbert transform. This method was chosen over other methods because of its high temporal resolution. The amplitude of three predetermined frequency bands (theta, 4–12 Hz; beta, 13–30 Hz; gamma, 30–100 Hz) during the CS and interval between the CS and US (trace interval) was computed with the following steps. First, in each trial, raw LFP signals during a 2 s window around CS onset were filtered with a bandpass filter (third-order Chebyshev type 1, forward and backward for zero phase distortion using the filtfilt function in MATLAB). Second, the instantaneous amplitude was calculated as the absolute value of the Hilbert transform of the filtered signal. Third, the amplitude was divided by the averaged amplitude during a 500 ms window before the CS onset (see Figs. 3, 4). Fourth, the normalized amplitude was averaged in a predetermined time window. Fifth, the values were averaged across trials and then used to calculate the DI as follows:
DI = abs(AMP_CSP − AMP_CSM)/(AMP_CSP + AMP_CSM), where AMP_CSP and AMP_CSM are the averaged, normalized amplitude in reinforced and unreinforced trials, respectively.
Correlation with CR%
In each rat, the Pearson correlation coefficient (r) was calculated between CR% and the normalized theta amplitude to each CS type during the seven sessions of the differential learning stage. R values were then averaged across rats in each group.
Experimental design and statistical analyses
Cell counting
The data presented are the group’s mean ± the group’s SEM across rats. Each group contained five rats. T tests were used to determine statistical significance (α = 0.05). For the experiment testing the possibility of a nonspecific effect of CNO, a one-way ANOVA with group as a between-subjects factor was used with a Tukey post hoc test.
EMG analysis
For the comparison of CR%, the data presented are the group’s mean for each day of conditioning ± the group’s SEM. Mixed ANOVAs with group as a between-subjects factor and session, epoch and CS type as within-subjects factors were used to determine statistical significance. The number of sessions needed for DI_CR to reach the significance was compared between the groups with Wilcoxon rank sum test.
Electrophysiological analyses
The data were presented as the mean and SEM across rats (Figs. 3C, 4, 5). To test the difference in CS-evoked amplitude, we ran mixed ANOVA on the DI with sessions or learning stages as a within-subjects factor and groups as a between-subjects factor. Correlations between CS-evoked theta amplitude and CR% were compared between the two groups with t tests.
Results
Excitatory pyramidal neurons in the mPFC were selectively activated by virally transduced DREADDs
We used AAVs to transduce the evolved human M3-muscarinic receptor (hM3Dq) gene into a subset of pyramidal neurons in the prelimbic region of the mPFC in adult male Long–Evans rats. The hM3Dq receptor can be activated by systemic injection of the pharmacologically inert ligand, CNO (Alexander et al., 2009). To target expression to excitatory pyramidal neurons, the hM3Dq gene was expressed under the control of the CaMKIIα promoter. The expression of hM3Dq receptors (detected by coexpression of mCherry) was restricted to the prelimbic region with very minor spread into adjacent rostral anterior cingulate and infralimbic regions (Fig. 1A,B). Among 24 rats that received the viral vector with the hM3Dq gene, 5 rats had insufficient spread into the prelimbic region. The data from these rats were removed from subsequent analyses.
To examine the cumulative impact of the chemogenetic manipulation and behavioral conditioning on the activity of single neurons, we monitored the expression of the immediate early gene, c-Fos, induced by subcutaneous injection of CNO or saline before the start of conditioning in 10 hM3Dq-expressing rats (Fig. 1C). Although many previous studies used hM3Dq to induce artificial firing (Farrell and Roth, 2013), our goal was to enhance natural responses of prefrontal neurons to incoming stimuli. Therefore, we used a low dose of CNO (0.1 mg/kg body weight), which is ∼5–30 times lower than the doses used in other studies (Garner et al., 2012; Zhan et al., 2013; Yau and McNally, 2015).
The overall number of c-Fos-expressing cells was higher in CNO-treated hM3Dq-expressing rats (n = 5 rats) than those treated with saline (n = 5; Fig. 1E; t test, p < 0.001). Consistent with previous reports (Garner et al., 2012; Zhan et al., 2013; Yau and McNally, 2015; Volle et al., 2016), the increase was observed regardless of hM3Dq expression: the proportion of c-Fos-expressing cells was higher in CNO-treated rats than in saline-treated rats in both hM3Dq-positive (p = 0.001) and hM3Dq-negative cells (p = 0.002). These results suggest that our manipulation increased the number of activated cells during the conditioning after systemic CNO injection.
Increased c-Fos expression in hM3Dq-negative cells raises a possibility that CNO may have nonspecifically increased neural activity regardless of hM3Dq expression. We confirmed that this was not the case by using a separate cohort of hM3Dq- and GFP-expressing rats that received CNO or saline injections without the conditioning (Fig. 1F). The proportion of c-Fos-expressing cells was significantly higher in CNO-treated hM3Dq-expressing rats (n = 5) compared with CNO-treated GFP-expressing rats (n = 5) and saline-treated hM3Dq-expressing rats (n = 5; one-way ANOVA, F(2,12) = 32.150, p < 0.001; Tukey post hoc test: p < 0.001). The latter two groups showed a comparable proportion of c-Fos expressing cells (p = 0.303). These findings suggest that CNO itself was not effective in activating neurons and that the increased c-Fos expressing in hM3Dq-negative cells (Fig. 1E) was likely because of the excitatory synaptic connections between hM3Dq-expressing and hM3Dq-negative cells.
Increasing prefrontal neuron activity accelerated the formation of temporal stimulus associations without compromising accuracy or flexibility
We first examined the effect of chemogenetic activation of the mPFC on differential, reversal learning and set-shifting paradigms in trace eyeblink conditioning. Although CNO or the metabolic conversion of CNO to clozapine may have off-target effects (Gomez et al., 2017), our previous study confirmed that systemic injections of CNO to rats that did not express hM3Dq had no effect on the acquisition of conditioned responses (CRs) in trace eyeblink conditioning (Volle et al., 2016). We, therefore, used saline-treated hM3Dq-expressing animals as controls. Nineteen hM3Dq-expressing rats daily underwent two epochs of differential trace eyeblink conditioning in two distinct conditioning environments (Fig. 2A). Thirty minutes before the first conditioning epoch, 9 rats received systemic injection of saline, whereas 10 rats received injection of CNO (0.1 mg/kg). These rats received the same treatment across all sessions. In the differential learning stage, CNO-treated hM3Dq-expressing rats acquired CRs to a neutral stimulus (CS1+, tone or light) that was paired with mild electric shock near the eyelid (US) faster than saline-treated hM3Dq-expressing rats in both epochs (Fig. 2B; four-way mixed ANOVA, Epoch×Group×CS×Session interaction: F(6102) = 0.686, p = 0.662; Group×CS×Session interaction: F(6102) = 4.716, p < 0.001). Follow-up two-way mixed ANOVA revealed that the frequency of CR expression (CR%) to the CS1+ was higher in the CNO-treated than saline-treated rats (Group×Session interaction: F(6102) = 5.617, p < 0.001). In contrast, the two groups showed comparable CR expression to the other CS presented alone across seven sessions (CS2−, light or tone; Group×Session interaction: F(6102) = 1.063, p = 0.390; Group: F(1,17) = 3.445, p = 0.081; Session: F(6102) = 0.631, p = 0.705).
Subsequently, the rats underwent the reversal learning stage, during which the stimulus contingency of the two CS with the US was reversed in both environments. CR% to either the currently non-reinforced CS1− or the newly reinforced CS2+ did not differ between the two groups in either of the two epochs (Fig. 2B; Epoch×Group×CS×Session interaction: F(6102) = 0.583, p = 0.743; Group×CS×Session interaction: F(6102) = 1.866, p = 0.094). Both groups increased CR% for the CS2+ (CS×Session interaction: F(6102) = 95.721, p < 0.001; follow-up one-way repeated-measure ANOVA: F(6108) = 91.823, p < 0.001) while concurrently decreasing CR expression for the CS1− (F(6108) = 9.371, p < 0.001).
The last set-shift stage required the rats to revise the previously acquired associations such that the conditioning environment, rather than the modality of CS, signaled which CS was predictive of the US. One CNO-treated rat was removed because of the loss of the head implant. Both groups showed comparable CR% to the two CS in each of the two epochs (Fig. 2B; Epoch×Group×CS×Session interaction: F(6,96) = 0.530, p = 0.785; Group×CS×Session interaction: F(6,96) =1.226, p = 0.300). CR%, however, differed between the two epochs (Epoch×Session interaction: F(6,96) = 8.154, p < 0.001) because both groups increased CR% to both CS in Epoch 1 during which the two CS were paired with the US (follow-up one-way repeated-measure ANOVA, a main effect of session: F(6102) = 4.604, p < 0.001). In contrast, they decreased CR expression to both CS in Epoch 2 during which the two CS were presented by themselves (F(6102) = 7.768, p < 0.001).
Faster differential learning in CNO-treated rats was also confirmed with another measure, which was designed to quantify the speed that rats developed reliable, differential responding to the two CS types (DI_CR combined with random permutation tests; see Materials and Methods). Compared with saline-treated rats, CNO-treated rats took fewer sessions to significantly differentiate CR% between the two CS during the differential learning stage (Fig. 2C; Wilcoxon rank sum test, p < 0.001). In contrast, both groups took a comparable number of sessions to adjust CR expression during the reversal learning and set-shift stages (p = 0.423, 0.377).
In addition, the two groups showed comparable temporal patterns of EMG activity in all three stages (Fig. 2D), suggesting that chemogenetic mPFC activation did not change the timing or the degree to which EMG amplitude was increased after CS onset (Volle et al., 2016).
Collectively, these findings suggest that chemogenetic mPFC activation facilitated differential learning but did not affect reversal learning or set-shifting.
CS-evoked theta amplitude was selective for the behavioral relevance of stimuli
To monitor changes in the network activity in responses to stimuli, we recorded LFPs from the prelimbic region of the mPFC during these conditioning sessions (Fig. 3A). Two rats (1 from each group) were removed because of misplaced electrodes, leaving eight saline-treated and nine CNO-treated rats for neural activity analyses. To examine whether the mPFC activity was selective for the behavioral relevance of the stimuli, we first analyzed LFPs during the differential learning stage. The CS evoked a lasting field potential response in the mPFC of both saline- and CNO-treated rats with prominent components in the theta frequency band (4–12 Hz; Fig. 3B). Both groups showed larger evoked responses to the CS paired with the US (CS1+) than the CS presented alone (CS2−). Moreover, after the CS1+, the stimulus-evoked responses became stronger to the expected onset of the US. To quantify these observations, raw LFPs were bandpass filtered within a predetermined frequency band, converted to instantaneous amplitude with Hilbert transform, and normalized with baseline amplitude. We then averaged the normalized amplitude during the last 100 ms time window ending at the time point closest to the US onset without any contamination of US artifact. These amplitude data were then converted to a DI in each rat to quantify the degree to which the normalized amplitude differentiated two CS types. In both groups, the DI of CS-evoked theta band activity (4–12 Hz; Fig. 3C, left) became stronger across seven sessions (two-way mixed ANOVA; Group×Session interaction: F(6,90) = 1.462, p = 0.200; Session: F(6,90) = 2.991, p = 0.010). Also, CNO-treated rats showed larger DI than saline-treated rats (Group: F(1,15) = 7.399, p = 0.016). On the other hand, there was a trend that the DI of CS-evoked beta band activity (13–30 Hz) was increased in CNO-, but not saline-treated rats (Group×Session interaction: F(6,90) = 2.184, p = 0.052). The DI of CS-evoked gamma band activity (30–100 Hz) did not significantly change across sessions (Group×Session interaction: F(6,90) = 1.432, p = 0.211; Session: F(6,90) = 1.840, p = 0.100). However, there was a trend that the DI in CNO-treated rats was larger than saline-treated rats (Group, F(1,15) = 4.507, p = 0.051). These results suggest that with differential learning, CS-evoked theta amplitude became more selective for behavioral relevance of the CS and that chemogenetic activation of excitatory neurons facilitated the development of this selectivity. Based on these observations, we concentrated further analyses on theta band activity.
Increasing prefrontal neuron activity promoted the development of ramping theta responses selective for behaviorally relevant stimuli
Having established that stimulus-evoked theta band activity differentiated the reinforced CS from the unreinforced CS, we then examined the time course over which the selective activity was developed and later adjusted according to changing stimulus contingencies. During the first few sessions of the differential learning stage, saline-treated rats showed a stronger phasic increase after the presentation of CS1+ compared to CS2− (Fig. 4A). Similar patterns were also observed in Epoch 2. The strong phasic response to the CS1+ was maintained during the rest of the differential learning stage. During the reversal learning stage, the phasic response continued to be stronger for the CS1− than the CS2+ despite the reversed stimulus contingency. In addition, during the first few sessions, in which the rats still frequently showed CRs to the CS1− (Fig. 2B), theta amplitude ramped up starting at ∼100 ms before the timing at which the US was presented during the previous stage (Fig. 4A, white arrows). This ramping response to the CS1− disappeared toward the end of the reversal stage while similar ramping responses gradually developed after the CS2+ (Fig. 4A, last 3 sessions). During the set-shift stage, in Epoch 1 the ramping responses were observed for both CS with comparable strength though the phasic response was still stronger for the CS1+ than CS2+. The ramping response was absent in Epoch 2 in which neither of two CS was paired with the US.
In parallel to the enhanced differential learning (Fig. 2B,C), chemogenetic mPFC activation accelerated the development of the selective ramping response. From the beginning of the differential learning stage, CNO-treated rats showed strong phasic responses as well as signs of ramping responses differentiating the two CS (Fig. 4B). Toward the end of the differential learning stage, the differentiation of the ramping responses became stronger. During the reversal stage, the ramping response gradually became smaller for the CS1− while concomitantly becoming larger for the CS2+. During the set-shift stage, the ramping responses did not differ between the two CS types in either of the epochs. These results suggest that in both saline- and CNO-treated rats, the CS-evoked theta band activity consisted of two components: the first component sharply increased after CS onset and differentiated the CS+ from the CS− during differential learning, but not during subsequent reversal learning or set-shifting (phasic responses). The second component gradually ramped up toward the expected US onset during differential learning and tracked changing stimulus contingency during reversal learning and set-shifting (ramping responses).
To quantify these observations, we separately calculated the DI for the phasic (50–150 ms after CS onset) and ramping (250–350 ms after CS onset) responses and averaged these values across the first (early) and last (late) three sessions of each learning stage (Fig. 4C,D). During the differential learning stage, the DI of the phasic responses was comparable between the early and late phases and between the two groups (Fig. 4C, left; two-way mixed ANOVA, Group×Phase interaction: F(1,15) = 0.011, p = 0.919; Phase: F(1,15) = 0.237, p = 0.633; Group: F(1,15) = 0.005, p = 0.945). During the reversal learning stage, the DI became smaller in both groups (middle; Group×Phase interaction: F(1,15) = 2.726, p = 0.120; Phase: F(1,15) = 54.474, p < 0.001; Group: F(1,15) = 0.736, p = 0.404). During the set-shift stage, the DI was comparable between the two phases and between the two groups (right; Group×Phase interaction: F(1,14) = 3.003, p = 0.105; Phase: F(1,14) = 3.614, p = 0.078; Group: F(1,14) = 1.442, p = 0.250).
The greater effect of chemogenetic mPFC activation was found in the ramping responses. During the differential learning stage, the DI of ramping responses was increased across the phases in both groups (Fig. 4D, left; Group×Phase interaction: F(1,15) = 1.924, p = 0.186; Phase: F(1,15) = 6.791, p = 0.020), and it was significantly larger in CNO-treated rats than saline-treated rats (Group: F(1,15) = 6.669, p = 0.021). During the reversal stage, in both groups, the sign of DIs changed from positive to negative, reflecting the strengthening of the ramping responses to the CS2, which was originally non-reinforced and became newly reinforced (middle; Group×Phase interaction: F(1,15) = 4.436, p = 0.052; Phase: F(1,15) = 37.156, p < 0.001; Group: F(1,15) = 0.019, p = 0.892). During the set-shift stage, DIs in both groups came close to zero, suggesting comparable responses to two CS types (right; Group× Phase interaction: F(1,14) = 3.596, p = 0.079; Phase: F(1,14) = 6.908, p = 0.020; Group: F(1,14) = 0.400, p = 0.537). We also confirmed similar patterns of the group-differences in the phasic and ramping responses in Epoch 2 (data not shown). These results suggest that chemogenetic mPFC activation enhanced the differentiation of the ramping responses between the reinforced and unreinforced CS only during differential learning.
Increasing prefrontal neuron activity strengthened correlations between the ramping activity and conditioned responses
The previous section showed that chemogenetic mPFC activation augmented the ramping activity selective for the behaviorally relevant stimuli (i.e., the CS paired with the US). To test whether the stronger ramping response was related to the faster differential learning (Fig. 2B), we calculated correlations between the ramping response and CR% across sessions during the differential learning stage. The majority of CNO-treated rats showed a significant correlation between the ramping response and CR% (an example rat is shown in Fig. 5A; for correlation coefficient in each rat, see Table 1). As a group, CNO-treated rats showed stronger correlations than saline-treated rats (Fig. 5B; t test, p = 0.003). In contrast, the strength of correlation between the phasic response and CR% was comparable between two groups (Fig. 5C; p = 0.560). These results suggest that the ramping, but not the phasic, theta activity was relevant for learning the behavioral relevance of stimuli and that the improved ramping activity was tightly linked to the improved differential learning.
Discussion
Although we experience an ongoing stream of events every day, the brain does not form lasting memory traces for every sequence of events that we have encountered. Seminal imaging studies in humans (Brewer et al., 1998; Wagner et al., 1998) and recent behavioral studies in rodents (Tse et al., 2011; Bero et al., 2014) implicated that the mPFC may control the strength of encoding of hippocampus-dependent memories. However, the real-time dynamics in the mPFC network that promote the encoding of relevant events remained unknown. Here, we show that the mPFC network response differentiated behaviorally relevant events from irrelevant ones, and that artificial enhancement of this exact network process facilitated the initial encoding of those events. Notably, the same manipulation did not affect the subsequent revision of these associations in the face of the changing stimulus contingency. These findings identify the mPFC network activity selective for behavioral relevance of events as a mechanism that controls the mnemonic fate of event information.
Linking two events that occur separately in time is an important aspect of everyday memory. Previous lesion and inactivation studies have shown that this ability depends on the integrity of the mPFC (Weible et al., 2003; Takehara-Nishiuchi et al., 2005; Gilmartin and Helmstetter, 2010; Gilmartin et al., 2013) and hippocampus (Solomon and Graves, 1985; Moyer et al., 1990; McEchron et al., 1998; Suh et al., 2011). In line with these early findings, we found that chemogenetic activation of the mPFC facilitated the formation of temporal stimulus associations, thereby highlighting the critical involvement of the mPFC in memory encoding dependent on the hippocampus. In contrast to the enhanced learning, chemogenetic mPFC activation did not affect rats’ ability to adjust behavioral responses to the stimuli when stimulus contingency was reversed or when the set predictive of aversive events was shifted (Fig. 2B). The lack of the effect on reversal and set-shifting is not because of tolerance to CNO, which might occur after repeated administration over 3 weeks, because c-Fos expression was higher in CNO-treated than saline-treated rats even on the day after the last set-shifting session (Fig. 1E). These observations counter the possibility that the enhanced learning is because of a general enhancement of sensory, motor processing, working memory, or attention. Rather, they support our view that increasing the activity of mPFC improves the functionality of the system specifically for the encoding of new event information.
The lack of effect on reversal and set-shifting appears to contradict with the established role of the mPFC in behavioral flexibility (Dalley et al., 2004; Floresco et al., 2009; Bissonette et al., 2013). In particular, manipulations that activate the mPFC network, such as reduced local GABA signaling via pharmacological blockade of GABAA receptors (Enomoto et al., 2011) or disruption of GABAergic neurons by genetic manipulation (Cho et al., 2015), impair set-shifting, but not differential or reversal learning. Our study differed from those studies in several points, including behavioral paradigms (classical vs instrumental conditioning), valence of reinforcement (aversive event vs reward), and types of the set predictive of reinforcement (environmental context vs unimodal stimuli). In addition to these procedural differences, another critical difference is the impact of the manipulations on the balance between excitation and inhibition in local circuits. The primary consequence of our chemogenetic manipulation was the elevated activity of CaMKIIα-positive, excitatory neurons that expressed hM3Dq; however, the elevated activity was also observed in cells without hM3Dq expression (Fig. 1E). Considering that excitatory neurons form synaptic input onto excitatory as well as inhibitory neurons (Povysheva et al., 2008; Otsuka and Kawaguchi, 2009), the latter group of neurons likely include both excitatory and inhibitory neurons. It is, therefore, possible that the concomitant increase of glutamatergic and GABAergic signaling may lead to an optimum circuit performance for fast, accurate and flexible memory encoding. In contrast, pharmacological blockade of GABA receptors or genetic disruption of GABAergic cells reduces GABA signaling. This may be detrimental to the proper functioning of the circuit, leading to a condition similar to the dysregulation of prefrontal activity in schizophrenia and bipolar disorder (Lewis et al., 2005; Green, 2006; Lisman, 2012; Tse et al., 2015).
In parallel to enhanced differential learning, chemogenetic mPFC activation promoted the development of the ramping increase of theta amplitude toward the expected onset of the aversive stimulus. Importantly, in rats with chemogenetic mPFC activation, the ramping activity developed hand-in-hand with differential learning (Figs. 2B, 4B). Moreover, the ramping activity was correlated with the frequency of conditioned responses to the reinforced and unreinforced stimuli during differential learning (Fig. 5A,B). These observations suggest a tight link between the ramping activity and the encoding of temporal stimulus relationships. One may argue that the ramping theta activity is related to eyelid muscle contraction, which rats showed after the reinforced, but not unreinforced, stimuli. Several observations counter this argument. First, theta amplitude began to ramp up ∼250 ms after CS onset (Fig. 4), although the major increase in EMG activity occurred at ∼350 ms after CS onset (Fig. 2D). Second, saline-treated rats did not display ramping activity in the same temporal pattern as CNO-treated rats during the last three sessions of the differential learning stage although the two groups of rats showed comparable patterns of eyelid movement (Figs. 2D, 4). These findings are consistent with our view that ramping theta activity is a process that leads to associative learning rather than a consequence of eyelid movement (for additional discussion, see Volle et al., 2016).
Caution is required for the interpretation of neural activity patterns induced by gain-of-function approaches because they may be artificial and never occur in intact brains. In the present study, chemogenetic mPFC activation elevated the oscillatory activity specifically for the reinforced CS (Fig. 3C), in particular the ramping theta band response toward the expected onset of the aversive stimulus (Fig. 4B,C,D). Notably, the ramping response was also observed in control rats although it was not detectable during the differential learning stage because of US artifact (Fig. 4A). During the reversal and set-shift stages, the latency of the ramping activity became shorter, which made it possible to detect the ramping activity in control rats. These observations, along with similar findings in differential fear conditioning in mice (Likhtik et al., 2014) and humans (Chien et al., 2017), suggest that the mPFC develops selective theta responses to stimuli that are important enough to be sent to long-term storage. And, it is this specific computation that was augmented by chemogenetic enhancement of the activity of prefrontal excitatory neurons.
In the present study, the activity level of the mPFC was artificially elevated by chemogenetic approaches, which resulted in enhanced differential learning. This raises the question as to what controls the activity level of an intact mPFC during an experience. One factor that is known to elevate mPFC activity and facilitate learning is the similarity between new information and prior knowledge of latent patterns, categories, and rules acquired through past experiences (Wang and Morris, 2010; van Kesteren et al., 2012; Preston and Eichenbaum, 2013). For example, the mPFC becomes strongly activated while new associations are incorporated into a previously learned set of similar associations in rats (Tse et al., 2011) and humans (van Kesteren et al., 2010; Bonasia et al., 2018). Moreover, when rats encounter familiar associations in a novel environment, both memory expression and prefrontal neuron firings selective for those associations immediately generalized to the new situation (Morrissey et al., 2017). The present finding expands on the previous behavioral and neurophysiological evidence by providing a proof of concept that the elevated mPFC activity induces a network state conducive to fast, accurate, and flexible memory encoding. Therefore, one role of the mPFC would be to continuously monitor the relevance of events based on their similarity to existing knowledge structure and then send the relevancy signal to promote the encoding of those events in the hippocampus. This top-down modulation of memory encoding contrasts with the bottom-up modulation based on extrinsic factors, such as novelty and emotional arousal of experiences, which depends on the locus coeruleus (Aston-Jones and Bloom, 1981; Sara et al., 1994; Takeuchi et al., 2016; Wagatsuma et al., 2018) and amygdala (McGaugh et al., 1996, 2002; McIntyre et al., 2005).
In summary, we found that enhanced mPFC activity facilitates the accurate and flexible learning of stimulus associations by promoting the development of mPFC network activity selective for behavioral relevance of stimuli. Future studies need to identify the long-range pathways through which prefrontal relevancy signals control memory encoding processes in the hippocampus. Although monosynaptic projections from the mPFC to the hippocampus are limited (Jones and Witter, 2007; but see Rajasethupathy et al., 2015 in mice), several mPFC efferent regions, such as the entorhinal cortex (Ryou et al., 2001; Brun et al., 2008; Lu et al., 2013) and nucleus reuniens (Ito et al., 2015; Hallock et al., 2016), are capable of modifying firing patterns of hippocampal neurons. From a clinical perspective, the present finding identifies manipulations of the mPFC’s activity level as a way to tap into an intrinsic memory encoding mechanism. This raises the potential of activating the mPFC as a novel strategy for cognitive enhancement to treat the growing elderly population facing memory disabilities.
Footnotes
The authors declare no competing financial interests.
This work was supported by NSERC Discovery Grant, CIHR Operating Grant, CFI Leaders Opportunity Fund (K.T.N.), and OGS Scholarship (J.J.).
This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International license, which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properly attributed.