Research ArticleResearch Article: New Research, Cognition and Behavior

Multiscale and Extended Retrieval of Associative Memory Structures in a Cortical Model of Local-Global Inhibition Balance

Thomas F. Burns, Tatsuya Haga (芳賀 達也) and Tomoki Fukai (深井朋樹)
eNeuro 23 May 2022, 9 (3) ENEURO.0023-22.2022; DOI: https://doi.org/10.1523/ENEURO.0023-22.2022

Abstract

Inhibitory neurons take on many forms and functions. How this diversity contributes to memory function is not completely known. Previous formal studies indicate inhibition differentiated by local and global connectivity in associative memory networks functions to rescale the level of retrieval of excitatory assemblies. However, such studies lack biological details such as a distinction between types of neurons (excitatory and inhibitory), unrealistic connection schemas, and nonsparse assemblies. In this study, we present a rate-based cortical model where neurons are distinguished (as excitatory, local inhibitory, or global inhibitory), connected more realistically, and where memory items correspond to sparse excitatory assemblies. We use this model to study how local-global inhibition balance can alter memory retrieval in associative memory structures, including naturalistic and artificial structures. Experimental studies have reported inhibitory neurons and their subtypes uniquely respond to specific stimuli and can form sophisticated, joint excitatory-inhibitory assemblies. Our model suggests such joint assemblies, as well as a distribution and rebalancing of overall inhibition between two inhibitory subpopulations, one connected to excitatory assemblies locally and the other connected globally, can quadruple the range of retrieval across related memories. We identify a possible functional role for local-global inhibitory balance to, in the context of choice or preference of relationships, permit and maintain a broader range of memory items when local inhibition is dominant and conversely consolidate and strengthen a smaller range of memory items when global inhibition is dominant. This model, while still theoretical, therefore highlights a potentially biologically-plausible and behaviorally-useful function of inhibitory diversity in memory.

Significance Statement

Broadly, there are two types of neurons: excitatory and inhibitory. Inhibitory neurons are amazingly diverse compared with excitatory neurons. Why? Using a computational model with realistically-sized groups of excitatory neurons (representing memories) associated together in a network of memories, we highlight a potentially biologically-plausible and behaviorally-useful function of inhibitory neuron diversity in memory. Two findings in particular standout: (1) inhibitory diversity can quadruple the range of memory retrieval; and (2) balancing the strength of different inhibitory neurons’ influence on excitatory neurons can dramatically change how the network of memories become activated, balancing and extracting both geometric and topological information about the network.

Introduction

The mechanisms by which our brains flexibly perform the complex tasks of learning and memory are not completely understood. Hebbian learning (Hebb, 1949), the relative increase in synaptic strength between neurons as a result of shared, causal activity, seems important. Hebb postulated memories were formulated in the brain by assemblies of highly-interconnected neurons (Hebb, 1949). Evidence for this “neuron assembly” hypothesis was found in hippocampus, where groups of neurons become synchronously activated in response to an animal’s spatial location, indicating a neural correspondence to and potential memory of the location (Harris et al., 2003). These memories are often mutually related, in physical or behavioral space for the case of navigation (Tolman, 1948), in reward space for the case of rewarded learning tasks (Dusek and Eichenbaum, 1997), in linguistic space for the case of language comprehension (Goldstein et al., 2021), and theoretically in any arbitrary semantic space for generalized graph-based reasoning (e.g., family trees; Whittington et al., 2020). How can the structure of these mutual relations be identified dynamically in cortical networks? Inhibitory mechanisms may hold an answer. Here, we computationally explore the possible role of inhibitory circuits in extracting graph-based relationships in the space of behaviorally relevant information.

The majority of experimental and computational work focusing on assemblies as representations of memory items has focused on the role of excitatory neurons. However, emerging evidence suggests inhibitory neurons play a nontrivial role in cortical networks. Throughout the brain, inhibitory neurons have classically been thought to coarsely keep excitation in check with a broad, nonspecific blanket of inhibition (Amit et al., 1994; Brunel, 2000). But more recent work has shown inhibitory neurons are tuned to specific external stimuli (Okun and Lampl, 2008; Xue et al., 2014), have specific associations with behavior (Dudok et al., 2021), have a large diversity of forms and functions within and across brain areas (Gouwens et al., 2020; Burns and Rajan, 2021), and form inhibitory assemblies (Zhang et al., 2017), often jointly with excitatory subnetworks (Otsuka and Kawaguchi, 2009; Koolschijn et al., 2019). A hallmark of many neuropathologies is inhibitory dysfunction (Amieva et al., 2004; Baroncelli et al., 2011; Burns and Rajan, 2022; Yao et al., 2022). If specific inhibitory dysfunction alone is sufficient for explaining these pathologies, then we could expect subtle inhibitory changes to cause dramatic changes in global function in complex tasks like those involving learning and memory. A greater understanding of the neurophysiological mechanisms underlying these changes may help us target treatments for such disorders and provide fundamental insight into the computational roles of inhibitory neurons in such circuits.

Previous modeling work in a formal model with binary neurons (Haga and Fukai, 2019) has shown how anti-Hebbian learning (i.e., involving inhibitory synapses) in an associative memory model was able to extend the span of association between mutually-related memory items organized in a simple ring structure, compared with a regular Hebbian learning rule (i.e., not involving inhibitory synapses). Later work extended this formal model to arbitrary graph structures (Haga and Fukai, 2021). These results suggest inhibition may play a nontrivial role in relational memory systems. However, these models lacked biological features, most prominently a lack of distinction between excitatory and inhibitory neuron populations, breaking Dale’s Law. Dale’s Law (sometimes also called Dale’s Principle or Dale’s Hypothesis), first appearing in Eccles et al. (1954), is the view that a neuron’s terminals do not transmit multiple, differently-acting chemical or electrical signals to postsynaptic targets, e.g., an excitatory neuron has the exclusive electrical effect of exciting postsynaptic targets and never inhibiting them. Another limitation of prior work is that the excitatory assemblies were also not nearly as sparse as those seen in biology and the neurons took on binary states. Nevertheless, the results indicate global functional changes can result from subtle inhibitory changes (Ferguson et al., 2013; Rich et al., 2017). This study proposes a more realistic connection scheme of distinct excitatory and inhibitory neurons to embed sparse cell assemblies which represent memory items mutually linked through arbitrary graph structures. Formulated in this way, the model allows us to confirm the previous suggestion that a balance between local inhibition and global inhibition on cell assemblies determines the scale and extent of memories retrieved in a neural network. We show this for various naturalistic and artificial associative memory structures, including as a potentially behaviorally-useful function to maintain a choice distribution given a juncture or decision point in physical or memory space. We find a balance between local and global inhibition allows control over the range of recall within arbitrary graph structures, as well as graph clustering effects which may be useful in navigation and memory tasks.

Materials and Methods

Model

In order to embed memories in the network, we generate binary patterns as vectors of length NE, the number of excitatory neurons. Then, the weight Tij of connections between any pair of excitatory neurons i and j is defined using these patterns. First, we create p random binary patterns (of 0 and 1 s) of length NE, {ξiμ}i=1,2,...,NEμ=1,2,...,p, with probabilities for 0 and 1 as Prob[ξiμ=0]=1−f and Prob[ξiμ=1]=f, and where we call f the “sparseness” parameter of the memory patterns. This means neurons can belong to one or more memory patterns, and can be expected on average to belong to p⋅f memory patterns. Memories are then embedded using a modified extended association rule (Griniasty et al., 1993; Amit et al., 1994) designed to allow association between memory items in an arbitrary graph structure where vertices are the memory patterns and edges represent an association of two memory patterns. Tij=∑μ=1pξiμ ξjμ+∑μ=1p∑k∈Kpξiμ ξjk (1)Specifically where K is the set of memory patterns neighboring (adjacent to, in the graph theoretic sense) pattern μ in the associative memory structure, M (an example of the memory patterns μ and K is illustrated in the example shown in Fig. 2A). Although all values of Tij are defined, not all are non-zero, in fact, many can be zero. This is because Equation 1 defines increases in Tij only when those units are assigned to the same memory pattern or neighboring patterns. We could interpret this functionally as neurons belonging to the same or neighboring patterns are connected with probability 1 and with probability 0 (or not connected) to all other excitatory neurons. An example of the functional consequence of this connectivity can be seen in Extended Data Figure 1-1.

Extended Data Figure 1-1

An example of spiking rates of all units in the stimulated pattern, its first neighbor (pattern adjacent to the stimulated pattern), the neighbor’s neighbor (second neighbor), the neighbor’s neighbor’s neighbor (third neighbor), and all other patterns. This is from a simulation using c=0. Download Figure 1-1, EPS file.

Two populations of inhibitory neurons are also modelled, one with global connectivity (uniform connection probabilities as indicated in Fig. 1) of size NG and another with local connectivity, which is specific to each memory pattern, and has a total size of NL, but where only fNL local inhibitory neurons participate in each pattern. Unless stated otherwise, we use NE=4,000, NG=500, NL=500, and f=0.01, meaning that each pattern consists of a joint assembly of 40 excitatory neurons and 10 local inhibitory neurons. A general schematic of the model from the perspective of a single memory pattern is shown in Figure 1A.

Figure 1.
Figure 1.

A, General schematic of the model from the perspective of a single memory pattern (Eμ) and its connections to its respective local inhibitory population (LI), neighbors (Ek), and the global inhibitory population (GI). Connection probabilities are indicated as values of P. To retrieve a pattern, excitation is given directly to a single pattern. Gaussian noise is also applied independently to all excitatory neurons. Key: striped/shaded arrows and circles indicate excitatory connections and populations, respectively, and unshaded arrows and circles indicate inhibitory connections and populations, respectively. N.B., although M consists of distinct memory patterns (and this distinction is necessary for the purposes of creating different associative memory structures), neurons can belong to any or all patterns (with independent probability of f to belong to any single memory pattern). Extended Data Figure 1-1 shows an example of the resultant activities over time for the stimulated pattern, neighbor, and other patterns. B, Input-output functions for the excitatory neurons (ϕ) and inhibitory neurons (ψ; from Amit et al., 1994). For the excitatory input-output function, values of I above 0.15 are mapped to V=0.08, and the inhibitory input-output function continues linearly with the same slope for values of I above 0.6.

Neurons are modelled as proportions of their maximum firing rates, based on an established method (Amit et al., 1994; note: the following completely describes our implementation, including modifications, so readers need not be familiar with the prior work (Amit et al., 1994)). At each timestep, currents are calculated for each excitatory neuron IiE, global inhibitory neuron IiG, and local inhibitory neuron IiL: τEIiE˙=−IiE + 1NE〈f〉∑j≠iTijVjE−(1−c)1NGPEG∑JijGEVjG−c1NLf∑JijLEVjL + Hiext (2) τIIiG˙=−IiG + 1NEfPGE∑iJijEGVjE (3) τIIiL˙=−IiL + 1NLf∑iJijELVjE (4)and then converted into proportions of their maximum firing rates by: ViĖ=ϕ(IiE) + ςi (5) ViĠ=ψ(IiG) (6) ViL̇=ψ(IiL), (7)where Jij is the balanced connection weight between neurons i and j, τE=10ms and τI=2ms are the time decay constants, c∈[0,1] is the local-global inhibition balance, and PEG=0.5 and PGE=0.1 are the connection probabilities from excitatory to global inhibitory neurons and global inhibitory to excitatory neurons, respectively. The 〈f〉 term is the sum of expected firing rates based on the average degree of M, e.g., if M is a 1D chain, 〈f〉=f⋅1.5=0.015 (where by “1D chain,” we mean a set of vertices wherein each vertex is connected to exactly two other vertices in the set, such that they form a chain-link structure as illustrated in Fig. 2A). The 〈f〉 term therefore acts to normalize the excitatory-to-excitatory weights and does not affect the probability of neurons belonging to memory patterns. External input to the network is given by Hiext=0.2, the drive given to excitatory neurons in the pattern we wish to retrieve during the stimulation window, and ςi∈N(0,0.00152) is small Gaussian noise (independently drawn at every step, for every excitatory neuron). The input-output functions for the excitatory neurons (ϕ) and inhibitory neurons (ψ) are shown in Figure 1B and are from a previous study (Amit et al., 1994). The network’s forward dynamics (governed by Eqs. 2–7) are solved using the Euler method with step sizes of 0.1 ms.

Figure 2.
Figure 2.

A, Illustration of M as a 1D chain. Arrows indicate the initially stimulated memory μ and the set of neighboring memory patterns, K, which are adjacent to μ in M. Shading of vertices indicates the strength of activity in each excitatory assembly (darker is more active). B, Example trials showing the correlation of approximate steady-state activities of excitatory neurons with neighboring memories in a 1D chain associative memory structure. Gray lines are single trials (n = 100) and black lines are the mean of all trials. Panels show increasing the value of c to 0.6 (to a local inhibition dominant network configuration) approximately doubles the initial range of retrieval. C, Example trials the same as B for c=0.7 with panels showing increasing sizes of networks (starting from 1x, which is NE=4,000, NG=500, NL=500). This indicates a strong finite field effect which appears in the local inhibition dominant state. D, Scatterplot showing the range of retrieval measure, D, increases with c. Gray dots are single trials (n = 5 per value of c) and the black line follows the mean of trials. Trials for c=0.7 were completed with NE=32,000, NG=1,000, NL=1,000, and for all other values of c the trials were completed with the regular network size (NE=4,000, NG=500, NL=500). Extended Data Figure 2-1 shows the stability of single units in these simulations of up to 5 s.

Extended Data Figure 2-1

Each panel shows the spiking rates over 5 s for 100 random excitatory neurons drawn from separate, unique random seed simulations where M was a 1D-chain with p=100 and the regular protocol of stimulating one memory pattern for the first 80 ms was conducted. The six panels each used different values of c; however, because only a small random sample is drawn from the entire excitatory population in each case, no systematic differences are observable. Two aspects are common to all panels, however (1) within the first few hundred milliseconds, all neurons reach and then maintain an approximate steady state level of activity for the remainder of the simulation (despite jittering caused by external random noise); and (2) neurons can settle on many different mean spiking rates, and (proportionally) many remain quiet or have very low levels of spiking activity. Download Figure 2-1, EPS file.

The excitatory-to-excitatory weights are considered balanced by setting Tij=JijEE. We then balance the inhibitory-to-excitatory and excitatory-to-inhibitory weights based on Tij. We balance the inhibitory-to-excitatory (JijGE and JijLE) and inhibitory-to-excitatory (JijEG and JijEL) connections by calculating the sum of each excitatory neuron’s presynaptic input in Jij and calculating the proportion of this sum compared with the mean sum of all excitatory neurons. This proportion becomes the connection weight, and obtains a mean of 1. In effect, this means excitatory neurons which receive stronger recurrent excitation than the mean excitatory neuron receive proportionally stronger local and global inhibition. Theoretically, this can be interpreted as a form of homeostatic normalization for the purpose of excitatory-inhibitory balance.

Associative memory structures M=(P,A) with |P|=p vertices (memory patterns) and edges (memory associations), A, is chosen and the model is instantiated according to the above procedure. We then choose a single pattern to receive external input to all of its excitatory neurons during the stimulation window, t=0ms to t=80ms, after which the network is left to settle into an approximate steady-state and stopped at t=500ms for analysis (we show representative examples in Extended Data Fig. 2-1 of simulations up to 5 s to demonstrate the stability of these approximate steady-states). The main variable of manipulation was the balance between local and global inhibition balance, c, where c=0 means only global inhibition is active, c=1 means only local inhibition is active, and c=0.5 means there is an equal contribution of both global and local inhibition in the network.

Analysis

We noted changes to c systematically changed the number of memory patterns in M which became activated during the simulated memory retrieval phase (from t=80ms, when the external stimulation ended, to t=500ms, when the simulation ended), despite no change to the excitatory weights or structure of M. We refer to this phenomenon throughout this and following sections as an “extension” in the “range of retrieval” of the memory patterns. To quantify this extension in the range of retrieval given by changes in c, we tested M as a 1D chain with p=100. We stimulated each pattern and recorded the excitatory firing rates at t=480ms to t=500ms. With WS=20ms being the number of timesteps being averaged, we calculate the mean Vμ¯ and variance ΔVμ2¯ of the final firing rates for each memory μ by: Vμ¯=1WS∑i=1NEViμ (8) ΔVμ2¯=1WS∑i=1NE(Viμ)2−Vμ¯. (9)

The covariance between two memories μ and v is: COVμ  v=1WS∑i=1NEViμViv−Vμ¯Vv¯. (10)

The correlation between two memories μ and v is: Cμ,v=COVμ  vΔVμ2¯ΔVv2¯. (11)

We then calculate the mean correlation between two memories at the shortest path distance d away from each other by: Cd=1p∑μCμ,μ+d. (12)

Finally, we quantify the range of retrieval D using the following algorithm:

1. Calculate |Cd−1−Cd| for all d>1.

2. D is the first value of d for which the next Y memory patterns have |Cd−1−Cd|<ε. If no such D is found, D=p2.

We use ε=0.05 and Y=5. Intuitively, this algorithm can be considered to estimate the distance in M from the initially stimulated memory pattern μ to the farthest sufficiently-active memory pattern d to quantify the range of retrieval.

We observed how the activity of the excitatory population spread through associative memory structure for different values of c and across time. We chose to visualize this spread in three classical graphs, Zachary’s karate club graph (Zachary, 1977), the K5-3-chain (Schapiro et al., 2013), and the Tutte graph (Tutte, 1946), and one constructed graph representing a multi-room spatial environment which we call the multiroom graph. The karate club graph (Zachary, 1977) is a classical graph where each vertex represents a karate practitioner and edges connect individuals who interacted with each other outside of their karate training (Fig. 3A, second row). The K5-3-chain (Schapiro et al., 2013) is a set of three almost fully-connected graphs on five vertices, but where the edge between two vertices in each of the three almost fully-connected are cut and instead those vertices are connected to another almost fully-connected graph to form a single, connected graph (Fig. 3A, first row). The Tutte graph (Tutte, 1946; Fig. 3A, third row) has some notable graph-theoretic properties: (1) each vertex has exactly three neighboring vertices; (2) unlike many other graphs with the prior property [property (1)], there exists no Hamiltonian cycle in the Tutte graph, i.e., there is no path through the graph which visits each vertex only once, never uses an edge more than once, and returns to the original vertex it started at; and (3) there is a central vertex which connects to three separate “rooms” (clusters of vertices), despite there being a strong global symmetry in the number of each vertex’s neighbors [property (1)] while there is also a subtle asymmetry in the lack of a Hamiltonian cycle [property (2)]. We designed the multiroom graph to represent a spatial environment with four equally-sized rooms, each connected to two other rooms by centrally-located “doorways” on two sides of each room (Fig. 3A, fourth row). These graphs were chosen for their complexity, relation to or derivation from real-world analogues, and well-known graph theoretic features.

Figure 3.
Figure 3.

Each row of subplots in this figure corresponds to data from four different associative memory structures (graphs); from top to bottom: K5-3-chain, karate club graph, Tutte graph, and multiroom graph. A, Example trials in the associative memory structures at two values of c. Vertices are shaded according to the sum of its neurons’ normalized activity (darker is more active). Arrows indicate the vertex which was stimulated at the beginning of the trial. B, Correlations of approximate steady-state activities of excitatory neurons with all other vertices in the same associative memory structures and at the same two values of c as in panel A. Vertices have been ordered such that those with similar correlations to other vertices are adjacent to illustrate the clustering effect that naturally arises from the network’s dynamics.

In order to quantify the similarity between the activity of the network and graph theoretic properties in the associative memory structures, we compared the approximate steady-state activity to the community detection and classification of vertices using the label propagation algorithm (Raghavan et al., 2007). We denote two vertices, e.g., μ and v, being members of the same community according to this algorithm with LPA(vμ,vv)=1 and LPA(vμ,vv)=−1 otherwise. Then, the clustering index for a given trial and its associated associative memory structure is given by the following: Q=1(p2−p)∑μ∑μ≠vLPA(vμ,vv)Cμ,v. (13)

The clustering index is a measure of how our model’s activity corresponds to topological features of M. To test how the activities correspond to geometric distance for arbitrary graphs, we define a local area around a vertex in M. This local area is the closed d-neighborhood of a vertex, i.e., the set of the vertex v and all vertices within distance d as measured by their shortest path to v. For a choice of d and v, we construct a local area function LA(μ|v,d) which assigns vertices in the local area with a value of 1 and −1 otherwise. We then calculate the geometric index by the following: R=1(p2−p)∑μ∑μ≠vLA(μ|v,d)Cμ,v. (14)

Code availability

The model was implemented using Julia 1.5.2. A copy of the code is publicly available at https://github.com/tfburns/BurnsHagaFukai (also see Extended Data 1).

Extended Data 1

Code. Download Extended Data 1, ZIP file.

Results

The general structure of the model is illustrated in Figure 1A. Memories are modelled as strongly-interconnected assemblies of excitatory neurons. Each memory item’s assembly is also interconnected to the assemblies of memory items which it is connected to in the associative memory structure, M. The associative memory structure can take on any form. Inhibition to the network is provided by two equally-sized populations: (1) a global inhibitory population, which has an excitatory to global inhibitory connection probability of 0.1 and global inhibitory to excitatory connection probability of 0.5; and (2) local inhibitory populations (one for each excitatory assembly), which are fully connected to individual excitatory assemblies in the associative memory structure. The balance between these two activities was governed by the parameter c: c→0 being strongly global, c→1 being strongly local, and c=0.5 being a balance between the two. A single trial is performed by giving a brief positive impulse (80ms) to a single excitatory assembly and then letting the network self-regulate its activity thereafter. This is similar to how a brief sensory stimulus of a single memory item can (even after the stimulus is removed) have persistent, representable activity and this activity can cause the retrieval of related memory items via cognition (Miyashita, 1988; MacDonald et al., 2011; Uitvlugt and Healey, 2019). We mostly analyze the approximate steady-state reached after 500ms.

Extended range of retrieval

Setting M as a 1D chain with p=100 memory patterns, we simulated values of c from 0 to 1 in 0.1 steps. We found the range of retrieval extended gradually with increases to c (Fig. 2A). At c=0.7, the network showed a dramatic increase in noisy behavior, however this slowly subsided as we increased the size of the network, indicating a finite field effect (Fig. 2B). Compared with c=0, which had a range of retrieval of around 5, c=0.7 quadrupled this distance to 20 neighbors in distance along the 1D chain (Fig. 2C). In the range of c>0.7, we tested networks of sizes up to NE=128,000, NG=4,000, NL=4,000 and found that in all cases the network activity was very noisy. Because of computational limitations, we did not test larger networks, however we speculate that sufficiently large networks are likely to exhibit even greater extensions to the range of retrieval but at smaller network scales are perturbed by noise from a finite field effect.

Spread of excitation in associative memory structures

We also tested more sophisticated associative memory structures, namely: the K5-3-chain, karate club graph, Tutte graph, and multiroom graph. As in the 1D chain case, trials with values above c=0.7 often had noise, although the largest graph (multiroom) had stable trials with values of up to c=0.85. We also observed most graphs change in their excitatory activity most noticeably in the region of c=0.5 to c=0.6. We therefore chose to focus on two cases: (1) strong global inhibition (c=0.1), and (2) slightly stronger local inhibition (c=0.525; Fig. 3).

In most cases (karate club graph, K5-3-chain, and multiroom graph) excitation spread across a larger range of the associative memory structure when local inhibition was dominant than when global inhibition was dominant. The Tutte graph uniquely decreased the spread of excitation when activating its central vertex (Fig. 3A, third row, arrow). We suspect this is because of the unique topology of the Tutte graph and this central vertex—no other graph has strongly segmented “rooms” all neighboring a single vertex.

Correlations between the vertices (assemblies) of the underlying neurons (neurons belonging to those assemblies, see Eq. 11) showed different resolutions of clustering. For most graphs, there was a trend of more and small clusters at c=0.1 and then fewer, larger clusters at c=0.525. However, the K5-3-chain showed the breaking down of clusters and some strong negative correlations at c=0.525. We can see in Figure 3B, top row, that the graph is made up of pseudo-K5 subgraphs—groups of five vertices completely connected, except for two “boundary” vertices, which connect the pseudo-K5 subgraphs together. Within each pseudo-K5 subgraph, the three “core” vertices (those which are fully connected within the pseudo-K5 subgraph and not the boundary vertices) remain strongly correlated with one another while the two “boundary” vertices become almost equally correlated with their own pseudo-K5 subgraph and their neighboring subgraph and negatively correlated with the opposite subgraph. For the well-connected core vertices, c=0.525 also represents the level at which the spread of excitation almost covers the entire graph. This is quite unlike the other graphs tested. At c=0.1, in the karate club graph, approximately five clusters of strongly correlated vertices were present, whereas at c=0.525 this reduced to approximately three (Fig. 3B, second row). The Tutte and multiroom graphs showed a similar trend in consolidation of clusters at c=0.525 (Fig. 3B, third and fourth rows).

We also observed how excitation spreads across the associative memory structure across time, after activation of vertices of interest, in the Tutte and multiroom graphs. For the Tutte graph we chose the central vertex, which branches off into three separate “rooms,” and for the multiroom graph we chose a location within one of the rooms that also led through a “doorway” to a neighboring room. We chose these vertices since they represent points of behavioral interest and ecological importance in animals—they are points at which an animal may make significant choice between which room to enter, explore, or exploit. In the Tutte graph, for c=0.1, there is initial activation of all three rooms (Fig. 4A). This is accompanied by a general rise in global inhibition and specific increases in the activity of local inhibitory populations connected to the respective active excitatory populations. However, at this early stage, one room is slightly more dominant in overall excitation (Fig. 4A, top-left panel, bottom-right “room”). This dominance appears to translate into gradual and then complete activity dominance compared with the other two rooms at the later time-windows. Contrastingly, for c=0.525, the activity of vertices in the Tutte graph is initially broader and this breadth of excitation is maintained steadily throughout the duration of the trial. We also see that the global and local inhibitory populations for c=0.525 (Fig. 4C) quickly stabilize in an approximate steady-state. In the case of c=0.1, the global inhibitory activity progresses through three distinct phases of activity (Fig. 4B, arrows): an initial rise, an unstable plateau, and finally a higher, stable plateau. Meanwhile, the local inhibitory activity for c=0.1 reflects the recruitment and release of various memory items before coming to an approximate steady-state at a similar time as the global inhibitory activity.

Figure 4.
Figure 4.

A, Example trials for memory item neuron activities in the Tutte graph during different time-windows for c=0.1 and c=0.525. The central vertex is activated for the first 80 ms of each trial. B, Global and local inhibitory firing rates over time for the Tutte graph trial with c=0.1 shown in A. Arrows illustrate three distinct modes or levels of global inhibition. C, Same as B but for c=0.525.

The multiroom graph showed a similar trend in broadening and maintaining a larger range of retrieval with increases in c. However, possibly because of the size of the network and because the chosen vertex was located within one of the rooms (thus biasing toward activation of that room’s other vertices, unlike the central vertex in the Tutte graph), observation of the effect required an increase in c. For illustration of the effect, we chose c=0.525 and c=0.7 (Fig. 5). Interestingly, in the case of c=0.7, initial broadening of the range of retrieval into the neighboring room (through the doorway adjacent to the memory item being stimulated) was slightly reduced and the first memory pattern of the room on the opposite doorway became active later in the trial.

Figure 5.
Figure 5.

A, Example trials for memory item neuron activities in the multiroom graph during different time-windows for two different values global-local inhibitory balances, c=0.525 and c=0.7. A vertex beside to uppermost “doorway” is activated for the first 80 ms of each trial. B, Global and local inhibitory firing rates over time for the multiroom graph trial with c=0.525 shown in A. C, Same as B but for c=0.7.

The clustering and geometric indices, Q and R, for each graph, at different values of c are given in Table 1. Since R depends on a choice of distance d in the local area, we calculated R for all values of d (from 1 up to the diameter) and report the largest value of R (and its d) in Table 1 and for all values in Table 2. In general, the larger the value of Q, the more agreement between the community structure measured by label propagation and by the correlations of vertex activities in the final network states (by our model). High values of R indicate the final activity states are similar to geometric distance. We analyze the activity based on all neurons and a subset of neurons which reach a firing rate of at least 0.02 of the maximum firing rate during the simulation. We call this subset the selective neurons.

View this table:
Table 1

Clustering and geometric indices for graphs at different values of c

View this table:
Table 2

Geometric indices (R) for different graphs for all tested levels of d

Clustering indices (Q) using only the selective neurons are generally larger than for all neurons, indicating these more-active neurons generally contribute positively to clustering. This is especially noticeable when the network settles into a state where assemblies take on a wide range of values (e.g., in the K5-3-chain graph for c=0.525). In general, the clustering indices indicate that given the size and topology of different graphs, different values of c have different propensities for clustering global characteristics.

Geometric indices (R) were generally greater than the clustering indices, indicating a greater emphasis of the geometry rather than the topology in these memory graphs at these values of c. Nonetheless, some topological information is captured and almost all of the geometric indices were of a comparable order as the clustering indices. As we increase c, the distance is increased or unchanged (i.e., not decreased). However, whether the clustering index increases with c depends on the structure of the graph. Importantly, either the clustering index or the distance becomes larger when c becomes larger, implying the approximate steady states can reflect the broader structure of the graph as the ratio of local inhibition to global inhibition is increased.

Discussion

Previous modeling studies have conflated excitatory and inhibitory neuron identities and learning rules (Griniasty et al., 1993; Haga and Fukai, 2019) or ignored inhibitory neurons’ functional participation (Amit et al., 1994) in associative memory structure retrieval. This work uniquely disentangles excitatory and inhibitory neurons and uses sparse excitatory assemblies to demonstrate the potential functional role of global-local inhibitory balance in a more biologically-plausible setting. In the simplistic case of a 1D memory chain (like might correspond to discrete memories in a sequence of events through time), shifting inhibition to a locally-dominant state quadrupled the range of activation or retrieval. In the case of more sophisticated memory structures, globally-dominant inhibition tended to emphasize finer scale partitions of the memory structure and consolidated strong local associations. Whereas, locally-dominant inhibition tended to capture broader scale partitions and allow excitation to extend across a larger range of the memory structure.

It is important to emphasize these results are generated in the context of a memory structure which relies on the correlation of semantically close units, implying that memory retrieval in such a structure is functionally optimized when nearby units are correlated. Biological evidence for such correlations was first prominently shown in monkey anterior ventral temporal cortex by Miyashita (1988), which showed that the activity of units selective for arbitrary complex visual patterns was correlated by the stimulus-stimulus associations in the temporal ordering of the stimuli presentations. However, this kind of correlated, associative memory structure is not only found in the visual system, it is also noticeable and widely studied in hippocampus. Within a spatial environment, place cells representing nearby place fields show correlated activity (Monsalve-Mercado and Roudi, 2020) and can maintain correlations in the same environment over different tasks (Hampson et al., 1996), mostly because of overlapping place fields. When the environment changes, however, these correlations are typically inconsistent with one another (Alme, et al., 2014), suggesting contextual cues alter or switch between different memory structures.

In our study, we selectively stimulate single memory patterns and see memory retrieval of the pattern and surrounding associating patterns in ∼100–200 ms of simulation time. Is this biologically realistic? Single neurons in human medial temporal lobe which learn to selectively encode associative episodic memories within just a few trials can be recruited in subsequent activations within ∼500–700 ms (Ison et al., 2015); maximal pattern completion of cortical ensembles in visual cortex after subensemble optogenetic stimulation typically takes on the order of 2–4 s (Carrillo-Reid et al., 2019); biasing memory-guided spatial behavior by selectively stimulating clusters of place cells for ∼1 s has been shown to improve performance in reward-attaining behavior (Robinson et al., 2020). Therefore, the speed of memory retrieval in our model is likely on a faster timescale than should be generally expected in actual biological systems, although this could also be because of simplifications in the model, or disanalogous stimulation methods or assembly/memory structures.

Recent experimental evidence in mice (Rolotti et al., 2022) shows that when optogenetic techniques are used to induce place field formation in CA1 neurons, feedback inhibition limits the number of neurons which become activated, thereby limiting the size of the neural assembly which becomes activated by the induced place field. However, using disinhibition, this effect can be nullified and the neural assemblies can be made larger. Rolotti et al. (2022) showed such disinhibition can improve performance on a head-fixed spatial goal-oriented learning task via overrepresentation of the rewarded locations used for performance in the task. Another functional benefit of such disinhibition may be in rapid place field formation, as is seen in the behavioral timescale synaptic plasticity mechanism (Bittner et al., 2017; Zhao et al., 2020; Milstein et al., 2021). Our modeling results suggest similar effects may be possible without the use of disinhibition but rather simply via a rebalancing of the relative activity or strength between different inhibitory populations.

In Rolotti et al. (2022), the feedback inhibition comes from the hippocampus, but they do not explore distinctions between different inhibitory populations therein. There are many different types of inhibitory neurons, each with distinct connectivity, dynamics, and morphology (Pelkey et al., 2017; Burns and Rajan, 2021; Campagnola et al., 2022). In our model, we speculate that the “local” inhibitory neurons are parvalbumin-expressing while “global” inhibitory neurons are somatostatin-expressing, given there exists some evidence for such connectivity profiles in visual cortex (Adesnik et al., 2012; Litwin-Kumar et al., 2016). However, it is possible different areas may recruit and use inhibitory neurons and their circuits differently, for example to develop different scales of representations in hierarchical planning (Brunec and Momennejad, 2022). It could also be the case that there are even more functional groups of inhibitory neurons involved in these phenomena (e.g., see later in this discussion regarding a potential additional “global” inhibitory group for decreasing the correlation between neighboring memory patterns).

Inhibitory neurons also contribute to the initiation, maintenance, and modulation of rhythmic oscillations in local electrical activity (Traub et al., 1998; Fries, 2005; Bartos et al., 2007; Buzsáki and Wang, 2012; Aton et al., 2013). One example is in the pyramidal interneuron network gamma (PING) mechanism (Whittington et al., 1995), which can generate rhythmic dynamics which can ultimately result in the synchronous firing of excitatory neurons. Classically, the PING mechanism is thought of as involving just one group of excitatory neurons and one group of inhibitory neurons, and this is generally sufficient for the generation of PING dynamics. However, Rich et al. (2017) showed by expanding the diversity of inhibitory neurons into two groups with different recurrent disinhibitory connectivity, one weakly connected and one strongly connected, it is possible to achieve richer and more robust PING dynamics. Although we do not study disinhibition in our model and our techniques are substantially different to Rich et al. (2017), we partly followed in the theme of Rich et al. (2017; albeit in a different mechanism and showing a different phenomenon) by showing how by considering a greater diversity of inhibitory neurons acting simultaneously in a network, we are able to generate more interesting and novel dynamics. How inhibitory diversity related to different mechanisms or phenomena (e.g., the PING mechanism and the multiscale and extended retrieval of associative memory structures we demonstrate here) interact with one another is an open question for both computational and experimental neuroscientists.

Theoretically, in the absence of noise and with a sufficiently large network, an associative memory structure with N neurons can expect to accurately store (and retrieve via pattern completion) a maximum of 0.14⋅N memory patterns (Amit et al., 1985; McEliece et al., 1987), N/log(N) memory patterns if we permit more errors (Amit, 1992), and fewer if those patterns are correlated (Löwe, 1998; although exactly how fewer depends on the manner in which the patterns are correlated). In our case, the patterns themselves are not correlated, but rather they are created independently of one another and then correlated “spatially” in the larger memory structure M via excitatory weights between the memory patterns as described in Equation 1 and illustrated in Figure 1. Since we set the probability of neighboring memory patterns being connected to one another to be 1, the effective spatial correlation will also be 1. Past theoretical and numerical results (Cugliandolo and Tsodyks, 1994; Gandolfo et al., 1999) therefore indicate the memory capacity will be smaller than if the patterns were not correlated. However, if the spatial correlation is lowered, e.g., <0.5, the theoretical memory capacity can be the same as if there was no spatial correlation (for sufficiently large networks without noise) and the memory patterns will be sufficiently separated to allow accurate pattern completion.

Conceivably, it is possible to functionally enter into the range of spatial correlation <1 in our model without changing the connection probability between excitatory memory patterns and instead by sufficiently increasing the absolute strength of global inhibition while c=0. Such an increase in global inhibition will gradually suppress all patterns, with those most weakly activated dying out earlier. At the level of global inhibition just before all patterns are suppressed, one or more patterns will be minimally active, and this is likely less than the number of patterns active before the increase in global inhibition. However, increasing the strength of a global inhibitory population like shown in our model may not be biologically realistic, perhaps a more realistic scenario would be to recruit another global inhibitory pool, i.e., a second inhibitory neuron group which is globally connected to the excitatory population. However, this is beyond the scope of the current study and here we focus on the case of just one global inhibitory group and one local inhibitory group for each memory pattern. Nevertheless, for these reasons, the memory capacity of our model is less than the theoretical optimum because of the correlations between patterns, and as c→1 it becomes even less optimum since it is theoretically equivalent to increasing the strength of the correlations between neighboring memory patterns. A similar capacity effect is present in prior models with correlation between the memory patterns (Griniasty et al., 1993; Amit et al., 1994; Haga and Fukai, 2019), however this effect comes about by (in whole or in part) modifying excitatory weights whereas here we demonstrate this effect can be generated by modifications to inhibitory weights alone.

The effects generated by these modifications, such as stable extension in the range of retrieval, appears limited because of increases in noise in strongly local-inhibition dominant states. This is likely because of a finite field effect and may indicate a necessary minimum size of local excitatory-inhibitory assemblies for such states. For example, stability in the case of c=0.7 for the 1D chain case with sparsity of f=0.01 required a network size four times greater than the case of c=0 to maintain stability of retrieval, translating to excitatory assemblies of 160 neurons paired with 40 local inhibitory neurons. Although assemblies of ∼300 neurons have been used in optical microstimulation experiments in sensory cortex to drive behavior in mice (Huber et al., 2008), most recorded assemblies are on the order of tens of neurons (Harris et al., 2003; Fujisawa et al., 2008). Among other benefits, such sparsity is accompanied by theoretical energy efficiencies (Levy and Baxter, 1996) and in associative memory models can lead to fewer spurious memories (Hoffman, 2019). It therefore seems likely that for the described mechanism of local-global inhibition to have a stable functional effect in extending the range of retrieval, the presence of both local and global inhibition is required in finite, real-world networks with sparse assemblies.

Alternatively, it is possible this mechanism requires a hybrid sparse-dense coding schema, as has long been suggested operates in hippocampus (Barnes et al., 1990), cerebellum (Marr, 1969), and more recently in sensory areas (Laurent, 2002; Sakata and Harris, 2009). In such a schema, sparse assemblies report their activity to densely-connected assemblies which broadcast information to other sparse assemblies. In our model, we could consider the global inhibitory population as a densely-connected assembly which broadcasts the overall level of excitation in the network to all local, sparse assemblies. It is just not excitatory, as in classic dense-sparse schemas. Through this interpretation, a reduction in the relative strength of global inhibition (as in the unstable region of c>0.7) is equivalent to a gradual transition in the coding schema from sparse-dense to sparse. Thus, if the described local-global inhibition mechanism requires a sparse-dense coding schema, its instability when the coding scheme becomes sparse is expected. Associative memory structures which had more sophisticated topologies also showed unstable regions at high values of c, however less so when the graph was sufficiently large (such as in the multiroom graph). So, it is also possible this mechanism can be supported when the memory structure is adequately structured or large.

Extension of the range of retrieval was not simply the only apparent function of the inhibitory mechanism in sophisticated associative memory structures, the mechanism also permitted multiscale segmentation of the associative memory structure. Local-inhibition dominant states typically activated coarser topological segments of the graphs whereas global-inhibition dominant states consolidated activity in more densely associated clusters, highlighting finer topological features. These results were similar to those found in a more abstract model of binary neurons (Haga and Fukai, 2021), except that the current model was unable to eliminate the spread of excitation totally (as the more abstract model (Haga and Fukai, 2021) was capable of). This is because the current model does not include direct potentiation of excitatory weights, but rather modulation of local-global inhibitory balance. In this model, where association is embedded ubiquitously, to sustain highly-specific activity within a narrow range of memory items or even a single memory item, it is necessary to create very strong self-excitation within an assembly and have stronger overall inhibition with c→0. This demonstrates a general limitation that in a more biologically-realistic setting it may not be possible to fully eliminate or reduce association between items embedded in an excitatory memory structure through inhibitory modulation alone. Nevertheless, such inhibitory activity may cause dissociation through plasticity and learning mechanisms, as demonstrated in numerous psychological and biological studies (Anderson, 2003; Chiu and Egner, 2015; Schmitz et al., 2017; Anderson and Hulbert, 2021), which we have not investigated here.

An intriguing aspect of this inhibitory mechanism is its ability to dramatically affect not just the range of retrieval but also which parts of the memory structure become dominant given an initial stimulation. For example, it appears in global-inhibition dominant states, global inhibition drives a “winner-takes-all” dynamic (Grossberg, 1973) whereby only the globally strongest memories remain active. In local-inhibition dominant states, this “winner-takes-all” dynamic appears to dissipate and permit a general extension of retrieval, or a more egalitarian sharing of the winners. However, this extension can also be mediated and a “winner-takes-all” dynamic can appear at the peripheries of the retrieval range, with different peripheries competing against each other (Fig. 5B). This may be considered as a global state transition from “winner-takes-all” to “winner-shares-all” (Fukai and Tanaka, 1997). We therefore hypothesize an inhibitory mechanism like we have described may be used to aid in the learning or retrieval of graph-based cognitive tasks in cortical networks (Whittington et al., 2020; Wang et al., 2021). Cognitive control or exploitation of this mechanism might also occur in concert with, for example, gamma oscillations, which are strongly tied to inhibitory activity (Buzsáki and Wang, 2012). This may be especially useful when faced with competing behavioral choices and maintaining the distribution of these choices is meaningful, such as in perceptual decision-making (Najafi et al., 2020). Indeed, Roach et al. (2022) report that tuned local inhibition can alter the attractor dynamics of perceptual decision-making networks to balance between the speed or accuracy of perceptual decisions.

Probing such circuits and behaviors may provide insights on the potential influence such inhibitory mechanisms have on neuropathologies, especially those associated with cognitive defects (Amieva et al., 2004; Baroncelli et al., 2011). For instance, the coordination and interaction of inhibitory-driven oscillatory activity in hippocampus and prefrontal cortex is known to play a role in spatial memory tasks (Jones and Wilson, 2005) and spatial decision-making (Tavares and Tort, 2022). This coordination and interaction can be disrupted in epilepsy, leading to decreased behavioral flexibility (Kleen et al., 2011). Perhaps the associated behavioral deficits are in part because of maladaptations or dysfunction of local-global inhibitory balance or other subtle disruptions to networks involving multiple inhibitory neuron types.

While this study has made some advances over prior models (Griniasty et al., 1993; Amit et al., 1994; Haga and Fukai, 2019) in terms of improving the “biological realism” of the model, there exist many simplifications and unrealistic features in our model. We treat neurons as having a single point of intracellular space, i.e., without dendrites or specific morphology, which other than itself being unrealistic also prevents us from allowing different classes of inhibitory neurons to preferentially synapse onto different regions of other neurons, which is known to vary widely across inhibitory neurons (Otsuka and Kawaguchi, 2009; Burns and Rajan, 2021; Dudok et al., 2021). We also assume that joint excitatory-inhibitory assemblies are completely connected, which is a simplification that does not match biology (Otsuka and Kawaguchi, 2009; Koolschijn et al., 2019; Rolotti et al., 2022). Therefore, these and other limitations mean that whether and how actual biological networks achieve the same functional benefits we described here using inhibitory neuron diversity currently remains unknown. Experimentalists may therefore wish to design studies to test the presence or absence of such computational benefits in biological networks with diverse inhibitory populations.

In our model, making a seemingly subtle change to the network structure by introducing some of the complexities and diversities of inhibitory neurons had a profound impact on retrieval. We have shown how this phenomenon mainly persists in a sparse, associative memory structure which obeys Dale’s Law and has more biologically-plausible connections than prior models. We have also shown and discussed some of the potential functional roles of this mechanism in graph-based cognitive tasks and discussed how this mechanism may contribute to a type of sparse-dense coding schema.

Footnotes

  • The authors declare no competing financial interests.

  • This work was partially supported by the Japan Society for the Promotion of Science KAKENHI Grants 21K15611 (to T.H.) and 18H05213 (to T.F.).

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International license, which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properly attributed.

References

  1. ↵
    Adesnik H, Bruns W, Taniguchi H, Huang ZJ, Scanziani M (2012) A neural circuit for spatial summation in visual cortex. Nature 490:226–231. doi:10.1038/nature11526 pmid:23060193
    OpenUrlCrossRefPubMed
  2. ↵
    Alme CB, Miao C, Jezek K, Treves A, Moser EI, Moser MB (2014) Place cells in the hippocampus: eleven maps for eleven rooms. Proc Natl Acad Sci U S A 111:18428–18435. doi:10.1073/pnas.1421056111 pmid:25489089
    OpenUrlAbstract/FREE Full Text
  3. ↵
    Amieva H, Phillips LH, Della Sala S, Henry JD (2004) Inhibitory functioning in Alzheimer’s disease. Brain 127:949–964. doi:10.1093/brain/awh045 pmid:14645147
    OpenUrlCrossRefPubMed
  4. ↵
    Amit DJ (1992) Modelling brain function: the world of attractor neural networks, pp 278–283. Cambridge: Cambridge University Press.
  5. ↵
    Amit DJ, Gutfreund H, Sompolinsky H (1985) Storing infinite numbers of patterns in a spin-glass model of neural networks. Phys Rev Lett 55:1530–1533. doi:10.1103/PhysRevLett.55.1530 pmid:10031847
    OpenUrlCrossRefPubMed
  6. ↵
    Amit DJ, Brunel N, Tsodyks MV (1994) Correlations of cortical Hebbian reverberations: theory versus experiment. J Neurosci 14:6435–6445. doi:10.1523/JNEUROSCI.14-11-06435.1994 pmid:7965048
    OpenUrlAbstract/FREE Full Text
  7. ↵
    Anderson M (2003) Rethinking interference theory: executive control and the mechanisms of forgetting. J Mem Lang 49:415–445. doi:10.1016/j.jml.2003.08.006
    OpenUrlCrossRef
  8. ↵
    Anderson MC, Hulbert JC (2021) Active forgetting: adaptation of memory by prefrontal control. Annu Rev Psychol 72:1–36. doi:10.1146/annurev-psych-072720-094140 pmid:32928060
    OpenUrlCrossRefPubMed
  9. ↵
    Aton SJ, Broussard C, Dumoulin M, Seibt J, Watson A, Coleman T, Frank MG (2013) Visual experience and subsequent sleep induce sequential plastic changes in putative inhibitory and excitatory cortical neurons. Proc Natl Acad Sci U S A 110:3101–3106.
    OpenUrl
  10. ↵
    Barnes CA, McNaughton BL, Mizumori SJ, Leonard BW, Lin LH (1990) Comparison of spatial and temporal characteristics of neuronal activity in sequential stages of hippocampal processing. Prog Brain Res 83:287–300. pmid:2392566
    OpenUrlCrossRefPubMed
  11. ↵
    Baroncelli L, Braschi C, Spolidoro M, Begenisic T, Maffei L, Sale A (2011) Brain plasticity and disease: a matter of inhibition. Neural Plast 2011:286073. doi:10.1155/2011/286073 pmid:21766040
    OpenUrlCrossRefPubMed
  12. ↵
    Bartos M, Vida I, Jonas P (2007) Synaptic mechanisms of synchronized gamma oscillations in inhibitory interneuron networks. Nat Rev Neurosci 8:45–56. doi:10.1038/nrn2044 pmid:17180162
    OpenUrlCrossRefPubMed
  13. ↵
    Bittner KC, Milstein AD, Grienberger C, Romani S, Magee JC (2017) Behavioral time scale synaptic plasticity underlies CA1 place fields. Science 357:1033–1036. doi:10.1126/science.aan3846 pmid:28883072
    OpenUrlAbstract/FREE Full Text
  14. ↵
    Brunec IK, Momennejad I (2022) Predictive representations in hippocampal and prefrontal hierarchies. J Neurosci 42:299–312. doi:10.1523/JNEUROSCI.1327-21.2021 pmid:34799416
    OpenUrlAbstract/FREE Full Text
  15. ↵
    Brunel N (2000) Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. Comp Neuro 8:183–208. doi:10.1023/A:1008925309027
    OpenUrlCrossRefPubMed
  16. ↵
    Burns TF, Rajan R (2021) Sensing and processing whisker deflections in rodents. PeerJ 9:e10730. doi:10.7717/peerj.10730 pmid:33665005
    OpenUrlCrossRefPubMed
  17. ↵
    Burns TF, Rajan R (2022) Temporal activity patterns of layer II and IV rat barrel cortex neurons in healthy and injured conditions. Physiol Reps 10:e15155.
    OpenUrl
  18. ↵
    Buzsáki G, Wang XJ (2012) Mechanisms of gamma oscillations. Annu Rev Neurosci 35:203–225. doi:10.1146/annurev-neuro-062111-150444 pmid:22443509
    OpenUrlCrossRefPubMed
  19. ↵
    Campagnola L, et al. (2022) Local connectivity and synaptic dynamics in mouse and human neocortex. Science 375:2022.
    OpenUrl
  20. ↵
    Carrillo-Reid L, Han S, Yang W, Akrouh A, Yuste R (2019) Controlling visually guided behavior by holographic recalling of cortical ensembles. Cell 178:447–457. doi:10.1016/j.cell.2019.05.045 pmid:31257030
    OpenUrlCrossRefPubMed
  21. ↵
    Chiu YC, Egner T (2015) Inhibition-induced forgetting: when more control leads to less memory. Psychol Sci 26:27–38. doi:10.1177/0956797614553945 pmid:25398560
    OpenUrlCrossRefPubMed
  22. ↵
    Cugliandolo LF, Tsodyks MV (1994) Capacity of networks with correlated attractors. J Phys A Math Gen 27:741–756. doi:10.1088/0305-4470/27/3/018
    OpenUrlCrossRef
  23. ↵
    Dudok B, Klein PM, Hwaun E, Lee BR, Yao Z, Fong O, Bowler JC, Terada S, Sparks FT, Szabo GG, Farrell JS, Berg J, Daigle TL, Tasic B, Dimidschstein J, Fishell G, Losonczy A, Zeng H, Soltesz I (2021) Alternating sources of perisomatic inhibition during behavior. Neuron 109:997–1012.e9. doi:10.1016/j.neuron.2021.01.003 pmid:33529646
    OpenUrlCrossRefPubMed
  24. ↵
    Dusek JA, Eichenbaum H (1997) The hippocampus and memory for orderly stimulus relations. Proc Natl Acad Sci U S A 94:7109–7114. doi:10.1073/pnas.94.13.7109 pmid:9192700
    OpenUrlAbstract/FREE Full Text
  25. ↵
    Eccles JC, Fatt P, Koketsu K (1954) Cholinergic and inhibitory synapses in a pathway from motor-axon collaterals to motoneurones. J Physiol 126:524–562. doi:10.1113/jphysiol.1954.sp005226 pmid:13222354
    OpenUrlCrossRefPubMed
  26. ↵
    Ferguson KA, Huh CY, Amilhon B, Williams S, Skinner FK (2013) Experimentally constrained CA1 fast-firing parvalbumin-positive interneuron network models exhibit sharp transitions into coherent high frequency rhythms. Front Comp Neurosci 7:144.
    OpenUrl
  27. ↵
    Fries P (2005) A mechanism for cognitive dynamics: neuronal communication through neuronal coherence. Trends Cogn Sci 9:474–480. doi:10.1016/j.tics.2005.08.011 pmid:16150631
    OpenUrlCrossRefPubMed
  28. ↵
    Fujisawa S, Amarasingham A, Harrison MT, Buzsáki G (2008) Behavior-dependent short-term assembly dynamics in the medial prefrontal cortex. Nat Neurosci 11:823–833. doi:10.1038/nn.2134 pmid:18516033
    OpenUrlCrossRefPubMed
  29. ↵
    Fukai T, Tanaka S (1997) A simple neural network exhibiting selective activation of neuronal ensembles: from winner-take-all to winners-share-all. Neural Comput 9:77–97. doi:10.1162/neco.1997.9.1.77 pmid:9117902
    OpenUrlCrossRefPubMed
  30. ↵
    Gandolfo D, Laanait L, Messager A, Ruiz J (1999) Memory capacity in neural networks with spatial correlations between attractors. Physica A 264:305–317. doi:10.1016/S0378-4371(98)00449-X
    OpenUrlCrossRef
  31. ↵
    Goldstein A, et al. (2021) Thinking ahead: spontaneous prediction in context as a keystone of language in humans and machines. bioRxiv. doi:10.1101/2020.12.02.403477.
  32. ↵
    Gouwens NW, et al. (2020) Integrated morphoelectric and transcriptomic classification of cortical GABAergic cells. Cell 183:935–953.e19. pmid:33186530
    OpenUrlCrossRefPubMed
  33. ↵
    Griniasty M, Tsodyks MV, Amit DJ (1993) Conversion of temporal correlations between stimuli to spatial correlations between attractors. Neural Comp 5:1–17. doi:10.1162/neco.1993.5.1.1
    OpenUrlCrossRef
  34. ↵
    Grossberg S (1973) Contour enhancement, short term memory, and constancies in reverberating neural networks. St App Math 52:213–257. doi:10.1002/sapm1973523213
    OpenUrlCrossRef
  35. ↵
    Haga T, Fukai T (2019) Extended temporal association memory by modulations of inhibitory circuits. Phys Rev Let 123:078101.
    OpenUrl
  36. ↵
    Haga T, Fukai T (2021) Multiscale representations of community structures in attractor neural networks. PLoS Comput Biol 17:e1009296. doi:10.1371/journal.pcbi.1009296 pmid:34424901
    OpenUrlCrossRefPubMed
  37. ↵
    Hampson RE, Byrd DR, Konstantopoulos JK, Bunn T, Deadwyler SA (1996) Hippocampal place fields: relationship between degree of field overlap and cross-correlations within ensembles of hippocampal neurons. Hippocampus 6:281–293. doi:10.1002/(SICI)1098-1063(1996)6:3<281::AID-HIPO6>3.0.CO;2-Q
    OpenUrlCrossRefPubMed
  38. ↵
    Harris KD, Csicsvari J, Hirase H, Dragoi G, Buzsáki G (2003) Organization of cell assemblies in the hippocampus. Nature 424:552–556. doi:10.1038/nature01834 pmid:12891358
    OpenUrlCrossRefPubMed
  39. ↵
    Hebb DO (1949) The organization of behavior. New York: Wiley.
  40. ↵
    Hoffman H (2019) Sparse associative memory. Neural Comp 31:998–1014.
    OpenUrl
  41. ↵
    Huber D, Petreanu L, Ghitani N, Ranade S, Hromádka T, Mainen Z, Svoboda K (2008) Sparse optical microstimulation in barrel cortex drives learned behaviour in freely moving mice. Nature 451:61–64. doi:10.1038/nature06445 pmid:18094685
    OpenUrlCrossRefPubMed
  42. ↵
    Ison MJ, Quian Quiroga R, Fried I (2015) Rapid encoding of new memories by individual neurons in the human brain. Neuron 87:220–230. doi:10.1016/j.neuron.2015.06.016 pmid:26139375
    OpenUrlCrossRefPubMed
  43. ↵
    Jones MW, Wilson MA (2005) Theta rhythms coordinate hippocampal–prefrontal interactions in a spatial memory task. PLoS Biol 3:e402. doi:10.1371/journal.pbio.0030402 pmid:16279838
    OpenUrlCrossRefPubMed
  44. ↵
    Kleen JK, Wu EX, Holmes GL, Scott RC, Lenck-Santini P-P (2011) Enhanced oscillatory activity in the hippocampal-prefrontal network is related to short-term memory function after early-life seizures. J Neurosci 31:15397–15406. doi:10.1523/JNEUROSCI.2196-11.2011 pmid:22031886
    OpenUrlAbstract/FREE Full Text
  45. ↵
    Koolschijn RS, Emir UE, Pantelides AC, Nili H, Behrens TEJ, Barron HC (2019) The hippocampus and neocortical inhibitory engrams protect against memory interference. Neuron 101:528–541.E6. doi:10.1016/j.neuron.2018.11.042 pmid:30581011
    OpenUrlCrossRefPubMed
  46. ↵
    Laurent G (2002) Olfactory network dynamics and the coding of multidimensional signals. Nat Rev Neurosci 3:884–895. doi:10.1038/nrn964 pmid:12415296
    OpenUrlCrossRefPubMed
  47. ↵
    Levy WB, Baxter RA (1996) Energy efficient neural codes. Neural Comput 8:531–543. doi:10.1162/neco.1996.8.3.531 pmid:8868566
    OpenUrlCrossRefPubMed
  48. ↵
    Litwin-Kumar A, Rosenbaum R, Doiron B (2016) Inhibitory stabilization and visual coding in cortical circuits with multiple interneuron subtypes. J Neurophysiol 115:1399–1409. doi:10.1152/jn.00732.2015 pmid:26740531
    OpenUrlCrossRefPubMed
  49. ↵
    Löwe M (1998) On the storage capacity of Hopfield models with correlated patterns. Ann Applied Prob 8:1216–1250.
    OpenUrl
  50. ↵
    MacDonald CJ, Lepage KQ, Eden UT, Eichenbaum H (2011) Hippocampal “time cells” bridge the gap in memory for discontiguous events. Neuron 71:737–749. doi:10.1016/j.neuron.2011.07.012 pmid:21867888
    OpenUrlCrossRefPubMed
  51. ↵
    McEliece RJ, Posner EC, Rodemich ER, Venkatesh SS (1987) The capacity of the Hopfield associative memory. IEEE Trans Information Theory 33.
  52. ↵
    Marr D (1969) A theory of cerebellar cortex. J Physiol 202:437–470. doi:10.1113/jphysiol.1969.sp008820 pmid:5784296
    OpenUrlCrossRefPubMed
  53. ↵
    Milstein AD, Li Y, Bittner KC, Grienberger C, Soltesz I, Magee JC, Romani S (2021) Bidirectional synaptic plasticity rapidly modifies hippocampal representations. Elife 10:e73046. doi:10.7554/eLife.73046
    OpenUrlCrossRef
  54. ↵
    Miyashita Y (1988) Neuronal correlate of visual associative long-term memory in the primate temporal cortex. Nature 335:817–820. doi:10.1038/335817a0 pmid:3185711
    OpenUrlCrossRefPubMed
  55. ↵
    Monsalve-Mercado MM, Roudi Y (2020) Hippocampal spike-time correlations and place field overlaps during open field foraging. Hippocampus 30:354–366. doi:10.1002/hipo.23173 pmid:31675168
    OpenUrlCrossRefPubMed
  56. ↵
    Najafi F, Elsayed GF, Cao R, Pnevmatikakis E, Latham PE, Cunningham JP, Churchland AK (2020) Excitatory and inhibitory subnetworks are equally selective during decision-making and emerge simultaneously during learning. Neuron 105:165–179. doi:10.1016/j.neuron.2019.09.045 pmid:31753580
    OpenUrlCrossRefPubMed
  57. ↵
    Okun M, Lampl I (2008) Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities. Nat Neurosci 11:535–537. doi:10.1038/nn.2105 pmid:18376400
    OpenUrlCrossRefPubMed
  58. ↵
    Otsuka T, Kawaguchi Y (2009) Cortical inhibitory cell types differentially form intralaminar and interlaminar subnetworks with excitatory neurons. J Neurosci 29:10533–10540. doi:10.1523/JNEUROSCI.2219-09.2009 pmid:19710306
    OpenUrlAbstract/FREE Full Text
  59. ↵
    Pelkey KA, Chittajallu R, Craig MT, Tricoire L, Wester JC, McBain CJ (2017) Hippocampal GABAergic inhibitory interneurons. Physiol Rev 97:1619–1747. doi:10.1152/physrev.00007.2017 pmid:28954853
    OpenUrlCrossRefPubMed
  60. ↵
    Raghavan UN, Albert R, Kumara S (2007) Near linear time algorithm to detect community structures in large-scale networks. Phys Rev E Stat Nonlin Soft Matter Phys 76:036106. doi:10.1103/PhysRevE.76.036106 pmid:17930305
    OpenUrlCrossRefPubMed
  61. ↵
    Rich S, Zochowski M, Booth V (2017) Dichotomous dynamics in E-I networks with strongly and weakly intra-connected inhibitory neurons. Front Neural Circuits 11:104. doi:10.3389/fncir.2017.00104 pmid:29326558
    OpenUrlCrossRefPubMed
  62. ↵
    Roach JP, Churchland AK, Engel TA (2022) Two roles for choice selective inhibition in decision-making circuits. bioRxiv. doi:10.1101/2022.01.24.477635.
  63. ↵
    Robinson NTM, Descamps LAL, Russell LE, Buchholz MO, Bicknell BA, Antonov GK, Lau JYN, Nutbrown R, Schmidt-Hieber C, Häusser M (2020) Targeted activation of hippocampal place cells drives memory-guided spatial behavior. Cell 183:1586–1599. doi:10.1016/j.cell.2020.09.061 pmid:33159859
    OpenUrlCrossRefPubMed
  64. ↵
    Rolotti SV, Ahmed MS, Szoboszlay M, Geiller T, Negrean A, Blockus H, Gonzalez KC, Sparks FT, Solis Canales AS, Tuttman AL, Peterka DS, Zemelman BV, Polleux F, Losonczy A (2022) Local feedback inhibition tightly controls rapid formation of hippocampal place fields. Neuron 110:783–794.e6. doi:10.1016/j.neuron.2021.12.003 pmid:34990571
    OpenUrlCrossRefPubMed
  65. ↵
    Sakata S, Harris KD (2009) Laminar structure of spontaneous and sensory-evoked population activity in auditory cortex. Neuron 64:404–418. doi:10.1016/j.neuron.2009.09.020 pmid:19914188
    OpenUrlCrossRefPubMed
  66. ↵
    Schapiro AC, Rogers TT, Cordova NI, Turk-Browne NB, Botvinick MM (2013) Neural representations of events arise from temporal community structure. Nat Neurosci 16:486–492. doi:10.1038/nn.3331 pmid:23416451
    OpenUrlCrossRefPubMed
  67. ↵
    Schmitz TW, Correia MM, Ferreira CS, Prescot AP, Anderson MC (2017) Hippocampal GABA enables inhibitory control over unwanted thoughts. Nat Commun 8:1311. doi:10.1038/s41467-017-00956-z pmid:29101315
    OpenUrlCrossRefPubMed
  68. ↵
    Tavares LCS, Tort ABL (2022) Hippocampal-prefrontal interactions during spatial decision-making. Hippocampus 32:38–54. doi:10.1002/hipo.23394
    OpenUrlCrossRef
  69. ↵
    Tolman EC (1948) Cognitive maps in rats and men. Psychol Rev 55:189–208. doi:10.1037/h0061626 pmid:18870876
    OpenUrlCrossRefPubMed
  70. ↵
    Traub RD, Spruston N, Soltesz I, Konnerth A, Whittington MA, Jefferys JGR (1998) Gamma-frequency oscillations: a neuronal population phenomenon, regulated by synaptic and intrinsic cellular processes, and inducing synaptic plasticity. Prog Neurobiol 55:563–575. doi:10.1016/S0301-0082(98)00020-3
    OpenUrlCrossRefPubMed
  71. ↵
    Tutte WT (1946) On Hamiltonian circuits. J London Math Soc s1-21:98–101. doi:10.1112/jlms/s1-21.2.98
    OpenUrlCrossRef
  72. ↵
    Uitvlugt MG, Healey MK (2019) Temporal proximity links unrelated news events in memory. Psychol Sci 30:92–104. doi:10.1177/0956797618808474 pmid:30513038
    OpenUrlCrossRefPubMed
  73. ↵
    Wang JX, King M, Porcel N, Kurth-Nelson Z, Zhu T, Deck C, Choy P, Cassin M, Reynolds M, Song F, Buttimore G, Reichert DP, Rabinowitz N, Matthey L, Hassabis D, Lerchner A, Botvinick M (2021) Alchemy: a benchmark and analysis toolkit for meta-reinforcement learning agents. arXiv 2102.02926v1.
  74. ↵
    Whittington JCR, Muller TH, Mark S, Chen G, Barry C, Burgess N, Behrens TEJ (2020) The Tolman-Eichenbaum machine. Cell 183:1249–1263. doi:10.1016/j.cell.2020.10.024 pmid:33181068
    OpenUrlCrossRefPubMed
  75. ↵
    Whittington MA, Traub RD, Jefferys JG (1995) Synchronized oscillations in interneuron networks driven by metabotropic glutamate receptor activation. Nature 373:612–615.
    OpenUrlCrossRefPubMed
  76. ↵
    Xue M, Atallah BV, Scanziani M (2014) Equalizing excitation-inhibition ratios across visual cortical neurons. Nature 511:596–600. doi:10.1038/nature13321 pmid:25043046
    OpenUrlCrossRefPubMed
  77. ↵
    Yao HK, Guet-McCreight A, Mazza F, Moradi Chameh H, Prevot TD, Griffiths JD, Tripathy SJ, Valiante TA, Sibille E, Hay E (2022) Reduced inhibition in depression impairs stimulus processing in human cortical microcircuits. Cell Rep 38:110232. doi:10.1016/j.celrep.2021.110232 pmid:35021088
    OpenUrlCrossRefPubMed
  78. ↵
    Zachary WW (1977) An information flow model for conflict and fission in small groups. J Anthro Res 33:452–473. doi:10.1086/jar.33.4.3629752
    OpenUrlCrossRef
  79. ↵
    Zhang XJ, Li Z, Han Z, Sultan KT, Huang K, Shi SH (2017) Precise inhibitory microcircuit assembly of developmentally related neocortical interneurons in clusters. Nat Commun 8:16091.
    OpenUrlPubMed
  80. ↵
    Zhao X, Wang Y, Spruston N, Magee JC (2020) Membrane potential dynamics underlying context-dependent sensory responses in the hippocampus. Nat Neurosci 23:881–891. doi:10.1038/s41593-020-0646-2 pmid:32451487
    OpenUrlCrossRefPubMed

Synthesis

Reviewing Editor: Viji Santhakumar, University of California Riverside

Decisions are customarily a result of the Reviewing Editor and the peer reviewers coming together and discussing their recommendations until a consensus is reached. When revisions are invited, a fact-based synthesis statement explaining their decision and outlining what is needed to prepare a revision will be listed below. The following reviewer(s) agreed to reveal their identity: NONE.

This manuscript address as important topic in the field of computational neuroscience, the role of various types of inhibitory interneurons in driving neural dynamics, as it pertains to memory retrieval of associative memory structures. The paper applies graph theoretical approaches to bridge a gap between past work on memory representations that used abstract models, and current experimental and modeling work that incorporates additional biological realism, such as neuronal cell types that follow Dale’s law, and have distance-dependent and cell-type-specific connectivity. The scope of the study, while narrow, is well-defined, and the analyses used are generally appropriate and clearly explained. The work is potentially of interest to both computational neuroscientists and experimental neuroscientists studying memory storage and retrieval. There are several concerns that need to be addressed so that this work is accessible to the broader interdisciplinary readership for which the findings will be of interest. Additionally, with the broader readership in mind, the manuscript could benefit from extended Discussion of the interpretation, implications, and broader consequences of their findings.

Specifically,

1. Both reviewers concur, and I agree, that the discussion could be improved for a neuroscience audience. Perhaps the implications and consequences of “extended retrieval range” could be related to ideas regarding pattern separation and pattern completion. Given that the connectivity of the memory structures are prescribed by the chosen set of input patterns, a chosen level of sparsity, and a chosen connectivity between memory patterns, there are a fixed number of clusters of discriminable patterns in each graph. However, as the dynamics of recurrent excitation and local/global inhibition evolve, the steady-state activities diverge from the initial activities and a lower number of clusters of discriminable patterns are produced. So the storage capacity of these memory structures is reduced by inhibition. Yet how the “extended retrieval range” constitutes a functional advantage of Dale’s law/functional diversity is not clarified.

Similarly better explanation of the motivation behind the computational analogues of memory retrieval studied here would be beneficial. For instance, the memory retrieval metric relies upon measuring the correlation of nearby units, implying that memory retrieval is optimized when nearby units are correlated with the stimulated memory. Is there biological evidence for this phenomenon, or is this an assumption used in the study of associative memory structures? Why are the time scales appropriate for memory retrieval, considering this would be memory at a time scale of less than a second? Is selectively stimulating the selected memory appropriate not just for the study of place-based memory, but memory generally? These issues should be considered in the discussion.

2. Several important details were not adequately reported in the methods and need to be addressed to improve clarity.

a. Were the neurons included in each memory pattern are unique: Figure 1 implies that they are, but the description of the model in the text is rather vague. It is not clear how the authors go about constructing their input patterns subject to both the sparsity constraint and the “degree of M” constraint? Please provide more detail.

b. The description of the “range of retrieval” metric is also quite confusing, exacerbated by the fact that the term “attractors” is not defined and the subscript t used on line 170 is also not defined.

c. The different graphs discussed in the paragraph beginning on line 173 should be explicitly detailed, and the multiple references to the “established method” of Amit et al needs to be explained within the text so that this work is approachable to those who are not familiar with this particular reference.

d. The authors should introduce Dale’s law for the broader readership (Line 73).

e. L96: What defines “neighboring”? Pairs of patterns with at least one shared active unit? Please provide some additional clarity in the manuscript. It could help to show examples of binary input pattern vectors that are neighboring and non-neighboring.

f. P5, L128, L154: At this point, it is not explained what is meant by a “1D chain”. It is clarified in Figure 2, perhaps a brief explanation and pointer to Figure 2 could be provided here in the Methods.

g. In Line 136 the synaptic weights are defined relative to the quantity T; this can be included directly in the equations presented just earlier for clarity.

3. The analysis of network dynamics between 480 and 500 ms as indicative of a “steady state” needs to be adequately substantiated by illustrating an example to show that that the steady state lasts longer than just 400 ms or by presenting the time course of the activity to justify the period that was selected for “steady state” analysis. Alternatively, longer duration simulations can be included to confirm that the behavior between 480-500 ms is indicative of a steady-state.

4. The move towards “biological realism” in the model is a definite strength and welcomed. However, some additional explanation of the extent to which the model can be considered realistic and the limitations may be worth emphasizing in the abstract, introduction and discussion for the benefit of the general neuroscience audience. For example, the choice of P=1 for the connection probability between a memory pattern and its local inhibitory population is a simplification that doesn’t match biology and may be misleading to more a more experimental audience.

5. A more extensive discussion of relevant computational studies examining the role of interneuron subpopulations would benefit the readers: two potential papers of interest may be “Dichotomous dynamics in EI networks with strongly and weakly intra-connected inhibitory neurons” and “Reduced inhibition in depression impairs stimulus processing in human cortical microcircuits”. Similarly, the idea that “global functional changes can result from subtle inhibitory changes” (Line 74) is something that has been the topic of contemporary computational study and thus this statement could benefit from some citations. Examples include “Experimentally constrained CA1 fast-firing parvalbumin-positive interneuron network models exhibit sharp transitions into coherent high frequency rhythms” and “Inhibitory network bistability explains increased interneuronal activity prior to seizure onset”.

Minor edits

1. Additional topics for discussion include

a. The difference between the dynamics in the Tutte graph relative to the other studied graphs could be probed/discussed further. For example, what aspect of this graph causes this difference?

b. Discussion of inhibitory disfunction as it pertains to neuropathologies in the introduction and relevance to diseases such as epilepsy, which is associated with cognitive defects could be beneficial.

2. Referring to curves in Figure 1B as “input-output functions” would be more appropriate than I?F curve which has specific experimental implication.

P8, L230: Caption for panel (D) is labeled (C).

3. P8, 9, Figure 3: The discussion of this figure would be easier to follow if the different graph types were labeled in the figure and figure legend, and discussed in the same order that they are presented in the figure.

4. P10: References to Figure 4 are mislabeled here as Figure 3.

5. P3, L93: There are numbered citations provided here, but the References are not numbered; “Memories are then embedded using a modified extended association rule [18, 29]”.

6. The supplemental data and tables should be made part of the main manuscript

Back to top

In this issue

Email
Print
View Full Page PDF
Citation Tools
Respond to this article
Multiscale and Extended Retrieval of Associative Memory Structures in a Cortical Model of Local-Global Inhibition Balance
Thomas F. Burns, Tatsuya Haga (芳賀 達也), Tomoki Fukai (深井朋樹)
eNeuro 23 May 2022, 9 (3) ENEURO.0023-22.2022; DOI: 10.1523/ENEURO.0023-22.2022
Reddit logo Twitter logo Facebook logo Mendeley logo

Jump to section

Responses to this article

Respond to this article

Jump to comment:

No eLetters have been published for this article.

Subjects