Abstract
In the brain, most synapses are formed on minute protrusions known as dendritic spines. Unlike their artificial intelligence counterparts, spines are not merely tuneable memory elements: they also embody algorithms that implement the brain’s ability to learn from experience and cope with new challenges. Importantly, they exhibit structural dynamics that depend on activity, excitatory input and inhibitory input (synaptic plasticity or ‘extrinsic’ dynamics) and dynamics independent of activity (‘intrinsic’ dynamics), both of which are subject to neuromodulatory influences and reinforcers such as dopamine. Here we succinctly review extrinsic and intrinsic dynamics, compare these with parallels in machine learning where they exist, describe the importance of intrinsic dynamics for memory management and adaptation, and speculate on how disruption of extrinsic and intrinsic dynamics may give rise to mental disorders. Throughout, we also highlight algorithmic features of spine dynamics that may be relevant to future artificial intelligence developments.
This is a preview of subscription content, access via your institution
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 print issues and online access
$189.00 per year
only $15.75 per issue
Rent or buy this article
Prices vary by article type
from$1.95
to$39.95
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
Fiala, J. C., Spacek, J. & Harris, K. M. Dendritic spine pathology: cause or consequence of neurological disorders? Brain Res. Rev. 39, 29–54 (2002).
Kasai, H., Matsuzaki, M., Noguchi, J., Yasumatsu, N. & Nakahara, H. Structure-stability-function relationships of dendritic spines. Trends Neurosci. 26, 360–368 (2003).
Yuste, R. Dendritic Spines (MIT Press, 2010).
Brown, T. et al. Language models are few-shot learners. arXiv https://arxiv.org/abs/2005.14165 (2020).
Sejnowski, T. J. The unreasonable effectiveness of deep learning in artificial intelligence. Proc. Natl Acad. Sci. USA 117, 30033–30038 (2020).
Coss, R. G., Brandon, J. G. & Globus, A. Changes in morphology of dendritic spines on honeybee calycal interneurons associated with cumulative nursing and foraging experiences. Brain Res. 192, 49–59 (1980).
Leiss, F. et al. Characterization of dendritic spines in the Drosophila central nervous system. Dev. Neurobiol. 69, 221–234 (2009).
Cuentas-Condori, A. et al. C. elegans neurons have functional dendritic spines. eLife 8, e47918 (2019).
Malenka, R. C. & Bear, M. F. LTP and LTD: an embarrassment of riches. Neuron 44, 5–21 (2004).
Herring, B. E. & Nicoll, R. A. Long-term potentiation: from CaMKII to AMPA receptor trafficking. Annu. Rev. Physiol. 78, 351–365 (2016).
Lillicrap, T. P., Santoro, A., Marris, L., Akerman, C. J. & Hinton, G. Backpropagation and the brain. Nat. Rev. Neurosci. 21, 335–346 (2020).
Hasson, U., Nastase, S. A. & Goldstein, A. Direct fit to nature: an evolutionary perspective on biological and artificial neural networks. Neuron 105, 416–434 (2020).
Botvinick, M., Wang, J. X., Dabney, W., Miller, K. J. & Kurth-Nelson, Z. Deep reinforcement learning and its neuroscientific implications. Neuron 107, 603–616 (2020).
Hassabis, D., Kumaran, D., Summerfield, C. & Botvinick, M. Neuroscience-inspired artificial intelligence. Neuron 95, 245–258 (2017).
Kasai, H. et al. Learning rules and persistence of dendritic spines. Eur. J. Neurosci. 32, 241–249 (2010).
Bosch, M. & Hayashi, Y. Structural plasticity of dendritic spines. Curr. Opin. Neurobiol. 22, 383–388 (2012).
Herms, J. & Dorostkar, M. M. Dendritic spine pathology in neurodegenerative diseases. Annu. Rev. Pathol. 11, 221–250 (2016).
Yasuda, R. Biophysics of biochemical signaling in dendritic spines: implications in synaptic plasticity. Biophys. J. 113, 2152–2159 (2017).
Forrest, M. P., Parnell, E. & Penzes, P. Dendritic structural plasticity and neuropsychiatric disease. Nat. Rev. Neurosci. 19, 215–234 (2018).
Moyer, C. E. & Zuo, Y. Cortical dendritic spine development and plasticity: insights from in vivo imaging. Curr. Opin. Neurobiol. 53, 76–82 (2018).
Okabe, S. Regulation of actin dynamics in dendritic spines: nanostructure, molecular mobility, and signaling mechanisms. Mol. Cell. Neurosci. 109, 103564 (2020).
Matsuzaki, M. et al. Dendritic spine geometry is critical for AMPA receptor expression in hippocampal CA1 pyramidal neurons. Nat. Neurosci. 4, 1086–1092 (2001).
Beique, J. C. et al. Synapse-specific regulation of AMPA receptor function by PSD-95. Proc. Natl Acad. Sci. USA 103, 19535–19540 (2006).
Harris, K. M. & Stevens, J. K. Dendritic spines of CA 1 pyramidal cells in the rat hippocampus: serial electron microscopy with reference to their biophysical characteristics. J. Neurosci. 9, 2982–2997 (1989).
Nusser, Z. et al. Cell type and pathway dependence of synaptic AMPA receptor number and variability in the hippocampus. Neuron 21, 545–559 (1998).
Takumi, Y., Ramirez-Leon, V., Laake, P., Rinvik, E. & Ottersen, O. P. Different modes of expression of AMPA and NMDA receptors in hippocampal synapses. Nat. Neurosci. 2, 618–624 (1999).
Holler, S., Kostinger, G., Martin, K. A. C., Schuhknecht, G. F. P. & Stratford, K. J. Structure and function of a neocortical synapse. Nature 591, 111–116 (2021).
Matsuzaki, M., Honkura, N., Ellis-Davies, G. C. & Kasai, H. Structural basis of long-term potentiation in single dendritic spines. Nature 429, 761–766 (2004).
Markram, H., Lubke, J., Frotscher, M. & Sakmann, B. Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275, 213–215 (1997).
Magee, J. C. J. D. A synaptically controlled, associative signal for Hebbian plasticity in hippocampal neurons. Science 275, 209–213 (1997).
Dan, Y. & Poo, M. M. Spike timing-dependent plasticity: from synapse to perception. Physiol. Rev. 86, 1033–1048 (2006).
Harvey, C. D. & Svoboda, K. Locally dynamic synaptic learning rules in pyramidal neuron dendrites. Nature 450, 1195–1200 (2007).
Tanaka, J. et al. Protein synthesis and neurotrophin-dependent structural plasticity of single dendritic spines. Science 319, 1683–1687 (2008).
Yagishita, S. et al. A critical time window for dopamine actions on the structural plasticity of dendritic spines. Science 345, 1616–1620 (2014).
Takao, K. et al. Visualization of synaptic Ca2+/calmodulin-dependent protein kinase II activity in living neurons. J. Neurosci. 25, 3107–3112 (2005).
Okamoto, K., Narayanan, R., Lee, S. H., Murata, K. & Hayashi, Y. The role of CaMKII as an F-actin-bundling protein crucial for maintenance of dendritic spine structure. Proc. Natl Acad. Sci. USA 104, 6418–6423 (2007).
Lee, S. J., Escobedo-Lozoya, Y., Szatmari, E. M. & Yasuda, R. Activation of CaMKII in single dendritic spines during long-term potentiation. Nature 458, 299–304 (2009).
Pi, H. J. et al. CaMKII control of spine size and synaptic strength: role of phosphorylation states and nonenzymatic action. Proc. Natl Acad. Sci. USA 107, 14437–14442 (2010).
Chang, J. Y. et al. CaMKII autophosphorylation is necessary for optimal integration of Ca2+ signals during LTP induction, but not maintenance. Neuron 94, 800–808 e804 (2017).
Murakoshi, H., Wang, H. & Yasuda, R. Local, persistent activation of Rho GTPases during plasticity of single dendritic spines. Nature 472, 100–104 (2011).
Hedrick, N. G. et al. Rho GTPase complementation underlies BDNF-dependent homo- and heterosynaptic plasticity. Nature 538, 104–108 (2016).
Krucker, T., Siggins, G. R. & Halpain, S. Dynamic actin filaments are required for stable long-term potentiation (LTP) in area CA1 of the hippocampus. Proc. Natl Acad. Sci. USA 97, 6856–6861 (2000).
Okamoto, K., Nagai, T., Miyawaki, A. & Hayashi, Y. Rapid and persistent modulation of actin dynamics regulates postsynaptic reorganization underlying bidirectional plasticity. Nat. Neurosci. 7, 1104–1112 (2004).
Honkura, N., Matsuzaki, M., Noguchi, J., Ellis-Davies, G. C. & Kasai, H. The subspine organization of actin fibers regulates the structure and plasticity of dendritic spines. Neuron 57, 719–729 (2008).
Kim, K. et al. A temporary gating of actin remodeling during synaptic plasticity consists of the interplay between the kinase and structural functions of CaMKII. Neuron 87, 813–826 (2015).
Okabe, S., Urushido, T., Konno, D., Okado, H. & Sobue, K. Rapid redistribution of the postsynaptic density protein PSD-Zip45 (Homer 1c) and its differential regulation by NMDA receptors and calcium channels. J. Neurosci. 21, 9561–9571 (2001).
Gray, N. W., Weimer, R. M., Bureau, I. & Svoboda, K. Rapid redistribution of synaptic PSD-95 in the neocortex in vivo. PLoS Biol. 4, e370 (2006).
Noguchi, J. et al. State-dependent diffusion of actin-depolymerizing factor/cofilin underlies the enlargement and shrinkage of dendritic spines. Sci. Rep. 6, 32897 (2016).
Tsuriel, S. et al. Local sharing as a predominant determinant of synaptic matrix molecular dynamics. PLoS Biol. 4, e271 (2006).
Saneyoshi, T. et al. Reciprocal activation within a kinase-effector complex underlying persistence of structural LTP. Neuron 102, 1199–1210 (2019).
Pellegrin, S. & Mellor, H. Actin stress fibres. J. Cell Sci. 120, 3491–3499 (2007).
Kassianidou, E. & Kumar, S. A biomechanical perspective on stress fiber structure and function. Biochim. Biophys. Acta 1853, 3065–3074 (2015).
Shirao, T. et al. The role of drebrin in neurons. J. Neurochem. 141, 819–834 (2017).
Park, Y. K. & Goda, Y. Integrins in synapse regulation. Nat. Rev. Neurosci. 17, 745–756 (2016).
Bamburg, J. R. & Wiggan, O. P. ADF/cofilin and actin dynamics in disease. Trends Cell Biol. 12, 598–605 (2002).
Rex, C. S. et al. Myosin IIb regulates actin dynamics during synaptic plasticity and memory formation. Neuron 67, 603–617 (2010).
Kim, I. H. et al. Disruption of Arp2/3 results in asymmetric structural plasticity of dendritic spines and progressive synaptic and behavioral abnormalities. J. Neurosci. 33, 6081–6092 (2013).
Hayama, T. et al. GABA promotes the competitive selection of dendritic spines by controlling local Ca2+ signaling. Nat. Neurosci. 16, 1409–1416 (2013).
Bosch, M. et al. Structural and molecular remodeling of dendritic spine substructures during long-term potentiation. Neuron 82, 444–459 (2014).
Yang, G., Pan, F. & Gan, W. B. Stably maintained dendritic spines are associated with lifelong memories. Nature 462, 920–924 (2009).
Yasumatsu, N., Matsuzaki, M., Miyazaki, T., Noguchi, J. & Kasai, H. Principles of long-term dynamics of dendritic spines. J. Neurosci. 28, 13592–13608 (2008).
Noguchi, J. et al. Bidirectional in vivo structural dendritic spine plasticity revealed by two-photon glutamate uncaging in the mouse neocortex. Sci. Rep. 9, 13922 (2019).
Fusi, S., Drew, P. J. & Abbott, L. F. Cascade models of synaptically stored memories. Neuron 45, 599–611 (2005).
Hayashi-Takagi, A. et al. Labelling and optical erasure of synaptic memory traces in the motor cortex. Nature 525, 333–338 (2015).
Oh, W. C., Hill, T. C. & Zito, K. Synapse-specific and size-dependent mechanisms of spine structural plasticity accompanying synaptic weakening. Proc. Natl Acad. Sci. USA 110, E305–E312 (2013).
Wiegert, J. S. & Oertner, T. G. Long-term depression triggers the selective elimination of weakly integrated synapses. Proc. Natl Acad. Sci. USA 110, E4510–E4519 (2013).
Abraham, W. C. & Goddard, G. V. Asymmetric relationships between homosynaptic long-term potentiation and heterosynaptic long-term depression. Nature 305, 717–719 (1983).
Wang, S. S., Khiroug, L. & Augustine, G. J. Quantification of spread of cerebellar long-term depression with chemical two-photon uncaging of glutamate. Proc. Natl Acad. Sci. USA 97, 8635–8640 (2000).
Nishiyama, M., Togashi, K., Aihara, T. & Hong, K. GABAergic activities control spike timing- and frequency-dependent long-term depression at hippocampal excitatory synapses. Front. Synaptic Neurosci. 2, 22 (2010).
Fujii, H. et al. Nonlinear decoding and asymmetric representation of neuronal input information by CaMKIIalpha and calcineurin. Cell Rep. 3, 978–987 (2013).
Zhou, Q., Homma, K. J. & Poo, M. M. Shrinkage of dendritic spines associated with long-term depression of hippocampal synapses. Neuron 44, 749–757 (2004).
Bernstein, B. W. & Bamburg, J. R. ADF/cofilin: a functional node in cell biology. Trends Cell Biol. 20, 187–195 (2010).
Stein, I. S., Park, D. K., Flores, J. C., Jahncke, J. N. & Zito, K. Molecular mechanisms of non-ionotropic NMDA receptor signaling in dendritic spine shrinkage. J. Neurosci. 40, 3741–3750 (2020).
Dore, K. & Malinow, R. Elevated PSD-95 blocks ion-flux independent LTD: a potential new role for PSD-95 in synaptic plasticity. Neuroscience 456, 43–49 (2021).
Ziv, N. E. & Fisher-Lavie, A. Presynaptic and postsynaptic scaffolds: dynamics fast and slow. Neuroscientist 20, 439–452 (2014).
Toyoizumi, T., Pfister, J. P., Aihara, K. & Gerstner, W. Generalized Bienenstock–Cooper–Munro rule for spiking neurons that maximizes information transmission. Proc. Natl Acad. Sci. USA 102, 5239–5244 (2005).
Kusmierz, L., Isomura, T. & Toyoizumi, T. Learning with three factors: modulating Hebbian plasticity with errors. Curr. Opin. Neurobiol. 46, 170–177 (2017).
Whittington, J. C. R. & Bogacz, R. Theories of error back-propagation in the brain. Trends Cognit. Sci. 23, 235–250 (2019).
Mongillo, G., Rumpel, S. & Loewenstein, Y. Inhibitory connectivity defines the realm of excitatory plasticity. Nat. Neurosci. 21, 1463–1470 (2018).
Hensch, T. K. Critical period plasticity in local cortical circuits. Nat. Rev. Neurosci. 6, 877–888 (2005).
Frankle, J. & Carbin, M. The lottery ticket hypothesis: finding sparse, trainable neural networks. arXiv https://arxiv.org/abs/1803.03635 (2019).
Sutton, R., Barto, A. Reinforcement Learning, Second Edition: an Introduction (Bradford Books, 2018).
Thorndike, E. L. Animal Intelligence (Macmillan, 1911).
Schultz, W., Dayan, P. & Montague, P. R. A neural substrate of prediction and reward. Science 275, 1593–1599 (1997).
Reynolds, J. N., Hyland, B. I. & Wickens, J. R. A cellular mechanism of reward-related learning. Nature 413, 67–70 (2001).
Gershman, S. J. & Uchida, N. Believing in dopamine. Nat. Rev. Neurosci. 20, 703–714 (2019).
Soares-Cunha, C., Coimbra, B., Sousa, N. & Rodrigues, A. J. Reappraising striatal D1- and D2-neurons in reward and aversion. Neurosci. Biobehav. Rev. 68, 370–386 (2016).
Luscher, C., Robbins, T. W. & Everitt, B. J. The transition to compulsion in addiction. Nat. Rev. Neurosci. 21, 247–263 (2020).
Marder, E. Neuromodulation of neuronal circuits: back to the future. Neuron 76, 1–11 (2012).
Izhikevich, E. M. Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb. Cortex 17, 2443–2452 (2007).
Shen, W., Flajolet, M., Greengard, P. & Surmeier, D. J. Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321, 848–851 (2008).
Abrams, T. W. & Kandel, E. R. Is contiguity detection in classical conditioning a system or a cellular property? Learning in aplysia suggests a possible molecular site. Trends Neurosci. 11, 128–135 (1988).
Urakubo, H., Yagishita, S., Kasai, H. & Ishii, S. Signaling models for dopamine-dependent temporal contiguity in striatal synaptic plasticity. PLoS Comput. Biol. 16, e1008078 (2020).
He, K. et al. Distinct eligibility traces for LTP and LTD in cortical synapses. Neuron 88, 528–538 (2015).
Ferguson, G. D. & Storm, D. R. Why calcium-stimulated adenylyl cyclases? Physiology 19, 271–276 (2004).
Yamaguchi, K. M. Y. et al. The minimal behavioral time window for reward c 1 onditioning in the nucleus accumbens of mice. Preprint at bioRxiv https://doi.org/10.1101/641365 (2019).
Kapur, S. How antipsychotics become anti-“psychotic”–from dopamine to salience to psychosis. Trends Pharmacol. Sci. 25, 402–406 (2004).
Winton-Brown, T. T., Fusar-Poli, P., Ungless, M. A. & Howes, O. D. Dopaminergic basis of salience dysregulation in psychosis. Trends Neurosci. 37, 85–94 (2014).
Matsumoto, M. & Hikosaka, O. Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459, 837–841 (2009).
Cohen, J. Y., Haesler, S., Vong, L., Lowell, B. B. & Uchida, N. Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature 482, 85–88 (2012).
Gerfen, C. R. & Surmeier, D. J. Modulation of striatal projection systems by dopamine. Annu. Rev. Neurosci. 34, 441–466 (2011).
Kalivas, P. W. Deconstructing and reconstructing the dichotomy that is dopamine receptor-1- and dopamine receptor-2-expressing neurons. Biol. Psychiatry 84, 862–864 (2018).
Iino, Y. et al. Dopamine D2 receptors in discrimination learning and spine enlargement. Nature 579, 555–560 (2020).
Lee, S. J. et al. Cell-type-specific asynchronous modulation of PKA by dopamine in learning. Nature 590, 451–456 (2021).
Waelti, P., Dickinson, A. & Schultz, W. Dopamine responses comply with basic assumptions of formal learning theory. Nature 412, 43–48 (2001).
Nagai, T. et al. Phosphoproteomics of the dopamine pathway enables discovery of Rap1 activation as a reward signal in vivo. Neuron 89, 550–565 (2016).
Mikhael, J. G. & Bogacz, R. Learning reward uncertainty in the basal ganglia. PLoS Comput. Biol. 12, e1005062 (2016).
Fujita, Y., Yagishita, S., Kasai, H. & Ishii, S. Computational characteristics of the striatal dopamine system described by reinforcement learning with fast generalization. Front. Comput. Neurosci. 14, 66 (2020).
Coddington, L. T. & Dudman, J. T. Learning from action: reconsidering movement signaling in midbrain dopamine neuron activity. Neuron 104, 63–77 (2019).
Collins, A. L. & Saunders, B. T. Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking. J. Neurosci. Res. 98, 1046–1069 (2020).
Gerstner, W., Lehmann, M., Liakoni, V., Corneil, D. & Brea, J. Eligibility traces and plasticity on behavioral time scales: experimental support of neoHebbian three-factor learning rules. Front. Neural Circuits 12, 53 (2018).
Mongillo, G., Rumpel, S. & Loewenstein, Y. Intrinsic volatility of synaptic connections — a challenge to the synaptic trace theory of memory. Curr. Opin. Neurobiol. 46, 7–13 (2017).
Ziv, N. E. & Brenner, N. Synaptic tenacity or lack thereof: spontaneous remodeling of synapses. Trends Neurosci. 41, 89–99 (2018).
Cane, M., Maco, B., Knott, G. & Holtmaat, A. The relationship between PSD-95 clustering and spine stability in vivo. J. Neurosci. 34, 2075–2086 (2014).
Minerbi, A. et al. Long-term relationships between synaptic tenacity, synaptic remodeling, and network activity. PLoS Biol. 7, e1000136 (2009).
Hazan, L. & Ziv, N. E. Activity dependent and independent determinants of synaptic size diversity. J. Neurosci. 40, 2828–2848 (2020).
Nagaoka, A. et al. Abnormal intrinsic dynamics of dendritic spines in a fragile X syndrome mouse model in vivo. Sci. Rep. 6, 26651 (2016).
Sigler, A. et al. Formation and maintenance of functional spines in the absence of presynaptic glutamate release. Neuron 94, 304–311 e304 (2017).
Sando, R. et al. Assembly of excitatory synapses in the absence of glutamatergic neurotransmission. Neuron 94, 312–321 e313 (2017).
Robison, A. J. Emerging role of CaMKII in neuropsychiatric disease. Trends Neurosci. 37, 653–662 (2014).
Zeng, H. et al. Forebrain-specific calcineurin knockout selectively impairs bidirectional synaptic plasticity and working/episodic-like memory. Cell 107, 617–629 (2001).
Seaton, G. et al. Dual-component structural plasticity mediated by alphaCaMKII autophosphorylation on basal dendrites of cortical layer 2/3 neurones. J. Neurosci. 40, 2228–2245 (2020).
Okazaki, H. et al. Calcineurin knockout mice show a selective loss of small spines. Neurosci. Lett. 671, 99–102 (2018).
Benavides-Piccione, R., Ballesteros-Yanez, I., DeFelipe, J. & Yuste, R. Cortical area and species differences in dendritic spine morphology. J. Neurocytol. 31, 337–346 (2002).
Montero-Crespo, M. et al. Three-dimensional synaptic organization of the human hippocampal CA1 field. eLife 9, e57013 (2020).
Dvorkin, R. & Ziv, N. E. Relative contributions of specific activity histories and spontaneous processes to size remodeling of glutamatergic synapses. PLoS Biol. 14, e1002572 (2016).
Fischer, M., Kaech, S., Knutti, D. & Matus, A. Rapid actin-based plasticity in dendritic spines. Neuron 20, 847–854 (1998).
Choquet, D. & Triller, A. The dynamic synapse. Neuron 80, 691–703 (2013).
Statman, A., Kaufman, M., Minerbi, A., Ziv, N. E. & Brenner, N. Synaptic size dynamics as an effectively stochastic process. PLoS Comput. Biol. 10, e1003846 (2014).
Shomar, A., Geyrhofer, L., Ziv, N. E. & Brenner, N. Cooperative stochastic binding and unbinding explain synaptic size dynamics and statistics. PLoS Comput. Biol. 13, e1005668 (2017).
Cohen, L. D. & Ziv, N. E. Neuronal and synaptic protein lifetimes. Curr. Opin. Neurobiol. 57, 9–16 (2019).
Vainchtein, I. D. & Molofsky, A. V. Astrocytes and microglia: in sickness and in health. Trends Neurosci. 43, 144–154 (2020).
Rubinski, A. & Ziv, N. E. Remodeling and tenacity of inhibitory synapses: relationships with network activity and neighboring excitatory synapses. PLoS Comput. Biol. 11, e1004632 (2015).
Loewenstein, Y., Kuras, A. & Rumpel, S. Multiplicative dynamics underlie the emergence of the log-normal distribution of spine sizes in the neocortex in vivo. J. Neurosci. 31, 9481–9488 (2011).
Ishii, K. et al. In vivo volume dynamics of dendritic spines in the neocortex of wild-type and Fmr1 KO mice. eNeuro 5, 0282–18 (2018).
Knott, G. W., Holtmaat, A., Wilbrecht, L., Welker, E. & Svoboda, K. Spine growth precedes synapse formation in the adult neocortex in vivo. Nat. Neurosci. 9, 1117–1124 (2006).
Quinn, D. P. et al. The stability of glutamatergic synapses is independent of activity level, but predicted by synapse size. Front. Cell. Neurosci. 13, https://doi.org/10.3389/fncel.2019.00291 (2019).
van Rossum, M. C., Bi, G. Q. & Turrigiano, G. G. Stable Hebbian learning from spike timing-dependent plasticity. J. Neurosci. 20, 8812–8821 (2000).
Kaufman, M., Corner, M. A. & Ziv, N. E. Long-term relationships between cholinergic tone, synchronous bursting and synaptic remodeling. PLoS ONE 7, e40980 (2012).
Matsubara, T. U. K. Homeostatic plasticity achieved by incorporation of random fluctuations and soft-bounded Hebbian plasticity in excitatory synapses. Front. Neurosci. https://doi.org/10.3389/fncir.2016.00042 (2016).
Humble, J., Hiratsuka, K., Kasai, H. & Toyoizumi, T. Intrinsic spine dynamics are critical for recurrent network learning in models with and without autism spectrum disorder. Front. Comput. Neurosci. 13, 38 (2019).
Holtmaat, A. J. et al. Transient and persistent dendritic spines in the neocortex in vivo. Neuron 45, 279–291 (2005).
Loewenstein, Y., Yanover, U. & Rumpel, S. Predicting the dynamics of network connectivity in the neocortex. J. Neurosci. 35, 12535–12544 (2015).
Pfeiffer, T. et al. Chronic 2P-STED imaging reveals high turnover of dendritic spines in the hippocampus in vivo. eLife 7, e34700 (2018).
Berry, K. P. & Nedivi, E. Spine dynamics: are they all the same? Neuron 96, 43–55 (2017).
Attardo, A., Fitzgerald, J. E. & Schnitzer, M. J. Impermanence of dendritic spines in live adult CA1 hippocampus. Nature 523, 592–596 (2015).
Trachtenberg, J. T. et al. Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex. Nature 420, 788–794 (2002).
Xu, T. et al. Rapid formation and selective stabilization of synapses for enduring motor memories. Nature 462, 915–919 (2009).
Yang, G. et al. Sleep promotes branch-specific formation of dendritic spines after learning. Science 344, 1173–1178 (2014).
Yang, S., Santos, M. D., Tang, C. M., Kim, J. G. & Yang, S. A postsynaptic role for short-term neuronal facilitation in dendritic spines. Front. Cell. Neurosci. 10, 224 (2016).
Fiala, J. C., Feinberg, M., Popov, V. & Harris, K. M. Synaptogenesis via dendritic filopodia in developing hippocampal area CA1. J. Neurosci. 18, 8900–8911 (1998).
Konur, S. & Yuste, R. Imaging the motility of dendritic protrusions and axon terminals: roles in axon sampling and synaptic competition. Mol. Cell. Neurosci. 27, 427–440 (2004).
Zito, K., Scheuss, V., Knott, G., Hill, T. & Svoboda, K. Rapid functional maturation of nascent dendritic spines. Neuron 61, 247–258 (2009).
Ziv, N. E. & Smith, S. J. Evidence for a role of dendritic filopodia in synaptogenesis and spine formation. Neuron 17, 91–102 (1996).
Mishchenko, Y. et al. Ultrastructural analysis of hippocampal neuropil from the connectomics perspective. Neuron 67, 1009–1020 (2010).
Stepanyants, A., Hof, P. R. & Chklovskii, D. B. Geometry and structural plasticity of synaptic connectivity. Neuron 34, 275–288 (2002).
Shepherd, G. M., Stepanyants, A., Bureau, I., Chklovskii, D. & Svoboda, K. Geometric and functional organization of cortical circuits. Nat. Neurosci. 8, 782–790 (2005).
Kaiser, M., Hilgetag, C. C. & van Ooyen, A. A simple rule for axon outgrowth and synaptic competition generates realistic connection lengths and filling fractions. Cereb. Cortex 19, 3001–3010 (2009).
Matsumoto-Miyai, K. et al. Coincident pre- and postsynaptic activation induces dendritic filopodia via neurotrypsin-dependent agrin cleavage. Cell 136, 1161–1171 (2009).
Andreae, L. C. & Burrone, J. The role of neuronal activity and transmitter release on synapse formation. Curr. Opin. Neurobiol. 27, 47–52 (2014).
Srivastava, D. P. et al. Rapid enhancement of two-step wiring plasticity by estrogen and NMDA receptor activity. Proc. Natl Acad. Sci. USA 105, 14650–14655 (2008).
Liston, C. & Gan, W. B. Glucocorticoids are critical regulators of dendritic spine development and plasticity in vivo. Proc. Natl Acad. Sci. USA 108, 16074–16079 (2011).
Liston, C. et al. Circadian glucocorticoid oscillations promote learning-dependent synapse formation and maintenance. Nat. Neurosci. 16, 698–705 (2013).
Murakami, G. et al. Rapid nongenomic modulation by neurosteroids of dendritic spines in the hippocampus: androgen, oestrogen and corticosteroid. J. Neuroendocrinol. 30, e12561 (2018).
Moda-Sava, R. N. et al. Sustained rescue of prefrontal circuit dysfunction by antidepressant-induced spine formation. Science 364, eaat8078 (2019).
Schatzle, P. et al. Rapid and reversible formation of spine head filopodia in response to muscarinic receptor activation in CA1 pyramidal cells. J. Physiol. 589, 4353–4364 (2011).
Walker, C. K. & Herskowitz, J. H. Dendritic spines: mediators of cognitive resilience in aging and Alzheimer’s disease. Neuroscientist https://doi.org/10.1177/1073858420945964 (2020).
Wixted, J. T. The psychology and neuroscience of forgetting. Annu. Rev. Psychol. 55, 235–269 (2004).
Ebbinghaus, H. Uber das Gedachtnis (Dunker & Humbolt, 1885).
Bourne, J. & Harris, K. M. Do thin spines learn to be mushroom spines that remember? Curr. Opin. Neurobiol. 17, 381–386 (2007).
Hung, A. Y. et al. Smaller dendritic spines, weaker synaptic transmission, but enhanced spatial learning in mice lacking Shank1. J. Neurosci. 28, 1697–1708 (2008).
Purpura, D. P. Dendritic spine “dysgenesis” and mental retardation. Science 186, 1126–1128 (1974).
MacDonald, M. L. et al. Selective loss of smaller spines in schizophrenia. Am. J. Psychiatry 174, 586–594 (2017).
McKinney, B. C. et al. Density of small dendritic spines and microtubule-associated-protein-2 immunoreactivity in the primary auditory cortex of subjects with schizophrenia. Neuropsychopharmacology 44, 1055–1061 (2019).
Young, M. E., Ohm, D. T., Dumitriu, D., Rapp, P. R. & Morrison, J. H. Differential effects of aging on dendritic spines in visual cortex and prefrontal cortex of the rhesus monkey. Neuroscience 274, 33–43 (2014).
Fauth, M., Worgotter, F. & Tetzlaff, C. Formation and maintenance of robust long-term information storage in the presence of synaptic turnover. PLoS Comput. Biol. 11, e1004684 (2015).
Deger, M., Seeholzer, A. & Gerstner, W. Multicontact co-operativity in spike-timing-dependent structural plasticity stabilizes networks. Cereb. Cortex 28, 1396–1415 (2018).
Branco, T. & Staras, K. The probability of neurotransmitter release: variability and feedback control at single synapses. Nat. Rev. Neurosci. 10, 373–383 (2009).
Kasthuri, N. et al. Saturated reconstruction of a volume of neocortex. Cell 162, 648–661 (2015).
Bartol, T. M. et al. Nanoconnectomic upper bound on the variability of synaptic plasticity. eLife 4, e10778 (2015).
Bloss, E. B. et al. Single excitatory axons form clustered synapses onto CA1 pyramidal cell dendrites. Nat. Neurosci. 21, 353–363 (2018).
Dorkenwald, S. T. et al. Binary and analog variation of synapses between cortical pyramidal neurons. Preprint at bioRxiv https://doi.org/10.1101/2019.12.29.890319 (2019).
Motta, A. et al. Dense connectomic reconstruction in layer 4 of the somatosensory cortex. Science 366, aay3134 (2019).
Lee, K. J. et al. Motor skill training induces coordinated strengthening and weakening between neighboring synapses. J. Neurosci. 33, 9794–9799 (2013).
Yang, Y. et al. Selective synaptic remodeling of amygdalocortical connections associated with fear memory. Nat. Neurosci. 19, 1348–1355 (2016).
Choi, J. H. et al. Interregional synaptic maps among engram cells underlie memory formation. Science 360, 430–435 (2018).
Scholl, B., Thomas, C. I., Ryan, M. A., Kamasawa, N. & Fitzpatrick, D. Cortical response selectivity derives from strength in numbers of synapses. Nature 590, 111–114 (2021).
Ikegaya, Y. et al. Interpyramid spike transmission stabilizes the sparseness of recurrent network activity. Cereb. Cortex 23, 293–304 (2013).
Chen, W., Hobbs, J. P., Tang, A. & Beggs, J. M. A few strong connections: optimizing information retention in neuronal avalanches. BMC Neurosci. 11, 3 (2010).
Kusmierz, L., Ogawa, S. & Toyoizumi, T. Edge of chaos and avalanches in neural networks with heavy-tailed synaptic weight distribution. Phys. Rev. Lett. 125, 028101 (2020).
Cossell, L. et al. Functional organization of excitatory synaptic strength in primary visual cortex. Nature 518, 399–403 (2015).
Keck, T. et al. Integrating Hebbian and homeostatic plasticity: the current state of the field and future research directions. Philos. Trans. R. Soc. Lond. B Biol. Sci. 372, https://doi.org/10.1098/rstb.2016.0158 (2017).
Shimizu, G., Yoshida, K., Kasai, H. & Toyoizumi, T. Computational roles of intrinsic synaptic dynamics. Preprint at bioRxiv https://doi.org/10.1101/2021.04.22.441034 (2021).
Spano, G. M. et al. Sleep deprivation by exposure to novel objects increases synapse density and axon-spine interface in the hippocampal CA1 region of adolescent mice. J. Neurosci. 39, 6613–6625 (2019).
Petersen, C. C., Malenka, R. C., Nicoll, R. A. & Hopfield, J. J. All-or-none potentiation at CA3-CA1 synapses. Proc. Natl Acad. Sci. USA 95, 4732–4737 (1998).
Courbariaux, M. H., Hubara, I., Soudry, D., El-Yaniv, R. & Bengio, Y. Binarized neural networks: training deep neural networks with weights and activations constrained to +1 or -1. arXiv https://arxiv.org/abs/1602.02830 (2016).
Bottou, L. Large-scale machine learning with stochastic gradient descent. in Proceedings of COMPSTAT’2010 (eds Lechevallier, Y., & Saporta, G.) 177-186 (Physica-Verlag, 2010).
Ge, R., Huang, F., Jin, C. & Yuan, Y. Escaping from saddle points – online stochastic gradient for tensor decomposition. JMLR:WCP 40, 1–46 (2015).
Wan, L., Zeiler, M., Zhang, S., LeCun, Y. & Fergus, R. Regularization of neural networks using DropConnect. JMLR:WCP 28, 1058–1066 (2013).
HaoChen, J. Z., Wei, C., Lee, J. & Ma, T. Shape matters: understanding the implicit bias of the noise covariance. arXiv https://arxiv.org/abs/2006.08680 (2020).
Kappel, D., Habenschuss, S., Legenstein, R. & Maass, W. Network plasticity as Bayesian inference. PLoS Comput. Biol. 11, e1004485 (2015).
Kappel, D., Legenstein, R., Habenschuss, S., Hsieh, M. & Maass, W. A dynamic connectome supports the emergence of stable computational function of neural circuits through reward-based learning. eNeuro https://doi.org/10.1523/ENEURO.0301-17.2018 (2018).
French, R. M. Catastrophic forgetting in connectionist networks. Trends Cognit. Sci. 3, 128–135 (1999).
Kirkpatrick, J. et al. Overcoming catastrophic forgetting in neural networks. Proc. Natl Acad. Sci. USA 114, 3521–3526 (2017).
Zenke, F., Poode, B. & Ganguli, S. Continual learning through synaptic intelligence. International Conference on Machine Learning https://arxiv.org/abs/1703.04200 (2017).
Bellec, G., Kappel, D., Maass, W. & Legenstein, R. Deep rewiring: training very sparse deep networks. ICLR https://arxiv.org/abs/1711.05136 (2018).
Ding, X. D. G., Zhou, X., Guo, Y., Han, J. & Liu, J. Global sparse momentum SGD for pruning very deep neural networks. NIPS 32, 8867 (2019).
Esser, S. K. et al. Convolutional networks for fast, energy-efficient neuromorphic computing. Proc. Natl Acad. Sci. USA 113, 11441–11446 (2016).
Cao, Y., Chen, Y. & Khosla, D. Spiking deep convolutional neural networks for energy-efficient object recognition. Int. J. Computer Vis. 113, 54–66 (2014).
Holtmaat, A., Wilbrecht, L., Knott, G. W., Welker, E. & Svoboda, K. Experience-dependent and cell-type-specific spine growth in the neocortex. Nature 441, 979–983 (2006).
de Vivo, L. et al. Ultrastructural evidence for synaptic scaling across the wake/sleep cycle. Science 355, 507–510 (2017).
Owen, M. J., Sawa, A. & Mortensen, P. B. Schizophrenia. Lancet 388, 86–97 (2016).
Collins, A. G., Brown, J. K., Gold, J. M., Waltz, J. A. & Frank, M. J. Working memory contributions to reinforcement learning impairments in schizophrenia. J. Neurosci. 34, 13747–13756 (2014).
Hayashi-Takagi, A. et al. PAKs inhibitors ameliorate schizophrenia-associated dendritic spine deterioration in vitro and in vivo during late adolescence. Proc. Natl Acad. Sci. USA 111, 6461–6466 (2014).
Miyakawa, T. et al. Conditional calcineurin knockout mice exhibit multiple abnormal behaviors related to schizophrenia. Proc. Natl Acad. Sci. USA 100, 8987–8992 (2003).
McCutcheon, R. A., Abi-Dargham, A. & Howes, O. D. Schizophrenia, dopamine and the striatum: from biology to symptoms. Trends Neurosci. 42, 205–220 (2019).
Lin, Y. C., Frei, J. A., Kilander, M. B., Shen, W. & Blatt, G. J. A subset of autism-associated genes regulate the structural stability of neurons. Front. Cell. Neurosci. 10, 263 (2016).
Pan, F., Aldridge, G. M., Greenough, W. T. & Gan, W. B. Dendritic spine instability and insensitivity to modulation by sensory experience in a mouse model of fragile X syndrome. Proc. Natl Acad. Sci. USA 107, 17768–17773 (2010).
Jiang, M. et al. Dendritic arborization and spine dynamics are abnormal in the mouse model of MECP2 duplication syndrome. J. Neurosci. 33, 19518–19533 (2013).
Isshiki, M. et al. Enhanced synapse remodelling as a common phenotype in mouse models of autism. Nat. Commun. 5, 4742 (2014).
Zeidan, A. & Ziv, N. E. Neuroligin-1 loss is associated with reduced tenacity of excitatory synapses. PLoS ONE 7, e42314 (2012).
Padmashri, R., Reiner, B. C., Suresh, A., Spartz, E. & Dunaevsky, A. Altered structural and functional synaptic plasticity with motor skill learning in a mouse model of fragile X syndrome. J. Neurosci. 33, 19715–19723 (2013).
Kasai, H., Fukuda, M., Watanabe, S., Hayashi-Takagi, A. & Noguchi, J. Structural dynamics of dendritic spines in memory and cognition. Trends Neurosci. 33, 121–129 (2010).
Adam, D. Mental health: on the spectrum. Nature 496, 416–418 (2013).
Gamache, T. R., Araki, Y. & Huganir, R. L. Twenty years of SynGAP research: from synapses to cognition. J. Neurosci. 40, 1596–1605 (2020).
Cohen, S. M. et al. Excitation-transcription coupling in parvalbumin-positive interneurons employs a novel CaM kinase-dependent pathway distinct from excitatory neurons. Neuron 90, 292–307 (2016).
Tuckwell, H. C. Introduction to Theoretical Neurobiology, vol. 2 (Cambridge University Press, 1988).
Acknowledgements
The authors thank D. Soudry, N. Brenner, R. Meir, O. Barak, Y. Loewenstein, S. Rumpel, S. Ishii and S. Koike for helpful discussions. This work was supported by Grants-in-Aid (20H05685 and 26221001 to H.K., JP18H05432 to T.T. and 19K16249, 16H06395, 16H06396 461 and 16K21720 to S.Y.) from the Japan Society for the Promotion of Science; the World Premier International Research Center Initiative from the Japan Ministry of Education, Culture, Sports, Science and Technology (MEXT); Core Research for Evolutional Science and Technology (JPMJCR1652 to H.K.) from the Japan Science and Technology Agency; the Strategic Research Program for Brain Sciences (JP20dm0107120 to H.K.); Brain Mapping by Integrated Neurotechnologies for Disease Studies (Brain/MINDS) (21dm0207069h0001 to S.Y. and JP21dm0207001 to TT) from the Japan Agency for Medical Research and Development; and the Israel Science Foundation (1470/18) and the State of Lower-Saxony and the Volkswagen Foundation (N.E.Z).
Author information
Authors and Affiliations
Contributions
All authors researched data for the article, contributed substantially to discussions concerning its contents and reviewed and/or edited the manuscript before submission. H.K., N.E.Z. and T.T. wrote the article.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Peer review information
Nature Reviews Neuroscience thanks A. Kirkwood and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Glossary
- Spike timing-dependent plasticity
-
(STDP). Adjustments of connection strengths based on the relative timing of the output of a particular neuron and input spikes.
- Filopodia
-
Thin transient protrusions that act as ‘feelers’ that allow cells to probe their surrounding environment. Can occasionally give rise to dendritic spines.
- Integrins
-
Transmembrane molecules that facilitate cell–cell and cell–extracellular matrix adhesion by connecting stress fibres and other intracellular actin structures to the extracellular matrix.
- Metaplasticity
-
The plasticity of synaptic plasticity.
- Nanodomains
-
The cytosolic domains within about 10 nm of the open pore of Ca2+ channels or NMDA receptors where Ca2+ concentrations can readily exceed 10 μM.
- Shunting inhibition
-
A predominant form of GABAergic inhibition that depends on increases in the membrane conductance but not necessarily on hyperpolarization.
- Critical periods
-
Periods during development in which a particular skill or characteristic is believed to be most readily acquired.
- Operant conditioning
-
A form of learning that uses rewards and punishments for enforcing behaviour. Sometimes called ‘instrumental conditioning’.
- Eligibility trace
-
A temporary record of the occurrence of an event which marks the memory parameters associated with the event as eligible for undergoing learning changes.
- Salience
-
The quality of being particularly noticeable or important.
- Drift
-
The averaged change of a parameter in a certain period. In the general case, the drift, μ(w), is dependent on the current value of the parameter w.
- Diffusion
-
The standard deviation of a parameter in a certain period. In the general case, the diffusion, σ(w), is dependent on the current value of the parameter w.
- Bit
-
A binary digit. The smallest unit of measurement used to quantify computer data.
- Working memories
-
Information stored in an accessible state for use in complex mental tasks.
- Brownian motion
-
Random movement of microscopic particles suspended in liquids resulting from the effect of molecules of the surrounding medium.
- Ornstein–Uhlenbeck process
-
A type of stochastic process whose stationary distribution is normal (Gaussian).
- Black–Scholes model
-
The most popular stochastic differential equation in financial economics to estimate the changing value of an option over time.
- Gradient descent
-
An optimization algorithm for finding a local minimum of a differentiable function.
- Overfitting
-
The fitting that corresponds too closely to a particular set of data, and may therefore fail to fit additional data or predict future observations reliably.
- Search space
-
The space of all feasible solutions, among which the desired solution resides.
- Bayesian network inference
-
Use of a Bayesian network to estimate the probability that a hypothesis is true based on evidence.
- Initialization
-
The assignment of initial values to parameters, such as synaptic weights in the context of artificial neural networks.
Rights and permissions
About this article
Cite this article
Kasai, H., Ziv, N.E., Okazaki, H. et al. Spine dynamics in the brain, mental disorders and artificial neural networks. Nat Rev Neurosci 22, 407–422 (2021). https://doi.org/10.1038/s41583-021-00467-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41583-021-00467-3
This article is cited by
-
Serotonin modulates excitatory synapse maturation in the developing prefrontal cortex
Nature Communications (2024)
-
Identification of a psychiatric risk gene NISCH at 3p21.1 GWAS locus mediating dendritic spine morphogenesis and cognitive function
BMC Medicine (2023)
-
Regulation of dendritic spine length in corticopontine layer V pyramidal neurons by autism risk gene β3 integrin
Molecular Brain (2023)
-
Quantifying postsynaptic receptor dynamics: insights into synaptic function
Nature Reviews Neuroscience (2023)
-
Information encoded in volumes and areas of dendritic spines is nearly maximal across mammalian brains
Scientific Reports (2023)