The ability of the environment to shape cortical function is at its highest during critical periods of postnatal development. In the visual cortex, critical period onset is triggered by the maturation of parvalbumin inhibitory interneurons, which gradually become surrounded by a specialized glycosaminoglycan-rich extracellular matrix: the perineuronal nets. Among the identified factors regulating cortical plasticity in the visual cortex, extracortical homeoprotein Otx2 is transferred specifically into parvalbumin interneurons and this transfer regulates both the onset and the closure of the critical period of plasticity for binocular vision. Here, we review the interaction between the complex sugars of the perineuronal nets and homeoprotein Otx2 and how this interaction regulates cortical plasticity during critical period and in adulthood.