Pain is a conscious experience, crucial for survival. To investigate the neural basis of pain perception in humans, a large number of investigators apply noxious stimuli to the body of volunteers while sampling brain activity using different functional neuroimaging techniques. These responses have been shown to originate from an extensive network of brain regions, which has been christened the Pain Matrix and is often considered to represent a unique cerebral signature for pain perception. As a consequence, the Pain Matrix is often used to understand the neural mechanisms of pain in health and disease. Because the interpretation of a great number of experimental studies relies on the assumption that the brain responses elicited by nociceptive stimuli reflect the activity of a cortical network that is at least partially specific for pain, it appears crucial to ascertain whether this notion is supported by unequivocal experimental evidence. Here, we will review the original concept of the "Neuromatrix" as it was initially proposed by Melzack and its subsequent transformation into a pain-specific matrix. Through a critical discussion of the evidence in favor and against this concept of pain specificity, we show that the fraction of the neuronal activity measured using currently available macroscopic functional neuroimaging techniques (e.g., EEG, MEG, fMRI, PET) in response to transient nociceptive stimulation is likely to be largely unspecific for nociception.