Experiments in animals leave no doubt that androgens, including testosterone, produced by the testes in fetal and/or neonatal life act on the brain to induce sex differences in neural structure and function. In this article, we argue that prenatal and neonatal testosterone exposure are strong candidates for having a causal role in sexual dimorphism in human behaviour, including social development.