Previous studies suggest organizing effects of sex hormones on brain structure during early life and puberty, yet little is known about the adult period. The aim of the present study was to elucidate the role of 17beta-estradiol, progesterone, and testosterone on cortical sex differences in grey matter volume (GM) of the adult human brain. To assess sexual dimorphism, voxel-based morphometry (VBM) was applied on structural magnetic resonance images of 34 healthy, young adult humans (17 women, 17 men, 26.6+/-5 years) using analyses of covariance. Subsequently, circulating levels of sex hormones were associated with regional GM using linear regression analyses. After adjustment for sex and total GM, significant associations of regional GM and 17beta-estradiol were observed in the left inferior frontal gyrus (beta=0.39, p=0.02). Regional GM was inversely associated with testosterone in the left inferior frontal gyrus (beta=-0.16, p=0.04), and with progesterone in the right temporal pole (beta=-0.39, p=0.008). Our findings indicate that even in young adulthood, sex hormones exert organizing effects on regional GM. This might help to shed further light on the underlying mechanisms of both functional diversities and congruence between female and male brains.