Lipids are prominent components of the nervous system. Here we performed a large-scale mass spectrometry-based analysis of the lipid composition of three brain regions as well as kidney and skeletal muscle of humans, chimpanzees, rhesus macaques, and mice. The human brain shows the most distinct lipid composition: 76% of 5,713 lipid compounds examined in our study are either enriched or depleted in the human brain. Concentration levels of lipids enriched in the brain evolve approximately four times faster among primates compared with lipids characteristic of non-neural tissues and show further acceleration of change in human neocortical regions but not in the cerebellum. Human-specific concentration changes are supported by human-specific expression changes for corresponding enzymes. These results provide the first insights into the role of lipids in human brain evolution.