Okay, you're right. I do think he denies white privilege elsewhere ("Is my skin finally working to my benefit now?"), but that is also a really key lyric, and I should have remembered it.