YTMND

 You know how calling another man a bitch or a punk comes from prison culture, and how those terms had much more specific meanings in their orignal contexts?  I wonder if "who's the man?" also originated in prison.