But the saying whose your daddy, is actually insulting because it is saying you don't know who your dad was. I realised this as me and my friend were watching a movie together, and one of the kids insults some other kid. We both look at each other and go, holy shit.