The implication is that you're not supposed to be or that you're not allowed to when you can and don't need to ask for permission. It's an ugly statement designed to be matter-of-fact, but meant to impugn.

Perhaps I'm showing my bias here, but I hate when people say stuff like that because it is solely hurtful and not constructive.