I'm afraid there are two reasons this wouldn't work:
They (plural) must be bosses, not boss.
We don't use "of" with personal pronouns, but a possessive instead:
My boss NOT The boss of me
Their bosses NOT The bosses of them
November 22, 2015