I don't thing it is wrong for an imperative to be preceded by the pronoun in English, but it is uncommon and it gives the wrong idea here, it seems too much like a habitual indeed. Plus the answer without the pronoun should also be accepted.
Hey you! Work with Neha! It seems the only reason you would say "you" is to get the attention of the person. Or if a person is delegating responsibilities he could say : Peter, you work with Neha. And John, you work with Anna.