That sentence has a different meaning. One says "not know", the other one says "not workers". The two are not the same in English, either. The word "nem" negates what comes after it. If you put it in front of "Te", it would become "Is it not you who knows workers?":
"Nem te ismersz munkásokat?"