It does make sense, it just isn't said often. Remove each of the objects of the sentence independently - it still makes sense: - "They meet him." - "They meet the man." It sounds odd, but really isn't.
Also, if you get weird looks for saying things like that, then it is those people who don't understand english.