"Let's not look at him any more."
Translation:Už se na něho nedívejme.
The main new point of the sentence comes last. If you are making the point that we should NOT look at him, you put the verb last. If the not looking is already within the discussed context, but you are making the point that it is HIM we should not look at, you would use your order. Sometimes this is possible to say with the same English sentence in a particular stress, often you rather have to you use the indirect sentence (It is .., whom...) in English.