Translation:Let's go and have lunch together!
The meaning in English is still different though. Often, "together" is implied by context, but not always. It should be similar in Chinese.
If, at the end of a late shift at work, your manager says "Home time! Let's go get some dinner." you probably wouldn't interpret it as an invitation to join him.