Is the sentence 下去很容易 (going down is easy) gramatically correct ?
Yes, it is.
shouldn't 下去走很容易 also be acceptable?
What does this even mean?
This means that the physical process of walking from a higher place to a lower place is easy (for example, walking down a hill.)