"We went to this school."

I am sorry I have to write here to let a mod know that this sentence appeared in the first skill of the verbs and I am not that far into the tree to have any knowledge about the past tense. Unfortunately, the report button doesn't allow me to report this.

Why is it ушли and not шли? I thought the у denoted departure from the location.