“Taller” applies to people, “higher” applies to things.
I am a native English speaker in NZ. Trees are definitely tall. Superman leaps tall buildings in a single bound. See also Wikipedia's list of the world's tallest buildings and its list of the tallest trees.