Because đó, đây, and kia all go after the subject you are referring to. Kind of like an adjective. Right? a big house is nhà lớn not lớn nhà.
instead of thinking "that book, or this book" think "the book there, or the book here" I find it easier to remember that way.