You can tell from the -en ending if you know the grammatical gender of the word.
Ett-words take -en in definite plural
En-words take -en in definite singular.
Since barn (and thus barnbarn too) is an ett-word, we can tell from the -en that this refers to several children.
It's a bit tricky, but that's the way it is.