It's optional same as "that" in English. Do you think (that) they are there? Ви думаєте, (що) вони там?
The problem was that the English sentence had two defaults, with and without "that", while the Ukrainian one has only one default, with що. Fixed it, thanks :)