Why is it not látom if we have the objects ? If I say látom, would it still be correct?
No, látom is not correct here.
Objects alone are not enough to demand the definite conjugation.
It has to be a definite object - something marked with the definite article (or a few other things like personal names).
Ablakokat vagy asztalokat látok? - Do I see windows or tables?
Az ablakokat vagy az asztalokat látom? - Do I see the windows or the tables? Some specific, definite windows and tables are referred to; we use the definite conjugation.
Is there a distinction between "see" and "look at?" I entered "Am I looking at windows or tables" and was counted wrong