Кафе is indeclinable, so all its forms (all the cases, both in plural and singular) are the same. This happens with foreign words sometimes.
Theoretically you could say «Мой дом располо́жен бли́зко к кафе́», but this is not the phrase I would use. «Во́зле кафе» sounds better. But I can't explain why, though, sorry!
Is «возле» a preposition that requires genetive? And is «кафе» a foreign word so it should not be declined?