Could you say: Nia familio semajne iras al restoracio
Sure, Duo may not like it, but I think most Esperantists would understand it well enough.
ĉiu semajno?
Mi nur revenis el ĉien