Right!

It’s a short for «Віта́ю з Нови́м Ро́ком» ‘I congratulate [you] upon the New Year’. English ‘congratulate’ requires ‘upon’, while Ukrainian «віта́ю» requires «з». It’s not the usual meaning of «з», it’s just the preposition used in this construction.