Safe to assume that if I'm talking to a native Hebrew speaker, we're using Celsius?
Two reasons I can think of. First, מעלות is in a plural form. Second, in English "zero" and its synonyms always ends up taking the plural form -- zero degrees, no cats, etc. "Zero degree" just doesn't fit right in English.
It definitely is. And being a strange mixture of several different languages certainly doesn't help.