Yes, why not. Search for "exeo", 1. singular of "exire":
There you will find the translation "leave" too.
I would agree that "often" is a synonym in English of "usually"; so that, if "usually" is accepted (turning the verb, soleo, "I am accustomed" into an adverb, "usually"), then "often" ought to be accepted, too.
It may take some time for moderators to do so, if they agree.
I agree with you.
In fact, there was a time (even before my time, though; but I've read about it) when the Latin teacher was likely to refuse to accept a translation that employed a derivative: so, he or she wouldn't want you to say "exit" when you see exīre .
In part, as you say, to avoid 'jargony' English.