Ha doesn't equal have in all cases. Å ha is the infinitive, and har is present tense for all persons. Verbs don't usually inflect based on word gender.
ha - infinitive or imperative
har - present tense
hadde - past tense
And that's all you have to remember :)