I think your key word here is context and pragmatics. Verbal forms may not have one single translation. By your comment of "muddying" it with the conditional is similar to saying the past progressive translations muddy past tense translations as they, too, would fit here in "certain contexts".
I see what is trying to be taught and it might be used often in Romanian. But, to my ear, a translation with "used to" and "rarely" is dissonant. And, I would wager that if you were to survey corpora, you would not likely find them together in the same clause.