It's not just a colloquial set phrase! Something can smart or be smarting, although you're more likely to see it written than spoken. he set off, still smarting from the blow, and tried to focus. You can also smart for a hurtful thing someone said. Generally it is used more for external sharp pain (like a slap) rather than internal aching.