I think that's the pattern I was looking for. It's kind of like phrases like this more so count the hours than they do just state the time. Like a shorthand and to the point way of saying "the hour, it goes to one" and "the hours they go to eleven".
I'd guess it's like here in Sweden: we officially use the 24-hour clock, but in casual conversation we usually say "eight in the morning", "ten o'clock tonight", etc. The 24-hour system is mostly used in writing, on computers and the like.