I'm not a native speaker, but बजे here is an adverb; so it doesn't decline, it's not a plural of 'बजा' (which is an inflection of the verb). For it to be a verb here you'd have to rephrase it to be something like 'I come home when it is [hitting] half past two': '... बज रहा है'।