Technically those don't end with -z, because -rz is one sound and so is -sz ;) + ż is also a different thing. But I guess you're on the right track...
I think that words ending with palatalized letters (-ń, -ź, -ś, etc.), especially if they describe abstract notions, are also often feminine.