Yes, English uses funny idioms here. UK English would use "Houses (pl) of Parliament", or just "Parliament" for short, as would Australian English to refer to the physical structure. US English uses "Congress". The wording "Building of Parliament" would mean the actual constructing of the building, not the building itself. Building in this usage is a gerund.