If 'clothes' is plural why 'pakaian-pakaianmu' is not accepted?
It's a plural in English.
Plural in English doesn't always indicate a plural in another language. But something to take note of.
Remember translation is not word for word. Its concept by concept.
I would have thought 'Pakaianmu tidak cocok' would be the answer
Pakaianmu tidak pantas.