Should be "my curtains are blue"
'curtains' should be accepted here, people usually have 'curtains' rather than a 'curtain'
It is very unusual to refer to a singular curtain. Curtains are almost invariably used in pairs (or more).
I believe this statement should be "My curtains are blue."
Why is "My curtain's blue" wrong?