If koupelna is feminine, why don't we use ta or tahle?
If you use "ta/tahle" you create a different sentence Ta koupelna není čistá - The/This bathroom is not clean.