"A cat drinks milk."
Yes, but not always. Un chat = male cat. Une chatte = female cat. Same with chien/chienne, renard/renarde. However some animals just are. Like un cheval regardless of sex (but there are less common terms for specific sexes, horses included...go looking for them if you want, but outside of specific circles a horse is a horse).