Yes they do! If there's one thing they can never eat, it's cheese
I find these kind of constructions a bit misleading. It's not clear if the phrase is about a particular mouse (this mouse) or a general phrase on mouse diet. If it's general, then the english translation would be 'Mice don't eat apples', even if in Russian (or other languages) you might express the same idea in singular.