That depends whether you are a biologist/medic or not. The reason 'bacteria' has come into common English usage and 'bacterium' has not is because we mostly need to refer to more than one. However, in Romanian, 'bacteria' refers to just one:

Bacterie - bacterium (singular)

Bacteria - the bacterium

Bacterii - bacteria (plural)

Bacteriile - the bacteria