why singular here?
In Czech you count 2, 3 and 4 as individuals using plural.
5 and more are considered a group (one group, to be precise) and therefore singular is used when referring to them.
Can I use "athletes" for "hráčů"?
It is not currently accepted. It is more like "sportovec" and in track and field also "atlet".