"I seldom see sportsmen here."
Translation:Ritkán látok itt sportolókat.
yes, I think you can basically put the word "itt" anywhere in this sentence as long as you don't put it between 'ritkán" and "látok". In your sentence it suggests that there is an emphasis on the word "itt", meaning that you do see sprotsmen in other places though, but here not really. It could also be "Ritkán látok sportolókat itt."