Why is "Vůbec jsem neznal ji." wrong? does ji also have to be in the 2nd position for some reason? Or is it the good-old classic that it just sounds weird? :)
Ji is an inconstant clitic, it can also appear in the strong position when stressed. It does sound quite strange to stress it here and making it the focus. Starting the sentence with "ji" sounds much better.