Kinou is an adverb adverbs of time like yesterday, today etc do not usually take particles. And when they do it's because it has become the topic/subject of the sentence. In this instance the subject is 'I' and there is no topic (topics aren't always necessary).
No, 違いますね。 You use ”は” here to compare with other time ( the day before yesterday or after tomorrow etc.)
Also, you need to stress it a little when you say the entire sentence.
You can also omit it.
PS: Follow me if you want to improve your Chinese!