"I have not been to that Chinese restaurant."
Your suggestion sounds like an informal spoken form that although Chinese speakers can understand what you say, but I don't recommend you to write that when you want to learn the more normal grammatically correct written Chinese(native speaker here). You may find it in fictions, but then the sentence functions differently.
I mean it's better to start learning with the basic grammar structure of Chinese, where the sentence begin with the subject. And since the English sentence starts with 'I', so 'I' is the subject here. Your suggestion is correct by itself with its meaning but can be problematic as a translation in this example. The subject is the subject OF THE SENTENCE, in your sentence the Chinese restaurant became the subject and the stressing point. Hope this answers you. I can't see here when did you ask this question.