"Did you never speak to my sister?" and "Have you never talked to my sister?" are both more likely ways of putting the question than just putting a question mark at the end of a statement. (Using a voice inflection in speech). "You never spoke to my sister?" carries a hint of disbelief or surprise - to my ears anyway. This may be different West of the Atlantic.
"Didn't you ever talk to my sister?" was wrong - am I forgetting my English???