"Is it fast?"
They're not. Very similar, but it's a difference of a couple lines. 速 vs 遠, you can see the difference once you look closely. I did feel similar to you when I saw them though XD The way I just decided to memorize the difference is to think of the fewer-strokes one as being written "faster" since it means "fast".