Translation:I hand over the gems to you.
"I hand the gems to you" should be accepted.
Yeah, there's a lot of places they keep insisting on the clunkyass "hand over to you".. Just keep reporting.
So should "I hand you (the) gems"
"Give" seems to be the appropriate word here.