Could this be a bequest or part of a will as in 'I will leave my books TO you'? (At times, 'com' is translated in this way.)
No, "i will leave my books to you" would be "(eu) deixarei meus livros para você".
"I will leave you with my books" should also be an accepted answer.
Why isn't it "contigo" instead of "com você"?
Both options are correct.