we begin to learn should be acceptable. not sure why not
"We begin learning Esperanto" is accepted now.
I think "We begin to learn ..." is accepted also.
Finally, after all of these lessons.
so there is a big difference beween beginning to learn and starting to learn! how about commencing to learn or begin learning?