What is Beta ??
It's a term meant to indicate a phase of testing. An early phase of testing is known as alpha, the one following that is called beta testing.
Here it means that the support for the French language on Duolingo is not quite finished yet, but you can give it a try before it's 100% complete.