I'm not sure why, but in this example I think "little by little" is better.
It might be because it seems more appropriate with a gradual continuous process such as learning a language and improving.
I have a feeling that "bit by bit" is rather like "step by step" - for things that happen in chunks rather than continuously.
This is my impression.