A bit is usually used when referring to time, and a little when referring to quantity.
I'll be there in a bit.
I only want a little, I'm not that hungry.
But you can also say little bit.
I'll be there in a little bit.
I only want a little bit.
They basically mean the same thing, they are all interchangeable.