I would only use "mull over" in reference to the process of coming to a decision, whereas "ruminate," it seems to me, applies to any kind of deep, reflective thinking.
"She needed a full week to mull over the offer."
"He sat by the fire all evening, ruminating about past loves."