Orange is listed in the Penguin Dictionary of Historical Slang as a term for the female pudendum. It is dated to the Restoration period.I think it might be a reference to being stimulated. Men are so cocksure and excited about women being their panty dropping playground.
Just like cocksure really isn't a word, maybe orange-horse could be interpreted using the whole sentence as reference.