It's unlikely that this is what is meant, but there is a third option, using the original punctuation of I will be there, a little, late.
"I will be there [at the party tonight], a little [= but I will be there only for a short time], [and I shall arrive] late." This elliptical wording would be understood in the context of a conversation.