Neither sounds goods to me. "(As) per our conversation" would work. (The "as" always seems superfluous to me but it's quite common in American English in business contexts.) "Per" means "according to" or "in accord with" in this context. "According to we said" or "According to we spoke earlier" doesn't make sense in English.