I think that's fine, as long as the customer understands the concept of a conference call.
You might need to say something like "You need to speak also with MS Jones, so I'll put this call on conference." If you just say "I'll put you on conference" it doesn't automatically suggest that you will still be on the line.