Hello, Djzuza. I sure don't get the idea that somebody has been abducted when I hear "He has gone to the city". People sometimes say that "He has gone missing" to mean that "He has disappeared. We don't know where he is."
I think you have the right idea in your second sentence: I have gone to Vienna. = I traveled to Vienna and I'm still there.