This wouldn't be an "adverse person." It sounds like this person is moving in reverse, or the opposite direction. S/he is not called a "reverse person" but there are many words that describe a person who doesn't follow the flow, if you're willing to provide adequate context.When everyone is moving in one direction, one person is moving in adverse direction. Can you refer to the one person as "adverse person"? In this case there's no metaphorical implication.