Since you want to say I know him, you should definitely say Je le connais.
Note however that Je lui connais X is also possible but means something else. For example, Je lui connais une maîtresse = Je sais qu'il a une maîtresse means I know he has a mistress.