What's wrong with people following you around? Just kill them and run, or go to your house and wait them out/unstick.

I follow people around to pk them sometimes, it's part of the game.