I don't really mind it. One time when I was walking around Graal City only with a horse I think it counted it as idling though. I'll have to test it again.