There may be someone in his house and when you move away from the item the trader picks up his item and his friend leaves the house and takes yours.
Other than that its an awesome guide