Just checked and I think you keep your old castle outside if you still had it before the nerf