Dithering is best reserved to large surfaced objects with no seams (to provide texture, variation or to just make it not look like plastic).

If its a small surface and its meant to be smooth, don't use dithering for the shading.