Next time save it as an optimized gif, all frames that have the same information will not count towards the filesize. Me simply saving it as optimized changed the filesize from 177kb to 8kb).

Alternatively, instead of using multiple frames for idle frames just set the time.