Well, generally speaking, Gem reaches the nearest enemy object (Castle or Hero) in 4 days.
So, the best possible option is 4.
But first, you need to collect the chests, so it will be difficult to complete it in 4 days, although it's probably possible =).
