The CrystalPod have told Kouchu hat the other stones might be up in the tower secured by the knights. So the brawlers looks for Kouchu's stones in the tower when Kouchu battles the knights for them. Afterwards, the Brawlers try to get the stone that is located on top of the tower.
