This is because of the saying of the Prophet (peace and blessings be upon him): "The imam is appointed only to be followed, so do not differ from him."