It is narrated from Sayyiduna Jarir (may Allah be pleased with him) that the Prophet (peace and blessings be upon him) said: "There is no people among whom there is a man who commits acts of disobedience, while they are more powerful and mightier than him, and they do not bring about change upon him, except that Allah will afflict them with a punishment."
Hadith Referenceالمعجم الكبير للطبراني / باب الجيم / 2367