Sayyiduna Abdullah bin Umar (may Allah be pleased with them both) says that the Messenger of Allah (peace and blessings be upon him) said: "The caliphate will remain in Quraysh as long as even two people remain."
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الصلاة / 5296