It is narrated from Sayyiduna Jubayr bin Mut'im (may Allah be pleased with him) that the Messenger of Allah (peace and blessings be upon him) said: "O Banu Abd al-Muttalib! O Banu Abd Manaf! If you are given any part of this responsibility, do not prevent anyone who performs tawaf of this House and prays at any hour of the night or day."
Hadith Referenceالمعجم الكبير للطبراني / باب الجيم / 1587