Sayyiduna Jubayr bin Mut'im (may Allah be pleased with him) said that the Messenger of Allah (peace and blessings be upon him) said: "O Banu Abd Manaf! Do not prevent anyone from performing tawaf of this House of Allah and praying, whatever time it may be."
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الحج / 9329