It is narrated from Sayyiduna Jubair (may Allah be pleased with him) that the Prophet (peace and blessings be upon him) said: O Banu Abd Manaf! Do not prevent anyone from performing Tawaf of the House of Allah or from offering prayer at any time, whether it is during the day or night.
Hadith Referenceمسند احمد / مسند المدنيين رضي الله عنهم اجمعين / 16736