Jubayr bin Mut'im (may Allah be pleased with him) says that the Prophet (peace and blessings be upon him) said: "O Banu Abd Manaf! Whoever among you becomes in charge of the affairs of the people, let him not prevent people from performing tawaf of the House of Allah, nor prevent anyone from praying at whatever hour he wishes, of the night or the day."
What is meant by the prayer mentioned is the two rak'ahs of tawaf. This is a prayer that has a cause; it is not specified. If what is meant is all supererogatory prayers, then the place is specified. The first view is closer to the reports (athar).
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الصلاة / 4413