Sayyiduna Ibn Abbas (may Allah be pleased with them both) said: "Quraysh used to circumambulate the Ka'bah naked, whistling and clapping. So Allah, the Mighty and Majestic, revealed this verse: 'Say: Who has forbidden the adornment of Allah' [Surah al-A'raf: 32], and they were commanded to wear clothes."
Hadith Referenceالمعجم الكبير للطبراني / باب العين / 12272