Sayyiduna Abu Umamah (may Allah be pleased with him) said: The Messenger of Allah (peace and blessings be upon him) stood up among the people and said: "Indeed, Allah has made Hajj obligatory upon you." A man from among the Bedouins stood up and said: "Every year?" At that the blessed tongue of the Messenger of Allah (peace and blessings be upon him) stopped, and he (peace and blessings be upon him) became angry and remained silent for a long time. Then he spoke and said: "Who is this questioner?" The Bedouin said: "It is I, O Messenger of Allah." He said: "Woe to you! What made you feel safe that I would not say 'Yes'? By Allah, had I said 'Yes', it would have become obligatory; had it become obligatory, you would have abandoned it; and had you abandoned it, you would have disbelieved. Listen! Those before you were destroyed only by leaders who created hardship (and strictness). By Allah, if I had made lawful for you everything on earth and forbidden you only something the size of a camel's hoof, you would still have fallen into it." Then Allah Almighty revealed: "Do not ask about things (which, if made plain to you, would trouble you)" [Surah al-Ma'idah: 101].
Hadith Referenceالمعجم الكبير للطبراني / باب الصاد / 7640