It is narrated from Sayyiduna Abdullah bin Abbas (may Allah be pleased with them both) that the Prophet (peace and blessings be upon him) said: "There is no room in Islam for sarurah (that is, complete abstention from marriage or from Hajj)."
Hadith Referenceالمعجم الكبير للطبراني / باب العين / 11545