Sayyiduna Abdullah bin Mas'ud (may Allah be pleased with him) said: "A man says a word with which he makes those sitting with him laugh, (although) he returns to his family having gained nothing from it, yet because of that word he falls further down than the distance from the heaven to the earth."
Hadith Referenceالمعجم الكبير للطبراني / باب العين / 9128