It is narrated from Sayyiduna Abdullah (may Allah be pleased with him) that he said: "On Friday, when the imam has come out (for the sermon), merely saying to your companion, 'Be silent,' is enough to count as laghw (idle talk)."
Hadith Referenceالمعجم الكبير للطبراني / باب العين / 9509