It is narrated from Abu Hurayrah (may Allah be pleased with him) that he (peace and blessings be upon him) said: "Whoever says to his companion on Friday, while the imam is delivering the sermon: Be quiet, has engaged in idle talk."
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الجمعة / 5825