It is narrated from Abu Huraira (may Allah be pleased with him) that the Prophet (peace be upon him) said: "When any one of you gets up from his place on Friday and then returns, he is more entitled to that place (from which he got up)."
Hadith Referenceمسند الإمام الشافعي / كتاب الجمعة / 421
Hadith Takhrijاخرجہ مسلم، السلام، باب اذا قام من مجلسہ ثم عاد فہو أحق بہ (2179)۔