Sayyiduna Jabir bin Abdullah (may Allah be pleased with them both) said that the Messenger of Allah (peace and blessings be upon him) "disliked that a man should return to his family at night."
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الحج / 10370