Sayyiduna Anas bin Malik (may Allah be pleased with him) said that the Messenger of Allah (peace and blessings be upon him) would not come to his family at night; rather, he would come in during the day, in the morning or the evening.
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الحج / 10368