It is narrated from Abu Salih (may Allah have mercy on him) that "Sayyiduna Amr bin al-As (may Allah be pleased with him) came to the house of Sayyiduna Ali (may Allah be pleased with him) looking for him, but did not find him. Then when he came again, he found him. (Meanwhile) when he had gone in, he had spoken with Sayyidah Fatimah (may Allah be pleased with her). So Sayyiduna Ali (may Allah be pleased with him) asked him: 'I think your purpose was only to speak with the woman?' He replied: 'Yes! Indeed the Messenger of Allah (peace and blessings be upon him) forbade us to go in (in privacy) to women whose husbands are not present (at home).'" Ibn Hibban recorded it in the same way in his Sahih through the chain of Imam Abu Ya'la.
Hadith Referenceإتحاف الخيرة المهرة بزوائد المسانيد العشرة / كتاب الأدب وغيره / 5308