Sayyidah Tuwaylah bint Aslam (may Allah be pleased with her), who was one of the women who pledged allegiance at the blessed hand of the Prophet (peace and blessings be upon him), narrates: We were praying in our place in the area of Banu Harithah when Abbad bin Bishr bin Qibti said: "The Prophet (peace and blessings be upon him) has turned to face the Sacred House and the Ka'bah." So the men turned around into the place of the women, and the women moved into the place of the men, and they prayed the remaining two rak'ahs facing the Ka'bah.
Al-Tabarani recorded it in al-Mu'jam al-Kabir, and its narrators have been declared trustworthy.
Hadith Referenceمجمع الزوائد ومنبع الفوائد / كتاب الصلاة / 1977