Sayyiduna Umarah bin Aws (may Allah be pleased with him), who had prayed facing both qiblahs, narrates: We were praying one of the two evening prayers when a caller called out (at the door of the mosque): "The qiblah has been turned towards the Ka'bah." I bear witness concerning our imam that he was turned towards the Ka'bah, and the men, women and children did the same. So some of us prayed facing this way and some of us facing that way.
Al-Tabarani recorded it in al-Mu'jam al-Kabir, and Abu Ya'la also recorded it, though he transmitted the words: "He said: I was in my house when a caller called out at the door." Then the narrator mentioned the whole hadith. Its chain contains Qays bin al-Rabi', whom Shu'bah and al-Thawri declared thiqah (trustworthy), and there is disagreement about using him as evidence.
Hadith Referenceمجمع الزوائد ومنبع الفوائد / كتاب الصلاة / 1973