It is narrated from Sayyiduna Abu Rafi' (may Allah be pleased with him) that the Prophet (peace and blessings be upon him) ordered that no religion other than the religion of Islam should remain in Madinah; rather, it should be expelled.
Hadith Referenceالمعجم الكبير للطبراني / باب الألف / 921