It is narrated from Sayyiduna Jabir (may Allah be pleased with him) that Abu Sufyan (may Allah have mercy on him) said: I asked Sayyiduna Jabir (may Allah be pleased with him) while he was residing in Makkah among Banu Fihr. A man asked him: "Did you (Companions) call anyone of the people of the qiblah an idolater (mushrik)?" He said: "Ma'adh Allah (Allah forbid)!" and he was greatly disturbed by that question.
Then the man asked: "Did you call anyone of them a disbeliever (kafir)?" He replied: "No."