It is narrated from Sayyiduna Abdullah bin Abbas (may Allah be pleased with them both) that when the Prophet (peace and blessings be upon him) saw the images inside the House, that is, the Ka'bah, he did not enter until he had ordered that they be effaced. He saw (images of) Sayyiduna Ibrahim and Isma'il (peace be upon them both) with divining arrows (azlam) depicted in their hands, and he (peace and blessings be upon him) said: "May Allah destroy them! By Allah, those two never sought divination with the azlam."
Hadith Referenceالمعجم الكبير للطبراني / باب العين / 11795