It is narrated from Sayyiduna Ibn Abbas (may Allah be pleased with them both) that the Messenger of Allah (peace and blessings be upon him) said: "The Black Stone will be raised on the Day of Resurrection in such a way that it will have two eyes with which it will see and a tongue with which it will speak; it will bear witness for the person who kissed it with truth." Sulaiman bin Harb said: That is, the Black Stone will bear witness for those who kissed it.
Hadith Referenceسنن دارمي / من كتاب المناسك / 1877
The meaning of kissing with truth is to do so with faith; thus, those polytheists are excluded who kissed the Black Stone (Hajar al-Aswad) while in a state of shirk (polytheism).
Kissing or touching (istilam) the Black Stone is an act of worship and a Sunnah. It is not permissible to kiss or touch any other stone, nor is it permissible to hold the belief that the Black Stone itself possesses the power to benefit or harm. It was to eradicate this polytheistic belief that Amir al-Mu’minin Sayyiduna Umar ibn al-Khattab radi Allahu anhu said: “I know that you are a stone that can neither harm nor benefit; had I not seen the Messenger of Allah sallallahu alayhi wa sallam kiss you, I would never have kissed you.” [ابن ماجه 2943].
This hadith will appear ahead (at 1903).
Therefore, kissing the Black Stone or performing tawaf (circumambulation) of the Sacred House (Bayt Allah al-Haram) is not for the greatness of any stone or building, but rather for following the Sunnah.