This excerpt is taken from Sheikh al-Islam Imam Ibn Taymiyyah's book Al-Jawab al-Bahir fi Zuwar al-Maqabir, translated by Sheikh Ataullah Saqib.
The graves of Ibrahim and Yusuf (peace be upon them) in Sham and the conduct of the Companions:
During the caliphate of Sayyiduna Abu Bakr Siddiq, Sayyiduna Umar Farooq, and Sayyiduna Ali Al-Murtaza, may Allah be pleased with them, and for a considerable time after, there is no evidence from any companion that they set out on a journey towards the grave of any prophet or any righteous person. The grave of Ibrahim (peace be upon him) was well-known in Sham, but no companion traveled to visit the grave of Khalil. The companions would go to Bayt al-Maqdis and pray there but would not go near the grave of Khalil. At that time, the grave of Khalil was not even visible because it was inside the building that Solomon son of David had constructed. Nor was the grave of Yusuf well-known; rather, it was revealed more than 300 years after the Hijri year. For this reason, there was disagreement about it. Most scholars denied this (grave), with Imam Malik being foremost among them. The companions never traveled with the intention of making the grave of Khalil known. When the Christians took control of Sham, they demolished the building in which the grave of Khalil was and built a church there. Then, when the Muslims reconquered Sham, they left the grave of Khalil open. During the time of the companions, the grave of Khalil was exactly as the grave in the honored chamber was.
The Blessed Grave and the Companions of the Prophet :
Among the Companions of the Prophet, there is not a single Companion who traveled to Madinah Munawwarah with the intention of visiting the honored grave. Rather, the usual practice of the Companions was that they would come to the Prophet's Mosque, offer prayers, enter the mosque during Tashahhud, and upon leaving, send blessings and salutations upon the Prophet. Meanwhile, the Messenger of Allah was buried in the blessed chamber of Sayyida Aisha Siddiqah (may Allah be pleased with her). The Companions neither entered the chamber nor stood outside it.
The Blessed Grave and the People of Yemen :
During the caliphate of Sayyiduna Siddiq Akbar and Sayyiduna Umar Farooq (may Allah be pleased with them), when Syria and Iraq were conquered and delegations from Yemen began to arrive in Madinah Munawwarah, they also prayed in the Prophet's Mosque. Among them, there was not a single person who would go near the Noble Grave or enter the Blessed Chamber, or stand inside the mosque outside the chamber; rather, every visitor would recite salutations and blessings from outside the chamber.
Regarding them, the Lord of Majesty says:
فَسَوْفَ يَأْتِي اللَّهُ بِقَوْمٍ يُحِبُّهُمْ وَيُحِبُّونَهُ
"Very soon Allah will bring a people whom He will love, and they will love Him."
Reference: (5-Al-Ma'idah:54)