Sahih Ibn Khuzaymah

And to ascend the mountains of Safa and Marwah to such an extent that the Ka'bah becomes visible. One should ascend the mountain of Safa before Marwah because Allah Almighty has mentioned the mountain of Safa first (in the Holy Qur'an) and mentioned Marwah afterwards. The Prophet Mustafa (peace be upon him), who clarified the command of Allah Almighty, has ordered that (the beginning of Sa'i) should be from Safa, which Allah Almighty has mentioned first in the Holy Qur'an.

It is narrated from the noble father of Hazrat Ja'far, Hazrat Muhammad, who says: We went to the service of Sayyiduna Jabir bin Abdullah (may Allah be pleased with them both) and we asked him about the manner of the Hajj of the Prophet Muhammad (peace be upon him). Then he narrated a part of the hadith, then the Messenger of Allah (peace be upon him) returned to the Black Stone, touched it, and proceeded towards the hill of Safa. And he said: "I begin (the Sa'i) from the hill from which Allah Almighty has begun." And he recited this verse « إِنَّ الصَّفَا وَالْمَرْوَةَ مِن شَعَائِرِ اللَّهِ » [ سورة البقرة : 108 ] "Indeed, Safa and Marwah are among the symbols of Allah." Then he ascended Safa until the House of Allah became visible, and upon seeing the House of Allah, he recited « اللهُ أَكْبَرُ » three times and made this supplication « لاَ إِلَهَ إِلاَّ اللَّهُ وَحْدَهُ لاَ شَرِيكَ لَهُ لَهُ الْمُلْكُ وَلَهُ الْحَمْدُ وَهُوَ عَلَى كُلِّ شَيْءٍ قَدِيرٌ ، لاَ إِلَهَ إِلاَّ اللَّهُ أَنْجَزَ وَعْدَهُ وَنَصَرَ عَبْدَهُ وَغَلَبَ الْأَحْزَابَ وَحْدَهُ » "There is no deity worthy of worship except Allah alone, He has no partner, His is the dominion, all praise is for Him, and He is over all things competent. There is no true deity except Allah, He fulfilled His promise, helped His servant, and alone defeated all the armies." Then he repeated this supplication three times (and made other supplications). Then he descended until when his blessed feet reached the middle of the valley, he ran. When he began to ascend (Marwah), he walked at a normal pace. Then he reached Marwah and ascended it, and when the House of Allah came into view, he recited « اللهُ أَكْبَرُ » and made the same supplications as he had made on the hill of Safa.