Sayyiduna Abdullah bin Abbas (may Allah be pleased with them both) says that the Prophet (peace and blessings be upon him) would keep saying the talbiyah in Umrah until he touched the Black Stone, and in Hajj until he stoned the Jamrah.
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الحج / 9411