It is narrated from Sayyiduna Ibn Umar (may Allah be pleased with them both) that the Messenger of Allah (peace and blessings be upon him) pronounced the talbiyah when his mount set off with him.
Hadith Referenceالمعجم الكبير للطبراني / باب العين / 13163