It is narrated from Sayyiduna Anas bin Malik (may Allah be pleased with him): "The Messenger of Allah (peace and blessings be upon him) carried out stoning (as the hadd for zina), and (after him (peace and blessings be upon him)) Sayyiduna Abu Bakr al-Siddiq and Sayyiduna Umar al-Faruq (may Allah be pleased with them both) also carried out stoning, and their practice is a sunnah." In support of this hadith there is also a supporting report (shahid) narrated from Sayyiduna Umar bin al-Khattab (may Allah be pleased with him), which Imam al-Tirmidhi recorded and declared sahih (authentic).
Hadith Referenceإتحاف الخيرة المهرة بزوائد المسانيد العشرة / كتاب الحدود / 3498