Imam al-Zuhri (may Allah have mercy on him) said: The one who was given this advice was Sayyiduna Thawban (may Allah be pleased with him).
And Imam Abu Ya'la (may Allah have mercy on him) narrated this hadith (with his chain) from Sa'id bin Abd al-Aziz.
Hadith Referenceالمطالب العالية بزوائد المسانيد الثمانية / كتاب البر والصلة / 2533