Sayyiduna Ibn Abbas (may Allah be pleased with them both) narrates that Sayyiduna Umar bin al-Khattab (may Allah be pleased with him) said to Abbas and Fadl bin Abbas (may Allah be pleased with them both): Mention to the Prophet (peace and blessings be upon him) that he should assign something for the two of you from the charities, and I will be present for you. So Fadl (may Allah be pleased with him) mentioned this to the Messenger of Allah (peace and blessings be upon him), and he (peace and blessings be upon him) said: "O Banu Hashim, be patient with yourselves; charities are only the impurities of the people."
Hadith Referenceالمعجم الكبير للطبراني / باب العين / 12924