It is narrated from Sayyiduna Anas (may Allah be pleased with him) that the Prophet (peace and blessings be upon him) would very rarely directly confront someone face to face if he saw them involved in something impermissible. One day, a man came and there were traces of yellow color on him. When he left, the Prophet (peace and blessings be upon him) said: "If he would change or remove that yellow (garment), it would be better."
Hadith Referenceالادب المفرد / كتاب السباب / 437
Hadith Gradingالألبانی:ضعيف
Hadith Takhrij«ضعيف : أخرجه أبوداؤد ، كتاب الترجل ، باب فى الخلوق للرجال : 4182 و النسائي فى الكبرىٰ : 9993 - انظر الضعيفة : 4255»
Explanation & Benefits
Shaykh Maulana Usman Muneeb
Benefits and Issues: This narration is weak; however, in other hadiths, it is prohibited for men to wear yellow and saffron-colored clothing. The Prophet (sallallahu alayhi wa sallam) said to Abdullah bin Amr: ((Inna hadhihi min thiyabi al-kuffar fala talbas-ha)) (Al-Sahihah by Al-Albani, Hadith: 1704) "These are the clothes of the disbelievers, so do not wear them."
Source: Fadlullah al-Ahad: Urdu Commentary on al-Adab al-Mufrad, Page: 437