It is narrated from Sayyiduna Abu Musa al-Ash'ari and Sayyiduna Mu'adh bin Jabal (may Allah be pleased with them both) that when the two of them were sent to Yemen to teach the people the rulings of their religion, "they took zakah only from these four things: wheat, barley, dates and raisins."
Imam Abu Ya'la, and Imam al-Bayhaqi in al-Sunan al-Kubra, recorded this hadith with a chain whose narrators are all thiqah (trustworthy).