Hazrat Abu Ja'far states that the 'usher' (tax collector) who collects from you will not be counted towards your Zakat.