وعن أبي حميد الساعدي رضي الله تعالى عنه قال : قال رسول الله صلى الله عليه وآله وسلم : « لا يحل لامرىء أن يأخذ عصا أخيه بغير طيبة نفس منه ». رواه ابن حبان والحاكم في صحيحيهما.
Narrated Abu Humaid as-Sa'idi (RA): Allah's Messenger (ﷺ) said: "It is not lawful for a person to take his brother's stick except if he is pleased with such." [Ibn Hibban and al-Hakim reported it in their two Sahih books].
Just as compulsion is permissible in the collection of zakat and some other financial matters, similarly, acting upon the hadith of Abu Hurairah radi Allahu anhu is also permissible despite the (unjustified) displeasure of the neighbor.
(Subul al-Salam)
Source: Bulugh al-Maram: Commentary by Safiur Rahman Mubarakpuri, Page: 737