Irbad bin Sariyah al-Sulami (may Allah be pleased with him) says: We came to Khaybar with the Prophet (peace and blessings be upon him), and a man of Khaybar who was rebellious said: "O Muhammad (peace and blessings be upon him)! Is it lawful for you to slaughter our donkeys, eat our fruit and beat our women?" The Prophet (peace and blessings be upon him) became angry and said: "O Ibn Awf! Mount your horse and announce that Paradise is lawful only for a believer, and that they should gather for the prayer." The narrator says: The Companions (may Allah be pleased with them) gathered. After leading the prayer, he (peace and blessings be upon him) delivered a sermon: "Does any one of you, reclining on his couch, think that Allah, the Lord of Might, has forbidden only those things that are in the Qur'an? By Allah! I have commanded, admonished and forbidden certain things, and their prohibition is just like the prohibition of something stated in the Qur'an, or even greater. And Allah, the Lord of Might, has not made it lawful for you to enter the houses of the People of the Book without permission, nor to beat their women, nor to eat the fruit of their orchards. This is not lawful when they pay their jizyah."
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الجزية / 18728