It is narrated from Sayyidah Aishah (may Allah be pleased with her); she said: The Messenger of Allah (peace and blessings be upon him) said: "I know when you are pleased with me and when you are angry." I said: "O Messenger of Allah, how do you know that?" He (peace and blessings be upon him) said: "When you are pleased with me and you swear, you say: 'No, by the Lord of Muhammad!' And when you are angry and you swear, you say: 'No, by the Lord of Ibrahim!'" I said: "Yes, O Messenger of Allah! I only leave off your name."
Hadith Referenceالمعجم الكبير للطبراني / مسند النساء / 19425