Adi bin Thabit al-Ansari narrates from Sayyidah Aishah (may Allah be pleased with her) that Aishah (may Allah be pleased with her) said: Whoever hears the adhan and does not respond to it, that is, does not come to the prayer, has not intended good, and so good will not be intended for him either.
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الصلاة / 4941