It is narrated from Sayyiduna Abdullah bin Abbas (may Allah be pleased with them both) that the Prophet (peace and blessings be upon him) said: "Whoever hears the adhan and does not respond to it (that is, does not come for the prayer) has no prayer."
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الجمعة / 5586