Abu Burdah (may Allah have mercy on him) narrates from his father (may Allah be pleased with him) that the Prophet (peace and blessings be upon him) said: "Whoever hears the adhan while free and healthy, and then does not respond (that is, does not come to the prayer), has no prayer."
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الجمعة / 5588