Abd al-Rahman bin Harmalah (may Allah have mercy on him) says that the Messenger of Allah (peace and blessings be upon him) said: "The difference between us and the hypocrites is attending the Fajr and Isha prayers; they do not have the strength to attend them."
Note: Imam al-Shafi'i (may Allah have mercy on him) says that the intention of the Messenger of Allah (peace and blessings be upon him) to burn people's houses was because they did not attend the Isha prayer due to hypocrisy.
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الصلاة / 4953