Sayyiduna Abdullah (may Allah be pleased with him) said that the Messenger of Allah (peace and blessings be upon him) said: "It is sin enough for a person that he neglects those whose sustenance he is responsible for."
Hadith Referenceالسنن الكبرى للبيهقي / كتاب السير / 17823