Ibn al-Qasim (may Allah have mercy on him) said: Imam Malik (may Allah have mercy on him) was asked about ill omen, whether it is in the horse and the house. He said: How many a house there is in which people lived and then perished, then others lived in it after them and they too perished. This is its explanation as we see it, and Allah knows best.
Hadith Referenceالسنن الكبرى للبيهقي / كتاب القسامة / 16526