Sayyiduna Samurah (may Allah be pleased with him) says: The Messenger of Allah (peace and blessings be upon him) used to forbid a man from tabattul (renouncing marriage in self-denial), and he declared entering the houses of the believers (without permission) to be forbidden.
Hadith Referenceالمعجم الكبير للطبراني / باب السين / 6991