Sayyiduna Abdullah bin Mas'ud (may Allah be pleased with him) said: "When someone wants to pass in front of you while you are praying, do not let him, for he causes half of his prayer to be lost."
Hadith Referenceالمعجم الكبير للطبراني / باب العين / 9258