Some of our companions have argued in this matter from the general statement of the Prophet (peace and blessings be upon him): "He should not turn away (from the prayer) until he hears a sound or finds a smell."
And they have also argued from his general statement in the hadith of Sayyiduna Abu Sa'id al-Khudri (may Allah be pleased with him): "Nothing breaks the prayer, and repel (whoever passes in front of you) as much as you can."
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الطهارة / Q1052