It is narrated from Sayyiduna Ibn Umar (may Allah be pleased with them both) that the Prophet (peace and blessings be upon him) used to offer voluntary prayers on his mount, facing whichever direction it turned.
Hadith Referenceمسند احمد / مسند المكثرين من الصحابة / 4956