Musannaf Ibn Abi Shaybah

Ibrahim says that the predecessors used to offer voluntary prayers on their mounts and their saddles, regardless of which direction they were facing. However, they used to dismount and perform the obligatory prayers and Witr on the ground.