Ibn Jurayj narrates: A man whom I trust narrated to me from Abu Bakrah (may Allah be pleased with him), from Sayyiduna Umar, Sayyiduna Uthman and Sayyiduna Ibn Mas'ud (may Allah be pleased with them), that when they began the prayer, they would say before the recitation: "O Allah, You are free of all imperfection, and all praise is Yours; blessed is Your name, exalted is Your majesty, and there is no god besides You."
Hadith Referenceالمعجم الكبير للطبراني / باب العين / 9269