Sayyiduna Abu Dharr (may Allah be pleased with him) used to say about a person who makes the intention of Hajj and later wants to annul it into Umrah: this was only for those people who were with him (peace and blessings be upon him).
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الحج / 8885