We asked Jabir bin `Abdullah (the same question) and he said, "He (that man) should not come near (his wife) till he has completed Tawaf between Safa and Marwa."
Hadith Referenceصحيح البخاري / كتاب الحج / 1646
Hadith Gradingمحدثین:أحاديث صحيح البخاريّ كلّها صحيحة