Sa'id bin al-Musayyib (may Allah have mercy on him) was asked about a man who married but did not have intercourse with his wife, and then committed adultery. He said: The Sunnah in this case is that he be flogged and not stoned.
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الحدود / 16945
Simak bin Harb said: A man from Banu Ijl told me: During the Battle of Siffin I was with Sayyiduna Ali (may Allah be pleased with him) when suddenly a man began crying out: I have committed adultery; let the prescribed punishment be carried out on me. I took him to Sayyiduna Ali (may Allah be pleased with him). Sayyiduna Ali (may Allah be pleased with him) asked: Have you married? He said: Yes. He (may Allah be pleased with him) asked: Have you also consummated the marriage with your wife? He said: No. So Sayyiduna Ali (may Allah be pleased with him) gave him a hundred lashes, had him pay his wife half the dowry, and separated them.
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الحدود / 16946
Hanash bin al-Mu'tamir said: A man from among us married a woman, then committed adultery before consummating the marriage. Sayyiduna Ali (may Allah be pleased with him) imposed the prescribed punishment on him, and the woman did not wish to remain with him, so he separated them as well.
The Shaykh said: (As for holding that) the separation between them was a legal ruling, we do not say this; and it is also possible that the separation was made with their consent.
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الحدود / 16947
Abu al-Zinad (may Allah have mercy on him) said: I heard the jurists of the people of Madinah saying: A man who, not having been muhsan before that, marries but has not been with his wife, and then commits adultery, there is no stoning for him, and the woman is likewise. If he has been with his wife for an hour of the night or the day, or more, and then commits adultery after that, stoning is due upon him, and the woman is likewise. Slave-women who are mothers of children (umm walad) do not make (their master) liable to stoning.
Hadith Referenceالسنن الكبرى للبيهقي / كتاب الحدود / 16948