Three Republican groups in Rep. Denver Riggleman’s district have voted to reprimand him in the weeks since he presided over a same sex wedding in July, triggering a strained debate about the Republican Party’s stance on same sex marriage in his Virginia district.

The efforts to censure Riggleman have been led in part by a consultant to an opponent to his 2018 nomination, a far-right social conservative, fueling speculation that some Republicans in his district are already laying the groundwork for a primary challenge in 2020.

The Rappahannock County Virginia Republican Committee voted to censure the freshman Republican last week, the third local GOP group to do so, the Rappahannock News reported.

The committee cited Riggelman’s votes in favor of granting more visas for foreign workers and for sending military support to Saudi Arabia. But the vote comes amid a high-profile dispute among local GOP leaders over whether to continue to back Riggleman after news broke that he wed two men, both former volunteers to his campaign, in July.

The Bedford County Republican Committee voted to censure Riggleman earlier this month. The Cumberland County Republican Committee passed a vote of no confidence in July.