(CNN) A lawsuit filed in a Georgia federal court by five state voters asks a judge to strip sitting Secretary of State and gubernatorial candidate Brian Kemp of his powers over the midterm election -- including any potential runoffs.

A motion for a temporary restraining order asks a judge to order Georgia's governor to appoint a replacement who is not affiliated with Kemp or his campaign. It also asks that the Secretary of State's Office remove from its website any reference to allegations against Georgia's Democratic Party.

No court action was expected Tuesday night, according to two of the plaintiff's lawyers.

Kemp has been under fire over allegations of conflict of interest for overseeing the election in which he is a candidate -- and for a last-minute decision over the weekend to level claims that Georgia's Democratic Party had been involved in an attempt to hack state voter data.

The charges originated with a private citizen's discovery of what he believed was a flaw in the system and sought to bring to the attention of authorities, and Georgia Democrats called the episode an abuse of Kemp's power.

Read More