Washington (CNN) Indiana Gov. Mike Pence is scrapping the development of a new state-run website that an internal memo had said his office would use at times to break news ahead of the independent press.

The move comes after The Indianapolis Star reported on Monday that the potential 2016 Republican presidential candidate was launching a site called "Just IN" to provide pre-written stories that the state's media outlets can re-publish. It was to be led by Bill McCleery, a former reporter for the newspaper, and include a managing editor and an editorial board.

"At times, Just IN will break news -- publishing information ahead of any other news outlet. Strategies for determining how and when to give priority to such 'exclusive' coverage remain under discussion," Pence's administration said in a question-and-answer sheet sent to state agencies' communications directors, the Star reported.

Pence quickly backtracked, telling a local conservative radio host that he'd only learned of the memo through The Star's report and that it clashed with his understanding of what was in development: a new one-stop clearing house for state agencies' press releases.

"I'm just telling you that I regret the confusion, and I'm telling you that that memorandum, however well intentioned, used language that was inappropriate," Pence told WIBC's Greg Garrison.

Read More