A first-term Colorado lawmaker left a loaded gun behind after a Wednesday committee meeting on concealed handgun permits, the Denver Post reported.

Rep. Jonathan Singer (D) told the Post that he found a black canvas bag under the table where lawmakers sit after the committee room cleared out. Inside he found a loaded handgun, which he and the sergeant-at-arms realized belonged to Rep. Jared Wright (R).

Wright, a former police officer, told the Post he frequently carries a concealed handgun inside the Capitol. He said he has the right to do so under state stature as a peace officer.

“I feel it’s my duty to be a first responder wherever I am at,” he told the Post. “That’s why I carry it.”

But Wright agreed to stop carrying the weapon inside the Capitol after being contacted by Gov. John Hickenlooper’s (D) office and speaking with Colorado State Patrol, according to the Post.

Although the Capitol is considered a gun-free zone, the Durango Herald reported last year that it’s an open secret between Colorado lawmakers that some colleagues do come armed with concealed weapons.