MISSOULA, Mont.—With a homemade .22-caliber rifle he calls the Montana Buckaroo, Gary Marbut dreams of taking down the federal regulatory state.

He's not planning to fire his gun. Instead, he wants to sell it, free from federal laws requiring him to record transactions, pay license fees and open his business to government inspectors.

For years,...