New York state tax officials have already seized and auctioned off a rare Nazi encryption machine and three valuable historical documents owned by convicted fraudster Martin Shkreli, even as the jailed former pharmaceutical executive fights efforts by federal prosecutors to seize his assets.

Shkreli's Enigma code machine, which was used by Germany during World War II to send secret messages, was seized last May and sold for $65,000 by the Sotheby's auction house, a spokesman for the state Department of Taxation and Finance told CNBC on Friday.

The money went toward reducing at least some of the "pharma bro" Shkreli's large tax liability with the state of New York, as did the three documents he had owned, which likewise were seized in May.

One of them was "a rare, unpublished manuscript in Latin signed by Isaac Newton at the beginning of his chemical research," which sold for $38,000, according to James Gazzale, the tax department spokesman.

A letter that Shkreli owned which was written by English mathematician and writer Augusta Ada King-Noel, Countess of Lovelace, signed "A.A. Lovelace, sold for $26,000. The countess was the only legitimate child of the poet Lord Byron.

The third item, a signed letter from legendary naturalist Charles Darwin to a man named Thomas Green about the publication of Darwin's research during his travels aboard the HMS Beagle, went at auction for $5,500, Gazzale said.

All told, tax officials recouped $134,500 from selling off the Shkreli items that they seized.

The Enigma machine's seizure came seven months before federal prosecutors in Brooklyn, New York, listed it as an asset they wanted him to forfeit in connection with his criminal conviction. The seizure came four months before Shrekli was convicted in the fraud case.

Shkreli's lawyer, Benjamin Brafman, first disclosed the Enigma machine's seizure on Thursday in a letter filed in Brooklyn federal court that opposes a forfeiture request by prosecutors.

Brafman's letter did not contain either the date of the filing or the amount obtained for the machine at auction. Nor did the lawyer's letter mention the historical documents seized by tax officials.

Brafman, who could not be reached for comment, wrote in his filing that despite the state's auction of the Enigma machine, the 34-year-old Shkreli still owed New York state more than $450,000 in taxes.