From New York to Washington to Chicago to Houston to New Orleans to Los Angeles—the police leaders in the biggest cities are all on the same page: The U.S. needs to fix its prison system.

I’m one of more than 130 police chiefs, prosecutors and sheriffs who are calling for a change to America’s system of mass incarceration. A blind man could see that we’re keeping the wrong people in jail. As a result, we’re not focusing enough on violent crime, which poses more of a danger to communities.

In Chicago, where I’m Police Superintendent, people want us to reduce violence, but we’re caught in a conundrum. The system is producing what it’s designed to produce. And it’s not producing a reduction in gun violence.

As a result of sentencing guidelines that were set during the 80s during the War on Drugs, more people are incarcerated for the low-level narcotics offenses than for possession of a loaded firearm. In 2012, 28% of inmates incarcerated at Cook County jail were incarcerated for narcotics-related offenses; less than 4% were incarcerated for illegal possession of a loaded firearm.

Narcotics possessors are likely to recidivate in a short time frame because they have an addiction problem—they’re put in jail so they don’t harm themselves. Gun possessors, on the other hand, have the potential to commit violent crimes—we need them in jail so they don’t harm others.

Consider the case of Hadiya Pendleton, who was shot and killed by somebody who had plead guilty to a gun possession two months earlier. Her shooter was back on the street because possession of an illegal loaded firearm is not considered a violent crime for sentencing purposes in Illinois.

This system does not make any sense.

We can do something about gun violence in this country. We’re choosing not to, and as a result people are dying.

Mass incarceration breaks up families. It gives people felony convictions and makes it so they can’t get jobs. It sometimes trains them to be worse criminals while they’re in jail. It also has a bigger impact on African Americans.

All of these things can be addressed and we can help shift the focus to what the community wants—fewer people incarcerated, and a system that makes sure that people who need to be in jail are in jail. That’s the bottom line.

Sign up for Inside TIME. Be the first to see the new cover of TIME and get our most compelling stories delivered straight to your inbox. Please enter a valid email address. Sign Up Now Check the box if you do not wish to receive promotional offers via email from TIME. You can unsubscribe at any time. By signing up you are agreeing to our Terms of Use and Privacy Policy . This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply. Thank you! For your security, we've sent a confirmation email to the address you entered. Click the link to confirm your subscription and begin receiving our newsletters. If you don't get the confirmation within 10 minutes, please check your spam folder.

Contact us at letters@time.com.