A Kentucky man just needed a place to set his gun while he relieved himself in a restaurant restroom on Sunday, but the toilet paper dispenser may not have been the best choice.

The unidentified man was using the restroom at Fazoli’s restaurant in Elizabethtown, Ky. when he set his pistol atop the dispenser. The weapon slipped off the dispenser and shot the man in the leg. Police told The News Enterprise that the trajectory of the bullet supported the man’s account.

According to the AP, police said the man has a concealed carry permit and was taken to a local hospital to be treated for a non-life threatening injury.