To kick a habit is to stop doing it. This is usually heard referring to a bad habit like smoking, drinking, or doing drugs because you'd really have to kick hard to get those habits far away from you. Some people think that the phrase comes from withdrawal symptoms of a drug user or alcoholic, which include muscle cramping that may cause a kicking or punching motion.