But only a few members of the panel said Madigan should also step down as House speaker, a position he has held for 34 of the past 36 years. Chief among them was state Rep. Scott Drury of Highwood, who was the lone Democrat not to vote for Madigan for speaker in 2017.