The fate of Stuart O'Grady's four Olympic medals rests in the hands of the International Olympic Committee, following the veteran Australian rider's admission he used the banned drug EPO in the lead up to the 1998 Tour de France.

The fallout began on Thursday, with Australian Olympic Committee president John Coates sending O'Grady an email asking for his immediate resignation from the AOC Athletes' Commission.

Stuart O'Grady (letf) on the podum with Graeme Brown after the pair won the Madison at Athens Olympics. Credit:Ian Waldie

Fairfax Media was awaiting comment from the World Anti-Doping Agency boss John Fahey on what course of action may occur regarding the 39-year-old, who has competed in 17 Tours and held the yellow jersey for three days during the 1998 race.

O'Grady announced his retirement on Wednesday amid speculation he would be named in a French Senate inquiry into doping. The report was released with O'Grady's name among a secondary group of 12 riders who returned “suspicious” samples during the 1998 race.