Victoria Police have confirmed they have spoken with numerous women about allegations of sexual assault against former Melbourne lord mayor Robert Doyle.

The force offered a brief statement on Thursday without naming the 65-year-old, or detailing the number of women interviewed so far.

"Victoria Police has spoken with a number of women in relation to historical sexual assault matters," it said.

Former Melbourne lord mayor Robert Doyle. Credit:Penny Stephens

"At this time it is only in the preliminary stages and the matter is under assessment."