Bank of Canada Gov. Stephen Poloz said Thursday that bitcoin’s ascent has all “the ingredients of something that could be a significant disturbance” to the financial system.

“I am hopeful the system will treat it cautiously from here,” he said at a press conference following a speech in Toronto about issues that keep him awake at night.

He...