Queen Elizabeth was left ‘infuriated’ over Sarah Ferguson’s scandal prior to her divorce