Sepp Blatter has insisted he will not make England pay for its failed attempt to stop him being re-elected unopposed as Fifa's president.

The Football Association tried to have the election postponed on Wednesday, but the move was heavily defeated at the Fifa Congress. Blatter said he had been surprised by the move but will not hold it against them.

Blatter said: "I'm the president of all the associations and will work with all of them. There's no bad feeling with any of the associations that didn't vote for me. I'm the president of Fifa, and with 186 votes I'm proud. Don't worry about the English.

"The number one national association in Fifa – the FA founded the game in 1863 – have the right to be called the FA, Football Association. They should be an example, so that was a surprise.

"I had heard about it, and Uefa made a special meeting trying to convince them. I thought this problem would be solved so was surprised when they tried to change the agenda of the Congress and not make elections."

Wales and Northern Ireland both chose not to support England – in fact only the Scottish FA did so publicly and the proposal was defeated by 172 votes to 17.

Britain's new Fifa vice-president, Jim Boyce, insists the FA now need to bring in new faces to "build bridges" following the fall-out.

Boyce, the former president of the Irish Football Association, claims there is a perception within certain Fifa circles that the FA is arrogant and says he is happy to help improve relations between the English association and the game's governing body.

He told BBC Radio 5 Live: "England in my opinion needs to build bridges both within Uefa and Fifa. I can assure you that I will do all in my power, if asked, to help the English FA."

The sports minister, Hugh Robertson, said: "I am disappointed that the election happened but now the focus must be on where Fifa goes from here. It's crucial that Sepp Blatter delivers on the reform that has been promised."