Story highlights Anthony Horowitz told the Daily Mail he didn't think Elba was a good fit

He said it had nothing to do with the actor's race

(CNN) The writer of the new James Bond novel "Trigger Mortis" has set off a firestorm with a remark about Idris Elba.

Anthony Horowitz recently told the Daily Mail that he believes Elba is "probably a bit too 'street' for Bond. Is it a question of being suave? Yeah."

Elba has long been touted as the fans' choice to become the first black Bond.

For some, the reference to Elba as "too street" was code for "too black."