Three football fans said they were "furious and humiliated" after being detained at a rugby league match for using their mobile telephones in a manner an onlooker deemed suspicious.

Dozens of people who claim they were unfairly swept up by authorities in the past few weeks are pursuing legal action, as the terrorism climate heats up in Australia.

Three rugby fans of Middle Eastern appearance were singled out by a spectator for allegedly using their mobile phones in a suspicious manner during the game. Credit:Andrew Quilty

Three men of Middle Eastern appearance were pointed out by a spectator at the Roosters-Cowboys game on Friday night because they were using their mobile phones in a way that did not match what was happening on the field, Fairfax Media understands.

They were removed by police in the 60th minute and questioned for about half an hour. The three men were so incensed they contacted lawyer Adam Houda, who will demand an apology or take civil action on the men's behalf.