Story highlights The match was stopped when fans started throwing Molotov cocktails

Fans of one of the teams tore up seats and stormed police lines, authorities say

Clashes had started before the match, and broke out again at half time

The stadium is where Olympic track and field events were held in 2004

Athens' Olympic stadium suffered heavy damage during violent clashes between soccer fans and police, authorities said.

The clashes left 20 police wounded, two seriously, police said. Fifty-seven people were detained and another 23 arrested on charges of violence against police and possession of Molotov cocktails.

Police said they were provoked by "a large group" throwing sticks, stones, bits of metal, Molotov cocktails and flares.

The clashes began two hours before a Sunday night match between Greece's two main football clubs, Panathinaikos and Olympiakos, was due to begin.

"Before the match, individuals who had already gained entry made a sortie from their stands, breaking stadium doors, attacking police and allowing others to enter without security checks," a police statement said.

One Panathinaikos fan who was present said that "there was a large group of fans that tried to get into the stadium through the basketball courts without tickets."

The match to got under way, but the violence resumed inside the stadium at half time, when dozens of Panathinaikos fans stormed police lines, authorities said. The second half of the match started almost an hour late, and was cut short by several minutes when fans started raining Molotov cocktails on the stadium. They ripped up seats and partly burned one of the stadium's two giant display boards.

Police later displayed pictures of seized Molotov cocktails and flares. They also seized three, 16-liter canisters of inflammable fluid that had been placed outside the stadium doors, presumably to resupply the troublemakers.

The stadium is a symbol of a modern Greek moment of glory. It hosted track and field events during the highly successful 2004 Athens Olympic Games. But it was never built to host soccer matches. It lacks turnstiles and heavy-duty security doors.

Cleanup crews were at work Monday piling broken plastic chairs onto the brick-red rubber track and cleaning up debris with leaf blowers. The display board was visibly charred, and splotches of dried blood adorned the aisles.

"When these groups can get away with such things, it is because they were able to get away with them in the past, with no one being punished," Public Order Minister Mihalis Chrysohoidis said on Skai, a local network.

Panathinaikos FC issued a formal apology for the violent clashes, and could be fined. Together with Olympiakos, it forms Greece's football powerhouse. The two clubs are, with few exceptions, the only ones to represent Greece in European leagues; but rivalry between their fans has plumbed such violent depths that the fans are no longer allowed to attend matches simultaneously, but are confined to home matches.

"The violence may have been partly provoked by the heavy police presence," one fan said. "There were seven busloads of police at the game."

But police may have arrived in such numbers anticipating an organized act of violence. "We knew it was going to happen," said taxi driver Konstantinos Kavdas, a Panathinaikos follower. "One of the more extreme fan clubs was going to pay the police back for heavy-handed behavior during one of their basketball matches last week," he said.

Greek football teams do have official fan clubs, but the vast majority of fans belong to independently groups not controlled by the teams.