Jurgen Klopp called on Liverpool to improve their "rubbish" defensive set-piece record after snatching a 5-4 victory at Norwich City thanks to an Adam Lallana winner deep into injury time.

Liverpool went into injury time 4-3 up, and Norwich thought they had secured a point with Sebastien Bassong's long-range volley on 92 minutes.

However, Lallana sent a bouncing shot past Rudd in the final seconds of the game to spark wild celebrations on the touchline with Klopp, whose glasses were accidentally broken by Christian Benteke.

Liverpool's defensive vulnerability was exposed throughout the game -- the visitors twice failed to clear a corner which led to Dieumerci Mbokani scoring Norwich's first, while Alberto Moreno made a pair of ill-advised challenges on Steven Naismith in the area to concede a penalty from which the Canaries went 3-1 up.

Klopp was furious following Bassong's late equaliser after the Reds failed to clear a long free kick, and the Anfield boss told BBC Sport: "We have had a few games with a similar story like this, we need to think whether it is because of us.

"It was exciting until the end and longer. We had a win after 90 mins, a draw after 92 and then a win again. It is not usual.

"There was about 70 minutes that were really good. We started well but then conceded the goals. Conceding four goals in general [is] not good. Conceding from set plays is the biggest rubbish ever because it is too easy for the other team.

Jurgen Klopp and his Liverpool players celebrated wildly after Adam Lallana's late goal at Norwich. Stephen Pond/Getty Images

"Usually we concede from the corner but now it was from the second ball, we were like rabbits in the headlights. We won the game, in the end it was deserved. The players played under big pressure and scoring five goals is not too easy. We did it.

"I was really surprised because the story of the game was not that we could make time pay. It was an open game, 90 minutes thank you and go but five? That's hard.

"It is not too easy to judge and stay cool in a game like this. I asked why five minutes [were added]. I was not satisfied with the answer, the referee was not satisfied with the question.

"We needed luck at the end and we had it."