Cheslin Kolbe and Willie le Roux (15) had plenty to celebrate as South Africa beat New Zealand in Wellington.

Now that was a test match.

Never mind about South Africa not being the test rugby foe they were. Nine years after their last win in New Zealand, and just 12 months on from a humiliating 57-0 loss in Albany, the Springboks have stunned the All Blacks 36-34.

In a performance full of heart and desperation, at Wellington's Westpac Stadium, South Africa withstood wave after wave of All Backs attack in the final moments, finally holding on to win well after the final hooter.

1 of 14 GETTY IMAGES Where did that go wrong? An All Blacks fan can't quite believe the result. 2 of 14 GETTY IMAGES Meanwhile, it was jubilation for those wearing green in Wellington. 3 of 14 ANDREW CORNAGA/PHOTOSPORT Captain's Kieran Read and Siya Kolisi at the coin toss with match referee Nigel Owens. 4 of 14 HANNAH PETERS/GETTY IMAGES TJ Perenara and Ardie Savea in full voice during the national anthem. 5 of 14 HAGEN HOPKINS/GETTY IMAGES Beauden Barrett congratulates his brother Jordie after scoring the opening try. 6 of 14 PHOTOSPORT It was one Smith to another as Ben assisted Aaron for the All Blacks second try. 7 of 14 PHOTOSPORT The Springboks rallied as Aphiwe Dyantyi races around to score. 8 of 14 PHOTOSPORT In the blink of an eye, the Springboks had a second. Willie le Roux scored after Jordie Barrett's quick-throw went astray. 9 of 14 PHOTOSPORT Karl Tu'inukuafe is wrapped up by Handre Pollard, whose goal-kicking was just as important as his tackling. 10 of 14 HAGEN HOPKINS/GETTY IMAGES Rieko Ioane darts around the Springboks on the overlap to score his first try. 11 of 14 GETTY IMAGES A dream start to the second half for the Springbok as Cheslin Kolbe celebrates his intercept try. 12 of 14 GETTY IMAGES The All Blacks take a moment to ponder where things are going wrong. 13 of 14 AP All Blacks captain Kieran Read is taken for a ride by South Africa's Malcolm Marx 14 of 14 GETTY IMAGES The Springboks celebrate their first win on New Zealand soil in nine years.

For the All Blacks there will be a few questions to answer, but the Springboks ought to be euphoric after that.

READ MORE:

* Player ratings: All Blacks in Wellington

* Jordie Barrett's rollercoaster night

* Opinion: Loss will cut deep for All Blacks

There's urgent and then there's frantic and the All Blacks were guilty of being too much of the latter.

A lot of it appeared to start with first five-eighth Beauden Barrett, who mixed good with bad for a lot of the first 40 minutes. There were the nice hands and deft pass that put fullback Jordie Barrett over to score, in the fifth minute, but at other times kicks were poorly conceived or executed and there seemed a desire to try to bite off more than was available.

Halfback Aaron Smith followed Jordie Barrett over, before South Africa replied with tries to wing Aphiwe Dyantyi, fullback Willie le Roux and hooker Malcolm Marx. By the time first five-eighth Handre Pollard kicked a penalty after the halftime hooter, the visitors were leading 24-17.

Le Roux's try was typical of New Zealand's half, as Jordie Barrett opted for a quick lineout that wasn't on, hurling the ball into midfield. Only instead of an All Blacks team-mates, it was le Roux who recovered the ball to score.

The Springboks had battled to get into the game at, at 12-0 down, you suspected they were staring down the barrel of a heavy defeat. The All Blacks were finding gaps in the defensive line but, by and large, South Africa's tackling was ferocious and helped create a bit of momentum.

A good passage of All Blacks play late in the half saw wing Rieko Ioane race over, but the right team were in front at the break

New Zealand needed to calm down, tidy up and earn the right to play.

PHOTOSPORT Ben Smith, left, burst down the blindside before passing inside for Aaron Smith to score.

Instead a Cheslin Kolbe intercept try, two minutes into the second spell, from an Anton Lienert-Brown pass put them even further under the pump. It was going require a pretty good comeback from 31-17.

It began with the All Blacks camping themselves in the Springboks' 22, from where Ioane eventually scored. Beauden Barrett's touchline conversion narrowed the gap to seven, but only for five minutes.

Dyantyi was soon in again and the game began to have upset written all over it.

PHOTOSPORT Willie le Roux was all smiles after being gifted a try by the All Blacks.

Then Codie Taylor went over from a lineout drive and things truly did get frantic. Le Roux was sinbinned, for a ruck infringement near the Springbok line and, from seven points in arrears, the All Blacks chucked everything at them.

Time after time, though, a South African player was there to make a crucial tackle.

Ardie Savea was the next All Black over from a lineout drive to make it 36-34, ony for Beauden Barrett to miss his fourth conversion of the night.

South Africa 36 (Aphiwe Dyanty 2, Willie le Roux, Malcolm Marx, Cheslin Kolbe tries; Handre Pollard 4 con, pen) New Zealand (Rieko Ioane 2, Jordie Barrett, Aaron Smith, Codie Taylor, Ardie Savea tries; Beauden Barrett 2 con) . HT: 17-24.

*Comments have been closed on this story*