When Spencer Wagner was hired to be Donald Trump's bodyguard, the martial arts expert probably thought he was onto a good thing.

Watching the backs of the billionaire and his then-wife, actress and present-day Dancing With the Stars contestant Marla Maples, must have seemed like a cushy position.

But he had no idea that the position would end in infamy and scandal - and destroy his spirit - as his ex-wife, Mary Miller, told Inside Edition Friday.

Married: Donald Trump was married to Marla Maples (with Trump, pictured at their wedding in 1993) when he hired martial arts expert Spencer Wagner to be his bodyguard

Bodyguard: Wagner (pictured) found himself having trouble dealing with Maples, who loved to party and pursued him 'aggressively,' his ex-wife Mary Miller told Inside Edition

Wagner found himself having trouble handling the party-loving actress, then in her thirties, Miller told said.

'She was out of control and he made no bones telling me that,' she said. 'She just loved to party a lot. She liked to go down to Miami and party when she was in town.'

Miller recalled: 'He said she would try to pull him into a bedroom in the house and she was aggressive.'

The pair grew closer, Miller says - and eventually found themselves caught up in scandal.

At 4am on April 16, 1996, a cop patrolling a beach near Trump's Mar-A-Lago resort in Palm, Beach, Florida made a surprising discovery.

He found Wagner, then 34, 'hiding under a lifeguard stand' on the beach, the NY Daily News reported that year.

According to a National Enquirer report, Wagner claimed he was there alone until Maples, then 33, emerged from underneath the stand wearing 'tight, black spandex leggings and a skimpy jogging top.'

The cop issued Wagner with a parking ticket and told the pair to move along, but the story broke soon after and tongues were set wagging.

Incident: It was near this plush Trump resort in Palm Beach, Florida, that Wagner and Maples were found at 4am on a beach by a police officer in April 1996. Both denied an affair, but Wagner was fired four months later

Crushed: Miller (right) told Inside Edition that Wagner (left) was 'crushed' by the scandal. His bodyguard business faltered, and he died of a drug overdose in 2012. She doesn't believe the affair happened

Maples claimed that she had been caught short and had to take a bathroom break, and Wagner denied claims of an affair too.

And a Trump spokesman said at the time, 'Along the lines of Elvis sightings and Martian invasions, the National Enquirer has once again fabricated a wholly unreliable cover story for this week's issue.'

But the rumors continued to swirl, media hounded Wagner, and four months later he was fired. The following year Trump and Maples split, and in 1999 they divorced.

'It probably bruised [Trump's] ego big time that here's this big strong Donald Trump and this bodyguard that he hires, ends up looking like he's having sex with his wife,' Miller told Inside Edition.

Miller said she doesn't believe her husband had an affair with Maples, and that he had denied the claims privately with her - 'He's not a sleazy guy,' she added.

But after he was fired, Wagner came forward and said he had slept with Maples after their 'passion boiled over.'

That may have been an attempt to get money, however, as the bodyguard business dried up for him after the scandal.

'These are older men with young wives and Spencer's a great-looking guy and a bodyguard, Miller explained, of her ex-husband's troubled career. 'C'mon!'

Wagner ultimately died on January 1, 2012 of a drug overdose - the result, she said, of a scandal that blew his life apart. 'It crushed him,' she said.

Marples moved to California, where she raised Tammy Trump, the daughter she had with her ex-husband. She most recently appeared on Dancing With the Stars.