If Jamie Dornan had returned to 'Once Upon a Time': What would've been

Once Upon a Time nearly got 50 shades hotter last season.

During season three, executive producers Adam Horowitz and Edward Kitsis revealed to reporters that they had a plan for Jamie Dornan to return as Sheriff Graham, a.k.a. the Huntsman, who died in season one after Regina crushed his heart. Ultimately, Dornan couldn’t make it work because the actor was busy shooting Fifty Shades of Grey. At the time, the Once bosses couldn’t even reveal their initial plans, and now it’s clear why: Sheriff Graham would’ve appeared in the season finale, which featured Emma and Hook accidentally traveling back in time to the Enchanted Forest that was.

“We wanted a Peggy Sue Got Married moment,” Kitsis tells EW, explaining that Emma would’ve seen Graham when she was locked up in the Evil Queen’s castle.

“He would’ve been one of the guards because it would’ve been during that period,” adds Horowitz. “She would’ve seen him, and it would’ve been heartbreaking for her because she would’ve wanted to reach out to him, but knowing that—because she’s on a mission—she couldn’t. It wasn’t a big plot thing, but it was an emotional moment that we wanted to do.”

So, unless there’s more time traveling in the future, don’t expect to see the Huntsman back anytime soon.

Once Upon a Time returns Sept. 28 at 8 p.m. ET on ABC.