Washington (CNN) Attorneys central to the drama surrounding an alleged affair between porn star Stormy Daniels and President Donald Trump argued at length Monday evening over the suggestion that the President's lawyer was tied to an alleged threat Daniels received in 2011.

Daniels alleged Sunday in a CBS interview that weeks after she agreed to sell her story to a magazine in 2011, a man walked up to her in a parking lot and threatened her and her infant daughter, saying, "Leave Trump alone. Forget the story."

Speaking on CNN's "Anderson Cooper 360," Daniels' attorney, Michael Avenatti said he was "not yet" accusing Trump's attorney, Michael Cohen, or the Trump Organization of having sent someone to threaten Daniels, but asserted that "there's only three groups of people that individual could have been sent by."

"... We know it's not my client that sent the goon," Avenatti told Cooper. "We know it's not the magazine that sent the goon. There's only one logical place left as to who would have sent the goon. It's common sense."

Cohen's attorney David Schwartz -- who said he is not representing Cohen in this case -- said Daniels' claim that she was threatened is false, and that the implication that Cohen was involved is "a complete lie."