FASHION designer Charlie Brown and her husband and boss Danny Avidan flew back into Sydney this week after three weeks in New York and Rio working to save their marriage.

Avidan yesterday denied the couple's 11-year marriage hit a low patch in December and that his high-profile wife asked him to move out of their newly refurbished and palatial Darling Point home.

"We are very happily married and have just had a beautiful three weeks away," he said.

But sources close to the couple said Avidan had moved out of their multimillion-dollar home, returning only after a furious Brown agreed to try to work out their differences. It is just the latest challenge the colourful and controversial couple have faced during their 15 years together.

American-born Brown shocked conservatives in Sydney's Eastern Suburbs when, after splitting from husband No. 1 and moving in with the Israeli-born Avidan, she installed her eight-year-old daughter Sophie in an apartment over the road with a nanny, saying she did it to give her relationship with Avidan every chance as "Danny was so hard to lasso".

In 1998 the couple married in an extravagant celebration, Brown six months pregnant through IVF at the time and newly converted to Judaism. They now have two children together.