Washington (CNN) As President Donald Trump has rotated between controversies for the last few days, two of his top advisers have been notably publicly absent -- again.

The couple was on vacation in Wyoming with their children over the weekend, and, on Monday, participated in a Trump Victory fundraiser alongside his acting chief of staff Mick Mulvaney. They returned to Washington this week but with a limited presence in the West Wing, people familiar with the situation said.

The President's daughter and son-in-law -- who are Modern Orthodox Jews -- stayed silent publicly as Trump caused a firestorm by questioning the loyalty of some Jewish Americans to Israel. Trump has recently decided that branding the Democratic Party as anti-Semitic would be savvy political strategy -- and aides have largely supported the fight, but when he questioned the intelligence and loyalty of Jewish people who support Democrats, some inside the West Wing privately conceded to CNN he had gone too far. The comments prompted criticism from many groups that what he said was anti-Semitic, but Trump dug in during the days that followed.

"I haven't heard anybody say that; it's just the opposite," he claimed to reporters Wednesday. "I think that if you vote for a Democrat, you're very, very disloyal to Israel and to the Jewish people."

Read More