Nine years after ground was broken on North America’s tallest building, One World Trade Center is set to open its doors Nov. 3 to publisher Condé Nast, its principal tenant, according to people familiar with the date.

Just don’t expect any fanfare—at least at first.

The Port Authority of New York and New Jersey, which is developing the tower,...