A historic building in Flushing with a history involving Orthodox Quakers will be torn down, with an eight-story building going up at the site.