It initially seemed like it was going to be a successful Thursday night for Billy Joel, not at Madison Square Garden but at the Sag Harbor Municipal Building.

His hired team, attorney Jon Tarbet and builder Jeffrey Collé, brought not one but three models displaying Mr. Joel’s proposed renovation to his property on Bay Street to the village Architectural Review Board. But the reception was not positive:

“Nobody on this board will be comfortable with that,” ARB Chairman Anthony Brandt said.

Mr. Brandt and the rest of the board members calmly dimmed hopes for Mr. Joel’s house project during the ARB meeting Thursday night, November 9. Mr. Brandt was responding to Mr. Joel’s plans to elevate and renovate one of the two structures on his Bay Street property. The presence of Mr. Collé and Mr. Tarbet in front of the ARB came after the village Zoning Board of Appeals denied Mr. Joel’s request for a backyard variance by a straw vote in September. Mr. Joel hoped to raise and rotate a two-story building to face Bay Street from Rector Street and combine it with the second structure for an entirely residential property.

“The meshing of the buildings in the streetscape will be so huge, it will dominate the area,” Mr. Brandt said. “Also, this would be a private residence in an area where there are no private residences. The impact of this would be huge.”

Zachary Studenroth, a consultant for the ARB, continued to point out how the combination of the structures would be too large for the traditional historic neighborhood. He also said it would not be appropriate to raise one of the homes and add to the blocking of the view.

“The board is not regulating the preservation of what’s there,” he said. “This would be so large in scale that it feels inappropriate for the site.”

Mr. Tarbet said the plan to bring the two structures together was meant to make the property look more appealing on the outside and fill the open gap of space between the two structures.

When Mr. Collé allowed the board to take a closer look at one of the models of the property, a small crowd formed around the scale model. One of the crowd members was Paul Davis, who lives on a Rector Street property behind Mr. Joel’s structures; he said that his home was misrepresented on the model.

“I really think that for us and the neighbors, this is a huge change in our lives and we’re not looking forward to any change,” Mr. Davis said. “We want to keep the history of the area to scale.”

“We would welcome a redesign of this,” Mr. Brandt said at the end of the meeting. “There might be a creative way of joining the structures without thrusting them together.”