Bespoke suits, jeans, tattoos and bow ties all have their place inside the office of Details magazine. But there's one thing the 65 employees of the men's fashion book, headquartered on the eighth floor of the Condé Nast building, agree on: proper fit.

"Men—particularly American men—tend to wear clothes that are too big for them,"...