Society researchers dug up evidence that both Damon and Affleck are descended from William Knowlton Jr. He was a bricklayer who came to the U.S. from England in the 1630s and settled in Ipswich.