"He was a quirky man," his daughter Dorothy Brown told the paper. "But when it comes to us kids, he loved us, he raised us well and, of course, we wanted to help him."