Former Vanguard Group Chairman and CEO F. William McNabb told CNBC that his first meeting with Jack Bogle, and the one that made a lasting impression on him, was his interview for a product manager position at the fund company in 1986.

Bogle, the founder of Vanguard who is credited with revolutionizing the investment business, had his feet propped up during the interview because of "doctor's orders" while he recovered from a heart attack. "It's the only concession I'll make to be in the office," McNabb recalled Bogle saying.

At the time, McNabb was working on Wall Street after graduating from the University of Pennsylvania's Wharton School, but Bogle didn't ask McNabb one question about his resume. Instead, they talked about values, education and books.

It was emblematic of the type of company Bogle had built and of his legacy, McNabb told CNBC. Bogle died Wednesday at age 89.