New York (CNN Business) Billionaire investor Ken Fisher has been barred from attending future Tiburon CEO Summits, after he made sexual remarks at the exclusive conference earlier this week.

Speaking at a fireside chat at the Tiburon conference in San Francisco on Tuesday, Fisher made comments about genitalia, compared wooing clients to picking up women, referenced Jeffrey Epstein, and made other inappropriate comments, several attendees said on social media and in interviews with the Washington Post and Bloomberg

In a statement, Fisher apologized for the remarks.

"Some of the words and phrases I used during a recent conference to make certain points were clearly wrong, and I shouldn't have made them," Fisher said. "I realize this kind of language has no place in our company or industry. I sincerely apologize."

Fisher is a well-known investment adviser. He pitches his money management firm, Fisher Investments, in television advertisements across many different media platforms, including CNN.

Read More