Marc Lasry and Barry Sternlicht at Delivering Alpha in New York on Sept. 13, 2016.

Donald Trump repeatedly assures voters of his business prowess, but a lot of investors are apparently reluctant to do business with him.

Dozens of the biggest names from the investing world gathered at the 2016 Delivering Alpha conference on Tuesday, and they were asked if they had met Trump. Several people in the room raised their hands. When Avenue Capital's Marc Lasry then asked the room how many would do business with Trump, no one raised a hand.

A few people raised their hands when asked the same question about doing business with Trump's Democratic opponent Hillary Clinton.

Roughly 125-150 people were in the room in total at the time. Delivering Alpha is an investor conference sponsored by CNBC and Institutional Investor.

Billionaire developer Trump has been criticized on the campaign trail for allegedly failing to pay contractors and benefiting personally from his companies' bankruptcies. Clinton and her allies have repeatedly attacked Trump for his business record.

Starwood Capital Chairman and CEO Barry Sternlicht, who appeared with Lasry on Tuesday, would not say whether he will vote for Trump, though he identifies as a Republican.

However, he said he "wouldn't count Donald out at all."