\$\begingroup\$

I don't have a source, but I recall an explanation when USB was new that the different shapes represent the different device types that USB could connect to. This emphasizes the universal in Universal Serial Bus.

Just as an example, USB 0.8 already supported output devices such as printers, HID devices, and I/O devices such as Zip drives.