Yes, the peer pressure and "all or nothing" mentality is intimidating and made me lie about how much I actally enjoyed the band.

No, you are your own person and can do what you want, no one is stopping you.