Your options:

1. Let them know you don't eat meat, which makes them feel obligated to cook them something special and/or makes you sound presumptuous.

2. Don't tell them, and so make them feel bad when you can only eat the side dishes.