If you're in the path of totality, you'll notice a sharp temperature drop. It's basically going to feel like the sun has set.

For people in the "partial-eclipse zone," things will cool down but not as dramatically.

These changes will happen because there will be less solar radiation reaching the surface of the Earth, which means temperatures will fall. Check out this excellent animation of how incoming solar radiation will change as the eclipse moves across the U.S.