Yes indeed XD Well let´s say the atmosphere is gravitational attached to the surface. If the edge is broken as here, it wouldn´t just fly out in space.

It might create extremely strong winds there but still be intact. Also the edges could never be as sharp as on this picture, it would be smoother.