Leaving back things you like to do because of work is something you should never do. If you ever get to the point where your job becomes demanding like that, you should see about cutting back on the work hours or, if that isn't possible because your boss is a slaver, find a new job that allows you to have a life again.