"The reality of it was too much," Ashley told the "Today." "We have hard conversations and had to talk about things that we didn't think we had to talk about until we were like 60 or 70."