Famous as the site of the first shots of the Civil War, Fort Sumter actually faced its toughest tests years into the conflict.