City workers on Monday removed the red, white, and blue banner - which has the Confederate flag in the top left corner - from a lighting standard near Passyunk Avenue after dozens of protesters and some local residents asked for it to be taken down, city officials said.