"It really does boil down to, on the individual level, how much of an impact is this making?" says Michael Pollock of the New Jersey Audubon Society. "We tag something as invasive when it's a tremendous pain. For home gardeners, that means 'this thing just won't go away.' "