Yeah, but I have a headcanon that it either doesn't hurt him as long as it's him drinking his own soul, or (and even if this one is it, it probably means both are true) as long as there's enough of his soul left in there it regenerates quickly. Quickly enough that he can do that every match as long as he only drinks a little bit, which he does.