There’s been a lot of misinformation going about DotaBuff’s closing (and current potential not-closing), the privacy setting, and what it means for statistical collection in Dota 2. I don’t claim to have all the answers, but here’s the facts as I know them to be.

You can divide DotaBuff into three features:

Everything that existed before the unveil of DotaBuff Rating and DotaBuff Plus The new features unveiled with DotaBuff Plus, i.e. spirit bear items, skill builds, hero win rates by DBR, chat logs, etc. DotaBuff Rating

Let’s take them one by one and see how the privacy changes affect them.

1 is easy in that the answer is “not at all.” You can check CyborgMatt’s mock-up for yourself. Virtually every stat DotaBuff aggregated is available through the API. You won’t be able to see the names of private players in a match, but every match is still available so you can still have hero win rates and item usage rates. You won’t be able to see your personal stats and match history without disabling your own person privacy settings.

2 is a bit trickier, at least at the moment. As far as I know, most of these features were created through replay parsing. Anyone could theoretically do this, but DotaBuff’s replay parser is likely significantly more advanced than any other parser outside of Valve. Parsing through hundred’s of thousands of matches per day is also a rather extreme feat that should not be trivialized.

Aside from this, you previously could grab match replays through an entry in the API which appears to have been disabled. Without access to this DotaBuff would no longer be able to do any match parsing.

My assumption is that this has been disabled until Valve can find a way to make replays mesh with their new privacy policy. I don’t personally know the details of what information replays store, but this post suggests that previously you could use replays as a way to bypass the privacy setting. I expect this functionality will eventually be returned which will allow for all parsing features to be replicated.

One other twist is that there were a few new DotaBuff Plus features that were dependent on DBR, specifically the hero win rates and skill build by DBR bracket. These features can be replicated using the in-game skill brackets that are available through the API. Admittedly, these are match measurements rather than player, but the difference is relatively negligible.

3 is absolutely broken. Unless something drastic changes or something new comes to light, it will stay broken.

So let’s look at this from the perspectives of DotaBuff and Valve.

DotaBuff came out with DotaBuff Plus. On one hand, their operation is pretty massive, and they need some way to offset expenses. On the other hand, there’s no reason to believe that this was a non-profit organization. Ultimately, I see no reason to laud or impugn their motives. Ultimately it’s just business.

DotaBuff Plus came with a lot of features, but the shining star was clearly everything related to DBR. Regardless of your personal opinions on a visible MMR, it was far and away the most capable feature of driving subscriptions, and DotaBuff likely knew this. It was also the feature that future competing stat sites would not be able to compete with. Having it killed off puts a big damper on their financial plans, and however you feel about those plans, killing them would put a damper in being able to cover their server expenses if nothing else.

That being said, they don’t appear to have thought of any contingency plans for if/when Valve took issue with DBR. A bad move on their part because that when turned out to be “very quickly.”

The obvious question is why was Valve so quick to respond? DotaBuff Plus and DBR get announced and within days Valve suddenly announces a privacy setting AND the re-release of the API. Both things have likely been in the works for a while, but the timing can only be seen as a response to DotaBuff’s announcement.

One reason suggested for this is that DotaBuff Plus in some way is the culprit, either that Valve didn’t like the attempt to monetize or that it somehow put them in an undesirable legal position. I can’t really say much about this explanation, but in the absence of evidence I don’t find it very compelling.

Other people point out that DotaBuff was using a backdoor method to get their information. Yeah, but it was basically an open secret that their stat aggregation wasn’t entirely on the up and up since before they were even called DotaBuff. Valve had to have known what they were doing and neglected to do anything about it until now. This explanation might serve as a pretext for Valve’s actions, but I don’t believe it is what drove them.

My preferred explanation is that Valve feels they cannot allow a public MMR to exist that they do not tightly control. DBR broke that rule, and Valve transcended Valve Time and broke DBR. So why is Valve so controlling when it comes to public MMR?

1. They want to tightly control how and when any kind of ratings get displayed in order to prevent poisonous behavior

Yes, I called DBR “relatively innocuous,” and it’s certainly less toxic than the way HoN handled ratings, but I can understand that weak assurance being not good enough. There was nothing stopping DotaBuff from changing their policies in the future, so cutting off their access was much safer.

2. DBR undermines their plans for the future development of the game

Some have said that they have no problem with All Pick being a serious competitive environment. Fine, there’s no accounting for taste. What’s not ok is the primary competitive outlet for a game having absolutely no party size requirements or restrictions.

Some people claim that stacking isn’t actually a good way to boost your win rate. There’s a kernel of truth to that, but only a kernel. In reality, stacks have a built-in matchmaking handicap that compensates for their (assumed) superior coordination. Many groups can’t quite live up to this handicap and experience sub-50% win rates. Meanwhile, there’s a relatively small number of groups that can easily outperform the handicap and maintain massive win rates. As of now this isn’t that big of an issue. Group handicaps are likely a work in progress, and no system will ever be perfect. If you suddenly turn the main matchmaking queue into a quest to get the highest DBR you’ll spur plenty of competition, but the most productive outlet for this competition will be to come up with a group design that best games the group matchmaking handicap. This is a completely unacceptable state of affairs. Any matchmaking with a visible MMR should either be 5v5 or solo queue.

Aside from that, one thing most people neglect to consider is that every matchmaking option is essentially in competition with all the matchmaking options. The quality of your matches is dependent on how many people are looking for a match at the same time, and every alternative game mode will be drawing people away from your queue. A visible personal rating is a feature that will draw many people to a mode, and having it in general matchmaking makes it significantly more difficult for Valve to test future matchmaking additions in a controlled environment. Along these lines, I stand by my previous position that public matchmaking with a visible MMR will compete for player attention with any ranked 5v5 mode. 5v5 is the harder mode to get running. The barriers to entry are higher, and it becomes very difficult to keep low end play rates high enough to keep low end matches sufficiently balanced, which in turn erodes match quality and leads to further low end player loss, etc. 5v5 needs to receive priority attention before any kind of solo matchmaking with a visible rating is implemented, and DBR interferes with this.

3. DBR could represent a potential security risk

The joke goes that Valve doesn’t want DBR because it would expose the fact that their matchmaking doesn’t work. Besides the typical D-K Overdrive conspiracy theory, there could actually be some truth to this. Valve presumably does not want its competitors knowing how its matchmaking system functions. DBR provides a list of matches along with a relatively generic rating system. If you find matches that don’t make sense within DBR, you could potentially use them to infer how the matchmaking system actually works.

I honestly find this one to be a bit of stretch. 1 and 2 are sufficient alone, but I guess it’s possible that DBR represents a potential security break in the future.

In any case, where we stand is this. All the stats we’re used to are still there. MMR is back to being completely hidden instead of partially, imperfectly revealed. DotaBuff may or may not survive, but even if they go down the competition now has all the tools to replicate what they’ve done until this point. That being said, no one is close to the scale of DotaBuff, so losing them would still be a loss in the short term. I personally feel that Valve’s implied stance on public MMR is justified regardless of the implications.

Share this: Twitter

Facebook

Like this: Like Loading... Related