The Saudi Arabian government enlisted a Twitter army to silence its critics online. It groomed a Twitter employee in the United States to try to get him to spy on certain accounts. And an American-based consultancy company helped the government identify and target dissidents on Twitter who were later punished and silenced.

Katie Benner, Mark Mazzetti, Ben Hubbard, and Mike Isaac at the New York Times on Saturday detailed the efforts of the Saudi government and Crown Prince Mohammed bin Salman (MBS) to quiet dissenters in the country and around the world. The report lands amid increased scrutiny on the Saudis and MBS over the disappearance and murder of dissident journalist Jamal Khashoggi, who went missing after entering the Saudi consulate in Istanbul on October 2.

The report reveals the dangers for American tech companies, which have until recently single-mindedly focused on growth. Like Facebook, Twitter is beginning to see the downsides of a completely open platform — particularly when it intersects with authoritarian regimes.

The Times report details how the Saudi government has been manipulating the power of Twitter

According to the Times, Saudi operatives have “mobilized to harass critics on Twitter” to keep them from speaking out. They’ve employed a number of tactics, including swarming critics with memes, creating distractions from relevant conversations, and reporting content they don’t want to be seen to Twitter as “sensitive.” The government has created its Twitter army by paying young men about 10,000 Saudi riyals, or $3,000, a month to tweet.

One of the most disturbing parts of the Times’s story is its account of how the Saudis identified and groomed a Twitter employee, Ali Alzabarah, to spy on accounts from within. He joined Twitter in 2013, during which time he obtained an engineering position that allowed him to access users’ phone numbers and IP addresses.

Twitter executives became aware of what was going on in 2015 after intelligence officials told them Alzabarah had “grown closer” to Saudi intelligence operatives who have “persuaded him to peer into several user accounts.” He was eventually ousted and went back to Saudi Arabia:

Caught off guard by the government outreach, the Twitter executives placed Mr. Alzabarah on administrative leave, questioned him and conducted a forensic analysis to determine what information he may have accessed. They could not find evidence that he had handed over Twitter data to the Saudi government, but they nonetheless fired him in December 2015. Mr. Alzabarah returned to Saudi Arabia shortly after, taking few possessions with him. He now works with the Saudi government, a person briefed on the matter said.

Twitter, according to the Times, subsequently sent out safety notice to the accounts Alzabarah had accessed.

An especially disturbing anecdote at the end of the Times story revealed a McKinsey & Company study that measured the public reception of economic austerity measures introduced in Saudi Arabia in 2015. The report found that the measures got twice as much coverage on Twitter as they did in more traditional news outlets, and the Twitter reaction was much more negative than positive.

Three accounts were driving the conversation on Twitter, McKinsey found. After the report came out, the man behind one of the accounts was arrested, and another man behind one of the accounts had his phone hacked and said two of his brothers were arrested. The third account, which was anonymous, was shut down.

A spokesperson for Twitter declined to comment on the Times story. McKinsey in a statement said they were “horrified” by the possibility that the report “could have been misused in any way.”

Statement in response to today's New York Times article https://t.co/o4Z3h2THcC pic.twitter.com/rJtMzDOclG — McKinsey & Company (@McKinsey) October 21, 2018

There are many reasons to be concerned about Saudi Arabia — and Twitter

Khashoggi’s disappearance has put Saudi Arabia and MBS under the microscope.

While the crown prince has sought to cast himself as a reformer, there has been evidence of a darker side to him for years: The Saudis were involved in the mysterious disappearance of the Lebanese prime minister in late 2017 (he later reappeared) and rounded up and imprisoned hundreds of influential business executives and members of the royal family last year. MBS is overseeing a war in Yemen and a diplomatic blockade of Qatar and this year has engaged in an ongoing spat with Canada.

The Trump administration, however, seems to like him.

The Times story also exemplifies how Twitter has been dealing with bad actors using its platform for manipulation and nefarious ends. The San Francisco-based company has said that it is trying to focus on the “health” of the conversations it hosts and purged suspicious accounts. A lot of focus has been placed on Russian bots, but Russia is hardly the only source of trouble.

Twitter CEO Jack Dorsey testified on Capitol Hill in September and acknowledged the “real-world negative consequences” of Twitter — specifically, in that case, in the United States. The Times story shows how much broader the problems, and more severe the real-world consequences, are.

We‘ve made significant progress recently on tactical solutions like identification of many forms of manipulation intending to artificially amplify information, more transparency around who buys ads and how they are targeted, and challenging suspicious logins and account creation. — jack (@jack) September 5, 2018

Update: Updated with statement from McKinsey.