In the coming weeks, every major Western newspaper and many top China analysts will be making strong claims about Chinese leader Xi Jinping’s political position in the wake of the 19th Party Congress. These reports will build off years of tea-leaf reading and Pekingology that collectively underpin a now familiar story of élite political strife met by Xi’s personal consolidation of power. Their accounts will end either with Xi “solidifying his dominance” or “succumbing to the countervailing forces of his rivals”—and they will project an air of certainty. Yet their conclusions, in most cases, will rest precariously on assumptions and guesses about underlying Party mechanics and motivations that can neither be proved nor disproved. Even the best-sourced experts can’t discern how policy preferences and objectives shape political coalitions or élite Party divisions, and we lack critical diagnostic information that would be necessary to confirm or refute competing hypotheses about major political questions.

China’s Party-state is extremely successful at controlling information. Even the most basic insights into policy deliberations and processes, leaders’ intentions and views, and élite power dynamics are filtered through a sophisticated propaganda and censorship regime. A researcher who wants to know, for example, a particular leader’s personal view on state-owned enterprise reform can’t simply interview that leader or read transcripts from committee meetings. She instead has to rely on oracular statements from the People’s Daily or highly scripted speeches at public events. Facing such constraints, analysts have developed alternative models to squeeze insight from the information either that the Chinese Communist Party (C.C.P.) releases through its Orwellian filter or that it cannot control. Such efforts can yield valuable insights. For example, close analysis of personnel movements can give indications of a leader’s expertise and connections, and close readings of Party documents can reveal a shift in policy concepts (like the change from “social management” to “social governance” in 2012). But in most cases, they depend heavily upon assumptions that paper over information gaps, or are structured in ways that exclude policy considerations and important variables.

China’s increasing importance in the world is self-evident, and yet we know shockingly little about the men (and they are almost all men) making decisions in Beijing. One might expect that we would be more familiar with the leadership personalities and processes in a country with China’s global footprint. Even more disconcertingly, we all too often use what little we do know to make assumptions that form the bedrock of larger, more sweeping judgments. Simply unearthing and clearly stating our assumptions, and asking what other conclusions the same set of facts might support, would help us enormously in knowing what we—journalists, think tankers, scholars—do know and knowing what we don’t.

* * *

There is an extraordinary amount of information available in China today about policy priorities and experiments, and even the Party’s intentions. Researchers can stagger through reams of five-year plans or even the government’s own datasets to understand the general contours of the Party’s governance program. But the C.C.P.’s propaganda apparatus has grown steadily more sophisticated and comprehensive in the last decade, and the Party subjects top leaders to ever more intensive image control to shape perceptions of their roles, individual intentions, and personalities. Whereas Jiang Zemin once flew off the handle when foreign reporters asked unwanted questions, and Premier Zhu Rongji admitted that he would rather not have visited the United States during a period of bilateral tension, leaders almost never speak off the cuff anymore to reveal their private thoughts. Gone are the Mao- and Deng-era days when intra-Party conflicts played out in the People’s Daily with enough transparency that observers could clearly draw connections between public policy debates and the associated alliances within the leadership. Official media outlets do still provide rich insight into the evolving Party line and associated policy considerations. We can, for example, use them to determine changes over time to the C.C.P.’s overall policy plans and focus. Yet the pages of Party papers no longer serve as a battleground on which leaders thrash out ideological or policy disagreements. This means the official media can rarely serve as a tool for tracking the relationships between the substance of policy discussions and the high-level political coalitions fighting behind the scenes.

Conversation What to Watch at China’s Party Congress Ho-fung Hung, Taisu Zhang & more The Chinese Communist Party’s 19th Party Congress, a hugely important political meeting usually held once every five years, will begin on October 18 in Beijing. Like many events involving China’s ruling party, the most important decisions and...

Almost everything we know about top leaders’ personal policy and ideological proclivities now depends on information that has passed through opaque political deliberations and has been released for purposes that we do not fully understand. And observers—including Western media—too often echo these portrayals uncritically. Xi has been regularly characterized as a strong advocate for market-oriented economic reforms, largely on the basis of his early speeches and the ambitious reform program ratified at the 2013 Third Plenum. Yet he has subsequently overseen a rather conservative SOE reform program and repeatedly advocated state-centric industrial policies that seem deeply contrary to—and indeed imperil—his initial reform goals. So, was Xi sincere but too weak to follow through? Or did the early statements reflect a liberal consensus, while his later statements reflect his own, stronger voice? Or do his own views contain the internal contradictions evident but often overlooked in the Plenum Decision? We don’t know because we can’t say with confidence whether major Party decisions and statements reflect individual leaders’ views, a political consensus, or other pragmatic considerations. And as a result, we are not only unable to identify individual views and priorities, but we are fundamentally unable to discern élite political coalitions based on policy preferences, ideological positions, or individual objectives.

Official Chinese media coverage of individual leaders is important and can reveal indications of policy shifts and political tension. But their public personas are also increasingly carefully crafted and controlled—from the caricature of the avuncular former Premier Wen Jiabao to the decisive, man-of-action Xi Jinping—and we have no way of knowing whether these public portrayals reflect reality, a calculated propaganda strategy, or both, because we have virtually no insight into the motivation behind directives the government issues to control that coverage. Different observers interpret the same change in state media reporting in fundamentally different ways because their conclusions depend largely on the assumptions they make about the Party’s motivation.

(The Straits Times) Two articles with different predictions about Wang Qishan published on ‘The Straits Times’ website, on October 13, 2017 and August 24, 2017.

Such concerns are especially relevant now, as official media tout Xi as the “core of the Party center” and highlight his slogans ahead of the 19th Party Congress. This laudatory coverage—and in particular, the description of Xi as the “core” leader, an appellation generally not used to refer to Hu Jintao—has led most observers to conclude that Xi has scored a major political victory. But to understand what the designation is meant to signify requires critical contextual information. Was the “core” designation the result of Xi’s flexing his political muscles? Was it a calculated effort to advance discipline within the lower ranks of the Party? Was it contested or supported by his colleagues within the leadership? How and where was the decision made? The range of possible interpretations for élite politics ranges from the mundane (e.g. a concerted effort to portray a strong leader in a time of great challenges) to the extreme (e.g. a signal that Xi is as powerful as Mao or Deng), again depending entirely on one's underlying assumptions about Party motivations and decision-making processes.

The existence of ambiguity is not inherently problematic; we can and should continue to monitor official media portrayals of leaders and watch for changes in propaganda. But we must account for—and be explicit about—how our assumptions influence our conclusions. For example, if you assume that enhanced media coverage of Xi is primarily a function of behind-the-scenes power struggles, then you will see a one-to-one reflection of his personal power in the associated propaganda. In contrast, if you assume that changes in media coverage are based on propaganda imperatives and political strategies, then the shift in coverage could have multiple potential meanings. The data itself—Xi’s media portrayal—doesn’t definitively prove one conclusion over the other without additional information about the Party’s internal calculus, which we know we do not have. This means we must allow for a range of possible behind-the-scenes explanations that are consistent with the evidence we have, and only exclude alternative conclusions if a rigorous—and transparent—analytic process can validate the full chain of assumptions and interpretations we are making. In other words, we need to ask, what are all possible (personal, political, collective, strategic) motivations behind enhancing the General Secretary’s media image? We may like certain explanations more than others, but unless we have evidence directly refuting a possible motivation (e.g. leaked memos showing other Politburo Standing Committee members’ opposition to Xi’s flattering coverage), we cannot rule them out.

* * *

This opacity has eroded our ability to address the role of high-level policy or ideological coalitions in élite politics. Instead, we do our best to squeeze information out of the few data sources the C.C.P. cannot easily control—namely, concrete policy actions and personnel movements—and use them as a proxies or instruments to estimate the leadership dynamics we cannot observe, such as the power of a given leader. While these tools can make important contributions under certain circumstances, they have enormous limitations and are unable to fill the gaps in our understanding of Chinese leadership dynamics.

Xi is almost universally seen as powerful because he appears to have accomplished things his predecessors’ administrations did not. He has overseen an aggressive anti-corruption campaign, dramatically increased Party discipline, overhauled military structures, and outlined a bold economic reform plan, to name a few. By contrast, his predecessor, Hu Jintao, is widely viewed as relatively weak because his administration appeared to have a far less ambitious program (though one could argue the political challenges were simply less titillating, e.g. the arduous fiscal and bureaucratic issues associated with the rural development program), and seems to have failed when it did outline ambitious goals.

There is certainly a plausible case for this analytic approach. Failure to deliver promised policies could very well indicate a lack of personal political capital. But the model is based on a simple framework: Chinese leaders advocate their personal preferences in the face of resistance (e.g. from other leaders, local governments, and often-unspecified interest groups). The resulting policy outcomes—vigorous or tepid—are therefore directly proportionate to the leader’s political strength. But this framework implicitly assumes that policy initiatives reflect the unadulterated priorities of the leaders themselves, not a consensus position that optimizes existing political support. Nor does it control for pragmatic considerations, competing priorities, or shifting pressures that factor into the policymaking environment.

Without insight into high-level deliberations and leaders’ priorities, it is almost impossible to differentiate between a strong Chinese leader who forces his compatriots to adopt his preferences and one who has a supportive environment and institutional capacity to enact such policies—or indeed, one whose statements and actions only ever reflected a consensus position in the first place.

Was Hu too weak to enact the political and economic reforms that he appeared to advocate (and at times experimented with), finding himself stymied in the face of powerful opposition? Or did he back away due to practical considerations, like the urgency of the global financial crisis or failure to find viable policy options that could satisfy diverse priorities? Likewise, did Xi launch the crackdown on corruption to solidify his political position? Or was the political environment supportive of such moves as the Party élite faced the existential threat posed by the Zhou Yongkang and Bo Xilai scandals? Without insight into high-level deliberations and leaders’ priorities, it is almost impossible to differentiate between a strong Chinese leader who forces his compatriots to adopt his preferences and one who has a supportive environment and institutional capacity to enact such policies—or indeed, one whose statements and actions only ever reflected a consensus position in the first place.

Let us consider this problem with an analogy. We see three men each standing behind a plain, unmarked box. The first and third men pick up their boxes and move them. The second reaches out and grabs his box but does not lift or move it. Why are the three men behaving differently? Are the first and third boxes dramatically lighter? Is the second man considerably weaker? Does the second box contain a ticking bomb that can’t be disturbed without going off? Were all three of them even intending to pick up their boxes in the first place? Without additional information, we simply don’t know. We therefore can only draw confident conclusions about leaders’ relative power if we are confident that we understand their true preferences and have a way to measure the shifts in relative pressures for and against underlying policy moves (or in this case, for lifting up the box). Most of the time, assessing a given leader’s performance on, say, achieving certain reform goals requires making an assumption that his public statements reflect his personal views (and even then we must be careful to confirm we know what leaders mean when they talk about reform goals).

A related issue is the conflation of Xi Jinping’s personal ambitions and political power over the Party élite with the C.C.P.’s dramatic reassertion of political control throughout China. It is now almost holy writ that the Party’s efforts to fight corruption and otherwise reform governing institutions reflect, and are evidence of, Xi’s personal domination of the political process. Reporting on Chinese politics regularly conflates the Party’s sweeping efforts to reassert its power with Xi’s own autonomy relative to his peers: “Analysis: China’s Xi Jinping Amasses Power in Huge Corruption Crackdown,” “China’s President Xi Solidifies Power with Overhaul of Military,” “Latest Shuffle in Beijing Puts More Economic Power into Hands of Xi Jinping.” Imprecise writing often compounds this problem, when “centralization” and “power consolidation” are used interchangeably to describe fundamentally different phenomena.

There is no doubt that Xi is more influential in his position as Party Secretary. This is due to institutional changes meant to strengthen the center of the Party, and that increase in individual power may well be his personal motivation for pursuing them. But one must differentiate between actions that make the Party stronger or more effective, and those that allow Xi to steamroll his colleagues at the apex of the political system. Additionally, there are multiple possible motivations for what Xi (or the leadership collectively) is doing: wresting Party control back from individual cadres who controlled their own political fiefdoms, and whose pursuit of power threatened the Party’s continued existence (e.g. Bo and Zhou); ridding the Party of endemic corruption that threatened popular support and the ability of the center to control its policy agenda; countering the corrosive effect of social media and other new technologies that were undermining Party ideological controls; eliminating bottlenecks and reasserting coherent Party oversight of a fractured and disjointed policymaking process; or presenting a clear and appealing image of the Chinese leadership for public consumption. All of these have clear antecedents prior to Xi’s ascendance, and none deviate from the C.C.P.’s political strategy since the early 1990s, except in intensity. So the bar is high for evidence that can prove or disprove that Xi’s personal political power was the key explanatory variable.

An oft-cited example of Xi’s personal power grab is his position as head of a large number of Leading Small Groups, making him “Chairman of Everything.” Leading Small Groups are Party- or government-affiliated advisory bodies organized around a policy topic or specific task (for example, the Leading Small Group on Finance and Economy, or the Beijing Olympics Preparation Leading Small Group). This interpretation commonly leads to the conclusion that Xi is using his authority in these groups to usurp political authority from other government institutions generally, and Premier Li Keqiang and the State Council specifically. Yet, again this interpretation often rests on assumptions to compensate for the lack of detailed information about how the Leading Small Groups interact with the larger People’s Republic of China policy-making apparatus, and how the role of key leadership positions in this system have or haven’t changed under Xi. We know very little about what happens at Leading Small Group meetings or exactly how group recommendations feed into the Party and state decision-making and implementation processes. In some cases, we don’t even know the full membership of a Leading Small Group.

It is certainly possible that Xi used the Leading Small Group system to make a power grab. But there are also plausible alternative explanations for Xi’s Small Group leadership that might represent a far less dramatic shift in political power. Changes to the leadership system could be an attempt to improve policy coordination and enforcement; by merging processes that were previously disjointed and ineffectual, with distinct decision points divided into separate meetings of the Politburo Standing Committee, Politburo, and State Council, the Party might have been preparing to tackle complex, cross-cutting policy problems. This explanation helps make sense of the fact that Leading Small Groups generally include all relevant policy stakeholders from the Politburo Standing Committee down to relevant ministers, including Li and the State Council.

To assess the ultimate implications of Leading Small Group changes for élite politics and Xi’s personal power, we would need to be able to differentiate between steps that the C.C.P. leadership has collectively taken to sustain its longevity or improve the efficacy of its institutions, and steps that Xi has individually made to advance his personal authority within the leadership system. Yet we are again fettered by how little direct insight we have into the internal dialogues that precipitate such moves, and cannot rule out opposing hypotheses for why Xi (or the Party leadership) made certain institutional reforms. Nor do we fully understand the Leading Small Group decision-making processes as they functioned before and after Xi’s administration, so we do cannot make strong conclusions about what the changes mean for élite power dynamics irrespective of their motives.

Personnel movements are one of the few data sources in Chinese politics that cannot be easily scrubbed from view and thus constitute an excellent starting point to track political machinations. But too often we interpret these tidbits of information using a factional model that is no longer comprehensive enough to support the results we derive—and overlook that we rely on the associated conclusions precisely because we lack more comprehensive insights into the increasingly complex Chinese political system.

During the Mao era, Western observers described “factions” as deeply rooted protective networks of patron-client relationships that transcended policy issues, except insofar as they protected specific economic and political power bases. In the 1980s, factions could still be more or less discerned, and could have their basis in shared ideology, bureaucratic interests, or pure power seeking. While networks of leaders with shared interests undoubtedly still exist, the term “faction” is all too often used in a loose and overly capacious fashion and is dependent on the very limited information we have about individual leaders; thus the apparently neat division of leaders into factions based on their former membership in the Communist Youth League or their status as children of former top leaders (“princelings”). Yet, the criteria often used to assign membership to various factions can be shaky. Politburo Standing Committee Member Liu Yunshan, for example, was often described as part of Jiang Zemin’s faction, but a review of his CV would seem to place him more in line with the Youth League camp.

Using factors such as a common work history or similar background to assume a deep, career-long patron-client tie to a single leadership network overlooks the fact that we have little information about the depth or strength of these relationships or how a leader’s particular work history played into his promotions. It presupposes a degree of coherence and organization to networks that might be better viewed as interest groups or even merely people with common backgrounds, with none of the attendant political influence. (It also ignores the fact that working with someone can create bitter feelings as well as strong bonds.) In some cases, the peculiarities of the Chinese promotion system may actually help create the appearance of strong patronage networks where they might not exist. (For example, according to one paper, the Communist Youth League offers faster-than-average promotions for cadres, providing a critical leg up by avoiding age caps as they reach higher levels of government. The outcome of higher long-term promotion potential has the appearance of a high-level patron-client network, when its real contribution might be an early-career push that lacks any of the cohesion and political force of a true faction.)

Even more fundamentally, the logic of the factional model is flawed because it does not allow for the possibility that leaders might sometimes prioritize policy objectives over the protection of their networks. We should not simply assume that Chinese leaders differ from their counterparts in other countries in promoting people they know to be competent or effective. Media did not describe Arne Duncan as being a member of President Obama’s “faction” when he brought him from Chicago to Washington to act as his Secretary of Education. Certainly Chinese leaders have similar motivations to bring with them people they know and trust, without necessarily forming a “faction.”

This is not to say that personal ties are irrelevant to power dynamics, and certainly does not mean such models cannot yield valuable insights. According to research by Franziska Keller, a Chinese government official’s past and current coworkers are more likely to determine his future promotion opportunities than, say, whether or not he shares an alma mater with another leader. Working relationships might then be more predictive of alliances between leaders, as well as indirect influence over key nodes of power, such as the Organization Department or Discipline and Inspection Commissions. And as the Bo Xilai and Zhou Yongkang affair amply demonstrated, there are still political networks in China that should be characterized as “factions” in the older patron-client sense (and they were indeed described as factions in official Chinese media).

However, especially given our limited knowledge of the individuals involved, describing all Chinese politics primarily in terms of factions unnecessarily flattens out a complex and evolving political landscape, and it overstates our confidence in the associated conclusions drawn from promotions. As in any country, sometimes “where you stand is where you sit,” and officials must advocate on behalf of interests derived primarily from their institutional affiliations rather than personal factional affiliations. This undermines our ability to predict leaders’ allegiances after they move to new positions, and raises serious questions about reliability of the factional models. Thus, it is probably more accurate to think of competing coalitions or strategic alliances that can shift as political or ideological circumstances dictate, which means that personnel movements can be important—but they can also be fairly mundane. So we should not discount personnel-watching as a tool for understanding the Chinese leadership, but if we interpret all personnel shifts as the result of zero-sum factional rivalries, leaving no room for policy considerations or shared objectives, we will vastly overstate our actual knowledge and inadvertently exclude more powerful explanations of Party political dynamics.

* * *

Any of the analytical shortcomings described above would be problematic in and of themselves, and we suspect that most analysts would agree that key information gaps should temper our confidence in specific conclusions. But in the face of deeply limited information, we have been forced to make assumptions about the C.C.P.’s motivations that are self-reinforcing, and the danger is that they are building off of each other to form a conventional wisdom about Chinese leadership politics that may be more fragile than many observers appreciate. In doing so, we have become vulnerable to the kinds of analytical “layering” that have led to dramatic intelligence failures.

Given the strong consensus in the China-watching ether regarding Xi’s personal power, there is a risk that new information either strengthens this argument or falls afield because it doesn’t fit into a clear narrative. But we must be careful not to paper over reasons to be skeptical given that nearly all of our conclusions rest upon important assumptions. So we should ensure that we are mindful of and constantly reevaluating our assumptions as contradictory information becomes available.

So how does one make sense of the reporting and analysis on the Chinese leadership, especially in advance of a major conclave like the 19th Party Congress? How does one know whether to believe news reports that will inevitably characterize Xi as either the new Deng (or Mao) or as an overly-ambitious leader checked by his rivals?

We recommend a high degree of skepticism, and suggest asking the following questions to clarify how much we know and what assumptions we’re making to reach our conclusions:

In terms of personnel promotions and the make-up of the Politburo, how reliably do we know that a given person is uniquely loyal to Xi (or to someone else)? How well do we understand the make-up and cohesion of the purported rival factions? Can we assess the strength of their connections beyond overlapping work assignments? What do we know about the procedures and considerations (e.g. competence, priorities, and alliances) that led to the promotion in question?

If no evident successors are named, what assumptions are being made about the reasons behind this? Why exactly was the leadership unable to come to a consensus at this time? Does it clearly indicate that Xi intends to stay on beyond a second term? Did he achieve this by force or in concert with his colleagues? If a successor is named, is this a blow to Xi? Do we know whether Xi ever intended to stay on beyond his two terms?

In terms of Xi's personal power “consolidation,” how has his standing changed relative to his colleagues in the Politburo or its Standing Committee? Can we differentiate between changes in strength of the institutions that he and his colleagues control or his own influence? What was the impetus for these changes?

In terms of changes to the Party constitution and other major policy initiatives, do we fully understand their significance and the motivations behind them? Was Xi pushing his own personal ideological priorities or trying to demonstrate his strength? Was there clear opposition or support from the political élite—if so, how much?

If we cannot answer these questions, we must interrogate our own thought processes: What assumptions are we making about the evidence we have? What additional information would we need to confirm or refute those assumptions? And what other conclusions are compatible with the evidence that we do have?

If forced to make prognostications, the two of us would predict a Party Congress that does not break any major taboos (e.g. scrapping tacit age or term limits for Politburo Standing Committee members), but one that also portrays Xi as powerful and thoroughly in command of the Party (e.g. following previous leaders in having his wisdom included in the Party’s constitution). But we have very little confidence in any such judgments, because we believe that most of the associated evidence is ambiguous or unreliable. The one thing we do predict with high confidence is that media coverage of the events of the19th Party Congress will box Chinese politics into overly clean and confident-sounding narratives about Xi’s power, with little mention of the crippling information gaps that should temper our conclusions.