delong250_smratboy10Getty Images_digitalsociety smartboy10/Getty Images

The Algorithm Society and Its Discontents

Modern civilization was built by adding markets and bureaucracy to other, much older modes of human organization: redistribution, reciprocity, and democracy. But the rapid rise of governance by algorithms could represent another epochal shift – and it will not be for the better.

BERKELEY – In my view, the most profound and insightful work of political economy written in the 2010s was neither a journal article nor a monograph nor a book in the traditional sense. Rather, it was an online symposium. In Red Plenty: A Crooked Timber Book Event, scholars and intellectuals, convened by political scientist Henry Farrell, used a new mode of print-communication to react to Francis Spufford’s very interesting book Red Plenty.

Spufford had analyzed the Soviet Union’s stunningly unsuccessful attempt to use bureaucracy and mathematics to build a better society than could be achieved using markets. Yet every time I return to Red Plenty: A Crooked Timber Book Event, I am struck by its contributors’ insights into the insurmountable dilemmas generated by the modern market economy itself. I am also still struck by how successful the “book event” was in using new technologies to drive a qualitative shift in how we communicate and come to understand the world together.

I have been thinking about these issues because Farrell recently published a new article, “The Moral Economy of High-Tech Modernism.” He and the sociologist Marion Fourcade argue that the internet and its progeny (what they call “high-tech modernism”) are changing the world in ways that are as profound as the rise of the market economy and the bureaucratization of society under the modern state.

This argument concerns the very foundation of human society. As individuals, we humans are each weak and helpless. Only with the knowledge that we gain from life within a culture are we able to survive. But to have a culture or produce anything, we need to organize and coordinate ourselves in a collective intelligence and distributed entity. For thousands of years, we generally have had three different modes of maintaining such organization.

The first is redistribution: information, resources, and useful products flow into a centralized pool and then flow out again in the form of assigned tasks, tools, rewards, or social support. The second mode has been reciprocity: each household is linked to a few others in long-term gift-exchange relationships that tend toward a rough balance. And, because there are only six degrees of separation in most human societies, one unit’s needs will affect the actions of many others. Lastly, there is democracy: people use debate and discussion to reach a rough consensus and achieve broad-based support for an agreed-upon plan.

Of course, each mode of organization entails a mode of distribution and authorization, to answer the question of who should get more of the good things (who should be “more equal” than the others). With redistribution, power accrues to the one at the center of the system; with reciprocity, to those with the most resources and friends; and with democracy, to those with the silver tongues.

Introductory Offer: Save 30% on PS Digital
PS_Digital_1333x1000_Intro-Offer1

Introductory Offer: Save 30% on PS Digital

Access every new PS commentary, our entire On Point suite of subscriber-exclusive content – including Longer Reads, Insider Interviews, Big Picture/Big Question, and Say More – and the full PS archive.

Subscribe Now

With the coming of modernity, we added two more modes: the market economy as engineered by the business class; and bureaucracy, as engineered by the modern state. The market is unmatched as a tool for crowdsourcing solutions to problems. But, in practice, its scope is limited to satisfying the demands of the rich, by ensuring the efficient use of those things that just so happen to command a market price.

Similarly, bureaucracy is uniquely powerful and capable in its ability to classify and standardize things, which allows it to see the bigger picture in ways that a reciprocity or redistribution system cannot. But, of course, it also can give rise to many inefficiencies.

Our mighty, but deeply flawed and unequal civilization was built by adding markets and bureaucracy to our three original modes of organization. But now, Farrell and Fourcade warn that we are adding a sixth mode: the algorithm.

According to techno-optimists, a society of algorithms would be much better than anything we can hope to create with markets and bureaucracy. Unlike a market, an algorithm is not restricted to seeing only the money demands of the rich and the money costs imposed by those who have managed to claim property rights. And unlike a bureaucracy, an algorithmic society will not force you, a square peg, into a round hole.

No longer will “experts” decide what category you should fall into. Instead, affinity groups will spring up spontaneously from the revealed preferences expressed by people’s words and actions. Resources will be mobilized to serve each individual by tapping into the unique power of economies of scale.

Is this a hope that we should all share? To be sure, when bureaucracy arrived as a new mode of organization, it erased tacit forms of knowledge, disrupted the messiness of people’s lives, and forced people into categories that were most useful to those holding the levers of power. Equally, markets introduced massive, costly new externalities by prioritizing the needs of the rich. But is there any good reason to think that an algorithmic society would fix these flaws, or that it would not introduce new, massive problems of its own?

The economics Nobel laureate Daniel Kahneman’s concept of thinking “fast” and “slow” can help us see what is at stake, here. An algorithmic society would serve only our “thinking fast” side, constantly seeking “engagement” – meaning fear and rage. Just as markets cater to the rich, algorithms cater to our worst impulses.

A clickbait society is no one’s vision of Utopia. Yet that, I fear, is where current trends are carrying us.

https://prosyn.org/pgvD1DU