The Age of Surveillance Capitalism Read online

  Copyright

  Copyright © 2019 by Shoshana Zuboff

  Hachette Book Group supports the right to free expression and the value of copyright. The purpose of copyright is to encourage writers and artists to produce the creative works that enrich our culture.

  The scanning, uploading, and distribution of this book without permission is a theft of the author’s intellectual property. If you would like permission to use material from the book (other than for review purposes), please contact [email protected]. Thank you for your support of the author’s rights.

  PublicAffairs

  Hachette Book Group

  1290 Avenue of the Americas, New York, NY 10104

  www.publicaffairsbooks.com

  @Public_Affairs

  First Edition: January 2019

  Published by PublicAffairs, an imprint of Perseus Books, LLC, a subsidiary of Hachette Book Group, Inc. The PublicAffairs name and logo is a trademark of the Hachette Book Group.

  The Hachette Speakers Bureau provides a wide range of authors for speaking events. To find out more, go to www.hachettespeakersbureau.com or call (866) 376-6591.

  Sonnets from China, copyright © 1945 by W. H. Auden, renewed 1973 by The Estate of W. H. Auden; and “We Too Had Known Golden Hours,” copyright © 1951 by W. H. Auden and renewed 1979 by The Estate of W.H. Auden; from W. H. Auden Collected Poems by W. H. Auden. Used by permission of Random House, an imprint and division of Penguin Random House LLC. All rights reserved.

  Excerpt(s) from Social Physics: How Good Ideas Spread—The Lessons from a New Science by Alex Pentland, copyright © 2014 by Alex Pentland. Used by permission of Penguin Press, an imprint of Penguin Publishing Group, a division of Penguin Random House LLC. All rights reserved.

  The publisher is not responsible for websites (or their content) that are not owned by the publisher.

  Library of Congress Cataloging-in-Publication Data

  Names: Zuboff, Shoshana, 1951- author.

  Title: The age of surveillance capitalism : the fight for a human future at the new frontier of power / Shoshana Zuboff.

  Description: First edition. | New York : PublicAffairs, 2018. | Includes bibliographical references and index.

  Identifiers: LCCN 2018003901 (print) | LCCN 2018039998 (ebook) | ISBN 9781610395700 (ebook) | ISBN 9781610395694 (hardcover)

  Subjects: LCSH: Consumer behavior—Data processing. | Consumer profiling—Data processing. | Information technology—Social aspects.

  Classification: LCC HF5415.32 (ebook) | LCC HF5415.32 .Z83 2018 (print) | DDC 306.3–dc23

  LC record available at https://lccn.loc.gov/2018003901

  ISBNs: 978-1-61039-569-4 (hardcover), 978-1-61039-570-0 (ebook)

  E3-20181129-JV-NF-ORI

  CONTENTS

  Cover

  Title Page

  Copyright

  Dedication

  The Definition

  INTRODUCTION

  1 Home or Exile in the Digital Future

  PART I

  THE FOUNDATIONS OF SURVEILLANCE CAPITALISM

  2 August 9, 2011: Setting the Stage for Surveillance Capitalism

  3 The Discovery of Behavioral Surplus

  4 The Moat Around the Castle

  5 The Elaboration of Surveillance Capitalism: Kidnap, Corner, Compete

  6 Hijacked: The Division of Learning in Society

  PART II

  THE ADVANCE OF SURVEILLANCE CAPITALISM

  7 The Reality Business

  8 Rendition: From Experience to Data

  9 Rendition from the Depths

  10 Make Them Dance

  11 The Right to the Future Tense

  PART III

  INSTRUMENTARIAN POWER FOR A THIRD MODERNITY

  12 Two Species of Power

  13 Big Other and the Rise of Instrumentarian Power

  14 A Utopia of Certainty

  15 The Instrumentarian Collective

  16 Of Life in the Hive

  17 The Right to Sanctuary

  CONCLUSION

  18 A Coup from Above

  Acknowledgments

  About the Author

  Praise for The Age of Surveillance Capitalism

  Detailed Table of Contents

  Notes

  Index

  This book is dedicated to the past and the future:

  In memory of my Beloved, Jim Maxmin.

  In memory of my courageous friend, Frank Schirrmacher.

  In honor of my children,

  Chloe Sophia Maxmin and Jacob Raphael Maxmin—

  I write to fortify your futures and the moral cause of your generation.

  THE DEFINITION

  Sur-veil-lance Cap-i-tal-ism, n.

  1. A new economic order that claims human experience as free raw material for hidden commercial practices of extraction, prediction, and sales; 2. A parasitic economic logic in which the production of goods and services is subordinated to a new global architecture of behavioral modification; 3. A rogue mutation of capitalism marked by concentrations of wealth, knowledge, and power unprecedented in human history; 4. The foundational framework of a surveillance economy; 5. As significant a threat to human nature in the twenty-first century as industrial capitalism was to the natural world in the nineteenth and twentieth; 6. The origin of a new instrumentarian power that asserts dominance over society and presents startling challenges to market democracy; 7. A movement that aims to impose a new collective order based on total certainty; 8. An expropriation of critical human rights that is best understood as a coup from above: an overthrow of the people’s sovereignty.

  INTRODUCTION

  CHAPTER ONE

  HOME OR EXILE IN THE DIGITAL FUTURE

  I saw him crying, shedding floods of tears upon

  Calypso’s island, in her chambers.

  She traps him there; he cannot go back home.

  —HOMER, THE ODYSSEY

  I. The Oldest Questions

  “Are we all going to be working for a smart machine, or will we have smart people around the machine?” The question was posed to me in 1981 by a young paper mill manager sometime between the fried catfish and the pecan pie on my first night in the small southern town that was home to his mammoth plant and would become my home periodically for the next six years. On that rainy night his words flooded my brain, drowning out the quickening tap tap tap of raindrops on the awning above our table. I recognized the oldest political questions: Home or exile? Lord or subject? Master or slave? These are eternal themes of knowledge, authority, and power that can never be settled for all time. There is no end of history; each generation must assert its will and imagination as new threats require us to retry the case in every age.

  Perhaps because there was no one else to ask, the plant manager’s voice was weighted with urgency and frustration: “What’s it gonna be? Which way are we supposed to go? I must know now. There is no time to spare.” I wanted the answers, too, and so I began the project that thirty years ago became my first book, In the Age of the Smart Machine: The Future of Work and Power. That work turned out to be the opening chapter in what became a lifelong quest to answer the question “Can the digital future be our home?”

  It has been many years since that warm southern evening, but the oldest questions have come roaring back with a vengeance. The digital realm is overtaking and redefining everything familiar even before we have had a chance to ponder and decide. We celebrate the networked world for the many ways in which it enriches our capabilities and prospects, but it has birthed whole new territories of anxiety, danger, and violence as the sense of a predictable future slips away.

  When we ask the oldest questions now, billions of people from
every social strata, generation, and society must answer. Information and communications technologies are more widespread than electricity, reaching three billion of the world’s seven billion people.1 The entangled dilemmas of knowledge, authority, and power are no longer confined to workplaces as they were in the 1980s. Now their roots run deep through the necessities of daily life, mediating nearly every form of social participation.2

  Just a moment ago, it still seemed reasonable to focus our concerns on the challenges of an information workplace or an information society. Now the oldest questions must be addressed to the widest possible frame, which is best defined as “civilization” or, more specifically, information civilization. Will this emerging civilization be a place that we can call home?

  All creatures orient to home. It is the point of origin from which every species sets its bearings. Without our bearings, there is no way to navigate unknown territory; without our bearings, we are lost. I am reminded of this each spring when the same pair of loons returns from their distant travels to the cove below our window. Their haunting cries of homecoming, renewal, connection, and safeguard lull us to sleep at night, knowing that we too are in our place. Green turtles hatch and go down to the sea, where they travel many thousands of miles, sometimes for ten years or twenty. When ready to lay their eggs, they retrace their journey back to the very patch of beach where they were born. Some birds annually fly for thousands of miles, losing as much as half their body weight, in order to mate in their birthplace. Birds, bees, butterflies… nests, holes, trees, lakes, hives, hills, shores, and hollows… nearly every creature shares some version of this deep attachment to a place in which life has been known to flourish, the kind of place we call home.

  It is in the nature of human attachment that every journey and expulsion sets into motion the search for home. That nostos, finding home, is among our most profound needs is evident by the price we are willing to pay for it. There is a universally shared ache to return to the place we left behind or to found a new home in which our hopes for the future can nest and grow. We still recount the travails of Odysseus and recall what human beings will endure for the sake of reaching our own shores and entering our own gates.

  Because our brains are larger than those of birds and sea turtles, we know that it is not always possible, or even desirable, to return to the same patch of earth. Home need not always correspond to a single dwelling or place. We can choose its form and location but not its meaning. Home is where we know and where we are known, where we love and are beloved. Home is mastery, voice, relationship, and sanctuary: part freedom, part flourishing… part refuge, part prospect.

  The sense of home slipping away provokes an unbearable yearning. The Portuguese have a name for this feeling: saudade, a word said to capture the homesickness and longing of separation from the homeland among emigrants across the centuries. Now the disruptions of the twenty-first century have turned these exquisite anxieties and longings of dislocation into a universal story that engulfs each one of us.3

  II. Requiem for a Home

  In 2000 a group of computer scientists and engineers at Georgia Tech collaborated on a project called the “Aware Home.”4 It was meant to be a “living laboratory” for the study of “ubiquitous computing.” They imagined a “human-home symbiosis” in which many animate and inanimate processes would be captured by an elaborate network of “context aware sensors” embedded in the house and by wearable computers worn by the home’s occupants. The design called for an “automated wireless collaboration” between the platform that hosted personal information from the occupants’ wearables and a second one that hosted the environmental information from the sensors.

  There were three working assumptions: first, the scientists and engineers understood that the new data systems would produce an entirely new knowledge domain. Second, it was assumed that the rights to that new knowledge and the power to use it to improve one’s life would belong exclusively to the people who live in the house. Third, the team assumed that for all of its digital wizardry, the Aware Home would take its place as a modern incarnation of the ancient conventions that understand “home” as the private sanctuary of those who dwell within its walls.

  All of this was expressed in the engineering plan. It emphasized trust, simplicity, the sovereignty of the individual, and the inviolability of the home as a private domain. The Aware Home information system was imagined as a simple “closed loop” with only two nodes and controlled entirely by the home’s occupants. Because the house would be “constantly monitoring the occupants’ whereabouts and activities… even tracing its inhabitants’ medical conditions,” the team concluded, “there is a clear need to give the occupants knowledge and control of the distribution of this information.” All the information was to be stored on the occupants’ wearable computers “to insure the privacy of an individual’s information.”

  By 2018, the global “smart-home” market was valued at $36 billion and expected to reach $151 billion by 2023.5 The numbers betray an earthquake beneath their surface. Consider just one smart-home device: the Nest thermostat, which was made by a company that was owned by Alphabet, the Google holding company, and then merged with Google in 2018.6 The Nest thermostat does many things imagined in the Aware Home. It collects data about its uses and environment. It uses motion sensors and computation to “learn” the behaviors of a home’s inhabitants. Nest’s apps can gather data from other connected products such as cars, ovens, fitness trackers, and beds.7 Such systems can, for example, trigger lights if an anomalous motion is detected, signal video and audio recording, and even send notifications to homeowners or others. As a result of the merger with Google, the thermostat, like other Nest products, will be built with Google’s artificial intelligence capabilities, including its personal digital “assistant.”8 Like the Aware Home, the thermostat and its brethren devices create immense new stores of knowledge and therefore new power—but for whom?

  Wi-Fi–enabled and networked, the thermostat’s intricate, personalized data stores are uploaded to Google’s servers. Each thermostat comes with a “privacy policy,” a “terms-of-service agreement,” and an “end-user licensing agreement.” These reveal oppressive privacy and security consequences in which sensitive household and personal information are shared with other smart devices, unnamed personnel, and third parties for the purposes of predictive analyses and sales to other unspecified parties. Nest takes little responsibility for the security of the information it collects and none for how the other companies in its ecosystem will put those data to use.9 A detailed analysis of Nest’s policies by two University of London scholars concluded that were one to enter into the Nest ecosystem of connected devices and apps, each with their own equally burdensome and audacious terms, the purchase of a single home thermostat would entail the need to review nearly a thousand so-called contracts.10

  Should the customer refuse to agree to Nest’s stipulations, the terms of service indicate that the functionality and security of the thermostat will be deeply compromised, no longer supported by the necessary updates meant to ensure its reliability and safety. The consequences can range from frozen pipes to failed smoke alarms to an easily hacked internal home system.11

  By 2018, the assumptions of the Aware Home were gone with the wind. Where did they go? What was that wind? The Aware Home, like many other visionary projects, imagined a digital future that empowers individuals to lead more-effective lives. What is most critical is that in the year 2000 this vision naturally assumed an unwavering commitment to the privacy of individual experience. Should an individual choose to render her experience digitally, then she would exercise exclusive rights to the knowledge garnered from such data, as well as exclusive rights to decide how such knowledge might be put to use. Today these rights to privacy, knowledge, and application have been usurped by a bold market venture powered by unilateral claims to others’ experience and the knowledge that flows from it. What does this sea change mean for us, for our children, f
or our democracies, and for the very possibility of a human future in a digital world? This book aims to answer these questions. It is about the darkening of the digital dream and its rapid mutation into a voracious and utterly novel commercial project that I call surveillance capitalism.

  III. What Is Surveillance Capitalism?

  Surveillance capitalism unilaterally claims human experience as free raw material for translation into behavioral data. Although some of these data are applied to product or service improvement, the rest are declared as a proprietary behavioral surplus, fed into advanced manufacturing processes known as “machine intelligence,” and fabricated into prediction products that anticipate what you will do now, soon, and later. Finally, these prediction products are traded in a new kind of marketplace for behavioral predictions that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are eager to lay bets on our future behavior.

  As we shall see in the coming chapters, the competitive dynamics of these new markets drive surveillance capitalists to acquire ever-more-predictive sources of behavioral surplus: our voices, personalities, and emotions. Eventually, surveillance capitalists discovered that the most-predictive behavioral data come from intervening in the state of play in order to nudge, coax, tune, and herd behavior toward profitable outcomes. Competitive pressures produced this shift, in which automated machine processes not only know our behavior but also shape our behavior at scale. With this reorientation from knowledge to power, it is no longer enough to automate information flows about us; the goal now is to automate us. In this phase of surveillance capitalism’s evolution, the means of production are subordinated to an increasingly complex and comprehensive “means of behavioral modification.” In this way, surveillance capitalism births a new species of power that I call instrumentarianism. Instrumentarian power knows and shapes human behavior toward others’ ends. Instead of armaments and armies, it works its will through the automated medium of an increasingly ubiquitous computational architecture of “smart” networked devices, things, and spaces.