Group items tagged

Our medical systems have terrible Internet security… MRI machines you can connect to with USB that still have “admin:password” to gain root access. That’s horrifying, sure, but that’s not an attack at scale. More frightening: we’re busily uploading all our medical records to the cloud. Take down that cloud, and no patients can be treated, because nobody will know what they have, what meds they are on. Software swallows your insulin pumps and your pacemakers. To kill people, all you need is to hack that database, or simply erase it or block access to it. After all, we don’t tend to realize that in an Internet of Things, humans are just Things too. As this software monster has encroached on stuff like election systems, the common reaction has been to go back to paper. So let’s consider a less obvious example. We should be going back to paper for our libraries too! We’ve outsourced so much of our knowledge to digital that the amount of knowledge available in analog has dropped notably. There are less librarians in the fewer libraries with smaller collections than there used to be. If the net goes down, how much reference material is simply not accessible that was thirty years ago? Google Search is “critical cultural infrastructure.” How much redundancy do we actually have? Could a disconnected town actually educate its children? How critical is Google as a whole? If Google went down for a month, I am pretty sure we would see worldwide economic collapse. How much of the world economy passes through Google hosting? How much of it is in GMail? How much is dependent on Google Search, Google Images, Google Docs? The answer is a LOT. And because financial systems are now also JIT, ten thousand corporate blips where real estate agencies and local car washes and a huge pile of software companies and a gaggle of universities and so on are suddenly 100% unable to function digitally (no payroll! no insurance verification!) would absolutely have ripple effects into their suppliers and their customers, and thence to the worldwide economic market. Because interconnection without redundancy increases odds of cascades.

But just as critically, governments and state actors seem to be the source of so many of the problems precisely because the Internet is now too many forms of critical infrastructure, and therefore too juicy a target. If software eats everything, then the ability to kill software is the ability to kill anything. Net connectivity becomes the single point of failure for every system connected to it. Even if the Net itself is designed to route around damage, that doesn’t help if it is the single vector of attack that can take down any given target. It’s too juicy a target for the military, too juicy a target for terror, too juicy a target for criminal ransom. The old adage goes “when they came for this, I said nothing. When they came for that…” — we all know it. Consider that the more we hand gleefully over to the cloud because we want convenience, big data, personalization, and on, we’re creating a single thing that can be taken from us in an instant. We’ve decided to subscribe to everything, instead of owning it. When they came for your MP3s, your DVDs, fine,. not “critical infrastructure.” When they came for your resumes, OK, getting closer.

As we rush towards putting more and more things “in the cloud,” as we rush towards an Internet of Things with no governance beyond profit motive and anarchy, what we’re effectively doing is creating a massive single point of failure for every system we put in it.

At some point, though, a presenter began reading a paper that caused me to look up at once from the wiki. This was Anna Kornbluh, of the University of Illinois at Chicago. Her paper was written in the same language as the others, but scythelike; she plied the language with weird skill, as if slicing a path toward some promontory of insight — and I found, to my surprise and unease, that I wanted to follow her there and stand and look out. Advertisement Her thesis was unsparing. “We have rhapsodized demolition as liberation while literally laying ruin to the university,” she argued, “a horror to be beheld by future historians — in the unlikely event there are any.” Literary theorists, by prizing an ethos of destruction in the name of freedom, had ironically aligned themselves with the external forces — political, administrative — that had for years conspired to obliterate the institution in which they work. “Human beings,” though, “are essentially builders,” she noted, channeling Marx — “architects of ideas” as well as topplers of norms. Both gestures, affirmation and dissent, are “life-sustaining”; ideally they coexist,  equipoised, twin components of a fulfilled life. A reconstructed university — and wider world — would depend on recovering the constructive and visionary impulse, which the profession had too long devalued in favor of critique. “Get building,” she enjoined the room.

Unfortunately, the enemy is complacency. Tech workers trust their founders, find labor organizing distasteful, and are happy to leave larger ethical questions to management. A workplace free of 'politics' is just one of the many perks the tech industry offers its pampered employees. So our one chance to enact meaningful change is slipping away. Unless something happens to mobilize the tech workforce, or unless the advertising bubble finally bursts, we can expect the weird, topsy-turvy status quo of 2017 to solidify into the new reality. But even though we're likely to fail, all we can do is try. Good intentions are not going to make these structural problems go away. Talking about them is not going to fix them. We have to do something.

Can we fix it? Institutions can be destroyed quickly; they take a long time to build. A lot of what we call ‘disruption’ in the tech industry has just been killing flawed but established institutions, and mining them for parts. When we do this, we make a dangerous assumption about our ability to undo our own bad decisions, or the time span required to build institutions that match the needs of new realities. Right now, a small caste of programmers is in charge of the surveillance economy, and has broad latitude to change it. But this situation will not last for long. The kinds of black-box machine learning that have been so successful in the age of mass surveillance are going to become commoditized and will no longer require skilled artisans to deploy. Moreover, powerful people have noted and benefited from the special power of social media in the political arena. They will not sit by and let programmers dismantle useful tools for influence and social control. It doesn’t matter that the tech industry considers itself apolitical and rationalist. Powerful people did not get to be that way by voluntarily ceding power. The window of time in which the tech industry can still act is brief: while tech workers retain relatively high influence in their companies, and before powerful political interests have put down roots in the tech industry.

Of course, whether it is using VR for the treatment of vertigo and PTSD, or drawing our attention to unconscious biases like racism, it is possible that VR does have the ability to change our perception of the world around us, that the knowledge we gain from this technology can be transformative. But Plato’s Cave presupposes that those freeing the prisoner from their chains to reveal the true nature of “reality” are altruistic in their intent—that the world being shown the freed prisoners is indeed the truth. It is an allegory that does not allow for the world as it is today, or the pervasive desire to escape it. The continued commercial failure of VR may represent an unconscious resistance to jettisoning our connection to the real. Maybe we are waiting for that blockbuster game to drive mass-market appeal. Perhaps the technology simply is not good enough yet to simulate a truly authentic—and profitable—experience. In this sense we are trapped. We crave authenticity of experience but, despite the efforts of philosophers, authors and auteurs, our imaginations appear limited to what we can individually consume and identify with. While capitalism lumbers on, we cannot see anything but the shadows on the wall.