IT100_52/Fall 2009

It's email that looks like it comes from some official site such as your bank, Paypal or eBay, but in fact it comes from someone pretending to be them.

Flickr offers more than 200,000 images of the Golden Gate Bridge alone. Every conceivable angle, lighting condition and point of view of the Golden Gate Bridge has been photographed and posted. If you want to use an image of the bridge in your video or movie, there is really no reason to take a new picture of this bridge.

The past is a rush of data streams cut and rearranged into a new mashup, while truth is something you assemble yourself on your own screen as you jump from link to link.

To the utter bafflement of the experts who confidently claimed that viewers would never rise from their reclining passivity, tens of millions of people have in recent years spent uncountable hours making movies of their own design.

There were more than 10 billion views of video on YouTube in September.

Just as in the TV cookoff contest “Iron Chef,” the Iron Editor must remix videos in real time in front of an audience while competing with other editors to demonstrate superior visual literacy.

With our fingers we will drag objects out of films and cast them in our own movies. A click of our phone camera will capture a landscape, then display its history, which we can use to annotate the image. Text, sound, motion will continue to merge into a single intermedia as they flow through the always-on network. With the assistance of screen fluency tools we might even be able to summon up realistic fantasies spontaneously. Standing before a screen, we could create the visual image of a turquoise rose, glistening with dew, poised in a trim ruby vase, as fast as we could write these words. If we were truly screen literate, maybe even faster. And that is just the opening scene.

It is a formidable task, but in the past decade computers have gotten much better at recognizing objects in a picture than most people realize. Researchers have started training computers to recognize a human face.

But even online I cannot link from this sentence to those “passages” in an online movie. We don’t have the equivalent of a hyperlink for film yet. With true screen fluency, I’d be able to cite specific frames of a film, or specific items in a frame.

Then, about 500 years ago, orality was overthrown by technology

Footnotes, invented in about the 12th century, allow tangential information to be displayed outside the linear argument of the main text.

Because of new consumer gadgets, community training, peer encouragement and fiendishly clever software, the ease of making video now approaches the ease of writing.

The oral skills of memorization, recitation and rhetoric instilled in societies a reverence for the past, the ambiguous, the ornate and the subjective. Then, about 500 years ago, orality was overthrown by technology.

Everywhere we look, we see screens. The other day I watched clips from a movie as I pumped gas into my car.

A Hollywood blockbuster can take a million person-hours to produce and only two hours to consume. But now, cheap and universal tools of creation (megapixel phone cameras, Photoshop, iMovie) are quickly reducing the effort needed to create moving images.

We are people of the screen now. Last year, digital-display manufacturers cranked out four billion new screens, and they expect to produce billions more in the coming years. That’s one new screen each year for every human on earth.

The self-organization that is common to chemistry, life, and the technium moves through the universe and time in the same way.

The technium of today reflects 8,000 years of almost daily incremental increases in its embedded knowledge.

This is more clearly seen at the extreme. The difference between four bottles of amino acids on a laboratory self and the four amino acids arrayed in your chromosomes lies in the additional structure, or ordering, those atoms get from participating in the spirals of your replicating DNA. Same atoms, more order. Those atoms of amino acids acquire yet another level of structure and order when their cellular host undergoes evolution. As organisms evolve, the informational code their atoms carry is manipulated, processed, and reordered. In addition to genetic information, the atoms now convey adaptive information. Over time, the same atoms can be promoted to new levels of order. Perhaps their one cell home joins another cell to become multicellular — that demands the informational architecture for a larger organism as well as a cell. Further transitions in evolution — the aggregation into tissues and organs, the acquisition of sex, the creation of social groups — continue to elevate the order and increase the structure of the information flowing through those same atoms.

The technium can be understood as a way of structuring information beyond biology. Foremost among all inventions is language, and its kin writing, which introduced a parallel set of symbol strings to those found in DNA. But the grammar and syntax of language far outstrips the flexibility of the genetic code. Literary inventions like the book index, punctuation, cross-references, and alphabetic order permitted incredibly complex structures within words; printing broadcast them. Calendars and other scripts captured abstractions such as time, or music. The invention of the scientific method in the 17th century was a series of deepening organizational techniques. Data was first measured, then recorded, analyzed, forecasted and disseminated. The wide but systematic exchange of information via wires, radio waves and society meetings upped the complexity of information flowing through the technium. Innovations in communications (phonograph, telegraph, television) sped up the rate of coordination, and also added new levels of systemization. The invention of paper was a more permanent memory device than the brain; photographic film even better. Cheap digital chips lowered the barrier for storing ephemeral information, further intensifying the density of information. Highly designed artifacts and materials are atoms stuffed with layers of complex information. The most mechanical superstructures we've ever built - say skyscrapers, or the Space Shuttle, or the Hadron Supercollider — are giant physical manifestations of incredibly structured information. There are many more hours of design poured into them than hours in manufacturing. Finally, the two greatest inventions in the last 25 years, the link and the tag, have woven new levels of complexity into the web of information. The technium of today reflects 8,000 years of almost da

Although it may not dominate matter's behavior, information must rest in the essence of matter. That's a lot less intuitive. When we bang a knee against a table leg, it sure doesn't feel like we knocked into information. But that's the idea many physicists are formulating.

To explain the how our minds work, or how evolution advances, we apply the pattern of a very large software program processing bits of information. None of these historical metaphorical pictures are wrong; just incomplete. Ditto for computation. But extropy must be more than information alone. We have thousands of years of science ahead of us. Information and computation can't be the most complex immaterial entity there is, just the most complex we've discovered so far. We might eventually discover that extropy involves quantum dynamics, or gravity, or even quantum gravity. But for now, information (in the sense of structure) is a better analogy than anything else we know of for understanding the nature of extropy. Following information will reveal a larger pattern.

No one wants to see themselves as someone else's program running on someone else's computer. Put that way, life seems a bit secondhand. But doctrine of universal computation means all existing things — the made, the found and the born — are linked to one another because they share, as John Wheeler said, "at the bottom — at a very deep bottom, in most instances — an immaterial source." This commonality, spoken of by mystics of many beliefs in different terms, also has a scientific name: information, computation, extropy

But why does the technium so rarely go backwards? Why are forgotten calculators, weapons, and medical encyclopedia so uncommon? Why is there a one-way directionality to technical progress, so that in its broadest outlines it inexorably moves towards the more complex with so little retreat?

To be honest, I used to feel the same way. History counseled that dynamite could be used to carve tunnels or blow up schools. Insecticides could boost crops or poison drinking water. GPS satellites can guide you if you are lost, or track you down with no place to hide. Surely the sum value of new invention was up to us. And the idea that we choose the valence of technology's charge is very appealing to our egos. But it does not match the evidence of technology's rise, nor its deep roots in life and the cosmos.

For four billion years evolution has been accumulating knowledge in its library of genes. You can learn a lot in four billion years. Every one of the 30 million or so unique species of life on the planet today is an unbroken informational thread that traces back to the very first cell.

The industrial age is nowhere near ending. Its continual expansion permits new post-industrial technologies to expand.

This is why the loss of a technology is so rare.

Information is, in fact, the fastest growing thing on this planet. Information is especially conducive to amplification and compounding. As the number of facts increase, the connections between facts increases exponentially faster. Because the mathematical law of combinations, the number of links between pages explodes faster than the number of pages increases. New inventions in certain fields like communication, which are powered by increasing combinations of connections, can increase the speed of invention overall, revving the engines of creation.

This store of order is a surprise. Earth's great heap of structure, complexity and knowledge does not seem to be contained "in" the physics that govern non-extropic stuff. Where do you hide 10^29 bytes of organization? The rules behind the fundamental behavior of the elemental particles and energies that make up our reality are very spare, almost naked.  It might take books and books to explain them in words, but the laws themselves can be compressed into a very small amount of information. If you were to take all the known laws of physics, formulas such as f=ma, E=mc^2, S= K log W, and more complicated ones that describe how liquids flow, or objects spin, or electrons jump, and write them all down in one file, they would fit onto a single gigabyte CD disk. Amazingly, one plastic plate could contain the operating code for the entire universe. Even if we currently know only 0.1% of the actual number of laws guiding universal processes, many of which we are undoubtedly still unaware of, and the ultimate file of physical laws was 1,000 times bigger, it would fit onto one high-density "disk" in a few years from now.  The total code for matter/energy is an infinitesimal fraction compared to mountain of extropic information that has accumulated on this planet. In fact the genome of a single living organism contains more information than required by all the laws of physics

universe

We can not make an exact informational definition of extropy because we don't really know what information is. In fact the term "information" covers several contradictory concepts that should have their own terms. We use information to mean 1) a bunch of bits, or 2) a meaningful signal. When entropy (disorder) increases, it produces "more information" as in more bits. But when entropy decreases, it is the same as a rise in extropy (negative entropy) which produces "more information" as in more structured meaningful bits.  Until we clarify our language the term information is more metaphor than anything else. I try use it in the second meaning here (not always successfully): as in bits that make a difference.

As a biological species born of life, we embrace our origins in life. And as a thinking species, we embrace our mindfulness. But now in the middle of this long evolution it has become clear that we are a technological species as well. Our self image says that we are a thinking animal that reluctantly produces the most powerful force in the world. That is true. But actually something more wondrous is going on. In reality we human beings are the product of the most powerful force in the universe. We are technology. The self-manufactured uroborous. So far, humanity is our greatest invention, and we aren't done yet.

It is not just writing. Music, another invention, also alters the brain in a sustainable way. Many studies have shown how listening to music strengthens the communication wiring between brain hemispheres. Beside fostering an expected growth in auditory regions of the brain, regularly playing musical instruments significantly strengthens the thickness of the corpus callosum fibers and activates the cerebral cortex.  Our mind makes a drum and flute, and the drum and flute remakes our mind.

That thread (DNA) learns something new each generation, and adds that hard-won knowledge to its code.  Geneticist Motoo Kimura estimates that the total genetic information accumulated since the Cambrian explosion 500 million years ago is 10 megabytes per genetic lineage. 

But what is order? Despite our intuitive sense, we lack a good operational definition of order, which seems to be tied up with complexity (see Ordained Becoming). For simple physical systems, the concepts of thermodynamics suffice, but for the real world of cucumbers, brains, books, and self-driving trucks, we don't have useful metrics for extropy. The best we can say is that extropy resembles, but is not equivalent to, information.

In an important way, this unfolding information is not contained in the physical realm. To be clear, I do not mean that it is supernatural. Either extropy must exist in the universe it is transforming, or it must exist outside of it as a supernatural force. If outside, then its dynamics are outside the range of science and of this book. I make the assumption that extropy is not a mystical supernatural force but operates in the lawful realm of physical reality. That is, we can measure it.

Another way to read the long-term trajectory of extropy is to view it as an escape from the material and the transcendence to the immaterial. In the early universe, only the laws of physics reigned.

Most people can appreciate how the essence of living things might be information and order. Information is vague enough to be similar to the idea of a "spirit." But if my hypothesis is true — that life is an extension of a 14 billion-year old inanimate autonomous order, one that now continues into the machines of technology — then this same spirit of information must reside at the core of the non-living world as well

Now in the "digital age" we apply the computational metaphor (see The Computational Metaphor ). To explain the how our minds work, or how evolution advances, we apply the pattern of a very large software program processing bits of information. None of these historical metaphorical pictures are wrong; just incomplete

Now in the "digital age" we apply the computational metaphor (see The Computational Metaphor ). To explain the how our minds work, or how evolution advances, we apply the pattern of a very large software program processing bits of information. None of these historical metaphorical pictures are wrong; just incomplete .

Even counting vast tracks of agriculture, the technium entails fewer than one percent of the atoms on the Earth's land surface. Yet the impact which this minute fraction of technological mass and energy has on the planet is in far disproportion to its size. Measured by impact per gram or calorie, there is nothing comparable to things we invent. Technology is the most powerful force in the world.

Each year the technium consumes more than 40 trillion pounds of coal, 1.6 trillion pounds of iron, 200 billion pounds of gypsum, and 1.2 trillion pounds of wheat, just four inputs among thousands of others needed to appease its appetite, and all those totals grow more than 5% per year. On average the technium must process twenty tons of atoms per year to support each man, women and child in the modern world. 

It's never a good idea to assign a single cause to any large scale cultural change. The  greater the number of people a change effects the more likely numerous factors are behind it. A web of complex conditions must converge to produce the hallmark transitions in a complex society. But when we trace back the origins for each agent in a field of causes, we find that each strand leads to a newly introduced technology, a new idea.   That means that new technologies today will cast a long shadow into the future and shape the lives of our descendents. The technologies of ultrasound fetal inspection and routine abortion enabled sexual selection of children so that now males outnumber females in the youth of China and India. This imbalance will leave an immense surplus of unmarried males in society, an excess which in the past has been a source of unrest, crime, and war. Still young, their story has not fully played out yet, but because of the sheer numbers involved (hundreds of millions in Asia) its concluding effect will be global. Whatever the consequences of this sex-ratio excess are — an increase in international prostitution, a surge of ambitious entrepreneurs and military recruits, or a massive outward migration to places like Africa — the effects will be broader, and less technological that what might be expected from the invention of ultrasound equipment.

The work of understanding all this information is migrating from humans to the technium. We can no longer keep up with our own creations, and so we are constructing an apparatus to structure what we think, in the same manner that we first used writing on paper to extend our memory. Now we are offloading other mental functions. The technium contains an elaborate knowledge processing  system consisting of encyclopedias, classification indexes, cross references, search engines, footnotes, citations, hypertext, and the web. These technologies organize the output of our collective minds — both intangible ideas and tangible inventions — into a semantic structure, much like an ecosystem. This incredibly complicated mesh of connections, interdependencies, associations, and emergent structure gives the technium a "meaning" that is outside our of understanding. It's reasonable to figure that since the technium is simply "that which the mind produces" then at its root the most powerful force in the world must not be technology but the human mind.

With the rise of life (in our immediate neighborhood) information ascended in influence. The informational process we call life took control of the atmosphere of Earth several billion years ago.

Extropy is neither wave nor particle, nor pure energy. It is an immaterial force that is very much like information. Since extropy is defined as negative entropy — the reversal of disorder — it is, by definition, an increase in order. But what is order? Despite our intuitive sense, we lack a good operational definition of order, which seems to be tied up with complexity (see Ordained Becoming). For simple physical systems, the concepts of thermodynamics suffice, but for the real world of cucumbers, brains, books, and self-driving trucks, we don't have useful metrics for extropy. The best we can say is that extropy resembles, but is not equivalent to, information.

For four billion years evolution has been accumulating knowledge in its library of genes. You can learn a lot in four billion years. Every one of the 30 million or so unique species of life on the planet today is an unbroken informational thread that traces back to the very first cell.

As a biological species born of life, we embrace our origins in life. And as a thinking species, we embrace our mindfulness. But now in the middle of this long evolution it has become clear that we are a technological species as well.

With our fingers we will drag objects out of films and cast them in our own movies. A click of our phone camera will capture a landscape, then display its history, which we can use to annotate the image. Text, sound, motion will continue to merge into a single intermedia as they flow through the always-on network. With the assistance of screen fluency tools we might even be able to summon up realistic fantasies spontaneously. Standing before a screen, we could create the visual image of a turquoise rose, glistening with dew, poised in a trim ruby vase, as fast as we could write these words. If we were truly screen literate, maybe even faster. And that is just the opening scene

Everywhere we look, we see screens. The other day I watched clips from a movie as I pumped gas into my car. The other night I saw a movie on the backseat of a plane. We will watch anywhere. Screens playing video pop up in the most unexpected places — like A.T.M. machines and supermarket checkout lines and tiny phones; some movie fans watch entire films in between calls. These ever-present screens have created an audience for very short moving pictures, as brief as three minutes, while cheap digital creation tools have empowered a new generation of filmmakers, who are rapidly filling up those screens. We are headed toward screen ubiquity

With our fingers we will drag objects out of films and cast them in our own movies. A click of our phone camera will capture a landscape, then display its history, which we can use to annotate the image. Text, sound, motion will continue to merge into a single intermedia as they flow through the always-on network. With the assistance of screen fluency tools we might even be able to summon up realistic fantasies spontaneously. Standing before a screen, we could create the visual image of a turquoise rose, glistening with dew, poised in a trim ruby vase, as fast as we could write these words. If we were truly screen literate, maybe even faster. And that is just the opening scene.

Digital technology gives the professional a new language as well. An image stored on a memory disc instead of celluloid film has a plasticity that allows it to be manipulated as if the picture were words rather than a photo. Hollywood mavericks like George Lucas have embraced digital technology and pioneered a more fluent way of filmmaking. In his “Star Wars” films, Lucas devised a method of moviemaking that has more in common with the way books and paintings are made than with traditional cinematography.

The overthrow of the book would have happened long ago but for the great user asymmetry inherent in all media. It is easier to read a book than to write one; easier to listen to a song than to compose one; easier to attend a play than to produce one. But movies in particular suffer from this user asymmetry. The intensely collaborative work needed to coddle chemically treated film and paste together its strips into movies meant that it was vastly easier to watch a movie than to make one. A Hollywood blockbuster can take a million person-hours to produce and only two hours to consume. But now, cheap and universal tools of creation (megapixel phone cameras, Photoshop, iMovie) are quickly reducing the effort needed to create moving images. To the utter bafflement of the experts who confidently claimed that viewers would never rise from their reclining passivity, tens of millions of people have in recent years spent uncountable hours making movies of their own design. Having a ready and reachable audience of potential millions helps, as does the choice of multiple modes in which to create. Because of new consumer gadgets, community training, peer encouragement and fiendishly clever software, the ease of making video now approaches the ease of writing.

As moving images become easier to create, easier to store, easier to annotate and easier to combine into complex narratives, they also become easier to be remanipulated by the audience. This gives images a liquidity similar to words. Fluid images­ made up of bits flow rapidly onto new screens and can be put to almost any use. Flexible images migrate into new media and seep into the old. Like alphabetic bits, they can be squeezed into links or stretched to fit search engines, indexes and databases. They invite the same satisfying participation in both creation and consumption that the world of text does.

The site organizes the sprawling threads of these visual chats so that they can be read like a paragraph of dialogue.

Currently, the smartest object-recognition software can detect and categorize a few dozen common visual forms. It can search through Flickr photos and highlight the images that contain a dog, a cat, a bicycle, a bottle, an airplane, etc. It can distinguish between a chair and sofa, and it doesn’t identify a bus as a car. But each additional new object to be recognized means the software has to be trained with hundreds of samples of that image.

It took several hundred years for the consumer tools of text literacy to crystallize after the invention of printing, but the first visual-literacy tools are already emerging in research labs and on the margins of digital culture.

The invention of writing systems for language and math structured this learning even more. Ideas could be remembered more accurately, and just as importantly, their organization could be examined and analyzed. Ideas could also be indexed, retrieved, and propagated easier. Writing allowed the organization of information to penetrate into many aspects of life and vastly accelerated trade, creation of calendars, and laws – all of which organized information further.