Group items tagged

One of the most fascinating things to come out of the current We Are 99%/Occupy Wall Street protests is the We Are 99% Tumblr.  At the site, people hold up signs that explain their current circumstances, and it tells the story of a whole range of Americans struggling in the Lesser Depression.  It is highly recommended. DATA The site features pictures of individuals holding their signs, and occasionally the tumblr reproduces the text of the signs themselves underneath the image as html text.  Sometimes the text under the image is blank, sometimes it is a different message, but often it is the sign itself. In order to get a slightly better empirical handle on this important tumblr, I created a script designed to read all of the pages and parse out the html text on the site.  It doesn't read the images (can anyone in the audience automate calls to an OCR?), just the html text.  After collecting all the text on all the pages, the code then goes through it to try to find interesting points. It's a fun exercise, pointing out things I wouldn't have seen otherwise.  For instance, I found this adorable little rascal, pictured below, mucking up the algorithm, as the first version of the code assumed all the ages would have two digits.  I found that he, and the sign his mom made for him as a confessional to her son, hit me a ton harder than any of the more direct signs of despair in this economy:

A study appearing Feb. 10 in Science Express calculates the world's total technological capacity to store, communicate and compute information, part of a Special Online Collection: Dealing with Data. The study by the USC Annenberg School for Communication & Journalism estimates that in 2007, humankind was able to store 2.9 × 1020 optimally compressed bytes, communicate almost 2 × 1021 bytes, and carry out 6.4 × 1018 instructions per second on general-purpose computers. General-purpose computing capacity grew at an annual rate of 58%. The world's capacity for bidirectional telecommunication grew at 28% per year, closely followed by the increase in globally stored information (23%). Humankind's capacity for unidirectional information diffusion through broadcasting channels has experienced comparatively modest annual growth (6%). Telecommunication has been dominated by digital technologies since 1990 (99.9% in digital format in 2007), and the majority of our technological memory has been in digital format since the early 2000s (94% digital in 2007).