Group items tagged

Data doesn't invade people's lives. Lack of control over how it's used does. What's really driving so-called big data isn't the volume of information. It turns out big data doesn't have to be all that big. Rather, it's about a reconsideration of the fundamental economics of analyzing data. For decades, there's been a fundamental tension between three attributes of databases. You can have the data fast; you can have it big; or you can have it varied. The catch is, you can't have all three at once. O'Reilly Radar (http://s.tt/1kHKE)

"Big Data is watching you. And it's big business. Credit card companies, for instance, are selling the data about what you're consuming. So why is it that you, as the person manufacturing the data, has no say over who's using it or what they're doing with it? "That's got to change," argues Rick Smolan who co-authored the book The Human Face of Big Data (available for download as a tab let app here) an ambitious project that aims to capture the "men, women, and children whose lives are being transformed by this data revolution.""

It's not just about Big Data. For the big players in enterprise technology algorithms, it's about finding big patterns beyond the data itself. The explosion of online life and cheap computer hardware have made it possible to store immense amounts of unstructured information, like e-mails or Internet clickstreams, then search the stored information to find some trend that can be exploited. The real trick is to do this cost-effectively. Companies doing this at a large scale look for similarities between one field and another, hoping for a common means of analysis.

This is a guest post by David Hales, a fellow associate of the new complexity think-tank, Synthesis. David specialises in computational social science and here he provides a thought-provoking response to the rise in big data, and some of the more outlandish claims made about it. For a good example of the latter, see Chris Anderson's piece 'The Data Deluge Makes the Scientific Method Obsolete'. He makes some really relevant points for development big data initiatives.

"THE cassette tape is about to make a comeback, in a big way. From the updates posted by Facebook's 1 billion users to the medical images shared by healthcare organisations worldwide and the rise of high-definition video streaming, the need for something to store huge tranches of data is greater than ever. And while hard drives have traditionally been the workhorse of large storage operations, a new wave of ultra-dense tape drives that pack in information at much higher densities, while using less energy, is set to replace them."

""Rick Smolan, creator of the epic "Day in the Life" photography books, is taking on a new challenge: big data.""

Six U.S. government agencies will spend more than $200 million to help the government better organize and analyze large volumes of digital data, in a new "big data" research and development effort announced by President Barack Obama's administration Thursday.

"Before I became a university professor, I had a long career in the entertainment business-first as a concert producer for the likes of Bob Dylan and The Band, and later as producer of motion pictures, including Martin Scorsese's Mean Streets and The Last Waltz. Both the music and movie industries have been utterly transformed by the Internet, in positive and negative ways. But I sense that we're still at the beginning stages of this big shift, and that some of the most interesting developments are yet to come. For example, social sentiment analysis is going to change the game for Hollywood marketing."

""MY, WHAT a big mouth you have, Grandma," says Little Red Riding Hood, with just a hint of suspicion. The wolf sneezes. "Bless you," says the little girl. Sound odd? That's because this snippet of Little Red Riding Hood was written not by a person but by a piece of software called Xapagy. It may not seem like much, but it demonstrates a first step towards computers that can invent stories. It also signals a new approach to designing a more human-like artificial intelligence."

IF YOU'VE ever suspected politics is increasingly being run in the interests of big business, I have news: Jeffrey Sachs, a highly respected economist from Columbia University, agrees with you - at least in respect of the United States.

"We thought ten people would care; instead a million people read our Storage Pod 1.0 blog post where we open sourced the Backblaze Storage Pod design and introduced the world's most cost-efficient way to store big data. The interest grew when we published our Petabytes on a Budget: Revealing More Secrets blog post that announced Storage Pod 2.0, which doubled the amount of storage and reduced the price. Since then several companies have built businesses selling Storage Pods inspired by Backblaze to hundreds of organizations around the world who are storing hundreds of petabytes of data on their own Storage Pods. Today we introduce Backblaze Storage Pod 3.0 which stores more data, costs less, is more reliable, and is easier to service."

Harbor Research Newsletter: Data Constellations and the Magic of Emergence Data Constellations and the Magic of Emergence: "Is there really an image of a bear in the nighttime sky? How about an archer, or some girls, or a big and little dipper? Across the planet and the centuries, people have seen pictures in the stars-and more or less the same pictures, too. It takes a special kind of intelligence to do that. Dogs, for example, are intelligent creatures, but they don't see the pictures.

Last Thursday, tech website Xconomy hosted a forum on "The Future of Robotics in Silicon Valley and Beyond." We were there, of course, and so were a lot of other famous robotics people, including Aaron Edsinger of Meka Robotics, who had an announcement to make: an entirely new company called Redwood Robotics, a joint venture between Meka Robotics, Willow Garage, and SRI International.

GOOD with numbers? Fascinated by data? The sound you hear is opportunity knocking.

What's in store for robotics in 2012? Nearly a quarter of the year is already behind us, but we thought we'd spend some time looking at the months ahead and make some predictions about what's going to be big in robotics.

There is no proverbial silver bullet to creating a safer city, but analytics technology is assisting law enforcement agencies all over the world to sort through information - part of the 2.5 quintillion bytes of data we create and consume every day - to get ahead of crime. Having access to all that information is an invaluable resource for law enforcement agencies, but it can also be pretty paralyzing. After all, only a fraction of the bits and bytes can actually be relevant, right? But how do you know and, more importantly, how do you find and act on it?

" It is, Julio Vildosola concedes, a very big bet. Enlarge This Image Warrick Page for The New York Times Julio and Eva Vildosola and one of their two children. Mr. Vildosola will join a small software company in Cambridge. Readers' Comments Readers shared their thoughts on this article. Read All Comments (269) » After working six years as a senior executive for a multinational payroll-processing company in Barcelona, Spain, Mr. Vildosola is cutting his professional and financial ties with his troubled homeland. He has moved his family to a village near Cambridge, England, where he will take the reins at a small software company, and he has transferred his savings from Spanish banks to British banks."

A debate that has gone on for millennia has flared up again in recent years Is the fact you are reading this story a decision you arrived at it by your own free choice, or was your interest programmed into the universe from the moment of the big bang? What makes free will such a fun topic is not only that it dives deep into physics, neuroscience, and philosophy, but also that we all feel we have a direct stake in the answers.

It has taken more than a decade, but PayPal - the coaster of the Internet that has had a downhill ride with the wind at its back pretty much since acquisition - is finally under serious threat. It may not be showing up in PayPal's numbers yet. Indeed, by the time you start to see these things on the balance sheet, the damage is irreversible. The question is whether it can still be reversed now. I'm arguing no for three big reasons. The first is the decreasing relevance of eBay. PayPal was never founded to be merely the payment arm of eBay, but eBay was so dominant in ecommerce at the time and the need for digital payments on the platform was so great that that became the bulk of the business.

As summer blockbuster season kicks into high gear, big-budget action movies like The Avengers, Battleship, and Prometheus remind us that there's one thing that unites Americans: Our shared fear of an alien attack. They also remind us that when the invading space fleet arrives, humanity is not going to surrender without a fight to our intergalactic invaders. Instead, we will band together to fight off their incredibly advanced weaponry with our ... well, with what, exactly? Are we really ready to battle our would-be alien overlords?