Group items tagged

Cloudera is a company that helps developers with big database problems. Here the CEO Mike Olson gives us a tour through the major database changes that are hitting lots of startups now.

The plan unveiled on Thursday designates money to create a "dashboard"-an interactive, online database-to give students, parents, and legislators access to detailed measures of departments' and colleges' productivity and efficiency. Data on individual professors will probably also be included, although Dr. Cigarroa stressed that each campus would be able to develop its own system of metrics and the details have not yet been worked out

BusinessWeek's 2006 Cover Story, "Math Will Rock Your World," announced a new age of numbers. With the rise of new networks, the story argued, all of us were channeling the details of our lives into vast databases. Every credit-card purchase, every cell-phone call, every click on the computer mouse fed these digital troves. Those with the tools and skills to make sense of them could begin to decipher our movements, desires, diseases, and shopping habits-and predict our behavior. This promised to transform business and society. In a book expanding upon this Cover Story, The Numerati, Senior Writer Stephen Baker introduces us to the mathematical wizards who are digging through our data to decode us as patients, shoppers, voters, potential terrorists-even lovers.

Which brings us to the underlying point of the piece - we are all leaving digital trails behind us, as we make our way around our individual lives. These trails are largely considered individual - even ethereal - yet technology is making these trails more visible and more readable everyday.

Over the last year, I've produced five data-driven pieces for Wired UK. Four of them have been for the two-page infoporn spread that can be found in every issue. I've looked at the UK's National DNA Database, used mined Twitter data to find people's travel paths, and mapped traffic in some of the world's busiest sea ports.

Needlebase allows you to view web pages through a virtual browser, point and click to train it in understanding what fields on that page are of interest to you and how those fields relate to each other. Then the program goes and scrapes the data from all of those fields, publishes them into a table, list or map, and recommends merges of cells that appear to be mistakenly separate. It's very cool and it lets non-technical people do things with data quickly and easily that we used to require the assistance of someone more technical to do.

DBpedia is a community effort to extract structured information from Wikipedia and to make this information available on the Web. DBpedia allows you to ask sophisticated queries against Wikipedia, and to link other data sets on the Web to Wikipedia data.

Por qué usar Data mining?