Group items tagged

You cannot accept problems as handed to you in the business environment. Never allow yourself to be the analyst to whom problems are “thrown over the fence.” Engage with the people whose challenges you’re tackling to make sure you’re solving the right problem. Learn the business’s processes and the data that’s generated and saved. Learn how folks are handling the problem now, and what metrics they use (or ignore) to gauge success.

Solve the correct, yet often misrepresented, problem. This is something no mathematical model will ever say to you. No mathematical model can ever say, “Hey, good job formulating this optimization model, but I think you should take a step back and change your business a little instead.” And that leads me to my next point: Learn how to communicate.

In today’s business environment, it is often unacceptable to be skilled at only one thing. Data scientists are expected to be polyglots who understand math, code, and the plain-speak (or sports analogy-ridden speak . . . ugh) of business. And the only way to get good at speaking to other folks, just like the only way to get good at math, is through practice.

Big Data is forecast to drive $34 billion of IT spending in 2013 and create 4.4 million IT jobs by 2015, but it is currently still a solution looking for a problem, according to analyst firm Gartner.

While businesses are keen to start mining their data stores for useful insights, and many are already experimenting with technologies like Hadoop, the biggest challenge is working out what question you are trying to answer

1. Project Sponsorship and Governance 2. Project Management 3. Development Team (Core Team) 4. Extended Project Team

1. Project Sponsorship and Governance IT and the business should form a BI steering committee to sponsor and govern design, development, deployment, and ongoing support. It needs both the CIO and a business executive, such as CFO, COO, or a senior VP of marketing/sales to commit budget, time, and resources. The business sponsor needs the project to succeed. The CIO is committed to what is being built and how.

2. Project Management Project management includes managing daily tasks, reporting status, and communicating to the extended project team, steering committee, and affected business users. The project management team needs extensive business knowledge, BI expertise, DW architecture background, and people management, project management, and communications skills. The project management team includes three functions or members: Project development manager - Responsible for deliverables, managing team resources, monitoring tasks, reporting status, and communications. Requires a hands-on IT manager with a background in iterative development. Must understand the changes caused by this approach and the impact on the business, project resources, schedule and the trade-offs. Business advisor - Works within the sponsoring business organization. Responsible for the deliverables of the business resources on the project's extended team. Serves as the business advocate on the project team and the project advocate within the business community. Often, the business advocate is a project co-manager who defers to the IT project manager the daily IT tasks but oversees the budget and business deliverables. BI/DW project advisor - Has enough expertise with architectures and technologies to guides the project team on their use. Ensures that architecture, data models, databases, ETL code, and BI tools are all being used effectively and conform to best practices and standards.

a lot of articles calling data scientists and statisticians the jobs of the future

there are more immediate needs that, when addressed, will have a much greater business impact.

Right now we have huge opportunities to make the data more accessible, more “joinable” and more consumable. Leaders don’t want more data – they want more information they can use to run their businesses.

First observation: Dice. I’m trying to be cautiously optimistic, but it seems as Business Intelligence market in general is picking up.

SiSense’s survey finds that salaries for data professionals are on the rise across all geographies. The annual earnings of a data professional can range from an average of $55,000 USD for a data analyst to an average of $132,000 for VP Analytics. As many as 61% of the survey respondents reported higher earnings in 2012 compared to 2011, and only 12% reported lower earnings.

Other highlights of the survey findings include: Data professionals are highly educated. 85% of the respondents have some college degree, 39% have a Master’s degree, and 5% are Ph.D.’s. Those with doctoral degrees earn on average 65% more than those with Master’s degrees, who in turn earn 16% more than those with Bachelor’s degrees. On the job experience is even more important than education in determining salary levels. On average, professionals with ten or more years of experience earn 80% more than those with 3 years or less.

At the same time, the survey shows that those with 6 years or less make up as much as 59% of the data profession workforce.

In the contemporary enterprise, almost everyone will need to have data-science skills of some kind.

“When most people think of a data scientist, they think of a statistician, a guy with ‘analyst’ in his title,’” Hanrahan says. “Or, someone who works in IT and manages the data warehouses. To do these jobs, you certainly needed programming skills; you probably needed advanced statistics skills, or some combination of those skills.”

“At the most basic level, you are a data scientist if you have the analytical skills and the tools to ‘get’ data, manipulate it and make decisions with it,” he says.

The reality of the inbox is that people subscribe to a lot more stuff than they are committed to reading. As a result, they sift through the advertising and marketing noise to find the gems--the messages they connect with and that add value to their lives.

From your initial sign up process to the content and frequency of your messaging, your most important job is showing your audience that you respect the privilege of being invited into their inbox.

Some of the Hadoop projects we will talk about are: HDFS : A distributed filesystem that runs on large clusters of commodity machines. Map Reduce: A distributed data processing model and execution environment that runs on large clusters of commodity machines. Pig: A data flow language and execution environment for exploring very large datasets. Pig runs on HDFS and MapReduce clusters. HBase: A distributed, column-oriented database. HBase uses HDFS for its underlying storage, and supports both batch-style computations using MapReduce and point queries (random reads). ZooKeeper: A distributed, highly available coordination service. ZooKeeper provides primitives such as distributed locks that can be used for building distributed applications. Oozie: Oozie is a workflow scheduler system to manage Apache Hadoop jobs.