Hot

6/recent/ticker-posts

How to think like a Data Scientist (Secret to a data-driven mindset)

 7 Steps to master your thoughts to become a data-driven person.

Photo by Mika Brandt on Unsplash

If you have read my previous article “Becoming a Data Scientist (Zero to Hero)”, Consider this as the second part of it. (Click below to read it in case if you have missed)

In addition to the concrete steps I listed in my first article above, to develop the skill set of a data scientist, I include seven challenges below so you can learn to think like a data scientist and develop the right attitude to become one.

1. Satisfy your curiosity through data

Photo by Michael Aleo on Unsplash

As a data scientist, you write your own questions and answers. Data scientists are naturally curious about the data that they’re looking at, and are creative with ways to approach and solve whatever problem needs to be solved.

Much of data science is not the analysis itself, but discovering an interesting question and figuring out how to answer it.

Here are two great examples:

Challenge: Think of a problem or topic you’re interested in and answer it with data!

For instance, I was using Google BigQuery for a data warehousing project a few months back and I was curious about the process of whole data migration thing and I researched for days and finally wrote this article:


2. Read news with a suspicious eye

Photo by Paul M on Unsplash

Much of the contribution of a data scientist (and why it’s really hard to replace a data scientist with a machine), is that a data scientist will tell you what’s important and what’s spurious. This persistent skepticism is healthy in all sciences and is especially necessary in a fast-paced environment where it’s too easy to let a spurious result be misinterpreted.

You can adopt this mindset yourself by reading news with a critical eye. Many news articles have inherently flawed main premises. Try these two articles. Sample answers are available in the comments.

Easier: You Love Your iPhone. Literally.

Harder: Who predicted Russia’s military intervention?

Challenge: Do this every day when you encounter a news article. Comment on the article and point out the flaws.

Here is one time I got suspicious about Google’s Nested Data Structure and Columnar format in Google Big Query and what I have found regarding it:

3. See data as a tool to improve consumer products

Visit a consumer internet product (probably that you know doesn’t do extensive A/B testing already), and then think about their main funnel. Do they have a checkout funnel? Do they have a signup funnel? Do they have a virility mechanism? Do they have an engagement funnel?

Go through the funnel multiple times and hypothesize about different ways it could do better to increase a core metric (conversion rate, shares, signups, etc.). Design an experiment to verify if your suggested change can actually change the core metric.

Challenge: Share it with the feedback email for the consumer internet site!

For instance, I was looking for a way to create a Dashboard using python to show the annual sales change between teo periods and the trends of products (Positive/ Negative) So I came with the idea of combining both R,R Shiny and Python to create a dashboard (With some cool graphs with the use of plotly package), If you’re interested click on the link below and read it :)


4. Think like a Bayesian

Photo by Sharon McCutcheon on Unsplash

To think like a Bayesian, avoid the Base rate fallacy. This means to form new beliefs you must incorporate both newly observed information AND prior information formed through intuition and experience.

Checking your dashboard, user engagement numbers are significantly down today. Which of the following is most likely?

1. Users are suddenly less engaged
2. Feature of site broke
3. Logging feature broke

Even though explanation #1 completely explains the drop, #2 and #3 should be more likely because they have a much higher prior probability.

You’re in senior management at Tesla, and five of Tesla’s Model S’s have caught fire in the last five months. Which is more likely?

1. Manufacturing quality has decreased and Teslas should now be deemed unsafe.
2. Safety has not changed and fires in Tesla Model S’s are still much rarer than their counterparts in gasoline cars.

While #1 is an easy explanation (and great for media coverage), your prior should be strong on #2 because of your regular quality testing. However, you should still be seeking information that can update your beliefs on #1 versus #2 (and still find ways to improve safety). Question for thought: what information should you seek?

Challenge: Identify the last time you committed the Base Rate Fallacy. Avoid committing the fallacy from now on.


5. Know the limitations of your tools

Photo by Sven Brandsma on Unsplash
“Knowledge is knowing that a tomato is a fruit, wisdom is not putting it in a fruit salad.” — Miles Kington
  • Knowledge is knowing how to perform an ordinary linear regression, wisdom is realizing how rare it applies cleanly in practice.
  • Knowledge is knowing five different variations of K-means clustering, wisdom is realizing how rarely actual data can be cleanly clustered, and how poorly K-means clustering can work with too many features.
  • Knowledge is knowing a vast range of sophisticated techniques, but wisdom is being able to choose the one that will provide the most amount of impact for the company in a reasonable amount of time.

You may develop a vast range of tools while you go through your Coursera or EdX courses, but your toolbox is not useful until you know which tools to use.

Challenge: Apply several tools to a real dataset and discover the tradeoffs and limitations of each tool. Which tools worked best, and can you figure out why?


6. Teach a complicated concept

Photo by Raghav Modi on Unsplash

How does Richard Feynman distinguish which concepts he understands and which concepts he doesn’t?

Feynman was a truly great teacher. He prided himself on being able to devise ways to explain even the most profound ideas to beginning students. Once, I said to him, “Dick, explain to me, so that I can understand it, why spin one-half particles obey Fermi-Dirac statistics.” Sizing up his audience perfectly, Feynman said, “I’ll prepare a freshman lecture on it.” But he came back a few days later to say, “I couldn’t do it. I couldn’t reduce it to the freshman level. That means we don’t really understand it.” — David L. Goodstein, Feynman’s Lost Lecture: The Motion of Planets Around the Sun

What distinguished Richard Feynman was his ability to distill complex concepts into comprehendible ideas. Similarly, what distinguishes top data scientists is their ability to cogently share their ideas and explain their analyses.

Challenge: Teach a technical concept to a friend or on a public forum, like on a blog/medium or Youtube.

PS: Here are some of my articles (Not that complicated but will save you hours worth of time for sure ) that you may enjoy :)





7. Convince others about what’s important

Photo by Priscilla Du Preez on Unsplash

Perhaps even more important than a data scientist’s ability to explain their analysis is their ability to communicate the value and potential impact of the actionable insights.

Certain tasks of data science will be commoditized as data science tools become better and better. New tools will make obsolete certain tasks such as writing dashboards, unnecessary data wrangling, and even specific kinds of predictive modeling.

However, the need for a data scientist to extract out and communicate what’s important will never be made obsolete. With increasing amounts of data and potential insights, companies will always need data scientists (or people in data science-like roles), to triage all that can be done and prioritize tasks based on impact.

The data scientist’s role in the company is the serve as the ambassador between the data and the company. The success of a data scientist is measured by how well he/she can tell a story and make an impact. Every other skill is amplified by this ability.

Challenge: Tell a story with statistics. Communicate the important findings in a dataset. Make a convincing presentation that your audience cares about.

Now- Since you finished learning about brightening up your skills as a data scientist, Read below article to crack open the right way of “Facing a Data Science Interview”



Good luck and best wishes on your journey to becoming a data scientist!

Thank you!



Keen on getting to know me and my work? Click here for more!

References

Chen, W. (2020). [online] Available at: https://www.quora.com/How-can-I-become-a-data-scientist/answers/4451343?share=1 [Accessed 3 Feb. 2020].



Post a Comment

0 Comments