My father gave me an excel sheet with his work details and asked me to infer anything and everything that I could. This is what I did.

source

What do you mean by Exploratory Data Analysis?

Wikipedia says “EDA is an approach to analyzing datasets to summarize their main characteristics, often with visual methods”. It is an approach which will help you build a better relationship with the new dataset. If you use it wisely, half of your analysis is done.

For example: When you are buying something online, do you read the reviews? Do you see the price? Do you see the color? Do you swipe through the…


Random little things that I learnt during my internship (P.S. these are not just technical things)

Image via Author

Currently, I am a Master’s in Data Science Student at NYU, Center for Data Science. I completed my first ever internship in Data Science and I would love to tell you all about it.

I worked for a contextual-AI company, where we detect toxic behaviors from various platforms.

God! Did I have fun? The answer is — hell YES!

One major thing to take away is how Academic Data Science differs from Industry Data Science. But, the transition is what makes it so exciting.

A few random things I learnt during my first Data Science Internship —

Technical Skills (from Industry Perspective) I wish I had learnt beforehand —

  1. Ability to write Production-Level Code: Even though you have vast ML knowledge, you need to know…


Do not have enough resources to get your own labelled data for your classification task? Try thinking out-of-the-box and actively start learning “Active Learning”. Let your algorithm choose what to learn from.

source

We talk about working on data all the time to gain specific insights related to our projects, our experiences, maximising profits, increasing revenue and so many other reasons. This is what anyone thinks about all the time. But.. Let us take a step back and think in terms of “actual” data by taking a break from our “hypothetical” data.

It is not always easy to get data. No company will give it to you for free. There are a lot of trades that take place. For instance, you help the other company monetarily and they will help you with the…


What makes your data insightful? How do you rank your insights?

source

What is the first word that comes to your mind when you hear the word — insight? As a Data Scientist, I refer to the word insight when I collect some useful information from my data. I believe there is an order which is followed by Data, Information and Insight.

There is a famous hierarchical structure that comes to mind after looking at these three words together:


Tweet Preprocessing!

Learn how to preprocess tweets using Python

https://hdqwalls.com/astronaut-hanging-on-moon-wallpaper

Note from the editors: Towards Data Science is a Medium publication primarily based on the study of data science and machine learning. We are not health professionals or epidemiologists, and the opinions of this article should not be interpreted as professional advice. To learn more about the coronavirus pandemic, you can click here.

Just to give you a little background as to why I am preprocessing tweets: Given the current situation as of May, 2020, I am interested in the political discourse of the US Governors with respect to the ongoing pandemic. I would like to analyse how did the…


As someone who did not have the experience of dealing with JSON files before this, I have had a lot of issues collecting various JSON files and then combining them.

Just to give you a little background as to why I am merging tweets: Given the current situation as of May, 2020, I am interested in the political discourse of the US Governors with respect to the ongoing pandemic. I would like to analyse how did the two parties — Republican & Democratic Party react to the given situation, COVID-19. What were their main goals at this time? Who focused…

Parthvi Shah

Masters in Data Science @ NYU

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store