How do I know if It is legal scraping a website?

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

Post Body

I know that I always have to check the robots.txt . But how do I actually know what can I do and how can I do It?

I'll give you an example. Recently a client asked me to scrape restaurants from Foodpanda. I've checked the robots.txt and It seems like they wouldn't like that. But is It actually illegal or It may bring just to IP block (which could be bypassed through proxies in that case)? I don't want any problems so I just want to understand if I can actually scrape Foodpanda's restaurant.

(Yes, I'm a beginner)

Author

Account Strength

80%

Account Age

6 years

Verified Email

Yes

Verified Flair

Total Karma

326

Link Karma

Comment Karma

180

Profile updated: 1 day ago

Posts updated: 1 week ago

Vinc__98

Subreddit

r/webscraping

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.

Posted: 3 weeks ago
Reddit URL: View post on reddit.com
External URL: reddit.com/r/webscraping...