✳flâneur — a map of the web's best reading

Web Scraping and Crawling Are Perfectly Legal, Right?

benbernardblog.com · 2,535 words · saved by 1 readers

In this post, you'll find out more on the legal aspect of web scraping and crawling, and what possible consequences you might face.

"Come on, I worked so hard on this project! And this is publicly accessible data! There's certainly a way around this, right? Or else, I did all of this for nothing... Sigh..." Yep - this is what I said to myself, just after realizing that my ambitious data analysis project could get me into hot water. I intended to deploy a large-scale web crawler to collect data from multiple high profile websites. And then I was planning to publish the results of my analysis for the benefit of everybody. Pretty noble, right? Yes, but also pretty risky. Interestingly, I've been seeing more and more projects

Explore this link on the map →

saved by

related reading