Comments by FakeHelicopterPilot (Top 2 by date)

FakeHelicopterPilot 28-Aug-19 12:49pm View

If I plan to sell the data or offer it publicly, that's a matter of copyright. As far as terms of service are concerned, I'm not incredibly worried about that, and that's where opinions come in as far as ethics are concerned.

If public data is readily available on the internet that can be compiled to make my life easier and save me an irreplaceable commodity, my time, I'm going to take advantage of that opportunity.

If I was rain man, I could just click through manually and remember each entry. Python is my personal rain man.

FakeHelicopterPilot 28-Aug-19 9:44am View

F-ES. I think that's a matter of opinion. It's akin to taking a picture of a phone book. If the information is available, there's nothing wrong with using it. The information I'm scraping is there specifically for business purposes. I'm just making it more digestible for how we need to use it. Not every website is advanced enough to have an API.