1
3 Comments

Does anyone need a web scraper?

I need to know that if you people need a web scraping software. If yes then what features do you want in it? Any suggestions??

on March 10, 2020
  1. 2

    I primarily use webscraper.io. it's great for a slightly-technical audience. there are a few others that are aimed at non-technical users. i think there's quite a few articles on how to write code to scrape, but the piece that I haven't seen a lot of info on, is how to manage the IP addresses so that you aren't blocked. So if you are building a tool/platform, it should ideally something be an end-to-end self-managed platform that includes handling of IPs, and maybe a (better) UI similar to webscraper.io. Happy to chat more if you want

    1. 1

      Umm yes, I am making a scraper for non technical users only and keeping the UI Clean also. You can check this out here https://www.indiehackers.com/post/need-feedback-on-a-future-product-release-15e7795abc . Thanks for sharing your views ...

  2. 1

    That's a very vague question. What's wrong with Scrapy?