for People who use scrapers a lot, what are the most common pain points?
by•
recently i was checking out the scraper services and it seemed like easy to build at first but when i thought about scaling it, that's when it got really difficult.
still i wanted to know the opinions of the people who use the scraper services and what services do they use commonly in general and their pain point, that way i will just focus on those points and try to build the first iterations.
really appreciate your thoughts on this matter.
29 views
Replies
Proxy management and blocked requests are probably the two things I'd want a service to handle for me. I'd rather pay for that infrastructure than spend days maintaining it myself.
@oscar_bennett makes sense, In the age of AI, building the product is getting cheaper. Building infrastructure that reliably works in the real world is where the value is.
thanks for the feedback, i really appreciate it.
Another interesting angle could be vertical specific scraping . Instead of scrape anything something like product data real estate listings, or job postings could make the value proposition much clearer
@owen_carter3 Yes, starting by offering services in a specific domain or niche could help sustain the business longer with less overhead.