Apify
Platform to build, run, and monetize web scrapers & AI tools
Start new thread
Kat Manalac

Apify - Your one-stop shop for web scraping and web RPA solutions

by
YC Female Founders Holiday Gift Guide 2017
•
Apify is an open web scraping and automation platform, where you can find dozens of ready-made data extraction and automation tools, build new tools using our popular open-source SDK, or order an affordable turn-key solution from certified developers.

Add a comment

Replies

Best
Kelly Belton
Quick question? Do you impose automated limits to make sure that we scrape reasonably or is it up to us to place such controls? What I usually struggle is to find the right balance for scraping a high volume of data in a reasonable amount of time.
Lukáš Křivka
Maker
@kellybelton Hi Kelly, this is a very important question. Most of our public scrapers in our Store (https://apify.com/store) have internal limits that depend on the capacity of the target website. If you build a new scraper, it is naturally slowed down by the available memory so you have time to evaluate the ideal speed/costs ratio. It is definitely a lot about common sense, if you scrape a website of Amazon's site, you can go faster, but with smaller sites, you want to go slower to not overload their servers. Our SDK allows you to limit the max concurrency and add more delays.
Niels Ole Dam
Have been using Apify for production tasks for over a year – very pleased with their service. And they have a great customer support team, too. Can definitly recommend!
Lukáš Křivka
Maker
@niels_ole_dam Thanks a lot for a nice feedback!
Jakub Balada
Maker
@niels_ole_dam Thanks for your recommendation!
Niels Ole Dam
@lukas_krivka1 You're welcome. BTW we're also using your handy google-sheets Actor for simplifing fetching dynamic pre-run data into some of our Apify tasks – very nice with these kinds of prebuild addons to the platform. :-)
Memories 2 Digital
Used Apify for a couple of years, their tools are great (even if you don't use their cloud services!)
Jan Čurn
Maker
@memories_2_digital Many thanks for your kind words!
Richard Nwankwo
Very useful scraping platform. Was up and running doing scraping tasks shortly after going through the tutorial (https://docs.apify.com/scraping/...) Great tool to have in your dev toolbox
Jan Čurn
Maker
@richnwan Thank you, Richard!
Vivian
From my perspective, Apify is the best web scraping solution.
Alexandru Porcescu
Apify made NodeJS a web scraping first citizen. Before it's tools Python was the king. Now it is giving scrapy a run for its money. Good job guys!
Ben
I've been using the service for around 3 years. It is fantastic and my go-to for scraping anything. If you have any issues the team are on it and always happy to help. I can't recommend Apify enough!
Jan Čurn
Maker
@beesum ❤️
Owen Richards
Been using Apify to scrape lots of specific news sources and report back to a customer with new content for about 3 years and love it! The service and documentation is great and the platform as a whole really reliable. Good job guys! 🎉
Jakub Balada
Maker
@owenthetwit Great use case! We're glad to have you onboard for such a long time.
Ryo Chiba
Excited to see this on Product Hunt, congrats Apify team! Highly recommend this product to anyone looking for a powerful but easy to use RPA. You can read about our experience here: https://apify.com/success-storie...
Jakub Balada
Maker
@ryochiba Thanks a lot for sharing your use case how Topic is using Apify!
Peter Marchal
Amazing product
First
Previous
123
Next
Last