Charlie Irish

Portia - Scrape websites visually

by

Add a comment

Replies

Best
Kevin Simper
I just tried signing up for Portia. They had a very cool introduction called Ben that wanted me to invite my team members. Funny because I don't think of scrapping as a team sport. Next I tried creating a spider, but there were no help here at all. I had to go to the docs and I still did not understand what I was doing. I clicked some elements on a page that I wanted scraped, but first afterwards discovered that I had to define the fields I wanted scraped and then annotate the page. On top of that it seems like they are out of capacity because I suddenly got a fatal mistake from the crawler when pressing "Test". Looks good, but still a long way! 👍
Samir Doshi
This is a huge improvement on some of those other wysiwyg macro scrapers out there that just don't work.
Saijo George
Nice product. How do you guys compare to https://www.producthunt.com/tech... , that is my go to scraper these days
Heather Redman
Really useful--web data for everyone on an on-demand accessible basis. Would be interested in whether Portia also provides data structuring?
Nick Kwan
@pablohoffman @gpuliatti doesn't look like Portia can currently handle scraping Twitter. Linkedin is even more secure than Twitter...Am I doing something wrong or is this how it is? Any suggestions for another scraper? Looking for something web based / usable on Mac. Data-miner.io is good, but a bit complex for us non-technicals.
dataflowkit
@pablohoffman @gpuliatti @nwkwan I'm sorry for late response. We've released new service for data scraping https://www.producthunt.com/post... . It is able to extract long infinite scrolled pages. I would really appreciate your expert review of our DFK service
Iverson Dantas
What do you think about tools to monitor updates social medias on twitter, facebook, youtube and instagram and also extract data from them?