Scrapinghub - Présentation
Description du logiciel Scrapinghub
Scrapinghub is a provider of full stack web scraping solutions, offering a suite of platform products for transforming websites into data at scale. Combining technology and services to meet the needs of business users and developers from entry to Enterprise-level, Scrapinghub's custom on-demand data extraction plans are backed by qualified web scraping engineers. In addition, its Crawlera product promises "smart" IP proxy management that operates via HTTP request sends to its API, providing automatic proxy rotation and ban management. Available across scalable pricing plans designed for small to Enterprise-level scraping based on monthly and concurrent requests; Crawlera offers automatic ban detection, user behavior simulation and unlimited bandwidth. Also supported by headless browsers, Scrapinghub's own Splash browser is a purpose-built solution available as an open source project or hosted SaaS product. This lightweight headless browser scrapes data from websites at scale, including JavaScript-generated content, while simulating user behavior via custom scripting. Scrapy Cloud is the provider's cloud-based platform for managing and automating the deployment of web crawlers or "spiders" via a real time dashboard interface. Built-in QA tools and integration of Scrapinghub’s own Spidermon framework join intelligent scheduling options and customizable containers. Lastly, Scrapinghub's automatic data extraction API (beta) provides eCommerce and article data extraction at scale. The Select Product API returns structured data such as product information from eCommerce URLs, while the Select Article API scrapes news articles and blog posts.Scrapinghub - Présentation
Prix
Types de licence
Data on demand:
Once-off: From $500 per site
Data Subscription: $250 per month
Custom: From $2,000 annually
Scrapy Cloud
Starter: FREE
Professional: $9 per unit, per month
Splash
Small: $25 per month
Medium: $50 per month
Large: $100 per month
Enterprise: Custom
Crawlera
C10 Plan: $25 per month
C50 Plan: $100 per month
C100 Plan: $250 per month
C200 Plan: $500 per month
Enterprise: From $1,000 per month
Scrapinghub - Fonctionnalités
Captures d'écran
Scrapinghub - Avis
Scrapinghub - Avis
When it just works
It makes me work really fast but still secure for my clients. I look really professional even though what I did was only suggesting and installing Crawlera. It's awesome!
Relatively Easy To Use
Our company, whatoplay.com, aggregates data from multiple sources around the world. Since we started using Crawlera, we haven't really encountered big issues. Our common ones in the last 6 months is just reaching our limit, so we just had to increase our plan.
K-LIX
I have a good experience with scrappinhumb, in a matter of minutes I can develop and publish a new spider.
Why do you need that title?
I use and recommend that platform for years for my customers which need production-ready enterprise-grade data scraping systems.
Simple, reliable and powerful service
Never had a problem, and customer services always replied to our requests promptly, and with attention to detail.
Comparatif avec les logiciels similaires : note globale
Comparer avec les alternatives
When it just works
Avantages
It really saves my time as a web scraping specialists. I always need rotated proxies for my client needs. I keep creating a new project and it is a lot of hassle of I have to buy proxies, renew proxies, and create proxy rotation on my own. I am glad I don't even need to think about it. It just works!
Inconvénients
Well, it's just doesn't have enough advanced documentation on Scrapy Splash combined with Crawlera. Their development team in Github is very responsive though.
Relatively Easy To Use
Our company, whatoplay.com, aggregates data from multiple sources around the world. Since we started using Crawlera, we haven't really encountered big issues. Our common ones in the last 6 months is just reaching our limit, so we just had to increase our plan.
Avantages
We're only using Crawlera for our data scraping needs and it has worked seamlessly since we started using it in 2016. When we had to upgrade to a higher limit, the transition was fast, and no dev time was wasted updating our existing codebase.
Inconvénients
Pricing can be a bit tricky especially if your need is right in between the plans.
K-LIX
I have a good experience with scrappinhumb, in a matter of minutes I can develop and publish a new spider.
Avantages
The software delivers the exactly promised result. It has a friendly interface and an efficient support.
Inconvénients
You need a roadmap of new features and the pricing of third-party services.
Réponse de Scrapinghub
Thank you for the review. All new features will be announced in our Support Center.(https://support.scrapinghub.com/support/home) We also have an Ideas Forum (https://support.scrapinghub.com/support/discussions/forums/22000200101) where we would love your input on ideas or new features you would like to see. We appreciate all input from our Customers to continue to help us improve our products.
Why do you need that title?
I use and recommend that platform for years for my customers which need production-ready enterprise-grade data scraping systems.
Avantages
- Original and flexible technology
- No vendor-lock
- Easy to use for professionals
- Pretty convenient API system for integration with third-party solutions
Inconvénients
- Not so easy to use by non-professional IT person that still wants to use data scraping
- Lack of ability to create some kind of simple and clear user interface for such a persons
- No simple solution for distributed/high-volume crawling
- Lack of monitoring and alerting, non convenient logging system
- Overpriced Crawlera
Réponse de Scrapinghub
Thank you for your review we appreciate all customer feedback. We do have a managed service offering for non IT professional who want access to the Data without having any scraping skills.
Simple, reliable and powerful service
Never had a problem, and customer services always replied to our requests promptly, and with attention to detail.
Avantages
We are very happy with Crawlera. It works like a charm with our Scrapy projects, just adding a few lines of code we completely forgot about proxies that ended up failing anyway.
Inconvénients
Some requests end up being very slow, but good news is most of them end up going through.
Comparatif avec les logiciels similaires : recommandation utilisateur
Comparer avec les alternatives
Scrapinghub - Prix
Scrapinghub - Prix
Data on demand:
Once-off: From $500 per site
Data Subscription: $250 per month
Custom: From $2,000 annually
Scrapy Cloud
Starter: FREE
Professional: $9 per unit, per month
Splash
Small: $25 per month
Medium: $50 per month
Large: $100 per month
Enterprise: Custom
Crawlera
C10 Plan: $25 per month
C50 Plan: $100 per month
C100 Plan: $250 per month
C200 Plan: $500 per month
Enterprise: From $1,000 per month
Data on demand:
Once-off: From $500 per site
Data Subscription: $250 per month
Custom: From $2,000 annually
Scrapy Cloud
Starter: FREE
Professional: $9 per unit, per month
Splash
Small: $25 per month
Medium: $50 per month
Large: $100 per month
Enterprise: Custom
Crawlera
C10 Plan: $25 per month
C50 Plan: $100 per month
C100 Plan: $250 per month
C200 Plan: $500 per month
Enterprise: From $1,000 per month
Comparatif avec les logiciels similaires : rapport qualité-prix
Comparer avec les alternatives
Scrapinghub - Fonctionnalités
Scrapinghub - Fonctionnalités
Comparatif avec les logiciels similaires : note sur les fonctionnalités
Comparer avec les alternatives
Catégories
Vidéos et tutoriels
Vidéos et tutoriels
Plus d'informations sur Scrapinghub
Plus d'informations sur Scrapinghub
Scrapinghub - Principales fonctionnalités
- Email Address Extraction
- Phone Number Extraction
- Web Data Extraction
Avantages
• Scrapinghub is a full stack web scraping platform for business startups and Enterprises, comprising a suite of developer tools alongside managed services for data on demand applications.
• Custom data extraction services are also available, supported by a team of over 100 qualified web scraping engineers.
• Crawlera is a proxy network designed for scalable web scraping based on monthly requests, with main features including automatic ban detection and IP rotation, persistent sessions, headless browser support, plus unlimited bandwidth.
• Splash is Scrapinghub's lightweight headless browser that facilitates the scraping of JavaScript generated content and the simulation of user behavior with custom scripts.
• Scrapy Cloud offers cloud-based management of the deployment and running of web crawlers, comprising a real time dashboard, built-in QA tools including spider monitoring, scheduling, customizable containers etc.
Scrapinghub - FAQ
Scrapinghub - FAQ
Voici quelques-unes des questions fréquentes sur Scrapinghub.
Q. Quels sont les types de licence disponibles pour Scrapinghub ?
Types de licences disponibles pour Scrapinghub :
À partir de: 9,00 $US/mois
Type de licence: Gratuit, Open source, Abonnement
Essai gratuit: Disponible
Data on demand: Once-off: From $500 per site Data Subscription: $250 per month Custom: From $2,000 annually Scrapy Cloud Starter: FREE Professional: $9 per unit, per month Splash Small: $25 per month Medium: $50 per month Large: $100 per month Enterprise: Custom Crawlera C10 Plan: $25 per month C50 Plan: $100 per month C100 Plan: $250 per month C200 Plan: $500 per month Enterprise: From $1,000 per month
Q. Quelles sont les principales fonctionnalités du logiciel Scrapinghub ?
Fonctionnalités du logiciel Scrapinghub :
- Email Address Extraction
- Phone Number Extraction
- Web Data Extraction
Q. Qui utilise Scrapinghub ?
Utilisateurs habituels du logiciel Scrapinghub :
Grandes entreprises, Entreprises de taille moyenne, PME
Q. Dans quelles langues Scrapinghub est-il disponible ?
Langues dans lesquelles Scrapinghub est disponible :
anglais
Q. Quels sont les types de licence disponibles pour Scrapinghub ?
Types de licences disponibles pour Scrapinghub:
Gratuit, Open source, Abonnement
Q. Scrapinghub prend-il en charge les appareils mobiles ?
Nous n'avons pas d'informations sur les appareils pris en charge par Scrapinghub.
Q. Avec quelles applications Scrapinghub peut-il s'intégrer ?
Applications s'intégrant à Scrapinghub :
Dropbox, GitHub, Google Drive
Q. Quelles sont les ressources d'aide disponibles pour Scrapinghub ?
Ressources d'aide disponibles pour Scrapinghub :
Support en ligne, Support téléphonique
It makes me work really fast but still secure for my clients. I look really professional even though what I did was only suggesting and installing Crawlera. It's awesome!