Every project we do involves collecting data that’s publicly available, which is 100% legal. But there can be scenarios where a certain website specifically mentions in their terms and conditions that copying or replicating data is not permitted. In such cases we contact the website on your behalf and make sure what we do is perfectly legal. In the case of a particular website terms and condition prohibits automation, we will find alternative data sources or manual resources to get you the same data you are after without violating any websites terms and conditions.

There have been many cases in the past where companies try to act as if they own the data on their websites, when in fact its public knowledge. You can find numerous court rulings to date where judges have decided web scraping is completely legal.

Recently LinkedIn was ordered to let users scrape the data. Read more

We respect each platforms terms and conditions and we want scraping solutions customers to use our service responsibly.

Yes. As long as the data is publicly available information that you can view through a browser, we can scrape it.

Yes, of course.

We provide a 12-month warranty against defects, so you can test the scraper as much as you want and if you can find a bug within 12 months, we will fix it for free.

There are many ways you can save the data.

The most common options are exporting the data to Excel, CSV or to a database of your choice. If you have a specific data saving option you would like to discuss, we are more than happy to accommodate it.

All our programs have the ability to run on multi-thread mode (that means they run more than one instance in parallel) to increase the speed of the data extraction. However, the actual speed may vary depending on the speed of your internet connection. We are more than happy to test and give you some rough numbers before you start a project with us to see whether you will be happy with the application.

Websites usually block your IP address if they see an unusual amount of connections being made from a single IP address. They do this to make sure the website doesn’t slow down for everyone else using it simply because of one single person’s activity. As long as you are using it in a controlled manner, there is no reason a website should block you.

All our programs are already catered to make sure we don’t send huge amounts of requests within a short period of time. For this we use techniques like “random time delays” between requests we send to the website to scrape the data. We also use a technique called “multiple user agent simulation” in our programs to mimic an actual browser behaviour in our scrapers, so the chances you will get blocked by a website are very minimal.

A proxy is an IP address that you can purchase/rent from the Internet to connect to a website. If you want to scrape large amounts of data from one single website within a short period of time, we want to make sure your IP address won’t get blocked by a website. To do this, we buy private proxies and use them in the scraping program. Please contact us to find out the cheapest and best private proxies to buy with the highest speed.

Yes. all our programs are compatible with OSX, Linux and Windows. Please make sure you mention the operating system you will be running the scraper on prior to starting the project.