How to collect data legally from a website that requires a login?

How to collect data legally from a website that requires a login?

October 7, 2020 Michael Attwood , , , , , ,

No doubt, web scraping is a very useful tool, you can access any amount of data from any website. For this reason, some website owners have opted to hide their content and data behind login screens. This practice prevents most web scrapers from collecting the required data legally because they cannot log in to gain access, without accepting websites specific terms and conditions which usually prohibits use of automation to scrape data.

In this article, I’ll take you through how to collect data legally from a website that requires login.

Michael AttwoodHow to collect data legally from a website that requires a login?
read more
Is Web Scraping Legal?

Is Web Scraping Legal?

September 10, 2020 Michael Attwood , , , , , , , ,

For a couple of months now, the debate out there has been revolving around the legality of web scraping. The question out there is, is web scraping legal? Is web scraping illegal? Well, for starters, web scraping, also known as crawling or spidering, is the process of gathering information or data from someone else’s website using some form of software, web scraping software to be precise. Even though some people still scrape websites manually.

The legality or illegality of such a process largely depends on the intention of the person gathering the information.

Michael AttwoodIs Web Scraping Legal?
read more
Web Scraping: Why So Many Businesses Use It and Why You Should Too!

Web Scraping: Why So Many Businesses Use It and Why You Should Too!

April 26, 2020 digitalcustomer @ scrapingsolutions , , , , ,

Over the years, web scraping has become an integral part of many small and large business structures. In order to scale up your business, streamline your business services and drive your profits, it is necessary to implement data scraping techniques. After all, the grounds on which business’ operate are always changing- at any given point you may be the very best of your industry and within a few months your status can change dramatically. 

With competition rising rapidly it is crucial to gauge what developments have been implemented in order to stay ahead in the ever-changing market of the business world.

digitalcustomer @ scrapingsolutionsWeb Scraping: Why So Many Businesses Use It and Why You Should Too!
read more
The eCommerce Conflict – How Market Intelligence Can Assist in the War of Digital Commerce

The eCommerce Conflict – How Market Intelligence Can Assist in the War of Digital Commerce

March 20, 2017 digitalcustomer @ scrapingsolutions ,

As it says in Sun Tzu’s The Art of War: “If you know both yourself and your enemy, you can win numerous battles without jeopardy.”

While this saying, placed into the context of digital marketing, may sound slightly melodramatic; the sentiment still stands true against the backdrop of the modern business. If you aren’t aware of the marketing tactics of your peers, you can be at a disadvantage when strategising your own. With that in mind, let us delve a little deeper into the benefits of competitor insights.

digitalcustomer @ scrapingsolutionsThe eCommerce Conflict – How Market Intelligence Can Assist in the War of Digital Commerce
read more

Recent Projects

Recent Articles

Tags

Categories