I'm a layman on the subject and would like to know where I can find more information on creating a crawler to download data and images from some sites. I searched a lot but until now I did not find anything very detailed!
Thank you for the answers.
Creating a CRAWLER php [closed]
2
asked by anonymous 12.04.2016 / 15:53
1 answer
1
Is php required?
So, first you need to understand your need to see if we really need to make use of php in this case, since a crawler works on requests per client. There is a crawler that works as a very fine extension for Google Chrome, which is called Web Scraper. You can find it here
I will use an automated process that will search for images periodically.
In this case, it is necessary to use php or some server-side programming language. In this case I recommend the framework PHPCrawl, that can be found here . It has a simple yet very rich operation, with several options. If you master the php language, just by reading the example you will be able to understand its usage.
What do I need to know to do crawler?
What I strongly recommend is that you have a good knowledge of Regexp as you will need recognize patterns to make accurate searches on the content you are looking for on the site where you are crawling.
12.04.2016 / 16:04