An upgrade to an existing PHP crawler platform is needed to include crawling of specific themes on the internet. A general crawler to crawl the web similar to the ones operated by the large search engines, however crawler needs to automatically recognise only certain themes of data and by country. It will probably need to activate search forms for this purpose as well.
When it finds suitable target data it needs to extract, normalize and categorize the surrounding metadata and store it properly formated into a mySQL database.
A short software licence agreement will need to be signed before we commence.