We need a PHP or Python script that runs on a linux server.
- Script will poll the main page of a web site, get sub-page links from it and then scrape those sub-pages for data
- Script that parses the sub-pages should be able to run asynchronously and concurrently with other instances of itself.
- Upon parsing data, it will be added to a MySQL database.
Script should be able to run over multiple VPN connections as an option.