I need an automatic tool that downloads a CSV file of a list of domain names (big data: millions of domains) from a website, and then uploads it on my CentOS dedicated server.
The final result would be a tool hosted in a web page that allows me to:
- Search for domains by word, per domain extension, per string length and with possibility to exclude terms.
- Shows me Alexa ranking for each domain. (so the tool is supposed to mass check all the domains for up-to-date alexa rankings)
- The tool also keeps periodically updating the list of domains from the original download link.