We need an aggregator to get feed content (RSS/Atom/XML etc.) from a list of over 100.000 blogs.
We only need a front-end to see the process of aggregation, we do not need any admin section or user interface. Just want to see the scheduled aggregation's process. For example: Latest aggregation time, total blogs, total posts received, failed aggregations/feeds/blogs etc.
We'll have the contents on a DB to attach to another application.
Database selection can be either MySQL or MsSQL.
Programming can be an exe file, or something to call as a CRON job. Any idea regarding to my need can be discussed.
Our must is the speed and reliability of the application.