We need an XML parser application that reads different XML files or feeds in RSS / Atom. ( example : [url removed, login to view] )
1- Read the XML file
2- Create the feed schema on the fly.
3- Open Connectivity with DB ( SQL server 2005)
4- Create related tables , if tables are not exiting in the DB,
5- Insert data within the tables.
6- in the inserted data, follow the links and repeat the above process if the link is in XML. for html links, retreive the HTML page and insert it in a seperate table
7- Code in .Net, and well documented.