83784 URL Spider / Auto categorizer

Need a script(s) to do the following: 1. Spider websites that are added by me from inside a mysql database. 2. Get all the urls on the sites and categorize them by their link title. For example: Lets say I have 25 categories: Amateur, Teen, Mature, etc Each category would have "keywords" like Amateur would have the keyword(s) 'amateurs' Teen would have the keyword(s) 'teen','young', '18' Mature would have the keyword(s) 'mature','older' Lets send the spider to [login to view URL] It collects all the links on that page and puts them in a temp mysql table, storing the url, title and date when spidered (01-28-02 style). Title not as meta tags but title as in link title (Look at the attached html file for an example of link title) Now using the category keywords it places the urls in their proper categories. Any link title that says "hot teen girl" would of course go into the TEEN category. This script would have to run once a day respidering whichever sites i have listed for it to collect urls from. 3. A blacklist table for certain domains i dont want to be categoriezed such as sponsors links. 4. A way to truncate parts of a link.. ill show you what i mean if you get the job. This is obviously adult related so take this job only if your comfortable with the content :c) thx Also I have a couple scripts that you could probably get the main spider code out of.