I need someone to write an application to extract data off a website. The site records are accessed through a predictable and sequential URL:
[login to view URL]
where the 559248 varies from 100001 to 572000 or so.
The app must be able to set a few options per run: start and end record numbers, time between requests, ability to hex code the URL and randomize the time between by 20%. The app should also be able to load a list of proxy server addresses to route through. The app should parse each HTML page and write each parsed field into a record, tab delimited. The app should store the table internally and then ftp it to a specified server. PM me for more details.
I will supply a layout of the GUI.