I would like a simple script that crawls the dynamic search results pages of a database driven website AND THEN goes to the first page of each result and copies the text from that page to a single .txt file.
Currently I login to a database driven dynamic page website, enter a search term, and select the databases I want to search.
Multiple pages of search result summaries are shown. I then click “view details” by each search result shown and am taken to a separate page that contains the text I want copied to a text file.
I would like this process automated with a script.
Let me know if any further information is needed. Thanks.