A few weeks ago, i had a coder that developed me a webcrawler written in JAVA.
The crawler gathers data from a website, based on a query, and then outputs data to an excel worksheet or a csv file.
It has a simple interface with the query field and 3 buttons. it also has a progress bar and progress number indicator.
The problem is that the crawler just stops working when i do a search for more than 1.000 records. I guess this is a memory problem.
I initially accepted the coder work because he said that he would fix anything if i could run in some sort of problems. I didnt had the time to test it exaustly, and the problems were found after i accepted his work.
Now, i need a JAVA programmer who can fix this. If you're a JAVA guru this is a breeze to you because the program, the engine, its all done, you only need to test it and debug it to find the error and fix it.
I initialy paid the coder 35 dollars to do this job.
So, whoever knows his away around JAVA, please reply, prove you can do this, state your bid, and i'll send you the files.
* * *This broadcast message was sent to all bidders on Friday Jun 12, 2009 3:21:48 PM:
To all bidders on this project: The site i am scrapping is: [url removed, login to view] The site was not blocking the app in anyway i think. But theres another big issue: The site has changed!!! The results page its almost the same, but it has some little differences... So i am releasing the code i have for you to take a look, and test it and evaluate if you can change the program to make it working with the new site design. Here's the link to download the Java app: [url removed, login to view] Waiting for our replies... Thanks, Vasco
* * *This broadcast message was sent to all bidders on Friday Jun 12, 2009 3:29:05 PM:
Hi all, Just one more thing: I prefer to maintain constant communication with the coder i will select for this project, so having MSN, ICQ or Gtalk its a must. Thanks Vasco
* * *This broadcast message was sent to all bidders on Friday Jun 12, 2009 5:00:25 PM:
Hi all, from what i see from some of the comments, the coder that built me this app did a lousy job... So i am willing to go to a newer version, built from scratch. So, please provide examples or a working prototype and make your bids accordingly, i need the app to work full proof, independently from minor site changes wich will occur from time to time. I also want a coder that doesnt bail out on me like the last one... I state again that i need to be in constant communication trough MSN, ICQ or GTALK. By my past experience this way we can work a lot faster and more productevely. I will keep all the logs from conversations on IM, and post them in case of any dispute, so everyone can rest asure... In the meantime, i will give you guys my initial requirements from the first job and a link to the screeshots i sent to the first coder so you can see what i want to save from the site. I will also give an excel result file from that java app. I will give you everything in just a couple of minutes. Thanks, Vasco
* * *This broadcast message was sent to all bidders on Friday Jun 12, 2009 5:05:01 PM:
Hi again: This is the initial requirements: Hi all, this is what i want: A desktop application that can scatter data from a website and save all of it in an excel file, or csv file that i can import to excel. The site is [url removed, login to view] The desktop app can be done in any language as long as it works. I require a prototype example before i can select a coder, so the one who presents the prototype first for the lower budget will get ths job. the interface of the app must have a search field and it must show the data being save on a window, in a data grid style. Records must be saved on the fly, and at the end prompt to save the whole file in xls or csv format (csv is easier i guess, and its fine by me) there must also be a record counter, a progress indicator and a progree bar. Please see attached images to see what i want, the data to be saved and so on... Any questions feel free to ask. Coder i select for this job must use IM ( MSN, ICQ or gtalk ) i must be in constant communication... thnaks happy bidding
* * *This broadcast message was sent to all bidders on Friday Jun 12, 2009 5:09:26 PM:
This is the link to download the images were i demonstrate wich data i want to scrap: [url removed, login to view] and this is an excel example produced by the app: [url removed, login to view]
* * *This broadcast message was sent to all bidders on Saturday Jun 13, 2009 11:08:01 AM:
Hi to all coders on this project, I just want to say to you all, that in order to accept a coder i need a Bid (some coders havent bid yet) and i also need a prototype (screenshots or video of a beta prototype working). I know this will not be difficult for those experience coders. So i am waitting for yur replys. Thank you, Vasco