This is a LARGE and involved Python/MySQL project which will require your 100% dedication for about 1-2 months in order to develop. Python is required, so if you cannot code in Python, then this is not the project for you. I may decide to award this project to anyone at anytime.
-Expertise in python. You must code the project in Python (and/or a python variant like stackless python, pypy or psyco).
-expertise in screen scraping EXTREMELY LARGE AMOUNTS OF DATA from websites FREQUENTLY using multiple IP addresses on many computers and routing this data to a central data center. I have 6.5 million products to scan through on a frequent basis.
-ability to extract large amounts of data frequently without getting my IP's blocked, and without using webservices.
-expertise in MySQL, HTML
-You must be able to provide daily email updates and allow me each day to see what code you have developed so far.
-Familiarity with grid computing or distributed computing concepts. Ability to advise me on how to go about extracting data using many geographically dispersed computers.
-availability to chat/email within 24 hours on business days.
-familiarity and/or expertise with [url removed, login to view], [url removed, login to view], ebay a huge plus.
-REFERENCES. You must provide references of medium to large scale work you have done in Python. I cannot trust inexperienced programmers try to take on this project.
Here is a brief outline of the project. I have all of these explained in detail in a 200-page specifications document which I will send to qualified contractors:
-Use database of 6.5 million products to extract sales ranks from [url removed, login to view] (or an alternate website which I will provide) on an ongoing basis
-extract top 4 lowest amazon used prices & top 4 lowest amazon used prices on a frequent ongoing basis either through amazon itself or through an alternate website (which I will provide)
-extract lowest [url removed, login to view] used & new prices
-extract ebay prices
-extract [url removed, login to view], [url removed, login to view], [url removed, login to view] prices
-compare prices between the websites above for each product
-automate listing items for sale on both [url removed, login to view] and [url removed, login to view]
-automate buying items on [url removed, login to view], ebay, [url removed, login to view], [url removed, login to view], [url removed, login to view], [url removed, login to view]
-ability to frequently scan my listings for sale on [url removed, login to view] and [url removed, login to view] and adjust their prices if necessary. I anticipate there being 1.5 to 2 million listings for sale at any given time on each website.
-use my templates to automate email responses
-build accounting system to keep track of incoming revenues and expenses
This project does not entail creating an e-commerce website, but rather, it is a server-side application with a GUI that employees can access. I have provided a very detailed description of each process that I need automated. I would be willing to pay a substantial premium price to any company who would be able to code, test, and deliver the project within 1 month. In addition to designing this program, I will require ongoing support and maintenance of the code, and am willing to pay the fees that you charge to provide this service. I anticipate that this project will need to utilize distributed or grid computing to run on many servers, so I will also need your input as to what hardware and operating system to use am flexible in terms of what operating system, hardware, networking, webhosting, should be used to implement this project (I will use my own money to pay for any hardware, and software as needed). I would like to get a talented company working on this project as soon as possible. This is a LARGE project and I will require the winner to be able to be able to be able to answer emails PROMPTLY (within no more than 24 hours) 7 days a week during development and afterwards for emergency support. If you cannot be available like this, please do not bid.