Đang Thực Hiện

162501 Data Scrape and Graph

This is a multi-part project, please read it carefully so you will fully understand what I am wanting, and what I am wanting to accomplish.

What the purpose of this script is: We are going to monitor a wide array of auction sites, that I will define. Each auction site has a total of 'x' listings. We are going to scrape that value, on a daily basis.

We will make an entry into the DB each time we scrape a site. Thats going to be the number of listings, and the timestamp that the value was input.

Most auction sites utilize the same auction software. However, some are unique. Because of this, we are going to have different scrape routines, based on the software package that the site uses.

When we query the DB for the list of sites to scrape, their will also be a value, which indicates which scrape routine we should be using.

Example:

If the site utilizes probid auction software, its flag will be #1. If the site utilizes rscript auction software, its flag will be #2, and so on. This way, we will know which routine needs which scrape function, to obtain the correct value.

Here are 2 examples of auction sites which use Probid auction software:

[url removed, login to view]

[url removed, login to view]

On these examples, you see the category names on the front page, and next to those category names, you see a number. That number gives the total listings for that category. Our scrape will gather all those numbers, add them together, and will give us the total count for that site, and thats the value that will be stored in the DB.

Here are 2 examples of auction sites which use rscript auction software:

[url removed, login to view]

[url removed, login to view]

On these examples, you see the category names on the front page, and next to those category names, you see a number. That number gives the total listings for that category. Our scrape will gather all those numbers, add them together, and will give us the total count for that site, and thats the value that will be stored in the DB.

Ok ... Now you know how we are getting the data.

Now, we are going to create a page which displays all of the data, and creates stats, with a graph.

Here is an example of a site which does this:

[url removed, login to view]

We want to graph the data basically the same way.

If you have questions, please ask.

This will be an ongoing job, as from time to time, we will need to employ you to do custom scrape functions, based on the software package that the site we are going to monitor has.

Good Luck and Happy Bidding.

Kỹ năng: Bất kì công việc gì, MySQL, PHP

Xem thêm: graph use data, what graph, use graph, the graph, part graph, list graph, job define, create front page project, graph using, graph part, graph data examples, graph c, for graph, define job, define data entry, data front, create graph, c graph, as graph, array graph

Về Bên Thuê:
( 29 nhận xét )

Mã Dự Án: #1908691

Đã trao cho:

$100 USD trong 2 ngày
(105 Đánh Giá)
5.6