Đang Thực Hiện

162501 Data Scrape and Graph

This is a multi-part project, please read it carefully so you will fully understand what I am wanting, and what I am wanting to accomplish.

What the purpose of this script is: We are going to monitor a wide array of auction sites, that I will define. Each auction site has a total of 'x' listings. We are going to scrape that value, on a daily basis.

We will make an entry into the DB each time we scrape a site. Thats going to be the number of listings, and the timestamp that the value was input.

Most auction sites utilize the same auction software. However, some are unique. Because of this, we are going to have different scrape routines, based on the software package that the site uses.

When we query the DB for the list of sites to scrape, their will also be a value, which indicates which scrape routine we should be using.

Example:

If the site utilizes probid auction software, its flag will be #1. If the site utilizes rscript auction software, its flag will be #2, and so on. This way, we will know which routine needs which scrape function, to obtain the correct value.

Here are 2 examples of auction sites which use Probid auction software:

[url removed, login to view]

[url removed, login to view]

On these examples, you see the category names on the front page, and next to those category names, you see a number. That number gives the total listings for that category. Our scrape will gather all those numbers, add them together, and will give us the total count for that site, and thats the value that will be stored in the DB.

Here are 2 examples of auction sites which use rscript auction software:

[url removed, login to view]

[url removed, login to view]

On these examples, you see the category names on the front page, and next to those category names, you see a number. That number gives the total listings for that category. Our scrape will gather all those numbers, add them together, and will give us the total count for that site, and thats the value that will be stored in the DB.

Ok ... Now you know how we are getting the data.

Now, we are going to create a page which displays all of the data, and creates stats, with a graph.

Here is an example of a site which does this:

[url removed, login to view]

We want to graph the data basically the same way.

If you have questions, please ask.

This will be an ongoing job, as from time to time, we will need to employ you to do custom scrape functions, based on the software package that the site we are going to monitor has.

Good Luck and Happy Bidding.

Kỹ năng: Bất kì công việc gì, MySQL, PHP

Xem thêm: www create a graph, which graph to use for data, what is data input, what is a graph, what graph to use for data, what graph, what does data entry do, use of graph, use graph, use a graph, the graph, part of graph, part of a graph, list graph, job define, in a graph, how to graph data, how to create graph, how to create front page of project, how to create a graph, how do you graph data, graph using c, graph to data, graph this data, graph the data

Về Bên Thuê:
( 29 nhận xét )

Mã Dự Án: #1908691

Đã trao cho:

$100 USD trong 2 ngày
(105 Đánh Giá)
5.6