Đang Thực Hiện

Data scraping from 3 Dutch websites

Hi!

For marketing research we need to collect public data form three websites.

REQUIREMENTS MUST HAVE

* PHP as programming language

* Use CURL library for HTTP requests

* PHP script should be run in commandline

* Efficient crawler to minimize number of requests

* Store data in MySQL database

* Configuration part in the script which sets database user/pass/dbname and other settings in one place

REQUIREMETS NICE TO HAVE

* Possibility to extend with new websites

* Possibility to stop the script and to continue where is left off. Do not crawl already crawled data more than once.

FIELDS TO SCRAPE AND STORE

source_website = name of the website

scrape_url = url where data form scraped from

contact_name

visit_adress1

visit_zipcode

visit_city

visit_country

post_address1

post_zipcode

post_city

post_country

phone1

fax1

email

website

company_name

company_vat_number

company_coc_number

company_description

company_url_logo

company_size

company_start

member_from

member_status

category

DELIVERABLES

* Database structure for MySQL tables.

* One PHP script, which can be run in command line. This script fills the database with data from the websites.

PAYMENT

* 2 milestones; 1) 50% when script is running and working and 2) 50% when everything is checked to be working properly.

WEBSITES

== 1 ==

Index page:

[url removed, login to view]

Data page:

[url removed, login to view]

Data example:

* URL to company logo

* URL: [url removed, login to view]

== 2 ==

Index page:

[url removed, login to view]

Data page:

[url removed, login to view]

Data example:

* URL to company logo

* [url removed, login to view]

== 3 ==

Index page (use the # A B C D … subpages for all entries):

[url removed, login to view]

Data page:

[url removed, login to view],CompanyId

Data example:

* [url removed, login to view]

* [url removed, login to view]

Kỹ năng: MySQL, PHP, Web Scraping

Xem thêm: working web crawler, working one freelancer, store freelancer, web data logo, websites name, websites programming, use data structure programming, use data structure, tables data structure, sets data structure, programming data, programming websites company, programming company logo, programming data structure, new data structure, need data structure, milestones freelancer, marketing freelancer websites, logo programming language, logo nl, logo freelancer websites, library part, index data structure, freelancer working fields, freelancer websites logo

Về Bên Thuê:
( 9 nhận xét ) HENGELO OV, Netherlands

Mã Dự Án: #1053510

Đã trao cho:

FMShinobi

Hello! i read your project details, i`m familiar with CURL and done similar projects, check PM please for more info.

€30 EUR trong 2 ngày
(2 Đánh Giá)
2.1

14 freelancer đang chào giá trung bình €131 cho công việc này

SigmaVisual

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

€200 EUR trong 7 ngày
(249 Đánh Giá)
7.9
tomydeveloper

Hello,We are experienced with Data scraping .Please check pmb for more detail.Thanks

€100 EUR trong 5 ngày
(219 Đánh Giá)
7.5
srinichal

Expert in scrapping and look forward to deliver the project

€200 EUR trong 4 ngày
(105 Đánh Giá)
7.2
lafor

Can be done.

€150 EUR trong 3 ngày
(160 Đánh Giá)
6.9
ExcellenceonPHP

HELLO DENIS.I AM READY FOR JOB.LET ME KNOW WHEN TO START.THANKS

€100 EUR trong 5 ngày
(118 Đánh Giá)
6.5
wildlily980

I can do it.

€90 EUR trong 5 ngày
(46 Đánh Giá)
6.1
phpXpertbd

Please see pm. Thanks

€140 EUR trong 10 ngày
(29 Đánh Giá)
6.2
alexander2007

Please check PM, Thanks.

€200 EUR trong 7 ngày
(30 Đánh Giá)
5.9
allhen

Ready to work !!

€420 EUR trong 9 ngày
(58 Đánh Giá)
5.7
z0mbie

Hi again, please check PM and attachment.

€50 EUR trong 2 ngày
(12 Đánh Giá)
4.6
vunv

Check your PMB, Thanks!

€100 EUR trong 3 ngày
(25 Đánh Giá)
4.5
a2infotech

please check PMB. Thanks a2infotech

€70 EUR trong 3 ngày
(4 Đánh Giá)
2.8
kayasystems

Please see PM

€100 EUR trong 2 ngày
(0 Đánh Giá)
0.0
PutraCoder

Hi sir, Please check your PMB...

€30 EUR trong 0 ngày
(0 Đánh Giá)
0.0