Đã Hủy

Script for Scrape data and safe. Fix it

I have a custom code that is used to scrape data from a different website and save images and data in MySQL database. It uses simplehtmldom and Nokogiri to scrape and parse data, angrycurl for proxy connection, etc.. MVC framework is used through the code.

There are bugs and issues that need to be fixed with the code and I need to developer who understand scraping to look into it.

Issues are:

1. fix all the scrapers for the different website to ensure there is no errors and the correct data is being scraped with the correct logic applied before saving into database.

2. There is a refresh mechanism so if the information of a product is changed, products are listed in the refreshed products page. There is a bug prevent this from working.

3. The script also greater XML and csv with product information. Some changes are required to the data and layout of these files.

4. There are currently 2 x [login to view URL] files, so configuration information is saved in two files. Need to merge them info one fire and ensure its secure/safe.

5. Optimize code/script for security and speed of scraping.

Please refer to the attached screnshots.

Kĩ năng: MySQL, PHP, Data Scraping, Scrapy, Web Scraping

Xem nhiều hơn: script pull data internet explorer, script add data mysql, scrape data google map, web scraping python beautifulsoup, scrapy, scraping websites for data, python script to download data from website, data scraping, parsehub, python web scraping library, script to pull data from website, web scraping using python code, web scraping python projects, perl script retrieve data excel, script update data, wallpapers script without data base, access script import data, php script form data csv, simple script import data php, script scrape web page

Về Bên Thuê:
( 3 nhận xét ) Gomel, Belarus

ID dự án: #26559271

6 freelancer chào giá trung bình$50 cho công việc này


Hello How are you ☆☆☆ My skill Python, web scraping, Selenium ☆☆☆ I think my experience can help you enough. It's always ready, so you can discuss more via chat. If you believe in me please send me a message. Than Thêm

$100 USD trong 2 ngày
(21 Nhận xét)

I can get it fixed for you with speed .

$70 USD trong 7 ngày
(20 Nhận xét)

Hi Employer I've read your job post and I can do your website as per your requirement. I believe I could swiftly surpass your expectations for this role. Now I can work full time on your timezone and will keep real tim Thêm

$20 USD trong 3 ngày
(0 Nhận xét)

I am professional data entry expert. I can complete the work with in set target time frame. I am very honest person.

$80 USD trong 14 ngày
(0 Nhận xét)

Hi, Greetings of the ! As you can see that i am a fresher on this website but let me tell you one thing that i have very good hands on experience on thsese kind of projects. So i can i assure you the quality of the wo Thêm

$20 USD trong 7 ngày
(0 Nhận xét)

Hi . My self sushant sharma . I am a Data Entry Professional and designer . I have been working since 7 to 8 year as a Data Entry operator and designer . I have good knowledge in MS excel ,MS design making I take my wo Thêm

$10 USD trong 1 ngày
(0 Nhận xét)