Đã Đóng

A Google scraper as first step of a startup project

I am looking for a developer highly experienced in Google scraping to build a desktop Google scraper, which takes and Googles a set of keywords and returns the scraping result in an MS Word file.

An important part of the scraper is a Google request timer. A keyword set will have up to 4 keywords, and in Googling a keyword set the distance between the keywords (i.e., Google requests) will be a random number between 1 ~ 2 seconds, to emulate human clicks. The timer sets a limit on the requests in terms of the number of requests per unit times and/or minimum distance between keyword sets, and issues a warning when the limit is breached. This limit will be the maximum rate of Google requests that can be made without getting a captcha. I would expect your advice on setting it. We may experiment a bit as well.

• The scraper should submit the requests exactly as human clicks do. So approve it only if it can do requests without a captcha at a rate very similar to human clicks can.

• Preferably, the Googling should go on in the background and cause no interruption to user’s desktop work.

• Each result in the Word file should have a clickable link and be formatted (bolds, colors, etc) for easy viewing.

• Google changes the markup format once or twice a year, upon which I would need you to fix the scraper very quickly. We will have a separate contract for this.

In fact, a robust Google scraper is already available at Compunect: [url removed, login to view] The difference is that Compunect usesxies and a powerful server, while my scraper only uses one IP and a PC. Also, the scraping contents are not exactly the same. They also publish a fix whenever Google changes the format. Using Compunect codes will make your job much easier.

About the startup project

This job is the first step of my startup project Engle, and I am very much hoping to find through it a long-term technical partner. In an effort to convince you that this is a project you can be proud of, I present a brief intro.

I am an Oxford-trained linguist and have invested many years into building Engle. Engle is a Google-based language tool that helps non-native English speakers write correct English. When non-native speakers are stuck with their English, the first thing they do is Google it. Google is currently the most powerful English reference tool. However, Google is not convenient for this purpose because this is not what Google is built for. Engle optimizes Google for English reference and learning, towards creating an English reference tool that is much more powerful than Google itself.

[Removed for encouraging offsite communication which is against our Terms and Conditions -Section 13:Communication With Other Users]

One-minute demo of Engle ([url removed, login to view])

Questions

1. What experience do you have with Google scraping?

2. How would you set the timer limit? How many four-keyword sets do you think can be Googled within a minute and within an hour without a captcha?

3. Can you implement all the features I have listed above, or are there any issues? Details appreciated.

4. How quickly will you be able to fix the scraper when Google markup changes, and how much will each fix cost?

5. What is your main coding language? Can you code in Python?

Kỹ năng: Coding, Python, Kiến trúc phần mềm, Phát triển phần mềm, Web Scraping

Xem thêm: google app engine sample project python, google scraper freelancer project, sample project python, google scraper web sites, google scraper php, corporation startup project plan, php google scraper, google calendar mysql java project example, google adsense account bid project, code drupal google map integration trial project, best startup project, google app engine browse project, google scraper, google scraper tools, google earth api aspnet project

Về Bên Thuê:
( 0 nhận xét ) Russian Federation

Mã Dự Án: #15235891

23 freelancer đang chào giá trung bình $483 cho công việc này

mhmhz

Hi I can build a desktop tool that fetches the data. can work on a demo if you like Thanks Relevant Skills and Experience . Proposed Milestones $833 USD - .

$833 USD trong 2 ngày
(181 Đánh Giá)
7.5
mantislin

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr Thêm

$556 USD trong 6 ngày
(208 Đánh Giá)
7.2
bouslimi1979

Hi I can code this as an Excel/VBA macro. I already did such thing. I ll use the [url removed, login to view] fundtion to simulate as possible a human request. Expérience et Compétences appropriées Excel/VBA web scraper Étapes p Thêm

$444 USD trong 5 ngày
(93 Đánh Giá)
6.9
schoudhary1553

Hello Sir, I have read your project requirement and i can deliver your project with 100% quality . please give me chance to work on your job. Relevant Skills and Experience I have more than 7 years of experience in C Thêm

$555 USD trong 10 ngày
(25 Đánh Giá)
5.8
$555 USD trong 10 ngày
(24 Đánh Giá)
4.7
edecena75

Hi... I am specialist in Python, certified by Freelacer. I fully understand your project and I have given you the best offer. Hire me :) Add my WhatsApp -> +584265960160 Or my Telegram -> @ejdecena Relevant Skills an Thêm

$250 USD trong 3 ngày
(25 Đánh Giá)
4.9
radiu

Hello! We are really interested in your project since we already have an old Google scraper that we used several years ago. It needs to be updated, but it is a good starting point. Relevant Skills and Experience Answe Thêm

$400 USD trong 10 ngày
(27 Đánh Giá)
4.9
adilhussain0411

Hello, I am expert in web scrapping ,Coding, Python, Software Architecture, Software Development . I have 7 years+ experience in web scrapping ,Coding, Python and I am certified web scrapper expert. I have completed Thêm

$250 USD trong 5 ngày
(20 Đánh Giá)
5.1
katilinas

Hello. 30 % of employers hiring me once hired me again. I have strong background in web data scraping and API. I CAN do this job, and do it well!

$520 USD trong 10 ngày
(13 Đánh Giá)
4.5
$526 USD trong 10 ngày
(11 Đánh Giá)
4.5
MykolaDudych

Hello, I am interested in your offer and I am ready to cooperate. Соответствующие навыки и опыт I can write a program for Windows to analysis of processes on the site page and receive information from the site. T Thêm

$722 USD trong 30 ngày
(11 Đánh Giá)
3.7
stevobujica91

Hi. I'm a professional software developer. I have a lot of experience in web scraping using Python. Relevant Skills and Experience Web Scrapping Python Google Scraping Proposed Milestones $350 USD - final

$350 USD trong 10 ngày
(9 Đánh Giá)
3.6
mpitianos

Hello, I can create a software that will simulate User's typing and clicking. Unfortunately the software will not be able to run at the background. My coding language is Visual Basic. Relevant Skills and Experience VB Thêm

$500 USD trong 10 ngày
(4 Đánh Giá)
2.8
samhegazy

I have made a project like this before for searching and updating hotels data using google. Relevant Skills and Experience I know all the problems that this project will face and i am sure i have the needed experience Thêm

$722 USD trong 10 ngày
(2 Đánh Giá)
2.3
RyanCoder18

Hi I am RYAN CODER I've reviewed your complete job description, and I fulfill all the qualifications required for this project. I have more than 7 years of experience in this field Relevant Skills and Experience Pyt Thêm

$250 USD trong 3 ngày
(0 Đánh Giá)
0.0
video556

A proposal has not yet been provided

$253 USD trong 1 ngày
(0 Đánh Giá)
0.0
$555 USD trong 10 ngày
(0 Đánh Giá)
0.0
megasoftsolution

Hi, Hope you are doing great! We, a team of experts, majorly OFFER services in the area of MOBILE APPLICATION DEVELOPMENT(ANDROID AND iOS), WEBSITE DEVELOPMENT, GRAPHIC DESIGNING, WEB AND MOBILE DESIGN, SOFTWAR Thêm

$555 USD trong 10 ngày
(0 Đánh Giá)
0.0
shriyashdgmail

I have worked on data scraping from google for different clients during my day job. I created both the models on VBA in MS Excel, I can do the same for you and export the results in MS word. Relevant Skills and Expe Thêm

$250 USD trong 8 ngày
(0 Đánh Giá)
0.0
csinfotechorg

Hi, On behalf of CS Infotech having experience of 7+ [url removed, login to view] have a team of experienced developers & designers who are capable of completing this project on time with quality. Relevant Skills and Experience We have g Thêm

$700 USD trong 30 ngày
(1 Đánh Giá)
0.0