Đang Thực Hiện

c# Data gathering from web applications


I have a program that gathers data from websites (adult). Each website is represented by a class with several methods (get articles from index, get data from article, etc.)

I need to create new classes for data collecting from a particular website (one for each website), no login is required. The data will then be structured as an object and returned.

I can provide you with some examples from other websites, usually it is very similar.

I have about 100 websites in a queue, waiting to be created. Some websites have a very similar structure, so the differences between those are minimal, usually some html tag has a different name/id.

I would prefer to split this project into more milestones - each milestone would represent 20 pages (or less/more depends what you prefer) and when the milestone is done, then you would start to work on a next batch of websites

First milestone will be a little bit harder/more complex (depends on your skills), but I need those sites to be done first.

It’s 6 very similar websites with almost identical html/JavaScript structure, but to access those websites there is a need to bypass double google captcha (at least from the server where I need the program to be running). Check no robot box, wait and check second no robot box, then the page loads, it’s google recaptcha).

In this case I would prefer a solution like this (if it is even possible):

- when captcha happens, sends the captcha link by email and wait till the captcha is filled on another device

- usually on mobile phone I will open the email and fill the captcha

- when it's done, process continues

Or if not possible, I would imagine something like this:

- when captcha happens, opens chrome with google captcha and waits till the captcha is done manually

- when captcha is filled, close/hide the chrome window and continue in the process

Other websites don't require the captcha bypass, so they won't be that complex.

When possible, I always prefer to use htmlagility pack, otherwise I'm using selenium chrome.

Except the captcha, it is not a complex scripting. Maybe a little time consuming, but I can provide you with a couple of done website where you can check how it was done and re-use the code for creating new classes.

In proposal, please let me know if you have done something similar in the past. And what would be the price.

Thank you and kind regards,


Kĩ năng: .NET, Lập trình C#, HTML, Javascript

Xem nhiều hơn: php display data tables web page, clone web applications, data net web application excel macro, research data gathering, layout examples crud web applications, create single page web applications php, software database driven web applications, programming data entry web page, web applications data entry layouts, data gathering web site design, pda data gathering applications, web data gathering extjs, web page data gathering, importing data excel sheet j2ee struts web applications, gathering web data, web data gathering free, cool web applications data processing, web applications solution developer, SQL, ASP.NET,MVC ,C#, .NET ,Web applications , Windows Applications

Về Bên Thuê:
( 16 nhận xét ) Hradec Kralove, Czech Republic

ID dự án: #23962153

Được trao cho:


Nice to meet you on freelancer. My name is Da Zhang. I am an experienced C# programmer with more than 3 years scraping experience. Look at my upwork profile also: [login to view URL]~016a0f5cbf2aeb73ea? Thêm

$250 USD trong 5 ngày
(7 Đánh Giá)

25 freelancer đang chào giá trung bình $508 cho công việc này


Hello there, I have read out the details of your project. And I am one of the suitable candidates for your project. We have more than 9 years exp in the development. We have focused to deliver perfect valuable deliver Thêm

$700 USD trong 30 ngày
(163 Nhận xét)

Dear, Thank you for your job posting I have read your requirement carefully and I understood what you want. I am very happy to see the job which is matching my skills and experiences. I have 19+ years of experiences in Thêm

$700 USD trong 7 ngày
(3 Nhận xét)
$444 USD trong 10 ngày
(42 Nhận xét)

Hi Matej You described proposal very carefully. Thanks again for your detailed explanation. I can help you with this project. I will use selenium mainly for this project and can do this project in 5 days.

$600 USD trong 10 ngày
(9 Nhận xét)

Hello Sir, I have read your requirement carefully. you need a web application We can do this job easily.. I have already developed many WEB APPLICATION, ERP,CRM,School management system, Hospital management system, Thêm

$500 USD trong 12 ngày
(18 Nhận xét)

Hi I am a C#/html/JavaScript expert and I ONLY apply to jobs when I know I can do it. I am confident that I will deliver you the best solution possible and will exceed your expectations. I never left a client unsatisf Thêm

$750 USD trong 7 ngày
(24 Nhận xét)

Dear client. Hope your are doing well. What about using python for your jobs? I am a python web scraping expert, I did many scraping job with python. I know how to avoid the captcha and how to make the classes for spec Thêm

$500 USD trong 7 ngày
(9 Nhận xét)

Hi. Excuse me, you only want C#? how about using python for your goal? I have over 5 years of experience with python. I have already completed several scraping projects on this site, so I can deliver 100% result to ti Thêm

$500 USD trong 3 ngày
(9 Nhận xét)

Hi there I have just read your post and interested in it. I am a web expert having great experience in .NET, C# Programming, HTML, Javascript. I will provide you the website as per your requirements where you can eas Thêm

$555 USD trong 7 ngày
(5 Nhận xét)

Hi I have done this type of project in past. I can do this project. I have few questions about the requirements. Please message me so that I can discuss the project in details with you. Warm Regards Amit Bandana

$611 USD trong 8 ngày
(9 Nhận xét)

Greetings, this kind of job is my every day job, I am an Electronics Engineer/Software Developer, I have worked reversing both hardware & software (which I enjoy most, by the way).Here you can find a video sample of a Thêm

$600 USD trong 7 ngày
(1 Nhận xét)

Hi, I am an Expert Software achitect (12+ Years) and 100% confident to presentthe Possible Cheapest Solution for this work post. -I am ready for Technical Discussion/Interview -Available as per your time zone - Thêm

$744 USD trong 9 ngày
(6 Nhận xét)

Hello, how are you? I had read your description very carefully. I can make the application for gathering data from multiple websites. I already had many experiences in bypassing google captcha with c#. Also I used for Thêm

$300 USD trong 7 ngày
(2 Nhận xét)

Dear Client I have read your description very carefully and I am sure that can complete your project perfectly in short time. The Honest and Hard Work is diffterent than other freelancers. I am a new Freelancer but a A Thêm

$250 USD trong 7 ngày
(3 Nhận xét)

Dear Client, I have read your requirement in detail. I have several projects of scraping with C#, Python, etc. We can start work immediately, and I can lead this project to perfect result. Thanks, Regards.

$500 USD trong 7 ngày
(1 Nhận xét)

Hello, Thanks for your job posting. I read your requirements carefully and feel your job just fits my skills. I am good at web scraping using Python, c#, and PHP. And I have rich experience in this area. So I confident Thêm

$500 USD trong 5 ngày
(2 Nhận xét)

Hi, We have over 11 years experience in developing web based software. As part of this, we have internally built scrapers to pull data from other websites and also for our own site for SEO audits. We have recently de Thêm

$500 USD trong 7 ngày
(0 Nhận xét)

I can works wonders for you and enthusiast to do new and complex jobs . I am a Gold medalist in Information Technology I also have a team under me with different expertise (like developing , designing , content wri Thêm

$300 USD trong 5 ngày
(0 Nhận xét)

Dear Prospect Hiring Manager, After a full understanding of your project description, I can say I could help you with strong interests and desire. I will use a mixture of selenium and htmlagility pack for your proj Thêm

$750 USD trong 60 ngày
(0 Nhận xét)

Hello, I read your requirement and I am able to design a Project for you in .NET C# I'm a new freelancer, but Honesty and hard work is the difference between others. I am a C# and ASP.Net, MVC Expert. I can offer you Thêm

$500 USD trong 7 ngày
(0 Nhận xét)