Đã Đóng

Github Crawler for Developer Information from a Repo

Goal :- We want to extract information about important developers who have meaningfully contributed to the repository, based on the filename filters.


A public github repository will be given. Example: [login to view URL]

A whitelist of filters will also be given. Example: src/*, config/*.json, so on. For the whitelist same syntax as .gitignore will be used.


A ranked list of developers who have contributed. Example

dev1 10000 additions | 5000 modifications | 4000 deletions.

dev2 ….

Steps :-

1. Check all commits which are related to the filters (whitelisted folder/file)

2. Use the “.patch” command on the url to get the following info: (refer: [login to view URL])

a. Name

b. E-mail address

c. No. of commits

d. No. of files changed

e. No. of Insertions/changes

From the patch, extract developer name, email and number of lines added/removed/modified in the whitelist.

Finally create a ranked list of developers who have contributed. Example

dev1 10000 additions | 5000 modifications | 4000 deletions.

dev2 ….

Choice of Language/Framework :-

Python + Scrapy

NodeJS + Puppeteer

If you want to try something else, first get it approved.


1. There will be no payment release for partial work completion, or low quality work. You will either get the full payment, or no payment.

2. Our team of senior developer will review the code, and this may take up to a week. The money will be released once the code has been approved by them. Else, we may ask for changes to the code, or in the worst case cancel the contract, and award it to someone else.

3. Only willing to work with individual freelancers.

Kĩ năng: Python, Scrapy, Node.js

Xem nhiều hơn: web crawler demo gathering information function, developer information plimus payment processing, pricing information crawler parse feeds, github api, ghcrawler, github api crawler, github repo crawler, scrape github repos, github pages crawler, scraping github repo, github crawler python, information english writers urdu language, web crawler pull information site, web crawler extract information java, program web crawler extract information website, github crawler, g mail e mail, web developer information, www co d er m ic e com, best programming language to create website

Về Bên Thuê:
( 1 Nhận xét ) Mumbai, India

ID dự án: #27007653

10 freelancer chào giá trung bình₹38417 cho công việc này


Hi I'm an expert in web scraping I have read your project description I can create this crawler in less than 3 days I can do this project for you perfectly I wait for your reply, I can start work now Thanks

₹30000 INR trong 3 ngày
(14 Nhận xét)

Hi I am a very experienced statistician, data scientist and academic writer. I have completed several PhD level thesis projects involving advanced statistical analysis of data. I have worked with data from several comp Thêm

₹50000 INR trong 7 ngày
(20 Nhận xét)
(8 Nhận xét)

Hi, nice to e-meet you. We have a team of experience Python, Django developers. We have developed a sophisticated trading platform ([login to view URL]) using Python, Django, PostGreSQL. Apart from this we have built a numb Thêm

₹35000 INR trong 15 ngày
(21 Nhận xét)

Hi! I have read all of your scrapping system needs and I am sure that I can finish this job. I have worked on many niches and unique Python-related projects and this scrapping service is an easy task for me. Hope we Thêm

₹50000 INR trong 13 ngày
(1 Nhận xét)

Hi I'm Dmitriy, can create parser github by your requests, will do it in python + scrapy, waiting for your response.

₹35000 INR trong 10 ngày
(1 Nhận xét)

Hi, My portfolio site, [login to view URL] My Github site: [login to view URL] Please leave a message, would be interested in hearing about the requirement and the objective that you plan to accomp Thêm

₹32500 INR trong 7 ngày
(2 Nhận xét)

Our team already done github crawlers, this won't be hard. Ready to start. We are a team of full stack developers with experience and work already done in this area. For easy tasks we usually get things done in a simp Thêm

₹38889 INR trong 2 ngày
(2 Nhận xét)

Hello, Greetings. I have lost job during recent covid related layoffs Hence this opportunity is important for me. please provide me this opportunity. Ping me over chat for more discussion and price negotiation

₹34999 INR trong 7 ngày
(0 Nhận xét)

Hello Sir/ma'am Iam very much interested and very highly experienced in this category. I have done so many project's like this before. I think am the best candidate for this recruitment of yours.. am all F Thêm

₹44444 INR trong 7 ngày
(0 Nhận xét)