Github Crawler for Developer Information from a Repo
Ngân sách ₹15000-50000 INR
Goal :- We want to extract information about important developers who have meaningfully contributed to the repository, based on the filename filters.
INPUT
A public github repository will be given. Example: [login to view URL]
A whitelist of filters will also be given. Example: src/*, config/*.json, so on. For the whitelist same syntax as .gitignore will be used.
OUTPUT:
A ranked list of developers who have contributed. Example
dev1 10000 additions | 5000 modifications | 4000 deletions.
dev2 ….
Steps :-
1. Check all commits which are related to the filters (whitelisted folder/file)
2. Use the “.patch” command on the url to get the following info: (refer: [login to view URL])
a. Name
b. E-mail address
c. No. of commits
d. No. of files changed
e. No. of Insertions/changes
From the patch, extract developer name, email and number of lines added/removed/modified in the whitelist.
Finally create a ranked list of developers who have contributed. Example
dev1 10000 additions | 5000 modifications | 4000 deletions.
dev2 ….
Choice of Language/Framework :-
Python + Scrapy
NodeJS + Puppeteer
If you want to try something else, first get it approved.
Disclaimer:
1. There will be no payment release for partial work completion, or low quality work. You will either get the full payment, or no payment.
2. Our team of senior developer will review the code, and this may take up to a week. The money will be released once the code has been approved by them. Else, we may ask for changes to the code, or in the worst case cancel the contract, and award it to someone else.
3. Only willing to work with individual freelancers.
10 freelancer chào giá trung bình₹38417 cho công việc này
Hi I'm an expert in web scraping I have read your project description I can create this crawler in less than 3 days I can do this project for you perfectly I wait for your reply, I can start work now Thanks
Hi I am a very experienced statistician, data scientist and academic writer. I have completed several PhD level thesis projects involving advanced statistical analysis of data. I have worked with data from several comp Thêm
Hi! I have read all of your scrapping system needs and I am sure that I can finish this job. I have worked on many niches and unique Python-related projects and this scrapping service is an easy task for me. Hope we Thêm
Hi I'm Dmitriy, can create parser github by your requests, will do it in python + scrapy, waiting for your response.
Hi, My portfolio site, [login to view URL] My Github site: [login to view URL] Please leave a message, would be interested in hearing about the requirement and the objective that you plan to accomp Thêm
Our team already done github crawlers, this won't be hard. Ready to start. We are a team of full stack developers with experience and work already done in this area. For easy tasks we usually get things done in a simp Thêm
Hello, Greetings. I have lost job during recent covid related layoffs Hence this opportunity is important for me. please provide me this opportunity. Ping me over chat for more discussion and price negotiation
Hello Sir/ma'am Iam very much interested and very highly experienced in this category. I have done so many project's like this before. I think am the best candidate for this recruitment of yours.. am all F Thêm
