Đã hoàn thành

link Checker

I need a backlinkchecker that looks after a list of backlink.

Available Source Data:

Backlink-URL, Anchor, Link destination, Follow or Nofollow, Checking Interval (Daily, Monthly, Weekly), Backlink ID

Here is want I want to check.

Checking is in 3 Steps.

1. Domain Check

- Checking the domain is alive via DNS and http status code

- Retrieving the IP of the hosting and the land of the IP.

- Retrieve the PR of the domain.

2. Checking the website where the backlink is.

- Look up the robots.txt. Backlink should not blocked via Disallow or Noindex in the robots,txt

- retrieve the webserver header response and checking for a X-Robots tag. Noindex and Nofollow should not be set. Also the http status code should be checked for the website. Must be Http Status Code 200.

- Now some checks on the website HTML. Lookup for Meta Tag Robots, must be Index and Follow. Check for a canonical url and if there is a canonical url it must be the same as the backlink url.

- Get the website Title and save it.

- Get the pagerank of the website

- count all links on the website

3. Checking the Link

- Check the Anchor is the same as in the source data.

- Checking the link destination is the same as in the source data

- checking the rel attribute. must be the same as provided in the sourcce data.

also we want a function that checks the position of the link and the sourrounded text.

I open to suggestions.

All data must be checked inthe intervall (dailiy, monthly, weekly) as provided in the source data.

Every error should be logged and on every check, it must be matched with the last saved data.

Following data should be written in a mysql table like this

Backlink ID, Check Status (True, False), Error (list of errors if check status is false), Domain PR, domain, website PR, all link on the website, IP-adress, last checked date,

I have no favorite programming language for this project, but it should be fast.

I am working on a decision diagramm, that will help to understand the process.

I hope, I have nothing forgotten.

Kĩ năng: Khai thác dữ liệu, Xử lí dữ liệu, Web Scraping

Xem nhiều hơn: web scraping process, table checker, programming robots, programming language list, processing programming language, open source programming language, open dns, look for dns, i get programming language, favorite programming language, fast web scraping, fast web programming language, check website programming language, blocked, canonical, need programming help fast, html checker, html table txt, domain checking, lookup table mysql, html table save, retrieve url, web scraping table data, adress list, html table position

Về Bên Thuê:
( 15 nhận xét ) Dortmund, Germany

ID dự án: #1630759

Được trao cho:


Hi, I have worked on a project which has 75% of the work you have mentioned. Please check my pm to you for more information. -- Nitin

€320 EUR trong 5 ngày
(13 Đánh Giá)

6 freelancer đang chào giá trung bình €498 cho công việc này


I am an expert in building such tools and look forward to take this up

€525 EUR trong 5 ngày
(29 Nhận xét)

I've done similar projects. Please check PM for more details.

€695 EUR trong 12 ngày
(18 Nhận xét)

I can do this work.

€750 EUR trong 30 ngày
(7 Nhận xét)

best backlink checker for you

€400 EUR trong 7 ngày
(1 Nhận xét)

Yeah, i did like this before . in Python.

€300 EUR trong 5 ngày
(0 Nhận xét)