Đang Thực Hiện

Youtube search result scraper / aggregator (No API usage)

-Private research project to analyze YouTubes video filtering system-

I need a program with very simple GUI (or just cmd) that does the following:

Input: Multiple Youtube search result URLs

Examples:

[login to view URL]

[login to view URL]

[login to view URL]

Function:

1.) Programm accesses all URLs

2.) Scrolls down until all search results are loaded. (Important. Google adds new results multiple times when the end of the page is reached)

3.) Saves all results, thumbnails, and links (links to video and channel) on the local hard drive (in a subfolder of the program) and creates an HTML file for opening the list in the browser at a later time. One file for each input link. (Example list in attachment)

4.) Refreshes pages after a set number of minutes (which can be adjusted by the user for each link)

5.) Automatically repeats steps 2-4 and adds new results to the previous local file. (Does not save duplicates.)

6.) The local file should look like a long search result list if opened. Links should be clickable, same as on Youtube.

Needed data:

- Video Thumbnail (Largest available size. Preferably animated gif, static Image is okay too)

- Channel name & Link

- Video name & Link

- Video description (Optional)

- Video length

- The time video was added by the program based on operating system time (Example: 10:24 AM)

Features:

- Being able to sort the list after opening it in the browser by: Video length, Video title, Channel title, Time added

- Channel URL link is changed to the videos pages by adding "/videos" to the end. See the attached file for example.

- An option to create a list of channels which should not be added to the HTML list if they appear in the results

- An option to define minimum video length for being added. (Example: "Add no videos shorter than 5 seconds")

- An option to set scraping times for each URL based on the operation system (Example: "Gather data from URL 1 only from 11 AM to 6 PM)

- An option to set wait times between scraping of each URL to prevent being IP banned for accessing results too fast

- An option to add banned words for the video title to a list. "If the video title contains any of the words in the list do not add it to the final HTML file"

Requirements:

- Must work on Windows 7 64bit

- Does not use Google API

- Has sorting arrows in the HTML file for video length, channel name, video title, and time added (Please look at the attachment files blue arrows.)

- The result looks similar to the attachment file, please make the thumbnail as the maximum size youtube provides it as

Please tell me what you would charge for creating this software :)

Kĩ năng: PHP, Web Scraping, Lập trình C#, Kiến trúc phần mềm, Python

Xem nhiều hơn: youtube api projects, youtube api fields, ai web scraping, scrape youtube comments python, youtube api, youtube api key, export youtube search results, youtube search scraper, youtube api search, googleapis youtube, youtube search service, simple youtube search api php, google search result tool adwords youtube toolbar, youtube search api wordpress, ebay search result scraper, miva search result retrieval api, perl details search result youtube, youtube search api php, youtube search engine api, excel scraper google search result vba

Về Bên Thuê:
( 0 nhận xét ) Chemnitz, Netherlands

ID dự án: #26392028

Được trao cho:

roooty

Dear Mr, Hope you are doing well, I am interested in your project and can start work on it immediately. I have 5 years’ experience in development ( C# / WPF / .NET / Java / PHP / MySql / SQLite / HTML / CSS / Javascr Thêm

$60 USD trong 3 ngày
(0 Đánh Giá)
0.0

12 freelancer đang chào giá trung bình $199 cho công việc này

kirilnberezebko

Hi Markus. I am a senior web and data scraping script developer with 6+ years of experience. I have worked on several similar projects scraping email address and phone number and specific datas from websites with pytho Thêm

$500 USD trong 3 ngày
(30 Nhận xét)
6.1
Stephenrajs

Hi there, I Have Scraped Amazon, Aliexpress, Yellow Pages, Yelp, Etc. I Have Unlimited Internet.I Have 6 Systems. I can do it. I have done many related projects like this. If you are provide this work, it will he Thêm

$250 USD trong 5 ngày
(114 Nhận xét)
5.6
apocalypsenow

Hey! I think that I can do that project - I have done similar things in the past and can easily do that. Message me so we can discuss more, please.

$130 USD trong 14 ngày
(15 Nhận xét)
4.3
gopalkrgautam

Hi, The project looks pretty interesting to me. But, what if we make a webapp using Django that will help operate and navigate the searches easily. Kindly ping me and discuss more to move further with the project. I w Thêm

$300 USD trong 7 ngày
(11 Nhận xét)
3.0
perfectd4y

Hi there, I am an experienced software developer. I read your job description, and I am interested in building this youtube analyzer. I can develop this software using python as I have multiple years of experience, an Thêm

$130 USD trong 7 ngày
(4 Nhận xét)
2.3
faizan2700

I have experience with web scraping and I have done several projects for my personal use and for clients ( which includes scraping sites like youtube, LinkedIn, Facebook ). I would like to discuss my detailed offer wit Thêm

$40 USD trong 7 ngày
(3 Nhận xét)
1.5
gauravb07

Hello, I have a youtube automation code which searches for a keyword and then goes through all the URLs of videos displayed and then one by one add comments to all the videos (no API has been used). I can write the cod Thêm

$222 USD trong 4 ngày
(1 Nhận xét)
1.0
Tushargarg98

Hi, The project looks pretty interesting to me. But, what if we make a desktop app using electron js that will help operate and navigate the searches easily. Kindly ping me and discuss more to move further with the pro Thêm

$140 USD trong 7 ngày
(0 Nhận xét)
0.0
emreyanik

hello I am working professionally with python programming language, I have executed many web scraping projects. I master libraries like Selenium beautifulsoup. I want to run this project for you if you contact me

$120 USD trong 2 ngày
(0 Nhận xét)
2.2
sandeepmeravi

having experience in developing similar kind of application extracting data from [login to view URL] need few clarity about performance and time limit on data load or not etc etc.

$300 USD trong 7 ngày
(0 Nhận xét)
0.0
ootta

Hello, I have experience with python web scrapers and i would be able to create program you want. I will be able to complete this project within 4 days. Oliver Otta

$200 USD trong 4 ngày
(0 Nhận xét)
0.0