Data Crawling and Cleansing Requirements
1. Crawl product information from [login to view URL], [login to view URL] for this project. We will need tocrawl more websites and we should agree a price range for future work
2. the original data should be one SKU per line, should include Generated Product ID, Generated Parent ID(empty if there is no variation), Original ProductID(for example, Amazon is ASIN), Brand, Product Title, Product Images, Category, SubCategory, LeafCategory, Product Description, Product Selling Price, Product Price Currency, Product Inventory, Manufacturer Name, UPC/EAN, # of Customer Reviews, Customer Review Rating, A plus Images, Category Ranking, Net Weight, Shipping Weight, Country of Origin, Size, Color
3. the must have data included Source Website, Original ProductID(for example, Amazon is ASIN), Brand, Product Title, Product Images, LeafCategory,Product Selling Price, Product Price Currency, Product Inventory
4. the inventory and price should be automatically updated every day and the other data will be updated every week at least.
5. the valid number of products should be no less than 2M for each site(those have the must-have information defined on 3) and should not ignore any categories intentionally without informing me.
6. Since it's an ongoing project, we need your support when the crawling engine is not working(for example may be the website changed their layout structure), anything this happened, your support is needed and we need to have an agreement on the supporting fee.
7, we will need to crawl a lot more website in future and we need to have a fee range for new websites.
M1: Database Design and Sample Data of one category for each website on local SQL SERVER
M2: M1 Results deploy to Cloud Server and pilot run for at least 1 week to check the automation performance, including product information update and inventory & price sync
M3:N11 and Hepsiburada Done
43 freelancer đang chào giá trung bình $1080 cho công việc này
hello, I can take up this task and will ensure the task is delivered to your level of satisfaction. I am a web scraper specialist. hope to hear from you.
I can crawl all your required websites as I am a professional with a decade of experience working in a US based NASDAQ registered company with all the skills and knowledge required for the project
Hi. I am already working in this field of data extraction and cleansing. So it won't be difficult for me to work with you. You will not regret after hiring me. Price is nagotiateable.
Hello , I have over 7 years of python web scraping experience. I am highly experienced with complex websites . Completely understand task at hand and able to show you past similar tasks which I’ve done .
I've MSCS and has expertise in data analysis and worked on various database an cloud computing projects. Relevant Skills and Experience Hand on experience in Hadoop, Oracle and Python.