Đã Hủy

Data mining (Data Scraping) from Amazon API

Hi guys,

We need to scrape Amazon and build a big list of author names from some specific book categories we want.

**** DO NOT APPLY UNLESS you can scrap Amazon products using their API/XML product feeds they provide to developers!

We ALREADY built Zenno bots to scrape front-end results pages using proxies, captcha-solving etc and it is NOT enough.

We are NOT interested in front-end webpage scraping. *****

We need to scrape data of all the English language books published in certain categories filtered by:

1. books published in last 30 days.

2. "new releases" - books published from current date descending till 2015

3. "coming soon" books

We do NOT want to scrape listings of books published from 3 years ago or older!

You need to scrape through all the available listings.

Front-end scraping is strictly limited by Amazon, so you MUST do it via their API [Amazon Products Feed API /associate XML]. We tried front-end scraping [and we know to build Zenno bots] but this will not provide ALL the data needed.

We need only the following data from scraping:

1. Author name

2. Author Amazon page url (if available. If the book's author has an Author page on Amazon, his name will be linked to his page.)

3. Book publication date

4. Main category name (such as "Romance" not sub-categories like: "Romance>Historical>Paranormal>Contemporary")

5. Book format (Kindle or Paperback/Hardcover etc.)

No need for any other info such as images, book title, pricing, reviews etc.

Just real basic light data.

DB must be made Clear of Duplicates (no matter the book names, we ONLY need UNIQUE Author Names).

All the delivered excel files need to be sorted by publication date descending.

Delivery needs to be in excel file format with the following deliverables:

[a] 1 big Excel file with ALL the scraped data, sorted by publication date descending.

[b] 3 Excel files per genre/category:

One excel for "coming soon"

One excel for books published in last 30 days

One Excel for all the books published from 2015 to current date.

Example: "Romance_Coming Soon", Romance_last 30 days", "Romance_2015-2017".

We're not some big merchant/company, just starting our little service for authors and need a list of leads.

We may need ongoing gigs for scraping newly published books each month.

We need this big list ASAP. Is it possible within 1 week?

How much will scraping Amazon cost?

We may also want to scrape Barnes & Noble to find additional author names.

How much will scraping Barnes & Noble cost?

Kỹ năng: Big Data, Data Extraction, Khai thác dữ liệu, Khoa học dữ liệu, Data Scraping

Xem thêm: webharvy amazon, scrape amazon product reviews, amazon scraper php, scrape amazon python, amazon web scraping policy, scraping amazon customer reviews, amazon product scraper software, crawl amazon products, amazon api data extract, amazon seller data mining, amazon api data extraction, amazon api data csv, ebay api data mining, amazon buyer data api, amazon api data excel

Về Bên Thuê:
( 0 nhận xét ) United States

Mã Dự Án: #14872534

22 freelancer đang chào giá trung bình $540 cho công việc này

ramzitra

Hi, I have checked your project related to amazon books scraping. Actually, I have about 2 millions books scrapped last month using Amazon API. All the data are in CSV file and ready to be delivered. Relevant Skills a Thêm

$500 USD trong 10 ngày
(33 Đánh Giá)
6.0
helmot

Hello. I have worked with all of Amazon APIs before. You can't get "coming soon"/"new release" lists from API. The solution is to scrape ISBNs from Amazon and then get book details from API. Relevant Skills and Experi Thêm

$866 USD trong 10 ngày
(8 Đánh Giá)
5.8
seaanddream

Hi, my name is Sevinc. I am expert with Amazon API and AWS... I read your "Data mining (Data Scraping) from Amazon API" project descriptions carefully before bidding. I checked your requirements as well... I got what Thêm

$500 USD trong 7 ngày
(52 Đánh Giá)
5.9
cybersolutionvw

Hi, I am ready to do this for you as per according to your requirements. I have lots of experience in doing such kind of projects. You can check my profile for my work experience. Thanks Relevant Skills and Experienc Thêm

$1333 USD trong 7 ngày
(8 Đánh Giá)
4.4
Yknox

Dear. i am a developer in china . i have a great of experience amazon api. i can do your job as top as you want. Please let's start with me. I have good reviews over 750. Thanks.

$750 USD trong 10 ngày
(6 Đánh Giá)
4.1
OvaisNazir

Hello, I've reviewed your complete job description, and I fulfill all the qualifications required for this project. I can perfectly scrap amazon and extract all the required data with exact filtration as; books publ Thêm

$250 USD trong 15 ngày
(3 Đánh Giá)
4.1
furqanorpiv

Hi, I am FURKAN, a CERTIFIED Big Data, Data Extraction, Data Mining, Data Science, Data Scraping, WEB SCRAPPING EXPERT . I would love to provide you Quality data by scraping Amazon and build a list of AUTHOR NA Thêm

$250 USD trong 1 ngày
(5 Đánh Giá)
4.1
tomkusvw

Hi! My name is Tomasz Kustra, and I am from Poland. I have plenty experience with amazon, check my profile: http://www.freelancer.com/u/tomkusvw.html Relevant Skills and Experience What you want to do is impossible Thêm

$750 USD trong 10 ngày
(1 Đánh Giá)
2.9
narsim3128

With respect to this project I would like to present myself as a candidate for your consideration. I have more than 8 years of IT experience. I have successfully completed few projects for US clients Relevant Skills a Thêm

$555 USD trong 7 ngày
(2 Đánh Giá)
2.9
$555 USD trong 10 ngày
(0 Đánh Giá)
0.0
bhatsajad

Hi I am Sajad, i am an expert in Data Mining, Data Science, Web Scraping and Web Crawling. I have developed some tools which scrap the data from websites with great speed. I can provide you the Script as well as the w Thêm

$250 USD trong 2 ngày
(0 Đánh Giá)
0.0
bestit4u

Nice to meet you. I 've read your post and so very interested in your job. I 'm sure I can satisfy you with my ability. I 'm working in part of coding and software developing for over 6 years. I have experiences th Thêm

$777 USD trong 10 ngày
(0 Đánh Giá)
0.0
filipeferminiano

I already developed several scrappers for different ecommerces, including Americanas.com.br, Extra.com.br and Walmart.com.br. I would be happy to help you with your task. Relevant Skills and Experience I already devel Thêm

$250 USD trong 10 ngày
(0 Đánh Giá)
0.0
kirstarg

Hello! How are you? I have many works like this. You can see my profile or see the links I have wrote above this. I can show you my works and talk about everything. My priority is get good reviews, so we want good rel Thêm

$825 USD trong 1 ngày
(0 Đánh Giá)
0.0
Umamaheswari01

A proposal has not yet been provided

$250 USD trong 3 ngày
(0 Đánh Giá)
0.0
tracygearth

I have read entire description and would do my best to create a generic script to produce Excel sheet using API. with regards,

$385 USD trong 10 ngày
(0 Đánh Giá)
0.0
$555 USD trong 10 ngày
(0 Đánh Giá)
0.0
$250 USD trong 10 ngày
(0 Đánh Giá)
0.0
asdfjklsemicolon

Hello, I have experience using Amazon's API and can complete this project for you in a timely manner. Relevant Skills and Experience I have completed several projects using Amazon's API. Proposed Milestones $666 USD Thêm

$666 USD trong 10 ngày
(0 Đánh Giá)
0.0
josersosa

I can do it in R languaje with a oauth, xml an other scraping packages. After analyzing the problem, I will send you an estimate of the hours required to resolve it. Habilidades y experiencia relevante I'm a R program Thêm

$555 USD trong 10 ngày
(0 Đánh Giá)
0.0