Đã hoàn thành

Open Access Harvest Project II (data gathering scripting)

Data Extraction/ Transformation

We are looking to build an Open Access archive of freely available scholarly journals. [url removed, login to view] is a good explanation of the what the content and project field is related to.


A. Create a harvesting engine in your own choice of coding ( parallel processing has proved the best results) that can:

1.) Crawl specific Internet sites (targets), we will help with the target choices, OAI is one method some site support

2.) If not crawling read from an input file to gleam the data, some site supply

3.) Ensure the data is accurate and test URLs for correctness

4.) Dump the defined data to a text delimited file format

5.) Transfer the data via ftp to us

B. Work with us to find new resources and refresh existing sources on a monthly basis.

C. Provide new and updated data feeds continually

D. Provide your own platform to run the harvests, a muli-core processor should be sufficient

E. The data provided will be Article level data relative to each Journal. The detail data will need these output fields:

"Publisher", "Journal Title", “Article Title”, "ISSN", "Alternate ISSN", "Journal Year", "JournalVol","JournalIssue", "HTML URL", "PDF URL", "Start Page", "End Page"

Kỹ năng: Lập trình C, Java, Perl, Ruby on Rails, Web Scraping

Xem thêm: open access, open access harvest project, what is parallel programming, what is data input, what is a method in programming, start a wikipedia page, programming wiki, programming resources, programming perl pdf, programming org, programming in access, perl programming pdf, parallel programming in c, open text, one harvest, html and scripting access, ftp engine, ftp dump site, find wikipedia, find sites for programming work, file processor, d&b supply, create a wikipedia page, c programming wiki, c programming find output

Về Bên Thuê:
( 5 nhận xét ) Windsor, United States

Mã Dự Án: #1640419

Đã trao cho:


Hi, Please check PMB

$400 USD trong 30 ngày
(2 Đánh Giá)

7 freelancer đang chào giá trung bình $457 cho công việc này


We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

$250 USD trong 7 ngày
(49 Đánh Giá)

I can start on this project. Please check my PM for more information.

$400 USD trong 4 ngày
(1 Đánh Giá)

check PM for details......

$250 USD trong 7 ngày
(1 Đánh Giá)

this would be good work for me!

$500 USD trong 14 ngày
(0 Đánh Giá)

Custom software development - <b><i>Removed by Admin</i></b>

$750 USD trong 1 ngày
(0 Đánh Giá)

Hello. I have experiences with similar projects.

$650 USD trong 5 ngày
(0 Đánh Giá)