Đã hoàn thành

Screen Scraper - Gov't Website - Check MySQL for duplicates

We need one public gov't website scrapped. It's a simple scrape; nothing special like captcha, password, etc... The gov't site is updated every time there is new information. The (Screen-Scraper .sss) Scraping Session in java would need to be aware of new information, and write this information in tsv format.

Scraped data needs to

(1) Have unique ID, compared to db for duplicates (mysql)

(2) Write scraped data to tsv format (approx 10 fields and 1 image)

(3) Have resilient extractor patterns

(4) Have Java Codes // Commented/Documented


The unique ID is incremental, and this is how you get to the details page.

The extractor patterns are simple.

Java Challenges:

(1) Must check if there is new information (scrapable data) with in a short period, or it will no longer be available.

(2) Sometimes the image doesn't yet exist, and the data does exist. With that said, here is the challange, sometimes the image will never exist, at which point we need to keep the scraped data, (i.e. iterate - after so many tries - if img not exist, keep the scraped data)

(3) It may seem like a simple site to scrape at first glance, but please don't underestaimate it, and leave it for the last day the project is due, as it has to be production ready when you submit it.


(1) Please only bid if you have experience with [url removed, login to view]

Project Due Date:

3-4 days after bid acceptance

This is my first post here with [url removed, login to view], so please bear with me as I learn the ropes. I work for an attorney firm who specializes with clients in direct marketing, so I will have more projects similar to this. We need this right away and production ready, as this is an integral part of a larger pilot program we are launching.

Thanks for reading this. Look forward to the bids.

Kĩ năng: Java, Web Scraping

Xem nhiều hơn: www freelancer id, www freelancer com how does it work, www direct freelancer com, www at&t.com, who needs freelancer java, website scraping projects, website freelancer website, web scraping site freelancer, web scraping part time, web data scraping freelancer, web attorney, tries in java, tries com, t&c freelancer com my, simple challenges, requirements for freelancer com, post project for freelancer, post production freelancer, pilot freelancer, need freelancer for java project, learn www freelancer in, learn web scraping, learn to freelancer id, learn java web scraping, learn java for web

Về Bên Thuê:
( 11 nhận xét ) Miami, United States

ID dự án: #1618406

Được trao cho:


I have lot of experience in Web Scraping. Please check your P.M.B. sir...!!

$90 USD trong 2 ngày
(23 Đánh Giá)

8 freelancer đang chào giá trung bình $125 cho công việc này


Hello, I am very inetested in this project, I have done similar Gov't Website scraper for my client,such as scraper for : [login to view URL] I am confident I can do this project for you in 3 days,please con Thêm

$200 USD trong 3 ngày
(58 Nhận xét)

Hello, I am an expert data extractor. Please refer your Inbox for my experiences and more details. Thank you.

$100 USD trong 3 ngày
(56 Nhận xét)

I specialize in similar projects. Please check PM for more details.

$180 USD trong 4 ngày
(16 Nhận xét)

hi i can do this contact if interested

$80 USD trong 2 ngày
(21 Nhận xét)

I am confident to do your work.

$47 USD trong 3 ngày
(0 Nhận xét)

The project will be completed within or before specific time using latest technology and skilled staff.

$55 USD trong 4 ngày
(0 Nhận xét)

<b><i>Removed by Admin</i></b> - Custom software development - skpye: <b><i>Removed by Admin</i></b>

$250 USD trong 1 ngày
(0 Nhận xét)