Đã Đóng

Immediate Need For Web Scraping Project

I have an immediate need for .NET developers to collect (scrape) real estate property and tax data from over 130 public websites in the US. We need to immediately add these sites to our existing server environment described below, with an additional 1,000 sites required immediately following the successful implementation of this project. Beyond that we anticipate to have many more contracts to follow based on our prior performance. The goal is to have the first 130+ sites coded within 30 to 45 days, with incremental deliverables along the way. We are inviting multiple individuals or teams to request an opportunity to participate. Each qualified individual/team that is selected will be awarded two sites to collect data from. Upon successful implementation, determined by the quality of data returned and the timeliness of completion, we will award additional contracts in incremental or bulk volume. The successful candidates that deliver the best performance will be invited to participate on future contracts.

The company I represent has an existing web application running on Windows Server 2012. The application accepts CSV and Excel XLS(X) files that contain search parameters and keys for input used by the scraping applications. These input files are uploaded by our client and converted to jobs in a database. When the client decides to start the saved job, the Job Manager begins executing as many multiple instances of scraper applications as needed, or possible, and instructs them as to which properties it needs to collect data for. The scraper applications are written as .NET service applications that support multi-threaded execution so that many instances of the same county scraping application can be running at the same time. Once the scraper application is done collecting its data it provides it back to the Job Manager as a CSV, XLS(X) or an XML file in the prescribed standard format. The data is then parsed and written into a SQL Server database by another service application and stored there until the client requests the output in CSV, XLS(X), XML or JSON formats, either through the web interface or through our custom API.

Our current scraping applications are written in Visual Basic .NET and Visual C# .NET, and these languages are our first preference. However, other language options will be considered if they are compatible with the .NET framework, can be executed as a service application and/or fit within the existing architecture with little or no modification. Candidates having experience working with any of the following web technologies will be considered first:

• Captchas • Flash

• Java • ASPX

• Flex • Silverlight

• Proxy IP rotation • Image download (.jpg, .png, .bmp, etc.)

• Direct API calls

If you are interested in this project please submit your proposal for development along with relevant experience. Please include which languages you are able to code in along with your years of experience for each, your availability to work on this effort in regards to starting date and number of hours a week you are available to work, which of the web technologies mentioned above you are experienced in working with, and whether or not you are working as an individual or have a team of developers that can develop multiple of these applications at the same time.

Please note that this is listed as an hourly project. We are required to specify a starting hourly range but are willing to compensate appropriately based on performance of the initial task. We will provide more detail about the sites that need to be scraped to all those who reply that have responded appropriately by establishing their relevant experience and qualifications. We will entertain a fixed price bid on future contracts after a candidate has demonstrated their successful implementation on this initial two site effort.

Kĩ năng: .NET, Khai thác dữ liệu, Web Scraping

Xem nhiều hơn: written proposal for a project, written project proposal, work for web developers, who project proposal format, web silverlight, web service for developers, web server languages, web scraping price, web scraping ip rotation service, web scraping application, web scraping api, web jobs development, web development technologies 2015, web development qualifications, web development job search, web development contracts, web development company support, web develop jobs, web developers jobs, web developers job

Về Bên Thuê:
( 12 nhận xét ) fredericksburg, United States

ID dự án: #7373762

34 freelancer đang chào giá trung bình $30/giờ cho công việc này


Hello, I have 12 years of experience in various technologies. I have worked for several years on Flex project QuoteStation, ViaOne CRM and Hero. I have developed several Silverlight projects. The largest Silverlight Thêm

$30 USD / giờ
(66 Nhận xét)

Greetings, This is Kris from DreamzTechUSA. Please open the chat room so we can discuss this in details. To get an idea of the quality of our work you can check the below link : [login to view URL] Thêm

$36 USD / giờ
(23 Nhận xét)

I have extensive experience in .net and scrapers having delivered many projects I like to discuss this one.

$39 USD / giờ
(106 Nhận xét)

Hello Sir, We have experienced programmers [login to view URL] have worked in WEB project. How can we discuss about job? Here is the link of feedback "http://www.freelancer.com/u/geekydeveloper.html" We would like to work Thêm

$39 USD / giờ
(66 Nhận xét)

Greetings, I have read Project Description & let me give you some info but once you will drop me a message, we can then discuss further, as there is character limitation on this initial message board. We have 50+ Thêm

$30 USD / giờ
(8 Nhận xét)

Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. y Thêm

$39 USD / giờ
(131 Nhận xét)

Dear customer, I created a lot of scrapers so far, please check my records. I use C# and HtmlAgilityPack to grab data from web sites. Regards Armando

$36 USD / giờ
(39 Nhận xét)

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel o Thêm

$27 USD / giờ
(24 Nhận xét)

hi sir.i have a list Email was extracted from their own [login to view URL] this email functional intended for their business coz its extracted from their own web site u can use this for email marketing ---------- Thêm

$41 USD / giờ
(60 Nhận xét)

Hi there, I'm available to work 40 hours a week; potentially more, if required. I have extensive experience with C#, working with it as my primary development language professionally for the last 8 years. I have Thêm

$27 USD / giờ
(4 Nhận xét)

Hi, We’ve had a good look at your project description and we’re very interested in providing a solution. We are a professional development company head-quartered in Pakistan. If you like what you see and if our quote Thêm

$25 USD / giờ
(13 Nhận xét)

sure we already do work in dot net c# sure we already do work in dot net c# sure we already do work in dot net c# sure we already do work in dot net c# sure we already do work in dot net c# sure we already do Thêm

$26 USD / giờ
(90 Nhận xét)

A proposal has not yet been provided

$25 USD / giờ
(9 Nhận xét)

Hi (Kindly watch my profile once), I am a full time freelancer having 6+ years of experience in web scraping and crawling. I have made 500+ scraping tools before using .Net Framework. I have already made scraping to Thêm

$33 USD / giờ
(7 Nhận xét)

Hi, Please feel free to discuss the project with me ........................................................................... Thanks, Murtaza

$25 USD / giờ
(8 Nhận xét)

Under my belt I have more than 30 scraped web sites, including various difficulty sites: - Easy scraping, where data is publicly accessible to any anonymous user. - Normal scraping, where websites had authenticatio Thêm

$25 USD / giờ
(1 Nhận xét)

Hi, we are interested in your project and we will be happy to do that for you. we have experienced with these skills. we have team of 10 developrs and designers so we can commit with delivery time and budget. we would Thêm

$31 USD / giờ
(4 Nhận xét)

Expert in Data Scraping ,Email Extracting , Website research , Database of any country and Category ,Payment after completed [login to view URL] for you reply . thank you

$41 USD / giờ
(18 Nhận xét)

hi i just finish an app that scrap detentions of words from many sites i think i can scrap your data in short time and beside that am .net professional you can depend on me i will try on 5 sites if all okay w Thêm

$25 USD / giờ
(1 Nhận xét)

Greetings! My name is Alexander. I represent a team of developers from Eastern Europe. I will represent us a bit: We have been in IT market for 7 years. You can look at some of our works here: [login to view URL] Thêm

$33 USD / giờ
(1 Nhận xét)