TITLE: Website Backend- Site-scraping, database, simple interface.
We are seeking someone to implement a simple back-end solution for our future website.
This job consists of several back-end automated data-manipulation tasks, namely:
1.) Implementing a site-scraping protocol to retrieve and store information from multiple websites.
2.) Formulating the right kind of server-side database requirements which can respond to future demands.
3.) Automatically gathering said data and manipulating it into said database.
4.) Visually display basic analytics on the data.
1.) Automated scrape. Data must first be gathered (scraped) from 2-3 source websites and manipulated/processed into a working database. This must be efficiently/optimally done as some of this data must be re-acquired periodically (e.g. once an hour, once a day).
2.) Setup a basic but somewhat future-proof database. Discuss our requirements and create the baseline server-side database structure we will require. Provisions should be made for the server-side array(s) to be fast, scalable, and flexible, as some components of the data may eventually need to be manipulated by many (eg. n > 1000) users simultaneously. The basic database setup should be conducive to future growth, reliability, performance, and security considerations.
3.) Essentially, we are looking for a nice google-analytics-like summary page for the data we scrape. We want public visitor users to be able to create/login to an account, query the information they like, and save these queries with their profile. Some of the changes a user makes (such as picking 5 names from a list) would have implications towards the data available to other users (eg. those names are unavailable or statistics are gathered based on which names have already been picked, picked the most, etc.).
(4) Visually, we just need a simple, non-elegant webpage(s) for interfacing with this data. The page should contain table(s) and graphical display(s) of this data from which the user can make simple queries. Some of the front-end, on-screen real-estate would go towards a table with scroll-bars and possibly filtering options. Other real-estate would go towards the graphical/visual representation of said data in the form of a simple pie chart, histogram, and time-series.
We can provide a wire-frame concept for the visual aspects (4), of this work.
We are flexible and open to any design feedback/recommendations you may have and can possibly tailor the job/budget accordingly. We will require a non-disclosure agreement (NDA) with the freelancing person or entity. We look forward to working closely with the freelancing person or entity to devise a solution that fits the budget. Should this project become a success, we would welcome a continued working relationship with the freelancing entity as our immediate go-to for future jobs/tasks.
Time is of the essence for this project. We are looking to get started immediately.
11 freelancer đang chào giá trung bình $522 cho công việc này
Hello, We will be keen in taking this up. We will provide you with single point of contact, who will be available on skype or any other IM's. Kindly check the PMB. Regards, Credent Team.