We need a tool to manage very huge data sets.
The data is currently stored in various forms (txt/csv/xlsx/etc) and have several different types of fields/parameters.,
We require a tool to be able to import/export and manage all the data, ability to compare and filter out the required data, filtering, searching, merge similar data, etc.
The data is in very huge numbers, running into several GB, few tera bytes.
If you are an expert in handling big data/large data sets, please get in touch.
Developers with expertise in HADOOP and related tools to handle big data will be preferred.