Hbasecông việc
cài đặt hbase, import dữ liệu (có thể là .csv) hoặc giới thiệu tool cài đặt để làm được hbase
I need to write Spark application in Scala that reads, write, delete and update data through HBase/HDFS Of course data has to be stored in HDFS I am going to provide the data which is publicly available, cluster nodes are from AWS
I am looking for a long term trainer who can teach Big Data and Hadoop. Following are the basic course outlines: Big Data Hadoop and Spark Developer Hadoop Architecture, HDFS, and YARN MapReduce, Sqoop, and Hive Data Ingestion into Big Data System and ETL Apache Hive NoSQL Databases- HBase Apache Spark Next-Generation Big Data Framework Spark Core Processing RDD Spark Graphx etc.
Role: Senior Software Engineer (Data) Summary of Duties & Job Description We are looking for a talented Senior Software Engineer (Data) to join our Solution Delivery team. The ideal candidate should have an advanced grasp of the software engineering lifecycle and is particularly strong in backend development. You will join a team that work on the collecting, storing, processing, and ana...
Hi Expert, For practice purpose i need to install hadoop, Sqoop, Hive & HBase.
1. In the existing Cloudera CDH 6.3 cluster and AWS EMR 6.1 cluster, need to install/integrate presto with phoenix to query data present in HBase. 2. You may take appropriate presto, phoenix to put into current data platform
Just to design the data model for hbase/apache druid as an output storage for api calls and have a dry run on sample data
Just to design the data model for hbase as an output storage for api calls and have a dry run on sample data
Just to design the data model for hbase/apache druid as an output storage for api calls and have a dry run on sample data
Just to design the data model for hbase/ apache druid as an output storage for api calls and have a dry run on sample data stored in hive
I need you to develop some software for me. I would like this software to be developed for Linux using SQL.
We are a ED Tech company. Our hbase crashed. Need an expert to help us to recover.
I am looking for a male who is expert in Hadoop, Java, MapReduce, Sqoop, Hive, Hbase and pig with good experience in Design patterns, ETL and Frameworks. Need good communication skills and available to take phone interview US EST time zone during working hours. I will send the job description well in advance. There might be multiple phone interview rounds, and the funds will only be transferred...
need to write python code or shell script to connect to hbase to check the duplicate file name and file patteren validatin check.
Expertly apply techniques to perform big data query manipulation, evaluate various data storage options and type of aggregated data modeling. Through a critical study, choose an appropriate storage model based on the application requirements for processing large amounts of structured and unstructured data. Independently perform data manipulation and querying (including updates, transactions, and ...
Need content for Kafka, Spark, Hive, Hbase topics
We have a Java Library the is a common library used by our loading sub-system and web access sub-system that hangs with a problem that seems to be caused by a memory leak as we have seen on various occasions that the memory is exhausted. The library reads information from Hbase. We have a work around in place that stops and starts the processing on a regular interval and the problem does not rec...
Requirement for a "FEMALE" Trainer for ETL Informatica and Big Data Technologies for US based Clients. Need to train and give technical support to few candidates as per their Requirements and Syllabus and MUST HAVE Exp. and knowledge of HADOOP, HBASE, HIVE, Scala, Spark, Sqoop, Flume, Kafka, Python. Must have Strong Knowledge & Hands on Exp. with SQL, Unix Shell Scripting, Ful SDLC L...
work experience in lieu of a degree At least 4 years of experience with Information Technology 3+ years of experience in Hadoop ecosystem, i.e. Hadoop, Hbase, Hive, Scala, SPARK, Sqoop, Flume, Kafka, Python At least 2 years of experience in Informatica ETL Projects, Informatica solution design and documentation Good experience in end-to-end implementation of DW BI projects, especially in data ware...
1. Good Skill working on Eclipse IDE 2. Coding Skill in Java and Scala Language along with Unit Test writing 3. Experienced in Spark, 4. Hive 5. Oracle DB and HBase. 6. Familiar with version controlling toll Git and Bitbucket 7. DevOps: Jenkins CI/CD Pipeline etc.
Need expert to work related to hadoop, Hbase using Java.
We are a startup company looking to develop a MVP app to test in the market. The technology used will be: Frontend: Native Backend: Python Database: PostgreSQL Cloud: AWS, Google Cloud Storage, Azure Video/Audio Transcoding: Amazon Elastic Transcoder, FFMPEG Media Server Configuration: HTTPS, RTMP & HTTP Meanwhile, there are few other technologies that are required- 1) Real-time Analyti...
1. Setting up Hadoop in 2 node cluster 2. Configuring Apache Spark 3. Transfer Data from MySQL to HDFS, HIVE & HBASE using SQOOP 4. Transfer Data from HDFS to MySQL using SQOOP 5. Create SQOOP Job for updated (incremental append) data transfer from MySQL to HDFS 6. Perform Hive Joins on Sample data (of your choice) 7. Implement a program using Hive queries with partitioning. 8. Implement a pro...
looking for a team to maintain a gambling system from china. need to know mandarin. need to know redis hbase nginx springweb dubbo kafka solr jstorm. Q 1, can you let me know how and whats the system structure with the above components? only the correct answer will be considered. Q 2, what's your past projects related to gambling? only team with experiences will be considered Q 3, what...
1. Kafka with spark streaming (experience on D streams to Structured streams) 2. Spark Scala 3. Airflow 4. Hbase 5. Hive 6. Kubernetes 7. ELK stack 8. Graphana 9. Pronetes [đăng nhập để xem URL], Jenkins
I am working on some project which needs develop shell script which utilities mapr utilities to copy data between source cluster on mapr v 5.2 Hbase into Maprdb on mapr v 6.1. There maybe requirement to copy data between hadoop hdfs locations as well. Need someone with expertise in hadoop to help develop / enhance existing scripts from past programmer with little or no documentation, add document...
Hello, I am working on some project which needs develop shell script which utilities mapr utilities to copy data between source cluster on mapr v 5.2 Hbase into Maprdb on mapr v 6.1. There maybe requirement to copy data between hadoop hdfs locations as well. Need someone with expertise in hadoop to help develop / enhance existing scripts from past programmer with little or no documentation, add ...
A talented person is required who has knowledge in Pig, hive Hadoop, Hbase and spark. If you have knowledge feel free to bid
Hello Everyone Need someone EXPERT IN BIG DATA AND DATAWARE HOUSE needed skills of conceptual modelling of a data warehouse, logical design of a data warehouse and implementation of a data warehouse as a collection of internal tables and external tables in Hive, querying a data cube, implementation of HBase table and querying and manipulating data in HBase table
needed skills of conceptual modelling of a data warehouse, logical design of a data warehouse and implementation of a data warehouse as a collection of internal tables and external tables in Hive, querying a data cube, implementation of HBase table and querying and manipulating data in HBase table
Technologies Required: Real-Time Analytics: Azure Stream Analytics, Spark Streaming, Apache Flink Cloud Environment: AWS Database: Mail Chimp Integration, Postgress, Cassandra, HBase, Mongo DB For Database Management: Datastax Payments: Paypal& Braintree, e-Wallet, Stripe Phone, Voice & SMS Verification: Twilio, Nexmo Push Notifications: [đăng nhập để xem URL], Twilio Cloud Stora...
Needs to hire 5 Freelancers We are looking for Data engineer with below expertise: - Data extraction, - transformation, - loading, and maintenance - ETL DATABASE - HADOOP - HIVE - HBASE -Data warehouse development Responsible for the ETL development and optimization, maintenance and monitoring of massive data, and timely resolution of ETL related technical issues. Responsible for data project i...
I am looking for a developer with a good knowledge of Java Spring framework. Who can develop a 2 page website using Java Rest, Angular, Spring and HBase. Please only bid if you are a java developer. Because of past experience, I am not looking for developers from India and Pakistan.
Develop and validate solution architecture to support business requirements Develop Spark applications to read transaction data and process business rules to report errors and transaction summary Load and transform large sets of structured and semi structured. Read data from Kafka and process data using Spark. Adopt innovative architectural approaches to leverage in-house data integration capabili...
We are looking for a full stack engineer who is sepcialized in React and Python, postgres. You should have 2+ years of experience in React and Python. - What you need to do Adding new features to the existing web platform. Implementing new design using React (Designs will be provided as Figma) Keep maintaining and improving the platform. - Skills & Qualifications: 2+ years software experienc...
build a simple django website that uses nosql database(prefarably hbase} be able to update details and link tables. very tight deadline. I want it in a day.
Hi I just started working in a new project. I need some help in my project. My project’s primary skill sets are hive. Spark, hbase, aws components (redshift, s3), Jenkins
Cassandra, MySQL, MongoDB, HBase, Big Data & Cloud Data Storage and Management
i will share the details its really a small task
I require a project that has the following requirements: “Practical” application for big data processing using state-of-the-art big data technologies. Any big data tools including not only Hadoop MapReduce but also other tools in Hadoop Ecosystem (e.g., HBase, Pig, Spark, Giraph). Only using Python libraries (e.g., NumPy, pandas) for data analytics is not acceptable unless the project ...
We need a single dedicated part time resource on hive,spark, Scala,shell scripting and hbase to give support on weekdays morning around 90 minutes IST 6 00 am to 8 00 am will provide 22000 per month and minimum 4+ years of experienced resource only eligible for the bid.
We need a single dedicated part time resource on hive,spark, Scala,shell scripting and hbase to give support on weekdays morning around 90 minutes IST 6 00 am to 8 00 am will provide 22000 per month and minimum 4+ years of experienced resource only eligible for the bid.
We need spark on top of mapreduce and hive and zookeeper and hbase and sqoop and oozie, HDFS too configurations are:AMD EPYC 7401P 24-Core Simultaneous Multithreading RAM: 128 GB DDR4 ECC Hard drive: 2 x 960 GB NVMe Datacenter Edition Needs to be installed webmin like cpanel, without deleting previous things.
Hello, I'm looking for an expert recruitment services. Requirement: We need 2 Data Scientists with machine learning for an initial 3 months on contract basis for Hyderabad location. If found suitable we on-board on permanent basis. Candidate Job Discription: - Use of cutting edge data mining, machine learning techniques for building advanced customer solutions. - Processing, cleansing, a...
We are looking for Python experts with experience in big data and data science. Must be familiar with Hbase and Hadoop/Spark. P.S: We are looking for freelancers who can work 8 hours a day , 5 days a week on our project. This project is scheduled for 4 weeks. We are targeting free lancers from India.
Hello Everyone, I will be joining a well-known company in the USA as a Data Analyst from November 2019. I am looking for someone who is an expert in Data Analysis and various technologies like Python, SQL & Tibco Spotfire (BI). There will be a new project which will require knowledge in big data technologies like Hadoop, Pyspark and data pipeline creation on Google Cloud platform. I have a ba...
I am looking for a Male / Female who is expert in Hadoop, Java, MapReduce, Sqoop, Hive, Hbase and pig with good experience in Design patterns, ETL and Frameworks. Need good communication skills and available to take phone interview for a contracting position in US EST time zone during working hours. I will send the job description well in advance. There might be multiple phone interview rounds, an...
We need a single dedicated part time resource on Hadoop,hive,hbase,Kafka, Talend and spark streaming to give support on weekdays morning around 90 minutes IST 6 00 am to 8 00 am will provide 22000 per month and minimum 4+ years of experienced resource only eligible for the bid.
We're looking for an experienced Java Backend Developer for our client in Bucharest, Romania for an 5 days onsite work (asap till end of Nov). We can only consider EU citizens or EU Blue Card Visa holders. Developer will correct and improve a running system. Therefore changes to the actual mappings are needed and corrections in the existing database (HBase) have to be performed. Required S...
I got the hbase daemon working on a Vm now I would like to containerize it. My understanding is that I would first need to create a docker file and install java 8jdk because the daemon is dependent on it and then define the command to start the rest daemon. And finally crease a docker image. Finally spin up the container with hbase rest daemon started with it spins up. In k8s