Nutch hadoop clustercông việc
...Below are a few sections that would do well in a pillar page. Depending on your topic, pick the sections that you think would do best on your page. Keep in mind – the bank below contains suggested sections. If you believe your pillar page needs a section that is not listed below, you should absolutely include it. You’ll also notice a prompt at the end of each section to link to a supporting cluster post. For example, if you’re writing The Ultimate Guide to Cooking and include a section about cooking pizza, you may want to link to your blog post about Italian food in that section to strengthen your on-page and website SEO. These pages should be hyperlinked naturally at some point in the body of that section. What is [Cellular Shades] (and Why Does it Matt...
Use Hadoop and Spark to reconstruct the taxi trips
...facilitate the appropriate infrastructure for high performing applications using hybrid cloud approach with help of bright cluster manager software. Below is the requirement What is the best solution to host a number of high-performance applications that would benefit from High-performance computing (HPC)-like systems offering increased flexibility with cost optimization? Use hybrid cloud approach to provide an effective solution to manage the workloads between on-premises linux and public cloud for the continuous growing requirements of high computing resources To use Bright Software in Hybrid Cloud and how it can be utilized to build an effective hybrid cluster solution---() Note: As a use case have to configure either
We want to build a software which will help us in Indoor navigation using virtual pathways inside a building or a cluster of buildings.
...overall Hadoop infrastructure. • Takes care of the day-to-day running of Hadoop clusters. • A Hadoop administrator will have to work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected. • If working with open-source Apache Distribution then Hadoop admins have to manually setup all the configurations- Core-Site, HDFS-Site, YARN-Site and Map Red-Site. • However, when working with Hadoop distribution like Cloudera the configuration files are setup on start-up and the Hadoop admin need not configure them manually. • Hadoop admin is responsible for capacity planning and estimating the requirements f...
Research report of Hadoop Mapreduce using Ubuntu and Virtualbox with Python Write a research report about the results of the analysis done in Python. The report should be 6 to 8 pages in length (including figures and references), and must follow the IEEE format in addition to be employing appropriate referencing methods and academic writing style. Free of plagiarism. Code implementation has already been done, so it is write a research report following results of docs uploaded. It is about Crimes in Boston, 2018 and 2019 especially.
We are looking for a Senior Developer with hands-on Java development skills to design and implement algorithmic trading a...storage solution(s) -Integration with 3rd-party data providers, and market brokers for real-time trading -Implementation microservices architecture paradigm using Kubernetes and AWS lambdas Requirements: -Hands-on experience as a Java Software Engineer for 5+ years -Deep knowledge of data structure and algorithms (time and space complexity, Big O) -Distributed architectures design experience (cluster management, message queues, resilience, application performance management) -Knowledge of security principles and standards -Experience with AWS lambdas is a plus Tech stack: -Kubernetes, Docker AWS Lambda -Java 11 -Spring, Hibernate -Git, Bitbucket -Aurora Post...
Need senior server expert to look at server and advise and help take steps tow...performance of the website, We are using wordpress, woocommerce, wpml, mycred, wordfence, cloudflare, w3 total cache , ACF etc the data size and processing is huge, Our database size is upto 5 GB with alof of read and write, The backend gets timed out and slow and sometimes does not save the full data, Server is hosted on linode 16 CPU Cores 32GB RAM SSD, but still wordpress s super slow, If managed cluster high performance hosting for database can help we can consider that Need a serious expert senior server person to help and sort this out in next few hours, This is time sensitive task, please bid if you can be responsive, responsible and move quickly to help us achieve this in reasonable time may be ...
Cluster State Visualization General We are looking for an experienced TypeScript and D3 developer to build a d3 extension for cluster state visualization. You will be required to sign freelance contract agreements. If we are satisfied with your work there is a potential for similar jobs in the future. Background: Clusters are represented by nodes (circles) and links (lines) between them. Each node and link state are represented using colors, size, line width, and style etc. The goal of the d3 library is to allow the user to easily present cluster states diagrams by only using JSON schema, and minimal TS or JS experience. The library should be as generic as possible, allowing tweaks, updates, and extensions. Goal: Create a generic Cluster State Visualization li...
Requires Experience on Salesforce Devops Python UI/web development QA Data analyst Hadoop Hourly based payment Work on Free time (mostly US time ) Note : No need of prior experience
I need to some one do a design for me one the following: - Tell me what all are required to make VM cluster . Preferable choose a private cloud. - You need to have all services designed and plan to implement on VM - Software Tools required for an SoC for doing development - Dev tools and software can conect to SoC - Application that would do FOTA to any SOC device connected. - Ideally, we also need a WEB interface from where we can do all these activity.
Hi puneetsingh01, We are having an issue with our mongo cluster. all the mongos's have becoming unresponsive though no errors are apparent. Can you help us?
Create a sample Dropwizard Java microservice API that connects to MySQL. The app should also use JWT token for authorization. The microservice should be dockerized and published to a Kubernetes cluster in GCP. Along with the project must document all steps on how to install dependencies, create the project in IntelliJ and provide all the documentation.
create an API in golang using the AWS SES functions to 1. Create a new contact in a topic and if contact exist update the conta...esv2/#) 2. Create a bulk insert api to insert contacts from a CSV file This is what the data is being saved as the post API should be able to , create a new subscriber under the following:: listname: EmailNotification, TopicName: Software_Update or System_Maintenance (opt-in, opt-out), for attribute data, the format is "apac_sdwan": 1, means the customer is subscribed to cluster apac and product sdwan, while "apac_sdwan": 0 means the customer is unsubscribed. 1=subscribed, 0=unsubscribed for 1, it creates a new customer and if the customer exists, it basically update the TopicDefaultPreferences and/or attribute data NB: All in G...
design hang on door flyer for cleaning company. the flyer is for a special promotion for a specific area , area name is ( Cluster X ) its a flyer for a cleaning company , in Dubai . company name : CleanB ( logo attached ) its for a special promotion for cleaning services ( 25dhs per Hour ) booking can be done on whatsapp or call 0585066444 for inquiries they can contact by email info@ or they can visit our website NB please dont use my wording " be creative :) "
I am running MySQL cluster v8. I have installed MySQL router in the webserver. I am getting time to time errors on DB connections and webs is slow due to it. error log: 2021-07-16 12:14:16 metadata_cache INFO [7f0fa17aa700] Potential changes detected in cluster 'EU_CLUSTER' after metadata refresh 2021-07-16 12:14:16 metadata_cache INFO [7f0fa17aa700] Metadata for cluster 'EU_CLUSTER' has 1 replicasets: 2021-07-16 12:14:16 metadata_cache INFO [7f0fa17aa700] 'default' (3 members, single-master) 2021-07-16 12:14:16 metadata_cache INFO [7f0fa17aa700] eudb1:3306 / 33060 - mode=RW 2021-07-16 12:14:16 metadata_cache INFO [7f0fa17aa700] eudb2:3306 / 33060 - mode=RO 2021-07-16 12:14:16 metadata_cache INFO [7f0fa17aa700] eudb3:3306 / 33060 - mode=...
Hi Gary, this is for the clustering project we just completed.
We have Application that is running on Kubernetes Container on a Rancher Cluster. Rancher is where you will see the Kubernetes POD running. The Application is running on Drupal. I need someone who is experience with creating a Jenkins CI/CD pipeline leveraging technologies such as (Kubernetes,Rancher,Terraform,Ansible,Docker) For source code management we use BitBucket and Configuration management we use Ansible. I need someone who is experienced in those technologies to help me setup a CI/CD pipeline from end to end. NOTE: This project is for someone who has already implemented similar project and can create a MAP from start to finish which can be easily followed
Would like to create a cert-manager component with letsencrypt for the cluster to manage ssl for domains... Our haProxy ingress will have a wildcard ingress rule to allow all domains This cert-manager will need an api so we can add and remove SSL secerts Our application would use the api endpoint from within the same cluster then the cert-manager just creates a secret with the key/cert and adds it to the wildcard ingress
Need a ndnsim expert who know the cache content . the topology is 30 nodes and we make cluster of similair nodes
I am working on my PhD project on modifying the yarn scheduler in Hadoop. The Hadoop is written in java and I am inexperienced in that. Although, I am well versed in writing hadoop applications in python/matlab. So, if the developer is not familiar with hadoop then I will assist him/her. The task is to write the scheduling policy in FAIR job scheduler. A code will also be shared which has already fulfilled the purpose. Now I want to use another suggested algorithm. I will also assist in the algorithm part if any problem persists. The responsibility of the java developer will be to write the code and check with the test cases. I will also help to setup the hadoop on the system so that it can be very well tested.
Must Haves: 10+ years experience with hands on engine...with hands on engineer/architecture 5+ years of experience with demonstrated Cloud architecture projects and deployments 3+ years experience with Kubernetes Cluster Provisioning CICD Automation Security Operators Service Mesh Must have extensive working experience with either Microsoft/Google/Amazon technologies, prefer that they are familiar with all, preference order (Azure, GCP, AWS) Strong experience with Terraform in Cloud Environments Proficient with PowerShell and/or Bash Plusses: Rancher Kubernetes Cluster Orchestration Experience with Jenkins, Ansible, Hashi Vault Azure AKS + Cloud Adoption Framework Google – Anthos Cluster Orchestration Kubernetes Service Meshing / Ingress Strategies Kubernetes ...
...field of energy management systems for solar power plants. Only those who have experience writing high-impact factor journals are required to bid (use #CSP_plant in your bids). I'll check their capabilities through google scholar. you need to search for the academic papers and peer reviews, cluster them by technical approach (different optimization methods, applied control system, forecasting methods, and the country), and then present the method used in each cluster with the variants of each paper in the cluster. Finally a deep comparison between the methods and the optimization models should be presented for different clusters and show the differences. The document should contain the following: - Introduction between 2-5 pages, - Deep literature review and pr...
Senior stack developer that is familiar with AWS including the branching strategy and priority items High Priority with these skills:: needs to be moved to RDS and off the EC2 instance a reader and write instance in the RDS cluster of a second EC2 instance for redundancy a load balancer be put in front of both instances 5. Great expertise in net core and angular
We have an excel spreadsheet that we import CVS data. The CSV is categorized by use (retail, industrial, office) region, county, cluster, and submarkets. After importing, we the industry (retail, industrial, office) then the quarter (1Q , 2 Q, etc). We then choose the area we want to analyzed, which are organized in county, the cluster, and submarket. After selection, charts are automatically created based on this data comparing vacancy rates, available square footage, rents, and prices. This information is compared with the current quarter and past quarters/years. Lastly, we use the spreadsheet to create a micro-market analysis for properties within a few miles of the property we are appraising. We input the properties (on average 100-150) to create an analysis of the m...
topic and area name (supervised learning in support vector machines) you need to search for the papers, cluster them by technical approach, and then present the method used in each cluster with the variants of each paper in the cluster. finally you need to compare the methods of the various clusters and show the differences. it should contain typically - introduction (2-3 pages) - description of the topic (4-5 pages) - techniques to address the topic (80-100 pages) - comparisons and discussion (10-20 pages) - conclusions (1 page) personals assistance needed as well.
topic and area name (supervised learning in support vector machines) you need to search for the papers, cluster them by technical approach, and then present the method used in each cluster with the variants of each paper in the cluster. finally you need to compare the methods of the various clusters and show the differences. it should contain typically - introduction (2-3 pages) - description of the topic (4-5 pages) - techniques to address the topic (80-100 pages) - comparisons and discussion (10-20 pages) - conclusions (1 page) personals assistance needed as well.
We have an enterprise PHP application that needs to be deployed in a Kubernetes environment. The project will be split into 3 phases: 1. Dockerization of the Application 2. Kubernetes Deployment & Upgrade Strategies 3. HELM support The project should assume that the DB cluster is already setup and ready for use and should only focus on web and application servers implementation. Attachments & logs are to be set on a separate volume for persistance.
Utility to scale any service pods to desired level. Combine it with current utilities of cluster restart. Utility can be created in Python/Shell/GO. Usage- ./ -a <appname> -rc <replicacount> -n <namespace> ./ -a rcm -rc 4 -n pos-dev2 If no app is defined then It should apply to all services. Replica count should not be allowed for >5 due to resource constraints. It should though error message if input arguments not specified by user.
The person qualified for this tasks should have excellent skills and knowledge about the following: - Cluster Analysis - Regression Analysis - Factor Analysis - ANOVA Please only apply if you are very comfortable and familiar with these topics, the task will take 3 hours, which will consist of Multiple Choice Questions = 30% ---> First 45 mins Open Questions: 70% ---> 150 mins
Rabbitmq cluster on windows servers Need help to create Rabbitmq cluster (3 nodes) All nodes are on windows server 2019 on aws ec-2 instances, each server is having rabbitmq installed on it we want to create a cluster on all those three nodes and want to create a mirrored queue and be sure the mirroring is working It's only configurations ... every required software is installed all ports are opened firewall is configured the only issue is : not able to create the cluster node2 and node3 do not able to join cluster on node1 This environment is as much as possible close to my production env .. so I'm trying to create a test env to do our test and to try the mirroring and clustering on it. And my team will replicate and repeat the steps on the ...
The spark script will parse JSON data and create hive tables and update partitions Bid only if you are a big data expert! ONLY IF you know programming spark, hadoop, hive, and python.
Aws deployment Help in creating docker image and deploying to cluster
Install and maintain Kubernetes application on Kubernetes clusters. To be considered, the expert MUST AT START HAVE OWN AWS ACCOUNT and MUST be able to demonstrate the installation of basic multi-master multi-worker Kubernetes cluster on AWS EC2s, using Infrastructure as Code . Infrastructure Code can be written either in Cloud-formation, AWS CLI (Bash Script), Python (Boto3 Library), or Terraform. The expert must be able to work minimum 32 hours a week, during US Eastern time 9am-5pm, and must be available during this time on video chat to assist our US team. $120 is the maximum hourly rate we can pay. 32 hours / week is what we are expecting. 6 Hours on weekdays, and 1 hour on weekends.
Would like to create a cert-manager component for the cluster to handle domain and ssl... This cert-manager will need an api so we can pass it a domain name. We would like for it to be able to be added or removed Our application would use the api endpoint from within the same cluster letsencrypt API for signing certificates. because there is a limit to etcd... would like to create a multidomain san.. we can create sans with upto 500 domains then create, more sans as needed then the cert-manager just creates a secret with the key/cert and adds it to the wildcard ingress This is what we are thinking to do... please provide your suggestions?
Need help in setting up cluster in Aws for my projects know about Aws wavelength services.
Create automated job to import files using Python. Have to create a Python script to upload data into Hive using SQOOP. This is to be done on GCP Cluster.
We are developing a software system with a microservices architecture that will be hosted on a Kubernetes cluster. We are developing using .Net core 5/Visual Studio 2019 and each microservice is a docker image based on linux OS. Our company has a tenant on Microsoft Azure and we user Microsoft Azure Devops as our repository and CI/DI system. We need to setup a pipeline like that shown in the attached document.
Hello everyone! We are Looking for Java Big Data Developer who has good experience in Java, Spark/Storm/Zoo Keeper , Kafka, MQ, Big Data Hadoop, App Dynamic – Performance Monitor , Prometheus – event Monitoring, Splunk – App Log, these skills must and should! 3 Hours Job support Timings: Evening 7:00pm IST after Min Exp*: 5+ Pay: DM me Positions: 1 Immediately Note: Only for the Developer's not for the company' ETC... Please DM me Only for Indians Many Thanks :)
I have a small exchange 2019 cluster (2 exchange servers, 2 domain controllers and 1 witness server). I have also set a virtual server running ASSP. The inbound spam scanning and relaying is working perfectly. But I'd like to fully integrate exchange into it. 3 things basically need to happen. 1. The server needs to be setup to allow exchange to route outbound mail through the ASSP server (making the ASSP server the default outbound mail server). 2. If possible I would love to integrate assp with LDAP on exchange so that it can verify local domains and email addresses before passing mail on to email account's that don't exist 3. I would also want to change ASSP to deliver detected spam to the spam/junk folder in exchange (rule based I assume). I would need the pers...
...won't accept a model that is comprised of 2 or more other models of which parts need to be "hidden" to create the final effect - I will give preference to those bidders who re-use existing DAZ3D store content rather than create their own content. For example, the content I've used to build the concept model are: - Any female character based on Genesis 8/8.1 - Genesis 8 Female anatomical elements - Cluster bomb (for the six breasts) - Nike female (for the extra pair of arms) These are some additional optional requirements - please let me know in your bid if you will be including these features: - I should be able to apply any Genesis 3/8/8.1 Female female texture to this model, but if this is too difficult then I will accept your bid as long as it correctly a...
Work can be done remotely, candidate needs to be available from 7:00 PM IST to 2:00 PM IST from monday to friday on daily basis. Knowledge of Hadoop, Spark, Scala, Python, Cassandra and Kubernetes is required. Only Serious candidates should apply
...Scraping. • Adept in statistical programming languages like R and Python, including Big Data technologies like Hadoop, Hive. • Experience and Technical proficiency in Designing, Data Modeling Online Applications, and Architecting Data Warehouse/Business Intelligence Applications. • Experience with Data Analytics, Data Reporting, Ad-hoc Reporting, Graphs, Scales, PivotTables, and OLAP reporting. • Highly skilled in using visualization tools like Tableau, Prometheus, Grafana, Django, flask for creating dashboards. • Work experience with extracting data from various database sources like Postgres, Mysql, and NoSQLs. • Hands-on experience with big data tools like Hadoop, Spark, Hive, Pig, PySpark, Spark SQL, PySpark • Experience ...
I currently have a Front End React App and Backend Node app that need to be deployed to EKS on AWS. And they need to be connected to a domain. 1. The code is hosted in Github 2. There is a ci/cd pipeline that is working for the EKS cluster for Develop and Testing but it doesn't work for Production. We need to be able to push our code to master on the front end and back end and the eks cluster updates automatically. And we need documentation so we can setup these for future projects.
...previous step in the table named 'russian_stock_prices' that looks like this: DATETIME | TICKER | OPEN | HIGH | LOW | CLOSE | VOLUME 4. Last but not least, technical indicators should be executed on the last 50 candles for each ticker and saved back to the table 'russian_stock_indicators', which looks like this: DATETIME | TICKER | RSI | MACD | SMA Infrastructure: I have already a running cluster of Airflow and clickhouse. All tasks regarding configuration I will take on my behalf. Expectations: My expectations regarding the project's deadline and costs are flexible. I would prefer quality over anything else. I will gladly answer any questions. Thanks!...
...updates, identify and resolves problems and improve technology and process. • Participating in RnD project’s • Development & supporting product’s CICD lifecycle • Writing cloud automation task • Supporting DevOps production services Field: CICD & Config Management tools Minimal requirement tool: Jenkins(pipeline) Terraform GIT Ansible/puppet/etc.. Minimum years requirement: 2 Field: Kubernetes cluster Minimal requirement tool Helm development Deployments management Minimum years requirement: 2 Field: Public cloud management Minimal requirement tool: GCP(GCE,GKE,VPC,storage,etc.) - Min 2 years AWS ( EC2,EKS,VPC,S3,etc.) - min 1 year Field: Programming skill Minimal requirement tool: Bash - min 3 years python - min 1 year Field: os Mi...
In need of a freelancer for an assignment related to Dataset Analysis and Visualization Using Big Data Programs.
Startup Ecomm website integration of api of vendors for pricing and inventory Also integration of crm , suport ticket and live chat features. Also need programming experience in google map api for cluster display of customer location. Woocommerce website as base
We would need a brief consultation and setup of Microsoft Azure virtual machine with specific parameters. The prospective individual must have at least 5 years cloud computing experience. The virtual machine must be able to have supercomputing cluster yielding High-Performance Linpack (HPL) result of 16.59 petaflops along with windows 10. With the correct experience this task can be completed in one day, completion and payment of funds will be made upon confirmation of benchmark tests.
