cloudera

Install oozie’s sharedlib cloudera

by

I have problems trying to install a new CDH5 cluster with cloudera. Using parcels everything goes fine except when oozie’s sharedlib is installed. It fails uploading due to end of time-out. Then I tried using packages but is worse. The cluster install fails downloading packages: “Operation too slow… trying another mirror… no more mirrors to … Read more

Apache Phoenix – Stops working If one of the region Server is down

by

Hi we are seeing an issue with our Cloudera setup. We have multiple data nodes and on each node we have phoenix set up to query on HBase tables. What we have observed is that when one of the region server is going through Garbage collection (GC cycle) it becomes unavailable. Due to this unavailability … Read more

HDFS’ ZKFC service unable to start

by

CDH4’s ZooKeeper Failover Controller (ZKFC) has been installed. Starting the ZKFC service: [vagrant@localhost ~]$ sudo service hadoop-hdfs-zkfc start Starting Hadoop zkfc: [ OK ] starting zkfc, logging to /var/log/hadoop-hdfs/hadoop-hdfs-zkfc-localhost.localdomain.out does not seem to work as the log file is empty: sudo vim /var/log/hadoop-hdfs/hadoop-hdfs-zkfc-localhost.localdomain.log Question How to run HDFS’ ZKFC? Answer Just installing the ZKFC and … Read more

Failed to find `/usr/bin/docker-quickstart` when running CDH5 Docker image

by

I’ve downloaded the CDH 5.12 Quickstart Docker image from Cloudera but it fails to run. $ docker import cloudera-quickstart-vm-5.12.0-0-beta-docker.tar.gz sha256:8fe04d8a55477d648e9e28d1517a21e22584fd912d06de84a912a6e2533a256c $ docker run –hostname=quickstart.cloudera –privileged=true -t -i 8fe04d8a5547 /usr/bin/docker-quickstart docker: Error response from daemon: oci runtime error: container_linux.go:265: starting container process caused “exec: \”/usr/bin/docker-quickstart\”: stat /usr/bin/docker-quickstart: no such file or directory”. On the other hand, … Read more

Cloudera Manager CDH5 – Installation Failure on Oozie Database

by

While doing the installation, i keep getting a failure on the step “Creating Oozie database” java.lang.Exception: DB schema exists at org.apache.oozie.tools.OozieDBCLI.validateDBSchema(OozieDBCLI.java:877) at org.apache.oozie.tools.OozieDBCLI.createDB(OozieDBCLI.java:184) at org.apache.oozie.tools.OozieDBCLI.run(OozieDBCLI.java:127) at org.apache.oozie.tools.OozieDBCLI.main(OozieDBCLI.java:78) How do i fix this? Where do i get the password/username/dbname for the PostgreSQL database to drop the existing schema? I tried cat /etc/cloudera-scm-server/db*.properties | grep pass and … Read more

Cloudera SCM Agent can’t heartbeat but port is contactable

by

I’m trying to add nodes to a Cloudera cluster. When the agent starts I get a python stacktrace saying it can’t heartbeat to master-host:7182, however I can connect to that port just fine. The stacktrace is from Python and ends saying the connection timed out. nc -z 1 -w master-host 7182 returns “connection successful” Firewalls … Read more

Unable to convert HDFS from non-HA to HA

by

Introduction Aim: Convert HDFS from non-HA to HA. Method: According to this documentation it should be possible to convert HFDS from non- to HA by implementing following configuration: /etc/hadoop/conf/hdfs-site.xml <property> <name>dfs.ha.automatic-failover.enabled</name> <value>true</value> </property> /etc/hadoop/conf/core-site.xml <property> <name>ha.zookeeper.quorum</name> <value>localhost:2181</value> </property> and executing following commands: sudo service hadoop-hdfs-journalnode start sudo service hadoop-hdfs-zkfc start hdfs namenode -initializeSharedEdits sudo -u … Read more