Fork me on GitHub

Use Cli to operate Hadoop Unit

Hadoop-unit can be used with common tools such as:

Zookeeper command

  1. ./zkCli.sh -server localhost:22010

HDFS command

  1. hdfs dfs -ls hdfs://localhost:20112/

For windows user, you could have some issue like -classpath is not known. The cause of these errors are because your JAVA_HOME has space into. If your JAVA_HOME is linked to C:\Program File\Java\... then declared it as C:\Progra~1\Java\...

Kafka-console command

  1. kafka-console-consumer --zookeeper localhost:22010 --topic topic

Ksql command

  1. ./ksql http://localhost:8083

HBase Shell

  1. <configuration>
  2. <property>
  3. <name>hbase.zookeeper.quorum</name>
  4. <value>127.0.0.1:22010</value>
  5. </property>
  6. <property>
  7. <name>zookeeper.znode.parent</name>
  8. <value>/hbase-unsecure</value>
  9. </property>
  10. </configuration>
  1. hbase shell

Hive Shell

  1. <configuration>
  2. <property>
  3. <name>hive.metastore.uris</name>
  4. <value>thrift://127.0.0.1:20102</value>
  5. </property>
  6. </configuration>
  1. hive

Hive beeline

For linux/MacOS user only

  1. beeline
  1. !connect jdbc:hive2://localhost:20103 user password

Cassandra Shell

  1. ./cqlsh localhost 13433

Alluxio Shell

  1. ALLUXIO_MASTER_HOSTNAME=localhost
  1. alluxio.master.port=14001
  1. ./alluxio fs ls <path>

Pulsar Shell

  1. ./pulsar-client --url pulsar://localhost:22022/ consume -s subscriptionName topic
  2. ./pulsar-client --url pulsar://localhost:22022/ produce -m message topic