Fork me on GitHub

Purpose

The main purpose of Hadoop Unit is to allow users to test the integration of their developments in the hadoop world.

Indeed, it is common to need the hadoop’s ecosystem to make integration test like:

Since v3.2, Hadoop Unit supports docker and docker-compose to allow to run anything.

It offers different kinds of utilization:

Compatibility matrix

Hadoop Unit version Hadoop mini cluster version HDP version Hadoop Version
3.8 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5 + Hadoop 3.2.1
3.7 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5 + Hadoop 3.2.1
3.6 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5 + Hadoop 3.2.1
3.5 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
3.4 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
3.3 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
3.2 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
3.1 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
2.10.1 0.1.16 HDP 2.6.5.0 Hadoop 2.6.5
2.9 0.1.15 HDP 2.6.3.0 Hadoop 2.6.3
2.8 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.7 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.6 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.5 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.4 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.3 0.1.14 HDP 2.6.2.0 Hadoop 2.6.2
2.2 0.1.12 HDP 2.6.1.0 Hadoop 2.6.1
2.1 0.1.11 HDP 2.5.3.0 Hadoop 2.5.3
2.0 0.1.9 HDP 2.5.3.0 Hadoop 2.5.3
1.5 0.1.8 HDP 2.5.0.0 Hadoop 2.5.0
1.4 0.1.7 HDP 2.4.2.0 Hadoop 2.4.2
1.3 0.1.6 HDP 2.4.0.0 Hadoop 2.4.0
1.2 0.1.5 HDP 2.4.0.0 Hadoop 2.4.0

Warning: Major releases are breaking compatibility

Available components

The available components are: