diff --git a/Dockerfile b/Dockerfile index f16c931..f16b80a 100644 --- a/Dockerfile +++ b/Dockerfile @@ -1,4 +1,4 @@ -# Creates pseudo distributed hadoop 2.7.0 +# Creates pseudo distributed hadoop 2.7.1 # # docker build -t sequenceiq/hadoop . @@ -31,11 +31,11 @@ ENV PATH $PATH:$JAVA_HOME/bin # download native support RUN mkdir -p /tmp/native -RUN curl -Ls http://dl.bintray.com/sequenceiq/sequenceiq-bin/hadoop-native-64-2.7.0.tar | tar -x -C /tmp/native +RUN curl -Ls http://dl.bintray.com/sequenceiq/sequenceiq-bin/hadoop-native-64-2.7.1.tar | tar -x -C /tmp/native # hadoop -RUN curl -s http://www.eu.apache.org/dist/hadoop/common/hadoop-2.7.0/hadoop-2.7.0.tar.gz | tar -xz -C /usr/local/ -RUN cd /usr/local && ln -s ./hadoop-2.7.0 hadoop +RUN curl -s http://www.eu.apache.org/dist/hadoop/common/hadoop-2.7.1/hadoop-2.7.1.tar.gz | tar -xz -C /usr/local/ +RUN cd /usr/local && ln -s ./hadoop-2.7.1 hadoop ENV HADOOP_PREFIX /usr/local/hadoop ENV HADOOP_COMMON_HOME /usr/local/hadoop @@ -106,4 +106,4 @@ EXPOSE 19888 #Yarn ports EXPOSE 8030 8031 8032 8033 8040 8042 8088 #Other ports -EXPOSE 49707 2122 +EXPOSE 49707 2122 diff --git a/README.md b/README.md index 62313fa..d1e2b60 100644 --- a/README.md +++ b/README.md @@ -1,11 +1,11 @@ -#Apache Hadoop 2.7.0 Docker image +#Apache Hadoop 2.7.1 Docker image _Note: this is the master branch - for a particular Hadoop version always check the related branch_ A few weeks ago we released an Apache Hadoop 2.3 Docker image - this quickly become the most [popular](https://registry.hub.docker.com/search?q=hadoop&s=downloads) Hadoop image in the Docker [registry](https://registry.hub.docker.com/). -Following the success of our previous Hadoop Docker [images](https://registry.hub.docker.com/u/sequenceiq/hadoop-docker/), the feedback and feature requests we received aligned with the Hadoop release cycle, so we have released an Apache Hadoop 2.7.0 Docker image - same as the previous version, it's available as a trusted and automated build on the official Docker [registry](https://registry.hub.docker.com/). +Following the success of our previous Hadoop Docker [images](https://registry.hub.docker.com/u/sequenceiq/hadoop-docker/), the feedback and feature requests we received aligned with the Hadoop release cycle, so we have released an Apache Hadoop 2.7.1 Docker image - same as the previous version, it's available as a trusted and automated build on the official Docker [registry](https://registry.hub.docker.com/). _FYI: All the former Hadoop releases (2.3, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.5.2, 2.6.0) are available in the GitHub branches or our [Docker Registry](https://registry.hub.docker.com/u/sequenceiq/hadoop-docker/) - check the tags._ @@ -15,14 +15,14 @@ _FYI: All the former Hadoop releases (2.3, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.5.2, 2. If you'd like to try directly from the Dockerfile you can build the image as: ``` -docker build -t sequenceiq/hadoop-docker:2.7.0 . +docker build -t sequenceiq/hadoop-docker:2.7.1 . ``` # Pull the image The image is also released as an official Docker image from Docker's automated build repository - you can always pull or refer the image when launching containers. ``` -docker pull sequenceiq/hadoop-docker:2.7.0 +docker pull sequenceiq/hadoop-docker:2.7.1 ``` # Start a container @@ -32,7 +32,7 @@ In order to use the Docker image you have just build or pulled use: **Make sure that SELinux is disabled on the host. If you are using boot2docker you don't need to do anything.** ``` -docker run -it sequenceiq/hadoop-docker:2.7.0 /etc/bootstrap.sh -bash +docker run -it sequenceiq/hadoop-docker:2.7.1 /etc/bootstrap.sh -bash ``` ## Testing @@ -42,7 +42,7 @@ You can run one of the stock examples: ``` cd $HADOOP_PREFIX # run the mapreduce -bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0.jar grep input output 'dfs[a-z.]+' +bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar grep input output 'dfs[a-z.]+' # check the output bin/hdfs dfs -cat output/* @@ -50,7 +50,7 @@ bin/hdfs dfs -cat output/* ## Hadoop native libraries, build, Bintray, etc -The Hadoop build process is no easy task - requires lots of libraries and their right version, protobuf, etc and takes some time - we have simplified all these, made the build and released a 64b version of Hadoop nativelibs on this [Bintray repo](https://bintray.com/sequenceiq/sequenceiq-bin/hadoop-native-64bit/2.7.0/view/files). Enjoy. +The Hadoop build process is no easy task - requires lots of libraries and their right version, protobuf, etc and takes some time - we have simplified all these, made the build and released a 64b version of Hadoop nativelibs on this [Bintray repo](https://bintray.com/sequenceiq/sequenceiq-bin/hadoop-native-64bit/2.7.1/view/files). Enjoy. ## Automate everything