Skip to content

Commit a4ba94e

Browse files
committed
spark 1.2.0 with hadoop 2.3
1 parent 6798049 commit a4ba94e

File tree

2 files changed

+34
-0
lines changed

2 files changed

+34
-0
lines changed

1.2.0-bin-hadoop2.3/Dockerfile

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,33 @@
1+
2+
# Inspired by these images:
3+
# https://github.com/sequenceiq/docker-spark
4+
# https://github.com/apache/spark/tree/master/docker
5+
6+
7+
# For building this image, See https://github.com/GELOG/docker-ubuntu-java
8+
FROM gelog/java:openjdk7
9+
10+
MAINTAINER Francois Langelier
11+
12+
ENV WGET_VERSION 1.15-1ubuntu1.14.04.1
13+
ENV SPARK_VERSION 1.2.0
14+
ENV SPARK_BIN_VERSION $SPARK_VERSION-bin-hadoop2.3
15+
ENV SPARK_HOME /usr/local/spark
16+
ENV PATH $PATH:$SPARK_HOME/bin
17+
18+
# Installing wget
19+
RUN \
20+
apt-get update && \
21+
apt-get install -y wget=$WGET_VERSION && \
22+
rm -rf /var/lib/apt/lists/*
23+
24+
# Installing Spark for Hadoop
25+
RUN wget http://d3kbcqa49mib13.cloudfront.net/spark-$SPARK_BIN_VERSION.tgz && \
26+
tar -zxf /spark-$SPARK_BIN_VERSION.tgz -C /usr/local/ && \
27+
ln -s /usr/local/spark-$SPARK_BIN_VERSION $SPARK_HOME && \
28+
rm /spark-$SPARK_BIN_VERSION.tgz
29+
30+
31+
# Default action: show available commands on startup
32+
CMD ["spark-submit"]
33+

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@
55
[![stars](https://img.shields.io/github/stars/apache/spark.svg) ![forks](https://img.shields.io/github/forks/apache/spark.svg) ![issues](https://img.shields.io/github/issues/apache/spark.svg) ](https://github.com/apache/spark)
66

77
## Supported tags and respective `Dockerfile` links
8+
- [`1.2.0-bin-hadoop2.3`/Dockerfile](https://github.com/GELOG/docker-ubuntu-spark/blob/master/1.2.0-bin-hadoop2.3/Dockerfile)
89
- [`1.1.0-bin-hadoop2.4`/Dockerfile](https://github.com/GELOG/docker-ubuntu-spark/blob/master/1.1.0-bin-hadoop2.4/Dockerfile)
910
- [`1.1.0-bin-hadoop2.3`/Dockerfile](https://github.com/GELOG/docker-ubuntu-spark/blob/master/1.1.0-bin-hadoop2.3/Dockerfile)
1011

0 commit comments

Comments
 (0)