Public Repository

Last pushed: 2 years ago
Short Description
This image provides python(2.7.3), java(1.7.0_79), hadoop(2.6.4), spark(1.6.0)
Full Description

docker run -v ~/src/:/usr/local/src/ -it fanteathy/spark /bin/bash

进入container

运行:

service sshd start # 启动sshd
start-dfs.sh # 启动hdfs
start-yarn.sh # 启动yarn
/usr/local/spark/sbin/start-all.sh # 启动spark master/worker
jps # 查看hadoop运行相关进程

hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.4.jar wordcount /input/apns.py /output # 运行hadoop wordcount示例程序

注意:
可以在docker run的时候使用p参数将对应的端口映射到host

Docker Pull Command
Owner
fanteathy

Comments (0)