Public | Automated Build

Last pushed: 2 years ago
Short Description
https://github.com/beniyama/sparkr-docker
Full Description

sparkr-docker

A Dockerfile to try out SparkR with RStudio frontend.

This dockerfile builds a centos-based (CentOS 6) docker image with Apache Spark, SparkR, and RStudio.

The prebuilt image in Docker Hub would save your time as spark build often takes long time.

Fetch ready-to-go image from Docker Hub

$ docker pull beniyama/sparkr-docker
$ docker run -d -p <YOUR PORT>:8787 -t beniyama/sparkr-docker

Or you may build & run from scratch

$ cd sparkr-docker
$ docker build -t beniyama/sparkr-docker .
$ docker run -d -p <YOUR PORT>:8787 -t beniyama/sparkr-docker

Don't forget to check your boot2docker vm IP as above port forwarding links the container's one to the vm, not your (host) machine.

$ boot2docker ip

The VM's Host only interface IP address is: 192.168.59.103

Then access http://192.168.59.103:<YOUR PORT> with your browser and login RStudio. Default RStudio login account is rstudio/rstudio .

Now you can load SparkR library to your R environment and start fancy things.

> library("SparkR")
Loading required package: rJava
[SparkR] Initializing with classpath /usr/lib64/R/library/SparkR/sparkr-assembly-0.1.jar

> sc <- sparkR.init("local")
14/05/12 12:17:56 INFO Slf4jLogger: Slf4jLogger started

Please refer to SparkR official site for further instruction, and please let me know if you happened to face any problems related to docker stuffs.

Docker Pull Command
Owner
beniyama
Source Repository

Comments (5)
gt1967
a year ago

Hello,
I managed to install the docker image and I can see the username/password prompt.

What I can use to access ?

Thanks for your job.

guzu92
2 years ago

Hi
I got the following error, thank for your support.

Step 22 : RUN sbt/sbt assembly
---> Running in ec986c0376fc
Attempting to fetch sbt

######################################################################## 100.0%
Launching sbt from sbt/sbt-launch-0.13.5.jar
Error: Invalid or corrupt jarfile sbt/sbt-launch-0.13.5.jar
The command '/bin/sh -c sbt/sbt assembly' returned a non-zero code: 1

harryzhu
2 years ago

9529ee7aaa0a: Error downloading dependent layers
Error pulling image (latest) from docker.io/beniyama/sparkr-docker, Driver devicemapper failed to create image rootfs 9529ee7aaa0ad73e5a4e7251f24f18c6d71d559f8da129e126e8b39be851fb5d: device 9529ee7aaa0ad73e5a4e7251f24f18c6d71d559f8da129e126e8b39be851fb5d already exists. Deleted=false

harryzhu
2 years ago

Thanks for your job!

artak
2 years ago

How do I find <YOUR PORT> ?