Sign inSign up

niro/spark-standalone

By niro

Updated over 10 years ago

Standalone cluster using spark-r image

Image
0

10K+

niro/spark-standalone repository overview

Spark Standalnoe Cluster setup with spark 1.6.0 hadoop 2.6

Base image Ubuntu:14.04

zeppelin-r image based on (https://github.com/elbamos/Zeppelin-With-R)

Connecting Cluster with RStudio

Sys.setenv(SPARK_HOME = "C:/Apache/spark-1.6.0-bin-hadoop2.6")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths()))

library(SparkR)

sc <- sparkR.init(master = "spark://172.24.205.41:7077")
sqlContext <- sparkRSQL.init(sc)

Tag summary

Content type

Image

Digest

Size

775.3 MB

Last updated

over 10 years ago

docker pull niro/spark-standalone