Oort is a light weight spark platform for feature test. 奥尔特是一个轻量的用于功能测试的spark平台。
68
Oort is a light weight spark platform for feature test. you can download the oort components in our site. extract code: 4osi
奥尔特是一个轻量的用于功能测试的spark平台。你能够在这里下载oort组件 提取码: 4osi
min：2cups+2G RAM+2G Disk
recommend：4cups +4G RAM + 5G Disk
These components are included in the Oort1.0：
spark-3.2.1
iceberg-0.3.1
hive-meatstore-2.3.4
These services are included after started:
spark-master
two spark-worker
spark history-server
hive meatstore
spark thriftserver
# write your oort path
export OORT_HOME='/Users/xiaobai/exchange/oort'
# preparing work
sh $OORT_HOME/oort.init
# define a network
docker network create --driver bridge --subnet 192.168.0.0/16 --gateway 192.168.0.1 oort_net
# start hive meta database node (mysql)
docker run --name oort_meta -h meta.oort \
-p 13306:3306 \
-n oort_net
-v $OORT_HOME/components/data/mysql:/var/lib/mysql \
-e TZ=Asia/Shanghai \
-e MYSQL_ROOT_PASSWORD=12345678 -d mysql:8.0.29
# start spark master node
docker run -itd --name oort_master -h master.oort \
-p 2201:22 \
-p 7077:7077 \
-p 7070:7070 \
-p 7071:7071 \
-p 7072:7072 \
-p 10020:10020 \
-n oort_net
-v $OORT_HOME:/app/oort \
--privileged -e TZ=Asia/Shanghai oort:3.2.1.arm
# initialize spark environment
docker exec - it oort_master spark.init
# start the components of the spark
docker exec - it oort_master spark.start
# stop the components of the spark
docker exec - it oort_master spark.stop
Content type
Image
Digest
sha256:6845ca19c…
Size
91.4 MB
Last updated
about 4 years ago
docker pull limoncc/oort:v1.0_3.2.1.amd