Public Repository

Last pushed: 2 years ago
Short Description
crawler server
Full Description

Crawler server run in a servicer
client result
profile api

Server Github : https://github.com/wohaokun/dockerone-crawler-server

Client Github: https://github.com/wohaokun/dockerone-crawler-client
Client Docker: https://hub.docker.com/r/kerngven/dockerone-crawler-client

Container params:

-v, --volume:

/dockerone-crawler-server/data/: store url in leveldb

-e, --env:

hostname=127.0.0.1:3000 #api url
mongodb=mongodb://127.0.0.1:27017 #profile db
redis=127.0.0.1:6379 #cache url
elasticsearch=127.0.0.1:9200 #carwler content

example:

docker run -d -p 3000:3000 -v /data/dockerone-crawler-server/:/dockerone-crawler-server/data/ kerngven/dockerone-crawler-server
Docker Pull Command
Owner
kerngven

Comments (0)