Sign inSign up

80dw/buildfarm-worker

By 80dw

•Updated over 6 years ago
Archived

Public container release for the https://github.com/bazelbuild/bazel-buildfarm shard worker.

Image
0

50K+

80dw/buildfarm-worker repository overview

⁠Run Redis Container

docker run -d --name buildfarm-redis -p 6379:6379 redis:5.0.9

⁠Create /tmp/worker directory for CAS

mkdir -p /tmp/worker

⁠Run Buildfarm Shard Worker Container

docker run -d --name buildfarm-worker --privileged -v $(pwd)/examples:/var/lib/buildfarm-shard-worker -v /tmp/worker:/tmp/worker -p 8981:8981 --network host 80dw/buildfarm-worker:latest /var/lib/buildfarm-shard-worker/shard-worker.config --public_name=localhost:8981

For shard-worker.config use the following:

port: 8981
public_name: "localhost:8981"
digest_function: SHA256
root: "/tmp/worker"
inline_content_limit: 1048567 # 1024 * 1024
operation_poll_period: {
  seconds: 1
  nanos: 0
}
platform: {
}
cas: {
  filesystem: {
    path: "cache"
    max_size_bytes: 2147483648 # 2 * 1024 * 1024 * 1024
    max_entry_size_bytes: 2147483648 # 2 * 1024 * 1024 * 1024
  }
}
execute_stage_width: 1
input_fetch_stage_width: 1
link_input_directories: true
default_action_timeout: {
  seconds: 600
  nanos: 0
}
maximum_action_timeout: {
  seconds: 3600
  nanos: 0
}
redis_shard_backplane_config: {
  redis_uri: "redis://localhost:6379"
  jedis_pool_max_total: 4000
  workers_hash_name: "Workers"
  worker_channel: "WorkerChannel"
  action_cache_prefix: "ActionCache"
  action_cache_expire: 2419200 # 4 weeks
  action_blacklist_prefix: "ActionBlacklist"
  action_blacklist_expire: 3600 # 1 hour
  operation_prefix: "Operation"
  operation_expire: 604800 # 1 week
  queued_operations_list_name: "{Execution}:QueuedOperations"
  dispatching_list_name: "{Execution}:DispatchingOperations"
  dispatching_prefix: "Dispatching"
  dispatching_timeout_millis: 10000
  dispatched_operations_hash_name: "DispatchedOperations"
  operation_channel_prefix: "OperationChannel"
  cas_prefix: "ContentAddressableStorage"
  cas_expire: 604800 # 1 week
  subscribe_to_backplane: true
}

Tag summary

Content type

Image

Digest

Size

459.4 MB

Last updated

over 6 years ago

docker pull 80dw/buildfarm-worker