Public Repository

Last pushed: 10 months ago
Short Description
MLeap Serving
Full Description

Mleap serving container is using default configuration for akka-http which doesn't allow to handle requests at full capacity. so, I replaced default dispatcher with fork-join dispatcher which handles the load better

applied following changes in - /mleap-serving/src/main/resources/application.conf

application.conf
ml.combust.mleap.serving {
http {
hostname = 0.0.0.0
port = 65327
bind-hostname = ${ml.combust.mleap.serving.http.hostname}
bind-port = ${ml.combust.mleap.serving.http.port}
}
}
akka {
loggers = ["akka.event.Logging$DefaultLogger"]
loglevel = "INFO"
log-dead-letters = 10
log-dead-letters-during-shutdown = on

Log the complete configuration at INFO level when the actor system is started.

This is useful when you are uncertain of what configuration is used.

log-config-on-start = off
actor {
debug {

  # enable function of LoggingReceive, which is to log any received message at
  receive = off
  # enable DEBUG logging of all AutoReceiveMessages (Kill, PoisonPill et.c.)
  autoreceive = off
  # enable DEBUG logging of actor lifecycle changes
  lifecycle = off
  # enable DEBUG logging of all LoggingFSMs for events, transitions and timers
  fsm = off
  # enable DEBUG logging of subscription changes on the eventStream
  event-stream = off
}
default-dispatcher {
  # Dispatcher is the name of the event-based dispatcher
  type = Dispatcher
  # What kind of ExecutionService to use
  executor = "fork-join-executor"
  # Configuration for the fork join pool
  fork-join-executor {
    # Min number of threads to cap factor-based parallelism number to
    parallelism-min = 2
    # Parallelism (threads) ... ceil(available processors * factor)
    parallelism-factor = 2.0
    # Max number of threads to cap factor-based parallelism number to
    parallelism-max = 8
  }
  throughput = 100
}

bounded-mailbox {
  mailbox-type = "akka.dispatch.BoundedMailbox"
  mailbox-capacity = 500
  mailbox-push-timeout-time = 10 milliseconds
}

}
}

Running the mleap-container
docker run -p 65327:65327 -v /development/mleap/models/:/models dpsdce/mleap-serving_optimized:latest

Docker Pull Command
Owner
dpsdce